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This is a book of applied and engineering mathematics, written in traditional notation and 
language, for students of science, engineering, and applied mathematics. It contains exam- 
ples drawn from a wide spectrum of physical and mathematical disciplines, and provides a 
fairly complete curriculum in undergraduate applied mathematics. 

In this text, results are typically stated “up front,” either informally, or formally as a 
theorem, then illustrated with examples before being proved or verified. A conscious effort 
has been made to ensure that students will understand what a theorem is saying, before they 
are subjected to its proof. While this is not the standard ordering one finds in math texts in 
general, it is the ordering often found in classrooms where applications rule. 

Nearly 7000 exercises are available for student practice and enrichment. Nearly all are 
completely solved in the /nstructor's Manual. 

This text is the outgrowth of more than ten years of using Maple in the classroom to 
teach science and engineering students courses in calculus, differential equations, linear 
algebra, boundary value problems, advanced calculus, vector calculus, complex variables, 
and statistics. The materials were conceived in laboratory/classrooms where each student 
sat at a desktop machine, and nurtured in an environment where each student carries a laptop 
computer the way we old-timers carried our slide rules. Over the years, the materials were 
presented at various stages in journal articles, conference talks, workshops, and seminars. 

Throughout, the theme guiding their development has been the realization that modern 
computer algebra systems and software pose a new paradigm for teaching, learning, and 
doing applied mathematics. Indeed, the phrase “new apprenticeship” echoes in the writings 
and talks leading up to this present volume. It is no longer enough to acknowledge the 
power of such software while still adhering to the paradigm of pencil-and-paper, and the 
chalkboard. 

Paralleling the text, therefore, is a collection of Maple worksheets which implement all 
the calculations and derivations found described in this book. In fact, each of the book's 273 
sections is mirrored in a worksheet that includes both the prose and the mathematics, the 
mathematics being “live” in the worksheet. Students reading the text can have the parallel 
discussion on their computer screens, and can execute in Maple, the calculations the text is 
describing. 

Yet, it is entirely possible to "lecture" from this text. There is ample opportunity for 
an instructor to reproduce calculations and derivations summarized in these pages. While 
such lectures are being delivered, it is hoped that students will interact with the material by 
using a computer algebra system to interpret the mathematics, and to work the exercises. 
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Two-thirds of the exercise sets are divided into problems of types A and B. Problems of 
type A are more conceptual, and less demanding computationally. The A-problems would 
be the ones a student might work by hand if they found that to be an effective way to 
learn. The B-problems are generally more computationally intensive. It is anticipated that 
technological tools of some sort will be used freely when working these exercises. 

Not all in the math, science, and engineering communities have embraced the use of 
technology as the operational instrument for meeting, and mastering. mathematics. Many 
times, both on my own campus and on others, I have had to articulate the case for the active 
use of technology as the learning agent in math courses. Typically. I would try to show by 
examples how technology has improved pedagogy. Sometimes, I would say something like 
“The course of instruction at a school for operators of earth-moving machinery should not 
end in a test of dexterity with a shovel, nor should admission be limited to those capable of 
digging a ditch with one." But my favorite analogy is that of the Magic Skates, born of my 
experiences at the ice-hockey rinks in Canada where I lived for twelve years. 

If you can't skate, you can't play hockey. Only youngsters who master the art of skating 
can experience the game of hockey. But suppose a poor skater acquires a pair of magic skates 
which transform the wearer into an adept skater capable of experiencing the thrill of the 
game of hockey. Is it viable to argue that the magic skates invalidate the player's ensuing 
encounter with the game? 

This text embraces the magic skates of computer algebra systems. Every volunteer 
hockey coach I knew back in Canada would have paid for pairs of magic skates from their 
own pockets, just to see their teams play a better game of hockey. It was the game that 
mattered, the play, the experience, the participation in a really exciting sport. And if we 
can't make our students feel the same way about applied and engineering mathematics, 
our programs will retain only the dwindling handful willing to make the 5:30 AM practice 
before school. 


Distinctive Features 


1) New Paradigm Access to computer algebra tools can be assumed throughout, and 
the pedagogy can be predicated on its availability and use. Although the text is written in 
traditional notation, its structure reflects the author's experience in using a computer as an 
active partner in teaching, learning, and doing applied and engineering mathematics. 


2) New Apprenticeship Insights into the deep results of classical applied mathematics 
are extracted from examples, as much by calculations and graphics as by subtle reasoning. 
This text shows how to use modern software tools to learn, do, and interpret applied and 
engineering mathematics. 


3) Flexibility A computer algebra system allows the instructor the option to bypass 
certain drills in skill-building, to concentrate on key ideas. Therefore, topics can be reordered 
more easily whenever supporting computations can be relegated to the computer. 


4) “Big Picture" First Reflecting the author's own learning style, most presentations 
begin with the “big picture,” with computations and supporting graphics given first. Then, 
when the goal is clear, the supporting calculations and relationships are developed. 


5) Parallel Worksheets The 273 sections of the text are paralleled by a matching 
number of Maple worksheets containing, not only the calculations and graphics of the 
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section, but also the text and explanations. The student using the Maple worksheet sees 
more than just a computer dialog. The complete text is included in the worksheets, with 
detailed explanations of both the mathematics and the Maple commands required to ob- 
tain it. 


l Relying on a computer algebra sys- 
tem | allows mathematical tools to be used before they are developed formally in the text. 
For example, numerical evaluation of integrals occurs well before the formal treatment of 
numeric integration in Unit Eight. Eigenvalues are computed numerically in Unit Three, 
before the chapters on numerical methods. 

) Complete Integration of Numeric and Symbolic Results Numeric results 
are interwoven with vate calculations throughout the text. Numeric solutions for dif- 
ferential equations appear early enough to be used throughout the study of models based 
on differential equations. The perturbation techniques of Poincare, Lindstedt, and Krylov- 
Bogoliubov are in the same unit as the second-order IVP. Collocation, Rayleigh-Ritz, and 
Galerkin techniques for solving BVPs are contiguous with analytic techniques, and with 
finite-difference, finite-element, and shooting techniques. Later, in Unit Five, numeric meth- 
ods for solving PDEs also appear in conjunction with the more classical symbolic results. 

' Appearance of the Laplace Transform The Laplace transform as a tool 
for mre an IVPs for ordinary differential equations appears in Chapter 6. This makes it 
available in Unit Three where systems of ODEs are studied. 


) ; stems of ODEs Systems of first-order 
linear ODEs motivate saod dce vector and matrix andi mulalims, Chemical mixing tanks 
provide the model, the Laplace transform is used to obtain solutions, and the vector-matrix 
structure in the model and its solution is deduced. This motivates a study of the eigenvalue 
problem, and leads to the fundamental matrix, first via the Laplace transform, then as the 
exponential of a matrix. Necessary matrix algebra is developed in the context of linear 
systems of ODEs. 


of Exercises, Part A and Part The exercises in approximately 
two- thirds of tes sections are b divided i into two categories. The A-exercises are generally 
more conceptual, and can be done without a suite of computer tools. The B-exercises 
generally presuppose access to appropriate computer tools, and provide both practice for 
the section and generalizations beyond the text. 


A unit discussing power series, Fourier series, and asymptotic 
series sits between the two units on ordinary differential equations. Solutions represented 
in these forms then appear in Unit Three, the second unit on ODEs. 


12) AU alculus oj A unit on the Calculus of Variations 
(Unit Nine) is available as a supplement. 


e /S The many questions (rather than new exercises) in a 
Chapter Review aid the student in organizing the chapter’s material. 
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Supplements 
Unit 9: Calculus of Variations (0-201-72204-6) 


This unit includes the chapters “Basic Formalisms;" “Constrained Optimization" and “Vari- 
ational Mechanics." 


Instructor’s Technology Resource & Solutions Manual 
(0-201-71001-3) 


This manual includes: 


Introduction to & Tips for Maple? 

Introduction to & Tips for Mathematica? 

Solutions to A Exercises 

A CD-ROM in the back of the manual includes: 

e Fully worked solutions to B exercises in Maple? Worksheets 

e Fully worked solutions to B exercises in Mathematica? Notebooks 
e Free Mathematica? Reader 


Student's Technology Resource & Solutions Manual 
(0-201-71004-8) 


This manual includes: 


Introduction to & Tips for Maple? 

Introduction to & Tips for Mathematica? 

Solutions to Selected A Answers 

A CD-ROM in the back of the manual includes: 

e Fully worked selected solutions to B exercises in Maple? Worksheets 

e Fully worked selected solutions to B exercises in Mathematica? Notebooks 
e Free Mathematica? Reader 


Web Site (http://www.awl.com/lopez) 


e Unit Nine in PDF files 

e Unit Nine in Maple? Files 

e Chapter 1 of the Student's Technology Resource & Solutions Manual in PDF files 
e Additional resources for instructors and students 
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UNIT ONE 


Ordinary Differential 
Equations—Part One 


Chapter 1 


First-Order Differential Equations 


Numeric Methods for Solving First-Order ODEs 


Chapter 2 Models Containing ODEs 

Chapter 3 Methods for Solving First-Order ODEs 
Chapter 4 

Chapter 5 Second-Order Differential Equations 
Chapter 6 The Laplace Transform 


The typical calculus studentis familiar with separable differential equa- 
tions arising from exponential growth and decay models, the logistic model, 
and Newton’s law of cooling. The techniques for solving these equations be- 
long to the arena of the calculus. After a brief reminder of these ideas, in- 
cluding a review of the technique of separation of variables, we continue 
with a study of analytic methods for solving first-order differential equations. 
The variable-volume mixing tank is modeled with a first-order linear equation 
whose solution we examine from the perspectives of integrating factors and 
variation of parameters. 

Many differential equations encountered in the applications cannot 
be solved with analytic techniques, Hence, we study a variety of numerical 
methods for solving first-order differential equations. Not so long ago a nu- 
meric method had to be programmed by each user. Now, numeric solutions 
of differential equations are available in preprogrammed software packages 
and on hand-held calculators. We rely on access to these newer technologies 
and slant our discussion on the conceptual bases for the numeric techniques 
presented. 

We particularly emphasize the meaning of order of the numeric method 
and consider empirical tests for determining or verifying the order of a method. 
For example, the simple Euler method is first order, whereas the slightly more 
complex rk4 method is fourth order. We are more interested in the difference 
between a first-order and a fourth-order method than we are in the actual 
computer coding of the algorithms. 


A second concept that is important for numerical techniques is that of 
error control. We explain how a numeric solver for a differential equation can 
be made to monitor the truncation error, and we show how this information 
can be used to return a solution of a guaranteed precision. 

Linear, second-order, constant-coefficient differential equations oc- 
cupy a preeminent position in engineering and applied science because they 
describe the oscillations of a spring-mass system that has both frictional 
losses and applied forces. They equally well describe the vibrations in an au- 
tomobile shock-absorber and the oscillation of current in an electric circuit 
containing resistance, inductance, and capacitance. These equations, then, 
occupy a preeminent position in this text, and their discussion comprises the 
remaining two chapters in this unit. 

In addition to the chapter devoted specifically to the linear, second- 
order, constant-coefficient differential equation, we also devote a chapter to 
the Laplace transform, a technique for converting linear differential equations 
into algebraic equations. This technique for solving differential equations 
is particularly effective in solving spring-mass and electric-circuit problems, 
especially when there are driving forces or voltages that are piecewise de- 
fined. The Laplace transform is but one example of an integral transform and 
provides a basis for mastering the Fourier transform later on in Unit Five. In 
addition, the Laplace transform is a very important component in the design 
of feedback control systems in all forms of engineering practice. 


Chapter ] 


First-Order Differential Equations 


INTRODUCTION In this first chapter we will learn what ordinary differential 
equations are and how they are classified. We will see examples of their use in modeling 
physical systems. We will learn how to verify that a given function is a solution of a 
differential equation and what the general solution of a differential equation is. We will also 
introduce the initial value problem and the boundary value problem. 

We will see the direction field determined by a first-order differential equation, and 
we will learn one theorem that indicates when an initial value problem has at least one, or 
exactly one, solution. We will also see Picard's iterative technique by which a solution of 
the first-order equation can, in theory, be constructed. 


Introduction 


Why Differential Equations? 


Three of the nine units in this text are devoted to differential equations; and of the three, 
two are devoted to ordinary differential equations. The astute reader immediately asks the 
following two questions. 


1. Why do differential equations occur in engineering and science? 


2. Why bother with differential equations? What do they say about physical systems? 


Answers 


QuzsrioN 1. Knowledge of the physical universe derives from observation of changes, 
not of absolute quantities. Forces are determined not directly, but rather by measuring 
displacements, or changes, in lengths of springs; the dynamics of a system are inferred 
from observations of changes in position; distances are determined by measuring changes 
in angles, lengths, and light intensities. 

Newton’s Second Law of Motion, F = ma, contains the acceleration, which is the rate of 
change of velocity, itself a rate of change of position. Rates of change are derivatives, velocity 
being a first derivative of displacement, and acceleration being the second. Derivatives are 
inherent in a Newtonian formulation of the laws of motion. 

As seen in elementary calculus, a rate of change is an instantaneous measure of a 
change per unit time. This is the derivative, the limiting value of the ratio of the change in a 
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quantity divided by the length of the time interval over which the change has taken place. It 
is important to avoid confusing the notion of the amount of change with the rate at which 
the change took place. 

If the rate of change is known, that is, if the derivative is known, then an approximation 
of the amount of change in a given interval of time is the differential. For example, if along 
a fixed axis, x(t) measures the displacement of an object from a fixed origin O, then x’ 
is the velocity, and the differential dx — x' dt approximates the displacement that occurs 
during the interval dt. The change in position is approximately the differential dx, but the 
rate of change in position is exactly the derivative dx 

Derivatives also appear in engineering and science, courtesy of conservation laws, or 
laws of balance. In ordinary circumstances, the amount of matter in a closed system remains 
a constant. If the amount of matter in the system changes, it must be that matter has entered 
or left the system. In fact, the change in the content of the system must be accounted for by 
the passage of content through the boundary of the system. Application of a conservation 
law usually involves derivatives, or rates of change. The rate of change of the conserved 
quantity is balanced against the rate of passage through the boundary of the system. Often, 
this boundary passage is determined by the rate of inflow less the rate of outflow. 

Examples of the formulation of differential equations are given in this chapter, in 
Chapter 2, and in Unit Three. Such differential equations are said to be mathematical 
models of a physical system, and the act of formulating the appropriate equation is called 
modeling. 


QurzsrioN 2 The examples below show not only how a model is framed by differential 
equations, but also what kinds of information can be extracted from the model. The purpose 
of the differential equation is not the solution, but rather the information contained in the 
solution. As we shall see, it is sometimes easier to extract information directly from the 
differential equation than from the solution. And every solution need not be an exact formula. 
Sometimes a numeric solution suffices, sometimes an approximate analytic expression. 

The differential equation is written to model a system in the real world. If the model is 
valid, it contains information about the physical system, and the mathematical techniques 
for analyzing differential equations become the tools by which that information is extracted 
from the model. Proficiency in these techniques should be prompted by the desire to under- 
stand, design, and control physical systems. 


Mechanical work In elementary physics, the mechanical work done by a constant force 
acting along a line is defined by W = fx, the product of the force f and x, the distance 
through which it acts. Using calculus, this definition is generalized to the case of the variable 
force f(x) via the definition W = | f (x) dx. This expression is obtained by arguing 
that over a small interval dx, the force is essentially the constant value f (x), so it does the 
differential amount of work dW = f (x) dx. If all such differential amounts of work are 
summed, the integral formula results. However, the integral formula for work is really the 
solution of the differential equation 


OW es f (x) (1.1) 


dx 


in which the derivative £V. becomes the differential dW by multiplying through by the 


dx 
increment dx. 
The force a spring exerts on an object is proportional to the stretch of the spring, 
resulting in the relationship f(x) = —kx. The minus sign indicates that the force opposes 
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EXAMPLE 1.2 


FIGURE 1.1 Solutions of y" + y = 0, 
different amplitudes, same frequency 


FIGURE 1.2 
y? = 0, different amplitudes, different 
frequencies 


Solutions of y" + y + 
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FIGURE 1.3 Formation of water from 
hydrogen and oxygen 


the stretch. Solving (1.1) tells us that the positive work done (on the system) when stretching 
the spring from its equilibrium length to x is W — ja kydy — kx’. “ 


Harmonicoscillator A spring is hung froma support, and a weight is attached and allowed 

to sag to equilibrium. Displacements of the weight upward from equilibrium are measured as 

positive. The weight is raised one unit and released, thereafter undergoing periodic motion. 

The weight is then raised two units and again released, again undergoing periodic motion. 
The differential equation governing the displacement of the weight is 


y"+y=0 


with y(0) = A, y'(0) = 0 representing the starting conditions for the weight. Of course. 
A assumes the values 1 or 2. In Figure 1.1, graphs of the two solutions show the weight 
experiences periodic motion. In each case, the amplitude of the oscillation is the same as 
the initial displacement, but the frequencies of the motions are the same. The frequency is 
independent of the starting amplitude. 

This is not the case for the differential equation 


y'-yc-yzz0 


In Figure 1.2, graphs of two motions starting, respectively, with initial displacements of 1 
and 2, show that while the amplitudes remain 1 and 2, the frequencies are now different. 
The frequency is dependent on the starting amplitude. $ 


We have demonstrated a fundamental difference between a linear and a nonlinear 
oscillator. The linear oscillator is the subject of Chapter 5, whereas the nonlinear oscillator 
appears in Sections 14.4—6. Definitions of /inear and nonlinear appear in Section 1.2, 
although the appearance of the term y? in the second equation signals the meaning of 
nonlinear. 


Law of mass action In chemistry, a mole of a substance is that quantity which contains 
Avogadro's number (6.023 x 10%) of molecules. The amount in a mole is related to the 
atomic number. For example, a mole of hydrogen atoms (H) has a mass of 1 gram while 
a mole of oxygen (O) has a mass of 16 grams. A mole of water (H2O) has a mass of 18 
grams. 

Using a catalyst and proper temperature control, the conversion of hydrogen and oxygen 
to water can take place at a rate considerably slower than explosive. Suppose 40 grams of 
oxygen (O) and 8 grams of hydrogen (H) are combined to form water. If the amount of water 
present at time f is given by x(t) and it is assumed (the law of mass-action) that the rate of 
change of the amount of water is proportional to the product of the amounts of hydrogen 
and oxygen remaining, the differential equation 


dx 16 ` 2 
—k (4o x) 8 x 
dt 18 18 


governs the reaction. (If at a particular moment there are 18 grams of water, that is, x = 18, 
then 16 of those grams came from oxygen and 2 came from hydrogen.) 

Since there is no water initially, x (0) — 0. she solution of the differential equation that 
satisfies this condition is 


(1.2) 


—8kt/3 __ 1 


(The differential equation is actually separable and can be solved with the techniques of 
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FIGURE 1.5 Equilibrium solutions for 
the harvested logistic model 


1.1 Introduction 5 


elementary calculus discussed in Section 3.1.) If an observation provides the data that at 
time t = | there were 6 grams of water, then the constant of proportionality k = à In = is 
determined, so 
A —] 52 
x(t) = 360 A= 
3A — 8 55 


The limiting value of the amount of water formed is ae = 45 grams, or 2 moles. 


Since the 40 grams of oxygen are also 2 moles, all the oxygen is consumed. The 5 grams 
of hydrogen consumed are 5 moles of H but 3 moles of binary hydrogen, H5. Figure 1.3 
shows the asymptote x — 45 and the dynamic history of the reaction. Thus, from (1.2) and 
an observation of x(t), the rate constant k for this reaction can be determined. $ 


Models of growth and decay If y(t) measures the size of a population and it is assumed 
that the rate of change of the size is proportional to the size, then the differential equation 
dy 
dt /— 
models the population. For growth, the constant r is positive and is called the growth-rate 
constant. The solution of the equation is y(t) = yoe”, the law of exponential growth that 
predicts the population will grow without bound. 

In an effort to make the model more realistic, the growth-rate constant r is modified 
to become a function of the population. Thus, the growth rate is allowed to vary, becoming 
zero as the population grows. This self-limitation is observed in closed biological systems 
when over-crowding or resource-depletion occurs. 

The simplest model incorporating self-limiting growth is the logistic model in which 
the growth rate is taken as r = k(a — y). When y(t) is small, the growth-rate factor is nearly 
constant at ka. As the population approaches the value a, the growth rate approaches zero. 
The resulting model is then 


ry 


dy 
dt 

For example, taking k — a — 1 gives the differential equation y' — (1— y)y, for which 
solutions satisfying the initial conditions of the form y(0) = 9,0 <a < 3, are displayed 
in Figure 1.4. The solutions y(t) = 0 and y(t) = 1 are called equilibrium solutions because 
for them y’ = 0 and y(t) remains constant. Neighboring solutions tend to the stable solution 
y = | and away from the unstable solution y = 0. 

The model expressed by (1.3) is more a statement of a theory than it is a device for 
predicting a population size. If experimental data shows (1.3) is a valid description of the 
dynamics of a population, the theorist then has confirmation that the appropriate features 
of the biological system have been identified. However, (1.3) does not account for the 
mechanisms that actually inhibit continued growth. Whether the population runs out of 
food or whether physical crowding actually inhibits reproduction remains unknown. The 
model only indicates that making the rate constant a function of population size can account 
for observed self-limitation in population sizes. 

As studied in Section 2.2, we next consider the effect of harvesting the self-limited 
population. Harvesting at a constant rate h modifies the differential equation to 


= k(a — y)y (1.3) 


dy 
—=(l-y)y-h 
dt 


For each value of the harvesting rate h, there is an equilibrium population y determined by 
the algebraic equation y’ = 0, that is, by the quadratic equation y? — y + h = 0. Figure 1.5 


FIGURE 1.6 
model with A < hy 


Solutions of the logistic 


FIGURE 1.7 Solutions of the logistic 
model with h = hj, 
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FIGURE 1.9 Equilibrium solutions for 
the equation of Example 1.5 
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contains a graph of y against / and shows that for each value of h < i there are two possible 
equilibrium populations. Thus, if the population starts at the equilibrium solution y — 1 
with no harvesting and over a period of years is subjected to gradually increasing harvesting 
rates, it can remain at slowly decreasing equilibria. The maximum harvest rate at which an 
equilibrium can exist is h = i, corresponding to y = ; 

It is extremely risky to attempt harvesting at this rate because if for some reason the 
population falls slightly below y — L, then it will rapidly become extinct. Indeed, consider 
the harvesting rate h = E for which the corresponding equilibrium populations are Le 
or, approximately, 0.72 and 0.28. Figure 1.6 shows these equilibrium solutions amongst 
others generated with this harvesting rate. The two equilibrium solutions are the horizontal 
lines. The larger equilibrium solution is stable, since nearby solutions tend toward it as time 
increases. However, the smaller equilibrium solution is unstable, since nearby solutions 
move away from it as time increases. Solutions slightly above the smaller equilibrium 
solution tend toward the larger equilibrium, while solutions below the smaller equilibrium 
solution tend toward extinction. 

In Figure 1.7 the horizontal line at y — 1, the only equilibrium solution, corresponds 
toh = i the maximum sustainable harvest rate. Populations that start out larger than + 
decrease toward 1, but populations that start out smaller become extinct. Harvesting at the 
maximum rate is perilous. If the population drops slightly below the equilibrium level, it 
becomes extinct. 

Of course, if the harvesting rate exceeds P the population becomes extinct no matter 
what the starting level might have been, as shown in Figure 1.8 where h = L, Models 
such as these are used by resource managers who are charged with regulating national and 


international fisheries. b 


| CR Soe |t 
0 | 2 3 4 5 6 7 8 


FIGURE 1.8 
with A > Aga 


Solutions of the logistic model 


Temperatures in a reaction vessel In the differential equation 


du = 9 =U s/t) sips fu) 

dt a 
from [55], the quantity u + 1 is the dimensionless temperature in a reaction vessel through 
which flows a stream of reactant with constant concentration and temperature. The analysis 
of the behavior of this system is similar to that of the harvested logistic in Example 1.4. The 
equilibrium solutions determined by u’ = 0 are the roots of the equation f(u) = 0. For 
each value of the parameter a, proportional to the flow rate through the reaction chamber, 
there is an equilibrium solution ua. The points (a, ua) lie on the curve shown in Figure 
1.9. At the two turning points (see Table 1.1) on the graph of u, there are two equilibrium 
solutions. For values of a between the turning points, there are three equilibrium solutions. 
Elsewhere, there is one equilibrium solution. 

By adjusting the flow rate, the parameter a can be varied. Hence, it is possible to operate 
the reaction vessel with different equilibrium temperatures. Table 1.2 lists five equilibrium 
solutions corresponding to values of a = 0.5, 0.65, 0.7, respectively, to the left of the 
turning points, between the turning points, and to the right of the turning points. 
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a 0.5 


0.65 0.7 
Ua 3 3 u = 2.17 
u üi = 3.65 us = 0.92 us = 0.185 
a 20e-7? = 0.6039 Se? = 0.6767 u4 = 0.24 
TABLE 1.1 Turning points for ua in Example 1.5 TABLE 1.2 Equilibrium solutions in Example 1.5 
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FIGURE 1.10 Solutions corresponding to 
a = 0.5 in Example 1.5 
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Figure 1.10 shows solutions corresponding to a = 0.5 < 0.6039. The horizontal line 
is the stable equilibrium solution u = u; that “attracts” solutions starting both above and 
below it. Figure 1.11 shows solutions corresponding to a — 0.65 € (0.6039, 0.6767). Both 
uz and u4 are stable equilibria since solutions starting on either side tend toward them. The 
equilibrium solution u = u3 is an unstable equilibrium because solutions starting on either 
side tend to move away. Figure 1.12 shows solutions corresponding to a = 0.7 > 0.6767. 
The one equilibrium solution is called stable since solutions on either side tend toward it 
with increasing time. $ 


FIGURE 1.11 Solutions FIGURE 1.12 Solutions corresponding to 
corresponding to a — 0.65 in a = 0.7 in Example 1.5 
Example 1.5 


The harvested logistic model is certainly simpler to analyze than this model of the 
reaction chamber. However, the techniques developed for analyzing the first model guide 
and enlighten the analysis of the second. 


An epidemic model As an epidemic courses through a population, it is discovered that the 
population divides into two groups: the infected individuals and the rest. The infected indi- 
viduals are carriers and can infect others, while the uninfected individuals are all susceptible. 

If i (t) is the proportion of infected individuals and s(t) the proportion of susceptible, 
then i + s = 1. Assuming that the infected individuals move freely and uniformly through 
the population and that the rate of infection is proportional to the product i(t)s(t) as a 
measure of the number of contacts between infected and susceptible individuals, we have 
the differential equation 

di 


T = ki(t)s(t) = ki(t)(1 — i (t)) 
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which is nothing more than a logistic model! The equilibrium solution i (t) = 0 is unstable, 
but the equilibrium solution i (f) = 1 is stable. Hence, the entire population will contract 


the disease. 


9$. 
hod 


Using similar techniques, Daniel Bernoulli modeled smallpox epidemics in 1760 and 
concluded that innoculation would extend the average life expectancy approximately 3 years 
on an existing expectancy of 27 years 7 months. 


EXERCISES 1.1 


pP 


. If x(t) = 5? — 7? — 4t + 3 is the distance of an object from a fixed 


origin O as the object moves along a line, find the velocity and 
acceleration of the object. 


If x(t) is the distance of an object from a fixed origin O as the object 
moves along a line and x” (t) = 4t? — 3t + 5 is its acceleration, find 
x(t) when x(0) = 12 and x'(0) = —1. 


. A spring whose natural length is 6 in is stretched to a length of 13 in 


by a force of 2 Ib. Find the spring constant k and the work done (in 
foot-pounds) during the stretch. 


. The differential equation x/(t) = (25 — 2x)( 12 — 2x) is obtained by 


applying the law of mass-action to two substances A and B that react 
to form C, the amount of which is measured by x(t). Describe the 
reaction. At equilibrium, x’ = 0. Determine the amount of C this 


solution and determine the fate of solutions starting with y(0) — 


Ni 


and 2. 

In the epidemic model of Example 1.6, assume that infected 
individuals are removed from the population according to the rule 
gd = —j, and that susceptible individuals are infected according to 


: ds is t m ay JD ane i , 
the rule z=}. i(0) — 59 and s(0) — 39° Obtain i (r) and, 


hence, s(t). What is the limiting value of s(t)? 


Write a differential equation governing a function y(x) for which the 
function times its derivative equals the sum of its first and second 
derivatives. 


. Write a differential equation governing a function y(x) for which the 


angle made by the x-axis and a line tangent to its graph is twice the 
distance from the origin to the point of contact. 


reaction generates. 


. Interpret the differential equation y'(f) = y — 2 as exponential 


growth with harvesting at a constant rate. Find the equilibrium 


Terminology 


Differential Equations 


An algebraic equation such as 3x + 5 = 7 is an open sentence, the truth or falsity of which 
is determined for each individual value ascribed to x, the placeholder or “opening” in the 
equation. This placeholder is usually called the variable in the equation, and the process 
of finding values for x that make the sentence true is called solving the equation. Another 
name for the variable x is the unknown in the equation. 
Similarly, an equation such as 
dy 


3 — 4 y(x)27 
dx 


containing one or more derivatives of an unknown function is called a differential equation 
(DE). Ordinary differential equations (ODEs) contain derivatives of functions of one vari- 
able, while partial differential equations (PDEs) contain derivatives of functions of two or 
more variables. Units One and Three are devoted to ordinary differential equations, whereas 
Unit Five treats the important partial differential equations of engineering and mathematical 
physics. 


(10) 


dy . 

— = sinx 

dx 

dy " 
—-+x*y(x) =5 
dx 


y (x)y(x) + 2y(x) = e* 
Ly’ (x)? + ya) = Inx 
f(t, y(t), y (0) =0 

y'(t) = g(t, y(t) 

2y" -- 3y' - Ay =r(t) 
F(t, y(t), y(t), y" (0) 20 
x(t) = 3x + 4y 


y(t) = 2x — 5y 
Pf Pf i 

d $ ; =0 
ax? + 3i T af (x, y) 


X = sint 


TABLE 1.3 Examples of differential 


equations 
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The notation y = f(x) indicates that the values of the variable y are determined by 
the function f. The notation y’ or f'(x) would indicate the first derivative of f(x). For 
emphasis, this derivative could be written as z, again indicating the distinction between the 
dependent variable y and independent variable x. An extremely handy notation, attributed 
to Isaac Newton, is the dot-notation in which y stands for y'(r) and y stands for y”(t), 
where the independent variable t is time. However, on occasion, it is even useful to use y 
for y'(x), especially when the derivative appears squared, as in y 1 + Y?, the integrand in 
the arc length integral of elementary calculus. 

For the function z = f(x, y) the variable z is dependent on the two independent vari- 
ables x and y. Hence, partial derivatives of the form fy = ar and f, = af or frx = n 
and f,, = S, could be found in a partial differential equation. 

Just the way the algebraic equation poses the question “what values of the variable, if 
any, make the equation true?" so also does the differential equation pose the question “what 
functions, if any, make the differential equation true?" However, in the algebraic equation, 
the variable, say x, appears in only one form. In the differential equation, the unknown 
function, say y(x), can appear, and so can one or more of its derivatives. So, the algebraic 
equation 3x + 5 = T has its variable appearing in two places, but it is the same variable in 
each place. The differential equation 


y” +3y + 5y =sinx 


has the single unknown y(x), but in addition to y(x) both its first and second derivatives 
appear. Other examples of differential equations are given later in this section. 


Vocabulary 


The following definitions are used to classify ordinary differential equations. 

A first-order equation is one in which the highest ordered derivative would be a first 
derivative. A second-order equation would be one in which the highest ordered derivative 
is a second derivative. 

A first-degree equation is one in which the highest ordered derivative appears to the 
first power. A second-degree equation would have that highest ordered derivative raised to 
the second power. 

A linear equation is one in which the unknown function y and its derivatives y appear 
as 35, 4 cc», with coefficients c, no worse than functions of the independent variable. A 
nonlinear equation is one that is not linear in the unknown function and its derivatives. 

A linear equation is homogeneous if, when the unknown function and all its derivatives 
are placed on the left side of the equation, the right side is then zero. A linear equation is 
nonhomogeneous (inhomogeneous) otherwise. Thus, the terms homogeneous and nonho- 
mogeneous rightly apply to linear equations. 

These definitions are illustrated by the examples in Table 1.3. 


Examples of Differential Equations 


1. Equation (1) is a linear, nonhomogeneous, first-order, first-degree equation. 

2. Equation (2) is also a linear, nonhomogeneous, first-order, first-degree equation. The 
coefficient x? multiplying y(x) does not violate the condition of linearity. 

3. Equation (3) is a nonlinear, first-order, first-degree equation. The product y'(x)y(x) 
makes the equation nonlinear. 
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4. Equation (4) is again a nonlinear first-order equation, but now it is of second-degree 
because of the square on the derivative. 


5. Equation (5) represents the most general first-order ordinary differential equation. Typ- 
ically, it is required that the first derivative can be isolated to yield an equation of the 
form (5’). Not every equation (5) can be so simply represented as (5^). For exam- 
ple, if equation (5) contains the term [y’(x)]’, then it takes two equations of the form 
(5^), namely, y'(t) = +g(t, y(t)), to express (5). Thus, solving for y' in the equation 
(y)? — t? = 0 gives two equations of the form (5), namely, y' — t = 0 and y' +t = 0. 

6. Equation (6) is a second-order, first-degree, linear equation with constant coefficients. 
It is homogeneous if r(t) — 0 and nonhomogeneous otherwise. Also, notice how we 
infer the independent variable of differentiation from the explicit indication given in 
r(t). This is usually a safe guess, but absolute precision would require that y" and y’ 

ay 


be replaced with symbols such as y"(t) or ^7. 


7. Equation (7) is the most general form of a second-order ordinary differential equation. 
As with equation (5), we would expect that we could solve for the highest ordered 
derivative to obtain an equation of the form y" = h(t, y(t), y'(t)). 


8. Equation (8) is a first-order, linear, homogeneous system. Its two equations are said to 
be coupled since no single equation contains just one variable and its derivatives. 
So far, all the differential equations presented have been ordinary differential equa- 
tions because the derivatives appearing in them are ordinary derivatives. 


9. Equation (9) is a second-order, linear, partial differential equation because the deriva- 
tives appearing in it are partial derivatives. In Unit Five, we will discover this equation 
to be a form of the wave equation governing the propagation of waves. 


10. Equation (10) is a first-order, linear, ODE written in notation useful when discussing 
velocity and acceleration in physics. 


Solution of a First-Order ODE 


The algebraic equation 2x? + 3x — 5 = 0 is quadratic in the unknown x; and therefore, its 
solutions, x = —3, 1, can be found by a specific algorithm called the quadratic formula. On 
the other hand, the two numbers that purport to be solutions can be verified by substitution. 
If substitution of a number into the equation results in an identity, then the numbers are 
solutions of the equation. 

In a similar manner, on any interval 7, the function y = f(x) = cx?— 1 can be verified 
as the solution of the differential equation 


xy —2y= 1 (1.4) 


The function f(x) has a first derivative and, if substituted into the differential equation, 
yields the identity 1 = 1. Hence, it is a solution, by which we mean a classical or pointwise 
solution. At each point in a given interval /, the derivative exists, and under substitution, 
the differential equation is satisfied point-by-point. Other terms for such a solution are strict 
and strong. A slightly more formal definition is given at the end of the section. 

The solution of (1.4) is found by the technique of separation of variables, studied in 
elementary calculus and reviewed in Section 3.1. The equation is written in the form 


dy dx 
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and an antiderivative of both sides leads to 


$In(1+2y)=Inx +a (1.5a) 
1+2y =e7"x? (1.5b) 
y=ex* — 1 (1.5c) 


(If constants of integration cr, and cg are introduced on the left and right, respectively, then 
a = Cg — CL, So only a single constant needs to be written on just one side of (1.5a).) 
For simplicity, we call the constant c = e°% in (1.5c) the arbitrary constant of integration 
introduced by antidifferentiation. 

Geometrically, (1.5c) represents a one-parameter family of curves. For each value of 
the arbitrary constant c, (1.5c) defines a distinct curve in the xy-plane. Any solution of 
the differential equation not containing an arbitrary constant is called a specific solution. 
Clearly, if the arbitrary constant c in the one-parameter family (1.5c) is given a value, a 
specific solution results. If a one-parameter family of solutions for a first-order differential 
equation is known to contain every possible specific solution, then the one-parameter family 
is called the general solution. 

There are first-order differential equations for which a one-parameter family of solu- 
tions does not contain all specific solutions. For example, the differential equation (y^)? + 
xy’ — y = Ois satisfied by every member of the one-parameter family of linear functions 
y = cx +c’, but the specific solution y = — x, a quadratic, is not a member of this family. 

Sometimes, a specific solution is a member of a family of solutions if the family is 
expressed in a certain way. The differential equation y’ = y? is satisfied by every member 
of the family y = (c — x)! and by y = 0. However, for no finite value of c will y = 0 be 
a member of this family. Yet, if the family is expressed by y = C(1 — Cx)~!, then y = 0 
is the member corresponding to C = 0. Whether or not a solution is essentially an outlier 
is thus difficult to determine. 

The first-order differential equation (y’ + y)(y’ + 2y) = 0 is satisfied by the members 
of the two one-parameter families of solutions y = ae~* and y = be~**. Hence, itis not even 
clear that first-order differential equations are always satisfied by a single one-parameter 
family of solutions. 

Fortunately, an n-parameter family of solutions constituting the general solution can 
be found for linear ODEs of order n. The theory for first-order linear equations is developed 
in Sections 3.4 and 3.5, and the theory for linear equations of order greater than one is 
developed in Chapter 5. 


An ordinary differential equation of order n can rightly be posed “alone,” with no additional 
conditions placed on its solution. In that event, a general solution depending on an appro- 
priate number of arbitrary constants would be the ideal solution sought. Failing that, an 
n-parameter family of solutions might be found. If additional conditions are included with 
the differential equation, we can have either an initial value problem (IVP) or a boundary 
value problem (BVP). Hence, there are three distinct senses in which the term “solution” 
might be applied. 

For the differential equation itself, a specific solution, the general solution (if possible), 
or an n-parameter family of solutions could be found. Depending on the type of additional 
conditions included with the differential equation, either an IVP or a BVP might be formed. 
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»(00 =a yO) = yz) 
yd) — B y'(0) = y'Qxz) 


TABLE 1.4 Common two-point boundary 
conditions 


FIGURE 1.13 Members of the 
one-parameter family F = x? +c 


In either of these two cases, we no longer speak of "solving the differential equation" but 
instead speak of solving the IVP or BVP. 


IVPs Ifthe values of the dependent variable and its derivatives are specified at a single 
point, the resulting problem consisting of these conditions and the differential equation is 
called an initial value problem. Examples include 


2y" + 3y + 4y = cost 
and y0) =1 
yl) =2 y0) — -1 


dy j 
= +x7y(x) = 
dx 


The first-order equation supports but one condition because its solution will generally 
contain but one "constant of integration." Applying any such condition results in an initial 
value problem. However, the second-order equation supports two conditions because its 
solution will generally contain two "constants of integration." Specifying both conditions 
at the same value of the independent variable results in the initial value problem. Incidentally, 
the second-order example, to be studied in detail later in Chapter 5, governs the forced motion 
of a damped linear oscillator whose initial position and initial velocity are prescribed. 


BVPs Sinceasecond-order ordinary differential equation can support two side-conditions, 
itis possible to impose these conditions at two different values of the independent variable, 
thereby forming the two-point boundary value problem. In such a problem, we seek a func- 
tion satisfying not only the given ODE but also the prescribed end-point conditions. The 
conditions on the left in Table 1.4 could arise in a heat-transfer problem where the temper- 
atures at the left (x — 0) and right (x — 1) ends of a conducting rod were prescribed to be o 
and Pf, respectively. On the other hand, if the heat-transfer problem involved temperatures in 
a conducting ring, periodic conditions on the right in Table 1.4 would express smoothness of 
the temperatures across the left and right faces of the rod that were joined to make the ring. 


The One-Parameter Family of Curves 


As c varies through all real numbers, the set of curves represented by F = x? +c comprise 
aone-parameter family. Through each point in the plane, one member of the family passes. 
Each curve is an upward-opening parabola; and as c varies, the vertex of the parabola moves 
along the y-axis. Figure 1.13 shows several members of this family. When c = 0 the vertex 
of the parabola is at the origin. For c < 0, the vertex of the parabola is below the x-axis; 
but for c > 0, the vertex is above the x-axis. 

If the function F = x? +c is thought of as a function of two variables, that is, as 
F (x, c), and graphed as a surface over the xc-plane, the plane sections c = constant would 
be the individual members of the family. Figure 1.14 shows a portion of this surface and 
includes, as a thick line, the intersection of the surface with the cutting plane c = 0. The 
space curve determined by this intersection is the parabola corresponding to c — 0, namely. 
yx 


The General Solution as a One-Parameter Family of Curves 


The general solution of the first-order ODE y’ = f(x, y) has a geometric representation 
as a one-parameter family of curves. Generally, one curve passes through each point in the 
xy-plane. However, there can be exceptional points through which more than one curve 
passes. This occurs, for example, with y = cx? — i the general solution of the differential 


FIGURE 1.15 


one-parameter family y — cx^ — 


Members of the 
2. 1 
2 


FIGURE 1.16 
F(x,c) = cx? 
Figure 1.15 


Plane sections of 
— 1 are the plane curves in 


EXAMPLE 1.7 
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FIGURE 1.1414 Plane sections of F (x, c) = x? +c 
are the plane curves in Figure 1.13 


equation xy’ — 2y = 1, several members of which are shown in Figure 1.15. Except for the 
point (0, —1), there is only one member passing through a given point. The characteristics 
of the differential equation responsible for this behavior will be examined more carefully 
in Section 14.1. 

We conclude this look at the one-parameter family of curves by providing one alternate 
view ofthe family. We plot, therefore, y (x) as a function ofthe two variables x and c, yielding 
the surface seen in Figure 1.16. The plane sections c — constant include the individual 
curves seen in Figure 1.15. 


Solution of a Second-Order ODE 


As we will learn in Chapter 5, the general solution of the second-order differential equation 
EP: +2 e + 10y(t) = 0 is y(t) = e ' (cı cos3t + cz sin 31) and now depends on two ar- 
bitrary constants, namely, cı and c2. Just as for the first-order equation, the solution is 


validated by the substitution 


(cie™ cos3t + coe! sin 3t)” + 2(cye' cos 3t + cre sin3t)' 
+ 10e™ (c; cos 3t + c2 sin 3t) = 0 


resulting in the identity 0 = 0. 

Since the general solution depends on two arbitrary constants, it forms a two-parameter 
family of curves. Unfortunately, the geometry does not lend itself to visualization as readily 
as it did in the case of the one-parameter family arising as the general solution of the 
first-order equation. 


The Initial Value Problem 


We give two examples of initial value problems for ordinary differential equations, a first- 
order equation, and a second-order equation. 

The initial value problem associated with the first-order differential equation x ay —2y(x) = 
1 consists of this equation and a condition of the form y(xo) = yo. As an example, take this 
condition to be y(1) — 2 and seek the single solution curve that passes though the point 
(1, 2) in the xy-plane. This solution curve can be extracted from the one-parameter family 
of solutions (1.5c). Imposition of the initial condition on this solution leads to the equation 
2 = c(1)? — 1, from which we obtain c = 3 and y(x) = 5x? — 5 as the solution of the 


initial value problem. Its graph resembles one of the parabolas in Figure 1.15. $ 
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EXAMPLE 1.8 The initial value problem for the second-order differential equation y" + 2y' + 10y(t) = 0 
consists of the differential equation and two conditions of the form y(to) = yo and y'(to) = 
yo. Initial values of the function and its first derivative are specified at a common value of the 
independent variable t. In the event y(t) represents a position, then the derivative represents 

n a velocity, so the IVP represents the motion of an object governed by the differential equation 

and set into motion at the location and with the velocity given by the initial conditions. 

We have already verified that y(t) = ce ^! cos 3t + c2e™ sin3t is the general solution 
of the differential equation. If we impose the initial conditions y(0) = 1, y'(0) = 2, we 
obtain the algebraic equations 1 = c1, 2 = 3c; — c; whose solution is c; = 1, c» = 1; so 
the solution of the IVP is y(t) = e™ (cos 3t + sin 3f). Its graph is the solution curve shown 


0 >x in Figure 1.17. $ 


-0.47 Formal Definition of a Solution 


FIGURE 1.17 Solution of the 


second-order IVP in Example 1.8 On the intervala < t < b, the function ¢ (t) is a classical solution of the differential equa- 


tion y' = f(t, y) if at every point in the interval, the derivative $' exists, and substitution 
of à (t) for y(t) in the differential equation yields the identity ¢’ = f(t, $ (t)). 

The requirement that the derivative exists means $ is continuous, and hence defined, 
throughout the interval. 

Other terms used for this notion of solution are strict, strong, and pointwise. 

The literature provides a spectrum of precision in the definitions for "solution" of a 
differential equation. For example, consult the definitions in [11], [12], or [13]. 


EXERCISES 1.2-Part A 


A1. Show that y = 4/1 — x? satisfies the equation x? + y? = 1. For each of Exercises A14—19: 


For each of Exercises A2-13: (a) Determine whether the system is an initial value problem or a 


(a) Identify the differential equation as linear or nonlinear. OTE aE 


(b) Determine whether there are the right number, too many, or 


(b) If linear, determine whether the equation is homogeneous or Li 
too few conditions. 


nonhomogeneous. 


(€) Determine the order and degree of the equation (c) State whether the differential equation is linear or nonlinear. 


(d) Identify the dependent and independent variables. (0) Clive theater af theequation. 


; dy A14. y' - xy? =Inx, y(1) 21 
A2. y = e e — —2xy = cosx 
dx A15. y" +3y' + 5y = cost, y(0) = 1, y'(0) 20 
A4. y" + 3xy’+5y =e“ sin3x — AS. y'y 2 xy +3 A16. y" — 2y" +5y’ — 7y 20, y(0) 20, y' (1) = 1 
A6. 3 — 3xyy +4ysin2x =x? — AT y +siny =] A17. y +xy'—y? =1, yO) +y) = 1, y) — »( =0 
dx? 


A18. y" + y 2 0, y(0) 20, y'(1) 20 


A8. (y) +3y = EF A9. y'+3y = [ry A19. x?y" + xy' +y 20, y(1) = L, y'(1) 20, y"(1) 2 
oa ; 5 , X 5 A20. Show that y(x) = cx? — $ satisfies the differential equation 
A10. (p) +3y=5 All. y +xy = > A12. y + pe xy’ = x + 3y. Find the value of c for which y(1) = 1, and graph 


the resulting solution. 


A13. y" + 2yy" — 7xy' -9y = siny 


EXERCISES 1.2-Part B 
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1.3 The Direction Field 


Show that y(x) = 9 + 5x + Haat 


3x? — 5xy + 4y? — 8x — 9y = 12. 


B1. is a solution of 


B2. Show that y(x) = sinx + 2x7 ! cos x + (c — 2 sin x)x ? satisfies 
y! + 2 = cos x. Find the value of c for which y (5)— = 1l, and 
graph the resulting solution. 


Show that x?y? — iy = 


x) Find the value of c for which y(0) = 1, and graph the 


B3. 
y= 
asd solntion. 


B4. Show that y(x) = Z satisfies y = xy?. Find the value of c for 


which y(1) — 2, and graph the resulting solution. 


. Show that y(x) — satisfies x?y' + 35x? + 1lxy+y? = 0. 
Find the value of c for which y(1) = 1, and graph the resulting 
solution. 


Show that y( 


y 
y = Mj 


x(Sx? =e) 


B6. (x) = x + /2x? + 1 is a solution of the IVP 


(0) = 1. Graph s solution. 


B7. SURE that y(x) lae /2 — 1) is a solution of the IVP 


y =x(1+ iim y( (0) = = 4. Graph this solution. 
B8. Graph representative curves from the family defined in 
(a) Exercise B2. (b) Exercise B3. 
(c) Exercise B4. (d) Exercise B5. 
Show that y(x) = ae^?* + be™ satisfies y 
values of a and b for which y(0) = 2, y'(0) = 
resulting solution. 


B9. "4 3y! 4 2y = 0. Find 


— ]. Graph the 


The Direction Field 


— c implicitly defines y(x) as a solution of 


B10. 


B11. 


B13. 


B14. 


B17. 


A Slope at Every Point 


A first-order differential equation in the form y' 


. Show that y(x) = ae? 


. Show that y(x) 


. Show that y 


Show that y(x) = ae ^ + be™ satisfies y” + Sy’ -- 4y = 0. Find 
values of a and b for which y(0) = —1, y'(0) = 3. Graph the 
resulting solution. 

Show that y(x) = (a cos x + b sin x)e * satisfies y" + 2y' + 

2y = 0. Find values of a and b for which y(0) = 4, y'(0) = — 
Graph the resulting solution. 

+ be^? satisfies y" — 2y' — 15y = 0. 
Find values of a and b for which y(0) = 2, y'(0) = —1. Graph 
the resulting solution. 


Show that y(x) = ax^! + bx~ satisfies x? y" + 7xy' + 5y = 0. 
Find values of a and b for which y(1) = 1, y'(1) = 2. Graph the 


resulting solution. 


Show that y(x) = ax + b In x satisfies x^( 
y = 0. Find values of a and b for which y(1) = 2, y 


Graph the resulting solution. 


1 — Inx)y" + xy' — 
'(1) = —2. 


= ax? + sin x satisfies (x? cos x — 2x sin x) y" + 
(x? + 2) sin(x) y' — 2(x sin x + cos x)y = 0. 

(x) = ax + be^ satisfies (2x — 1)y" — 4xy' + 

4y = 0. Find values of a and b for which y(0) = 2, y'(0) = 1. 
Graph the resulting solution. 

Show that y(x) = axe™ + be” satisfies (x + 1)y" — (3x + 4)y/ + 
(2x + 3)y = 0. Find values of a and b for which y (0) = = =3, 
y'(0) = 5. Graph the resulting solution. 


(x) = fox 


x)) has an interesting geo- 


metric interpretation. At each point (x, y) in the xy-plane, the number f (x, y) is the value 


of y’, 


so it is the value of a slope on some solution curve. The totality of such slopes in a 


region of the plane constitutes a direction field. The typical graph used to represent such a 
field of slopes or tangents is a collection of arrows or line segments, each of whose slope 
corresponds to the slope defined at the point where the arrow or line segment is drawn. The 
graph itself is often called the direction field. 

At every point on some solution curve $ (x), a member of the direction field is tangent. 
If at each point (x, y) a line segment having its slope determined by f(x, y) is drawn, then 
the solution curve $(x) will have one of these line segments tangent to it at each of its 
points. So, given the graph of the direction field, it is sometimes possible to sketch solution 
curves by following the flow of the arrows. We illustrate these ideas with an example. 


EXAMPLE 1.9 


Consider the differential equation y'(x) = f(x, y(x)) 2 x + y? and the region 0 « x, 


y < 1. On this region establish a grid whose nodes are the points (x;, yj) = G, A 0<i 


FIGURE 1.18 — Block diagram for the slopes 
generated by y' =x + y? 
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j € 4. If the function f (x, y) is evaluated at each nodal point, we have 25 numbers which 
exist at the nodes of a rectangular grid, and which are listed in Table 1.5. 


2 ell. l 9 

isy 0 16 4 16 1 
_ 1 5 1 1B 5 
m 4 16 2 16 4 
_ 1 9 3 9 3 
i=2 2 16 4 16 2 
TE 3 B 21 1 
i=l 4 16 l 16 4 
i 1 5 25 

i=0 1 16 4 16 2 


TABLE 1.5 Slope field evaluated on a rectangular grid 


Each number in Table 1.5 represents the value of a slope. One way to visualize these 
different slope values is by a graph in which heights are a measure of the slope, as shown 
in Figure 1.18. Even though the graph in Figure 1.18 is a mathematically correct way of 
representing the values of the slopes generated by f(x, y), it is neither typical nor partic- 
ularly revealing. These slopes are usually displayed as arrows such as seen in Figure 1.19. 
Solution curves emananting from the initial points (0, 0.2), (0, 0.4), (0, 0.6), and (0, 0.8) 
are superimposed on the direction field in Figure 1.20. e 
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0 l 
FIGURE 1.19 Direction field for FIGURE 1.20 Direction field and solutions 
y-2x-cy? for y =x + y? 


Notice how the arrows in the direction field are approximately tangent to each of the 
four solution curves. (It’s hard to know where to draw tangents to a solution if the solution 
isn't known.) Consequently, a direction field can, at best, suggest the shape of solution 
curves. Modern numeric solvers can obtain the solution curves as easily as the direction 
field itself. 


Isoclines 


An isocline is a curve along which the slopes in a direction field are constant. Since these 
slope-values are determined by the function f(x, y), an isocline is just a level curve of 
f(x, y). (A level curve, or contour, of f(x, y) is a curve along which f(x, y) remains 
constant.) Several such contours are graphed on the surface z = f(x,y) = x + y? in 
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Figure 1.21. Figure 1.22 shows the contours superimposed on the direction field and several 


2t T solution curves. 
— Also in the literature is the term nullcline, indicating the particular isocline through 
y 0 points in the xy-plane where the direction field has slope zero. This particular level curve, 
determined by the equation f(x, y) = 0 to be x = —y^, is shown in Figure 1.23. 
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FIGURE 1.21 Surface and level curves 
for f(x, y) =x+y? 


FIGURE 1.22 Level curves for f (x, y) = FIGURE 1.23 
x + y^; direction field and solutions for Nullcline for 
y = fy) yoxty 


With today’s technological tools, it is usually as easy to obtain solution curves as it is 
to obtain the direction field. However, [59] uses the direction field to anaylze the qualitative 
behavior of the equation v £ = a(V — v)? — bx”, which governs x, the length of the gouge 
a grounding iceberg makes on the ocean floor as the berg drifts with velocity v in a current of 
velocity V. So, while the direction field isn’t normally an efficient way to obtain solutions, 


it can occasionally provide insight into their behavior. 


EXERCISES 1.3-Part A 


A1. Sketch several solution curves on the direction field in Figure 1.24, A2. Sketch several solution curves on the direction field in Figure 1.25, 


computed for the differential equation y’ = |x| — 2|y|. Sketch the computed from the differential equation y' = yx? + y?. Sketch 
nullclines. Sketch the isoclines along which y' assumes the values the nullclines. Sketch the isoclines along which y' assumes the 
1, 2, and 3. values 1, 2, and 3. 
y y 
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FIGURE 1.24 Direction field for Exercise Al FIGURE 1.25 Direction field for Exercise A2 


EXERCISES 1.3—Part B 
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B1. Construct a direction field for the differential equation y' = x + 
3y, and on it show the isoclines where y' assumes the values 1, 2, 
and 3. In addition, sketch the solution emanating from the initial 
point G, 1). 

Construct a direction field for the differential equation y' = x? + 
3y, and on it show the isoclines where y' assumes the values 1, 2, 
and 3. In addition, sketch the solution emanating from the initial 
point G. 1). 


B2. 


B3. Construct a direction field for the differential equation y' = x + 
3y?, and on it show the isoclines where y' assumes the values 1, 2, 
and 3. In addition, sketch the solution emanating from the initial 
point G, 1). 

B4. Construct a direction field for the differential equation y' = x? + 
3y?, and on it show the isoclines where y’ assumes the values 

L 1, 2, and 3. In addition, sketch the solution emanating from the 
initial point (4, 4). 

B5. 
k 


and on it show the isoclines where y’ assumes the values +, 
- 10 


Picard Iteration 


Picard Iteration 


Construct a direction field for the differential equation y’ = x sin y, 


B6. 


B7. 


B8. 


B9. 


k = 1, 3, 5, 7. In addition, sketch the solution emanating from the 

initial point (0, 1). 

Construct a direction field for the differential equation y' = 5, and 
on it show the isoclines where y’ assumes the values 0.1, 0.3, 0.5, 

and 0.7. In addition, sketch the solution emanating from the initial 
point (—0.3, 0.5). 


Construct a direction field for the differential equation y’ = xy’, 
and on it show the isoclines where y' assumes the values 0.1, 0.3, 
and 0.5. In addition, sketch the solution emanating from the initial 
point (—0.3, 0.5). 


Construct a first-quadrant direction field for the differential 
equation yy’ = (1 — y)? — x?, and on it show the nullcline, the 
isocline where y' assumes the value 0. In addition, sketch the 
solution emanating from the initial point (0, 1). Use the direction 


field to argue that c, the x-intercept of this solution, satisfies c 1. 
Determine the equilibrium solutions for the differential equation 
y = y? — 3y? + 2y, y > 0. For x > 0, sketch the direction field 
and use it to determine the stability of the equilibrium solutions. 


EXAMPLE 1.10 


Given the initial value problem defined by the equation y'(x) — f(x, y(x)) and the ini- 
© du = f* f(t, y(r)) dt 


tial condition y(xo) = yo, the formal integration y(x) — yo = . » 


leads to the iterative scheme 


iis) = ee + f F(t, Po(t)) dt 


dal) had + f F(t, ét) dt 


Qaa (x) = $o(x) + f f(t, On (0) dt 


for generating $i(x). $2(x), ..., a sequence of approximations that Emile Picard (1856— 
1941) proved converges to a solution of the IVP. Known as Picard's theorem, this result. 
explored in Section 1.5, guarantees both the existence and uniqueness of a solution. The 
iteration scheme itself is called “Picard iteration." 


If ġo = 1, the IVP y' = y, y(0) = 1, with exact solution y(x) = e", generates Picard 
iterates that are nothing more than the partial sums of the Maclaurin expansion of e* 


b=14 f ldt=14x &-ie[ 
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1.4 Picard Iteration 


As an example of a more complex computation, consider the differential equation y'(x) — 
f (x, y(x)) 2 x + y? and the initial condition y(0) = 0. The solution of this IVP, given in 
terms of the Bessel functions Jy(h(x)) and Y,(h(x)), where « = 1 and -$ and h(x) = 


2 3/2 à 
2x7/2. is 


-Jap (h G0) — N/3Y aj (hx) 
J/x 
Jys (hx) — V 3Yis (hx) 


Of course, Bessel functions of any kind are beyond the typical reader this early in a study 
of differential equations since Bessel functions are solutions of special second-order dif- 
ferential equations. (See Section 16.2.) However, a computer-generated series expansion of 
this solution is found to be y(x) — jx? + ax + ax + sx +--+, anda graph of the 
solution is the solid curve in Figure 1.26. (See the companion Maple worksheet for details 


y(x)-— 


s x ofthe computation.) 
1 


FIGURE 1.26 — Exact solution (solid) and 
Q4 (x) (dashed) for the IVP of Example 1.11 


the next four iterates: 


The Picard iteration scheme, implemented with $9 = yo = 0, yields the following as 


1 


A 1,2 a igp lS P E a E E: ul 
$1(x) = 54 $o(x) = 5X^ + 39% P3(X) = 3X^ + WX + X + aago* 
Ada dog d mi 7 3 14 87. — 17 
a(x) = 5X" + wX + iig t oX + 92807 t 339360007 
1 20 1 23 
+ TO40.0007 T 345.280.000% 


Visual inspection of the terms in each approximation confirms the claim about con- 
vergence to the solution. Figure 1.26 shows the exact solution (solid) and $ (x) (dashed). 
Subsequent iterates are so close to the exact solution as to be indistinguishable. Hence, for 
this example, the convergence is rapid. e 


EXERCISES 1.4—Part A 


Al. Solve the IVP y’ = x, y(1) = 1, exactly, and then apply Picard A4. Obtain the exact solution of the IVP y' = 7, y(1) = 1. Set do = 1, 
iteration starting with $o = 1. and obtain the next three Picard iterates. Generalize, and show that 
A2. The exact solution of the IVP y’ = x + y, y(0) = 1 is y(x) = 2e*— the Picard iterates converge to the exact solution. 
x — 1. Set go = 1, and show that the next two Picard iterates are AS. Obtain the exact solution of the IVP y’ = y?, y(0) = 1. Set 
the terms of the Maclaurin expansion of the exact solution. oo = 1, and obtain the next three Picard iterates. Compare the 
A3. Obtain the exact solution of the IVP y’ = xy, y(0) = I. Set Maclaurin expansion of the exact solution to the series generated 
o = 1, and show that the next three Picard iterates are the terms by Picard iteration. 
of the Maclaurin expansion of the exact solution. 
EXERCISES 1.4—Part B 
B1. Show that y(x) = ioe* 1 — 2x — 2x?) is a solution of the Taylor polynomial at the point x — 0; then use Picard 
initial value problem y’ = x? + 2y, y(0) = 1. For this solution, approximation with @9 = 3 and compare the result with the Taylor 
create a Taylor polynomial at the point x — 0; then use Picard polynomial. 
approximation with œo = 1 and compare the result with the Taylor — B4. Repeat the Picard iteration of Exercise B3, this time using do = x 
polynomial. and $4, as given in Exercise B2. Observe that $9(0) z 3. 
B2. Repeat the Picard iteration of Exercise B1, this time using $9 = x B5. Show that y(x) = ip sin x + cos x + e" (4cos x — 8sinx)] isa 


and $y,1 = y(0) + fo f(t, d (0) dt, k > 0. Observe that 

$9(0) #1 = y0). 

Show that y(x) = x (76e>* — 1 — 5x) is a solution of the initial 
value problem y’ = x + 5y, y(0) = 3. For this solution, create a 


B3. 


solution of the initial value problem y" + 2y' 4- 2y = cos x, 

»(0) = 1, y'(0) = —2. For this solution, create a Taylor 
polynomial at the point x = 0, then, with ġo = (0); use the 
following extension of Picard iteration, comparing the result with 
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the Taylor polynomial. 
Yn 1 (x) = »(0) + Í y'(0) dt T 


0 


2x +3y =4 
2x+3y=5 
2x+3y=4 
3x4-3y25 
2x+3y =4 
4x + 6y = 


TABLE 1.6 Linear algebraic equations 
with no solution, one solution, and 
infinitely many solutions, respectively 


VOP +p 2 0 


y(00-1 
y +y(x) =x 
yO) =1 


xy’ —2y(x) = 1 


y(0) = -i 


TABLE 1.7  IVPs with no solution, one 
solution, and infinitely many solutions 


B6. Repeat Exercise B5 for y(x) — #19 sin 2x — 6cos 2x + 


{ [ f, ys, y (0) dt ds e ? (22sin 3x — 150 cos 3x)] and the initial value problem 
, Yn(t), y, (t)) dt ds 
0 0 


y" + 2y! + 10y = sin 2x, y(0) = —2, y'(0) = 3. 


Existence and Uniqueness for the Initial Value Problem 


Existence and Uniqueness: Algebraic Equations 
A system of linear algebraic equations such as 
aux +ay2y = C] anx + à22y = C2 


can have no solutions, exactly one solution, or an infinite number of solutions, depending 
on the values of the constant coefficients. For example, the system on the left in Table 1.6 
is inconsistent and has no solution. On the other hand, the system in the center of Tabl 


1.6 has the unique solution x = 4, y = £. Finally, the system on the right in Table 1.6 has 


[27 


3 
an infinite number of solutions, here represented as x = 2 — 3t, y = t, for —oo < t < x 
Sections 12.4—12.7 show that linear systems such as these have a unique solution if the 
system determinant, the determinant of the coefficient matrix, [s zb is nonzero and 
will have either no solution or an infinite number of solutions if this determinant is zerc 
For the examples in Table 1.6, we find the determinants to be 0, —9, 0, respectively. Only 
the second example has a unique solution. The first example has no solution; the third, an 
infinite number. 

We seek criteria for determining when an initial value problem for a first-order ordinary 
differential equation has a solution, when it has a unique solution, and when it has no 
solution. 


Initial Value Problems 


Table 1.7 lists three examples of initial value problems of the form f (x, y(x), y'(xd)) = 0. 
y(xo) = yo. one of which has no solution, one that has exactly one solution, and one with 
an infinite number of solutions. 

The initial value problem on the left in Table 1.7 has no solution. For real numbers, 
a? +b? — 0 implies a = b = 0, so the solution of the differential equation itself is 
y(x) — O. Then, the initial condition cannot be satisfied, and there is no solution to the 
given IVP. The initial value problem in the center in Table 1.7 has the unique solution 
y(x) = x — 1+ 2e^*. Verification that this is a solution is left to Exercise 19. That it 
is the only solution requires Picard's theorem. Finally, the initial value problem on the 
right in Table 1.7 has an infinite number of solutions. In fact, these solutions are given by 
y(x) = cx? — 1. For any value of the constant c we have y(0) = —1. This family was 
studied in Section 1.2. | 


Picard's Theorem 


The following existence and uniqueness theorem is attributed to Picard, who showed that 
the iteration scheme studied in Section 1.4 converges, under suitable conditions, to a unique 
solution of the initial value problem 


y = f(x,y) yQo = yo (1.6) 


EXAMPLE 1.12 


EXAMPLE 1.13 


EXAMPLE 1.14 
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A proof of this theorem requires more mathematical tools than we have yet mastered; it can 
be found, for example, in [80]. 


THEOREM 1.1 


1. Ris the closed rectangle defined by |x — xo| < a and |y — yo| < b, with a and b 
positive. 


2. OnR, f(x, y) and f,(x, y) are both continuous. 
3. OnR,|f (x, y)| x M and | f(x, y)| < L. 

4. histhe smaller of a and I. 

— 


The Picard iterates converge, on |x — xo| < h, to the unique solution of the IVP. 


Hypothesis 2, which requires f(x, y) to be continuous demands more than is needed 
and can be replaced with the condition that f(x, y) obey a Lipschitz (Rudolf Lipschitz, 
1832-1903) condition in y. The Lipschitz condition requires all possible “secant lines" to 
have bounded slopes, that is, | 22/1) 


E | < N. Hypothesis 3 is actually a consequence 
of Hypothesis 2, since a fundamental theorem of analysis declares that a continuous function 
on a closed set is bounded. 

This is a local theorem since it guarantees a solution exists in the bounded interval 
|x — xo| < h. A global existence and uniqueness theorem from [95] replaces the “local” 
Lipschitz condition with the uniform Lipschitz condition in which the same constant N 
works as a bound for all x and y. In this case, existence and uniqueness is guaranteed for 


all x. 


The IVP (1.6) where f(x, y) = 1 + y? and y(0) = 0 has solution y(x) = tan x, which 
cannot be extended outside the interval (—5, 7) because the function f(x, y) = 1 + y 


2 2 
32—X 


obeys only a local Lipschitz condition. In fact, LN | simplifies to |y» + y;|, which means 


the Lipschitz constant N depends on y and is, hence, local. $ 


The IVP (1.6) with y(0) = 0 and f(x, y) = cosx has solution y(x) = sin x, which is the 
unique solution for all values of x. This function f satisfies a uniform Lipschitz condition 
since 


fŒ, y2) —f(x.y) cosx — cosx 0 


2 — X1 2 = MI 


so the Lipschitz constant N, which can be taken as zero, applies for all x and y. E 


This final example explores the relationship between the bounding constant M, which 
dominates the function f (x, y), and the size of the interval |x — xo| < h for which Picard's 
theorem guarantees existence and uniqueness. The theorem concludes that h is the smaller 
of a and Ei where a and b are the dimensions of the rectangle R over which the bound M 
dominates f(x, y). 

Consider the initial value problem y' — 2x, y(0) — 0, which clearly has solution 
y(x) — x?. The function f (x, y) is 2x and we take the rectangle R to be centered at the 
origin. If the upper right corner of R rests at (a, b) = (3, 5), then M = 6 bounds f (x, y) 
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y on R. Thus, A is the smaller of 3 and - and y(x) — x? escapes the rectangle R before x gets 
to 3. In Figure 1.27, the lines y = Mx and y = —Mx are dashed and the lines y = / 
y — —b are dotted. The intersection of the dashed and dotted lines determines the value 
of h = zT. If the dashed line goes through the top of rectangle R, then h < a, otherwise 
h = a. Of course, the solution can exist and be unique outside the interval |x — xo| < A. 
' "7 but the theorem only guarantees existence and uniqueness within this interval. a 
-3 3 
L4 1 * 
jd — 
jog. Y 


FIGURE 1.27 The rectangle R for the 
IVP in Example 1.14 


EXERCISES 1,5 


1. 


Show that if the homogeneous system a;1x + a12y = 0, 

d21X + any = 0 has only the trivial solution x = y = 0, then the 
nonhomogeneous system a;,Xx + dj2y = C1, 421X + ayy = c; has a 
unique solution. Hint: Assume two solutions, subtract, and reduce 
the problem to the homogeneous case. 


For each of Exercises 2-11: 


(a) Determine if the system has a unique solution, no solution, or 
infinitely many solutions. 

(b) Exhibit any solutions that exist and give a reason why no 
solution exists if that is the case. Valid arguments could be 
based on a graph, computation of a determinant, or on some 
explicit solution technique. 


2. 3x — 5y = 7, —6x + 10y = —14 

3. 3x — 5y = 7, —6x + 10y = —21 

4. 3x — 5y = 7, 6x + 10y = —14 

5. 3x — 5y = 0, —6x + 10y =0 

6. 3x — 5y = 0, 6x + 10y 20 

7. 3x — 2y + 5z = 1, Ty -z = 1, x — 31y + 6z = —4 
8. 3x — 2y + 5z = 1, Ty — z = 1, x — 31y + 6z = 4 
9.3x -2y +5z=1, 7y—-z = 1, x +3ly+6z = —4 
10. 3x — 2y + 5z = 0, 7y -z = 0, x — 31y + 6z = 0 
Chapter Review 

1. What is a differential equation? 


. What is a solution of a differential equation? How is a function 


shown to be a solution of a differential equation? 


. What is the difference between a differential equation of first order 
and one of first degree? 


14. 


15. 


.3x — 2y + 5z = 0, 7y — z 20, x -31y -62 20 


. Show that both y = 0 and y = (xy are solutions of the initial 


value problem y' = y!/^, y(0) = 0. Explain why this does, or does 
not, contradict Picard's theorem. 


. Repeat Exercise 12 for y = 0 and y = x* and the initial value 


problem xy’ — 4y = 0, y(0) = 0. 

What does Picard's theorem say about the existence and uniqueness 
of a solution to the initial value problem y’ = 1 + y?, y(0) = 0? Is 
the function tan(x) significant in this setting? 

What does Picard's theorem say about the existence and uniqueness 


of a solution to the initial value problem yy’ = 1, y(0) = 0? Are 
the functions 4-4/2x significant in this setting? 


In each of Exercises 16-18: 


16. 


18. 
19. 


(a) What does Picard's theorem say about the existence and 
uniqueness of a solution? 


(b) Using the technique of separation of variables learned in 
calculus, obtain one or more solutions for each problem. 


y = Jay, 0 20 17. y =y”, yO) =0 
y —yy*-1, y(0021 


Verify that y(x) = x — 1+ 2e™ is a solution of the middle IVP in 
Table 1.7. 


. Give an example of a differential equation of first order and second 


degree. 


. Give an example of an ordinary differential equation of second 


order and first degree. 


. Give an example of a first-order, linear, differential equation. 


1.5 Existence and Uniqueness for the Initial Value Problem 23 


7. Give an example of a first-order, nonlinear, differential equation. 
8. Can a first-order, second-degree differential equation be linear? 
9, Can a nonlinear differential equation ever by homogeneous? 


10. Give an example of an IVP posed for a first-order ODE. 


11. Give an example of an IVP posed for a second-order linear ODE. 


12. Give an example of a BVP posed for a second-order linear ODE. 


13. Does it make sense to pose a BVP for a first-order ODE? Why? 
14. What is a one-parameter family of curves? 


15. What is a general solution of a first-order ODE? 
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17. 
19. 
20. 
21. 


22. 


. Give an explanation of the term direction field. What is its 
relevance to the study of differential equations? 


Whatisanisocline? 18. What is a nullcline? 
What does Picard iteration accomplish? 
Give an example of the process of Picard iteration. 


State a theorem governing the existence and uniqueness of 
solutions of a class of differential equations. 


Explain the value of an existence-uniqueness theorem for 
differential equations. 
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Chapter 2 


Models Containing ODEs 


INTRODUCTION This chapter examines four simple physical structures that 
are easily modeled by a first-order ordinary differential equation embedded in an initial 
value problem. The purpose here is to show the reader that differential equations are a 
natural vehicle for capturing a wide spectrum of physical processes. 

At a deeper level, the modeling process is typical of the way science settles on theories. 
After observations are made, hypotheses are formulated, and these hypotheses are often 
crafted into a differential equation as a model. To test the validity of the hypotheses, the 
predictions of the model are determined by extracting information from the differential 
equation and its solution. Then, new experiments and observations are made to validate the 
predictions. If the data do not contradict the predictions, the model is upheld or, at least, 
not invalidated. 

To the extent that new observations suggest a need for further refinement of the model, 
the process continues until a better model is obtained. However, the reader should be aware 
that models built from a differential equation help quantize phenomena but do not neces- 
sarily provide mechanistic explanations. For example, Schroedinger's differential equation 
of quantum mechanics describes atomic events but does not "explain" them beyond the 
primitive concepts upon which the differential equation itself is based. 


Exponential Growth and Decay 


Exponential Growth 


Growth for which the rate of change of the increasing substance is proportional to the 
amount of substance already present is called exponential growth. This type of growth is 
captured in the first-order differential equation £ = kP(t),k > 0, where P(t) is the 
amount of substance present at time f. For bacterial colonies, human populations, and even 
for money compounding at interest, it is not unreasonable to contend that the rate of growth 
is indeed proportional to the existing size or amount. 

If an initial amount P(0) = Po grows under this law, then the population at any later 
time will be given by P(t) = Poe", the solution of the differential equation. The initial 
amount grows exponentially, a characteristic of a growth law where the rate of change is 
directly proportional to the present amount. The rate constant k determines how quickly 


growth takes place. Figure 2.1 shows exponential growth curves for k = 1 and k = 1. 


> t 


t 
0 1 2 


FIGURE 2.1 Growth curves (increasing) 


and decay curves (decreasing) for k = 
(dotted) and k = 1 (solid) 


EXERCISES 2.1 


NI- 


2.1 Exponential Growth and Decay 25 


DouBLING TimE The time it takes for a population to double is called the doubling time. 
It can be determined by solving the equation 2P) = Poe for the doubling time t = nz, A 
population for which k = 3 would have a doubling time t = m2 = 0.23, where the units 
would be determined by those of k. : 

When dealing with the growth of investments, the doubling time is a convenient quan- 
tization of the return. An investment earning 6% will double in t = is = 11.55 years. 
To simplify the arithmetic, 1001n 2 = 69.31471806 is replaced by 72 since 72 has more 
factors than 69. Then, the doubling time for the 6% investment would be approximately 
2 = 12. In financial circles, this approximation technique for the doubling time is called 


the Rule of 72. 


Radioactive Decay 


The radioactive decay of elements like uranium can be modeled with the first-order dif- 
ferential equation i = —kP(t),k > 0. Unfortunately, this differential equation is often 
explained by saying that the rate of decay of the amount of material P (t) is proportional 
to the amount of material present. However, this explanation anthropomorphizes the ra- 
dioactive substance. It gives an intelligence to the material by claiming an individual atom 
adjusts its tendency to decay according to whether it is part of a large sample or a small 
sample. There can be no communication mechanism in uranium by which an individual 
atom knows the size of the sample in which it resides! 


The differential equation should be written in the equivalent form 


dP 
dt ee 


P(t) 


which supports the explanation that the rate of decay per unit substance is constant. This 
view of inert matter gives to Mother Nature a reasonable uniformity. (We could also have 
made the same observation about population growth, stating that the rate of growth per 
individual is constant.) 

An initial amount Pp will decay to an amount P(t) according to the law determined 
by the solution of the governing differential equation, namely, P(t) = Pye~*". Figure 2.1 
shows curves of exponential decay for k = 1 and k = 1. 


Hatr-Lire The length of time it takes for half the initial amount to decay is called the 
half-life of the radioactive substance. Since k > 0, we solve the equation a = Poe for 
the half-life t = —. Growth and decay models differ only by the sign of the proportionality 
constant in the differential equation, so it is not surprising that the doubling time and the 
half-life are governed by the same expression. 


1. A population grows exponentially from Pp to 13 Pp in 8 years. What 4. After an hour, a population is measured at 15,000, and an hour later, 
constant annual growth rate accounts for this? at 27,000. Find the initial population and the doubling time if the 


2. A population growing exponentially doubles in 7 years. What is the 


growth is exponential. 


annual growth rate? What is the population after 10 years? 5. A radioactive element has a half-life of 5000 years. How long will it 


3. A population growing exponentially triples in 11 years. What is the 


doubling time? 


take for all but 1% of the initial amount to decay? 
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6. A radioactive element has a half-life of 100 minutes. How long will 8. Write a differential equation modeling a growth rate inversely 


it take for all but 5% of the initial amount to decay? proportional to the square root of the population size. 

7. The National Association of Investment Clubs (NAIC) recommends 9. Many college students invest $100,000 in their educations. If at age 
buying and holding stocks that have the potential to double in value 18 a student invested that amount of money at 1096, what would it be 
within 5 years. If the value grows exponentially, what annual growth worth upon retirement at age 65? Suppose retirement is postponed 
rate must a stock sustain to meet this target? until age 67. How much more is the investment worth? 
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FIGURE 2.2 Solutions of the logistic 
equation 
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FIGURE 2.3 Solutions of the logistic 
equation with variable harvesting rate 


) Logistic Models 


Self-Limiting Growth 


The exponential growth model of Section 2.1 predicts that a population will grow exponen- 
tially, forever, with no bound. Clearly, in a finite world, such infinite growth cannot occur. 
Hence, the exponential growth model is often modified to take into account the tendency of 
a population to self-limit its growth. Overcrowding and the depletion of resources combine 
to limit growth in most observable closed colonies. Hence, the logistic model 

dP 


It 
—— =k(a— P(t)) 
PO (a ( 
introduces k(a — P(t)), a population-dependent growth rate that is nearly ka when the 
population is small but tends to zero as the population increases to the value a. This behavior 
is called “self-limited” growth. The techniques of integral calculus yield 


a Po 
Po + (a — Pole 


as the solution of the IVP containing the condition P(0) = P». Details of the solution 
process itself are deferred to Section 3.1. However, with a > 0 and Py Æ 0, the limiting 
value of the population is lim, ,44 P(t) = T = a, so the constant a is called the carrying 
capacity of the population. Moreover, if the differential equation is written in the form 
P'(t) = kP(t)(a — P(t)), we see P(t) = a is a solution of the equation P’(t) = 0. The 
solution P (t) = a is therefore an equilibrium solution since a population starting out at the 
carrying capacity will remain at that size indefinitely. 

For the specific model where k — 1 and a — 1, solutions with initial populations 
Po= b and Py = i along with the equilibrium solution P(t) = 1 are plotted in Figure 2.2. 

The equilibrium soluüon is the horizontal line. A population that starts out at the 
carrying capacity remains at that size indefinitely. The solid curve is a classic example of a 
logistic curve with its characteristic "S" shape. It shows the behavior of a population starting 
out below the carrying capacity, growing quickly at first, then experiencing a diminution 
of its growth rate. The population is asymptotic to the carrying capacity. Finally, the dotted 
curve shows the decay to carrying capacity for a population that starts out greater than the 


carrying capacity. 


P@) = 


Logistic Growth with Harvesting 


Section 1.1 contains an example of logistic growth with constant harvesting. Suppose, in 
that model, harvesting is not constant but is a periodic perturbation of a constant rate. In 
something like the fishing industry where harvesting represents catching fish, the rate of 
harvesting would probably not be readily maintained at a constant level. So, assuming it 
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varies periodically about a constant level, we write the differential equation 


aP = P(t)(1 — P(t)) + l 2t 2.1 
di al eae (s) 


Unfortunately, (2.1) cannot be analyzed for large values of t by setting P’ = 0 because the 
resulting expression for P is not independent of t. Instead, Figure 2.3 shows numeric solu- 
tions of (2.1) with different values of P (0). For low enough values of the initial population, 
extinction occurs. For higher values, the population is asymptotic to what appears to be a 


periodically varying "steady state." 


EXERCISES 2.2-Part A 


A1. The logistic equation P’ = kP (a — P) can be solved by separation A2. For P' = kP(a — P) — h, the general logistic equation with 
of variables. Relying on skills from elementary calculus, obtain constant harvesting h, obtain an expression for P; (/), the limiting 
Pg — k dt, integrate both sides, and solve for P — y(t). Apply population corresponding to P’ = 0. From P,,(h), determine hax, 
the initial condition P(0) — A to determine the constant of the maximum sustainable rate of harvesting. At this rate of 
integration. harvesting, what is the new eqilibrium level of the population? 
EXERCISES 2.2-Part B 
B1. The growth of a population is modeled with a logistic equation. the hint still applies. Use the solution to determine the population 
Determine the three parameters Po, a, and k from the observations at time t — 12. 
10, 57, 94 made at times 0, 2, 1, respectively. Exhibit the logistic B4. Repeat Exercise B2 for the data points (1, 118), (5, 497) 
curve, graph it, and use it to determine the population at time f = ;. (10, 923). Again, a numeric solution of three equations in three 
Hints: Clearly, Po is known, so there will be just two equations in unknowns must be computed. Use the solution to determine the 
two unknowns. Equally spaced time intervals yield (e^)? = population at time t = 8. 
e~*k22 from which an algebraic solution can be extracted “by > - : 
hand." LAdtermarivel n a computer algebra system.) . BS, Salve the TVP y = yl — 9, FO =, obtaining: solution JUD 
` - y» Lx MOLD AN . dependent on the parameter A. For what values of A does the 
B2. The growth of a population is modeled with a logistic equation. graph of the solution have an inflection point? Where is that 
Determine the three parameters Po, a, and k from the observations inflection point located? 
57,94, 98 made at times 1, 1, £, respectively. Exhibit the logistic . NE : . 
Qs y pate y 7 B6. A population of size P(t) experiences growth for which the growth 


curve, graph it, and use it to determine the population at time 

t= i. Hints: An analytic solution is now impossible. A set of three 
equations in three unknowns must be solved numerically, best done 
with appropriate technology. 


B3. Repeat Exercise B1 for the data points (5, 497), (10, 923), 
(15, 993). Notice that now the initial population is not known, but 


rate r — r(P) is quadratic in P. Formulate a differential equation 
modeling this growth. What can be said about the population if 
r (P) has no real zeros? 


Mixing Tank Problems— Constant and Variable Volumes 


The Mixing Tank 


Brine containing c pounds of salt per gallon that flows into a tank at a fixed rate of rı gallons 
per second is instantly mixed with the existing contents of the tank, and the fluid in the tank 
is drained at a fixed rate of r2 gallons per second. The tank initially contained V gallons 
of fluid in which h pounds of salt were dissolved. We seek a differential equation and an 
initial value problem describing the amount of salt in the tank at any time f. 
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FIGURE 2.4 Schematic for the 
constant-volume mixing tank 


EXAMPLE 2.1 
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FIGURE 2.5 Salt content in a constant- 
volume mixing tank. Dotted line is the 
asymptote x. = 3000 


EXAMPLE 2.2 
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FIGURE 2.6 Salt content in a mixing 
tank with increasing volume 
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The assumption of instantaneous mixing allows us to model the fluid in the tank as a 
homogeneous mixture at all times. If the rates of flow into and out of the tank are equal, 
namely, if rj; = r2 = r, the volume of fluid in the tank remains constant. If r1 > r2, the tank 
fills until it overflows. If rı < r2, the tank drains until it is empty. A useful diagram for a 
tank problem with constant volume appears in Figure 2.4. 

Let x(t) be the amount of salt in the tank at any time f. If we account for changes in 
the salt content of the tank by recording the rate at which salt enters and leaves the tank, 
we obtain the initial value problem 


x(0) =h 


The derivative a is measured in pounds per second. The rate at which salt enters the tank 
is rc, also measured in pounds per second. Each second, r gallons of fluid leave the tank, 
taking with them some of the dissolved salt. In fact, since these r gallons represent the 
fraction > of the volume of fluid in the tank, they take with them an equal fraction of the 
salt then in the tank, namely, they take the fraction > of x(t) pounds of salt—hence, the 


differential equation. 
Constant Volume 


Suppose brine containing 3 1b of salt per gallon flows at a rate of 4 gal/s into a tank that 
initially held 1000 gal of pure water. If the fluid in the tank mixes instantly and exits at a 
rate of 4 gal/s, model the salt content in the tank up to the moment the tank is full. 

If x(t) represents the amount of salt in the tank at any time f, then a differential equa- 
tion governing that amount is B =3x4- mx (0. With the initial condition x(0) — 
0, a solution for the initial value problem associated with this tank would be x(t) = 
3000(1 — e7*/250), 

Before performing any analysis on this solution, a moment's thought reveals significant 
information about the model. As t becomes infinite, the tank will contain 1000 gal of brine, 
each gallon of which will contain 3 Ib of salt per gallon. Since the tank initially contained 
water, a graph of the solution x(t) should be that of an increasing function that approaches 
the asymptote x = 3000 from below. Noting xo; = 3000 and observing Figure 2.5 with its 
plot of the solution x(t) and the asymptote x = 3000, confirm this analysis. $ 


Varying Volume 


The filling tank Suppose brine containing 3 Ib of salt per gallon flows at a rate of 4 gal/s 
into a 1000-gal tank that initially held 200 gal of pure water. If the fluid in the tank mixes 
instantly and exits at a rate of 2 gal/s, model the salt content in the tank. 

The volume of fluid in the tank increases at a rate of 2 gal/s. Therefore, the volume of 
fluid in the tank is given by V(t) = 200 + 2t. After 400 s, the tank will overflow and any 
differential equation describing the salt content in the tank will cease to be valid. 

If x(t) represents the amount of salt in the tank at any time f, then a differential equation 
governing that amount is 


dx 2 2 
— = 3 x 4 — — x(t) = 12 — ————x(t) 
dt V(t) 200 + 2t 


Along with the initial condition x (0) = 0, this differential equation forms an initial value 


. 2 2 , . . . . 
problem whose solution, x(t) = Der is plotted in Figure 2.6. We observe an increasing 


amount of salt in the tank, with a maximal amount of 2880 occurring at time t = 400. $* 


EXAMPLE 2.3 
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FIGURE 2.7 Salt content in a mixing 
tank with decreasing volume 
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The emptying tank Suppose brine containing 3 Ib of salt per gallon flows at a rate of 4 
gal/s into a 1000-gal tank that initially held 800 gal of pure water. If the fluid in the tank 
mixes instantly and exits at a rate of 5 gal/s, model the salt content in the tank. 

The volume of fluid in the tank decreases at a rate of 1 gal/s. Hence, this varying volume 
is given by V(t) = 800 — ¢ and the tank will be empty in t = 800 s. After this time, the 
differential equation we now build is no longer valid. 

If x (t) represents the amount of salt in the tank at any time f, then a differential equation 
governing that amount is 


M yd quan > x() 

— =3%4— — X (l)—l12—--————x 

dt VO 800 — r` 
Since the initial condition is still x(0) = 0, the solution of the associated initial value 
problem is 


3 ;5 
409.600,000.000 


" 3 4 3 3 3 x 
x(t) n 102,300,000 t + 61,0004 80! + 12t 


the graph of which appears in Figure 2.7. 

We see that the amount of salt in the tank initially increases to a maximum, then, as the 
actual volume of fluid in the tank decreases, the amount of salt decreases. When the tank is 
empty, there is neither fluid nor salt present, so x(800) = 0. We can, however, ask for the 
limiting value of the concentration of salt in the tank at the moment the tank empties. An 
expression for the concentration at any time t is the ratio of the amount of salt to the volume 
of fluid. A graph of the concentration C = 2€ appears in Figure 2.8. The concentration 


. V(t) . . . 
at t = 800 is 3 Ib of salt per gallon. The last few drops of fluid leaving the tank have this 
concentration, which is the concentration of the influx. $ 

— t >t 

0 200 400 600 800 

FIGURE 2.8 Concentration of salt in the 

decreasing-volume mixing tank 

EXERCISES 2.3-Part A 

Al. Write the differential equation governing x(t), the amount of salt A3. If the initial amount of salt in the tank in Exercise Al is xo, show 
in a constant-volume mixing tank if the constant volume is V that x(t) = cV + (xo — cV)e"""/" , Is this solution consistent with 
gallons, the flow rate is r gallons per second, and the concentration the results of Exercise A2? 


of salt in the influx is c pounds per gallon. 


A4. Show that the units for x(t) in Exercise A3 are consistent. 


A2. Obtain the limiting amount of salt in the tank of Exercise Al. Hint ^ A5. Sketch a representative curve determined by x(t) in Exercise A3. 
Set x' — 0 and solve for x. Obtain the limiting concentration of 


salt in the tank. Does this make sense physically? Explain. 


EXERCISES 2.3-Part B 


B1. Brine containing c = 2 lb of salt per gallon that flows into a tank tank at any time f. Plot a graph of the solution, and determine the 
at a fixed rate of rj; = 3 gal/s is instantly mixed with the existing limiting amount of salt in the tank. Hint: The differential equation 
contents of the tank, and the fluid in the tank is drained at the for this problem is variable separable and can be solved with 
same rate of r; — 3 gal/s. The tank initially contained V — 200 methods learned in calculus. Alternatively, a computer algebra 
gal of water in which A = 20 Ib of salt were dissolved. Formulate system can be used. 


and solve an initial value problem for the amount of salt in the 
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B2. Repeat Exercise B1 if the parameters are c = 5, rji = 2, m = 2, 
V — 500 and the tank initially held pure water. 


B3. Repeat Exercise B1 if the parameters are c = 6, ri = 7, r; — 7, 
V = 50, and à = 25. 


B4. Repeat Exercise B1 if the parameters are c = 3,r; = 4,72 = 4, 
V = 300, and 4A = 15. 


In Exercises B5-9, use a computer algebra system or other technology 
to obtain and plot either an analytic solution or a numeric solution. 


B5. Brine containing c — 2 lb of salt per gallon that flows into a 
C = 300-gal tank at a fixed rate of rı = 3 gal/s is instantly mixed 
with the existing contents of the tank, and the fluid in the tank is 
drained at the rate of r2 = 2 gal/s. The tank initially contained 
V = 100 gal of water in which 4 = 10 Ib were dissolved. 
Formulate an initial value problem for the amount of salt in the 
tank at any time t. Determine the amount of salt in the tank at the 
moment it overflows. 


B6. Repeat Exercise B5 if the parameters are c = 7, ri = 5, r2 = 3, 
V = 50 and the C = 300-gal tank initially contained pure water. 


B7. 


B8. 


B9. 


B10. 


Repeat Exercise B5 if the parameters are c = 2, r; = 6., m2 = 4. 


V = 400, à = 200, and C = 1000. 

Brine containing c = + Ib of salt per gallon that flows into a 

C = 300-gal tank at a fixed rate of r, = 3 gal/s is instantly mixed 
with the existing contents of the tank, and the fluid in the tank is 
drained at the rate of r2 = 5 gal/s. The tank is initially filled with 
water in which 30 Ib of salt are dissolved. Formulate an initial 
value problem for the amount of salt in the tank at any time f. 
Determine the limiting concentration of the fluid in the tank at the 
moment it empties. 

Repeat Exercise B8 if the parameters are c — i. yy =H 2,9 =T 
C = 600 and the tank is initially filled with pure water. In 
addition to a graph of the amount of salt in the tank, obtain a 
graph of the concentration of salt in the tank. 


At the time-dependent rate of r = 3 + cost gal/min, brine 
containing 2 Ib of salt per gallon flows into a 500-gal tank which 
initially held 200 gal of pure water. If the instantly mixed fluid in 
the tank is drained at a rate of 1 gal/min, formulate a differential 
equation for the amount of salt in the tank up to the moment the 
tank overflows. 


Newton's Law of Cooling 


Newtonian Model of Heat Flow 


To quantize the change in temperature observed when a body of one temperature is placed 
in an environment of a different temperature, we assume the rate of change of temperature 
is proportional to the difference in temperature between the body and the environment. 
This assumption includes the supposition that the instant a temperature gradient (spatial 
difference of temperature) exists, heat flows, and flows everywhere. Heat flow exhibits no 
inertia: as soon as a difference in temperature is established, heat instantly flows. The rate 
of change of temperature is proportional to the difference in temperature between the body 
and the surroundings. 

The model of heat transfer so postulated and captured in the following differential 
equation is attributed to Isaac Newton. Letting U (t) represent the temperature of the object 
in question and U, represent the temperature of the surrounding environment, we also 
assume that U, remains constant during the process of heat transfer to or from the body. 
Such an environment is called a heat sink, a reservoir of heat energy capable of absorbing 
or releasing heat without having its own temperature appreciably changed. The ocean, for 
example, is a heat sink for a thermal event on a passing ship. 

Thus, we have the differential equation S = k(U (t) — U,), whose solution is U (t) = 
U, + Ae". Consequently, the model contains the three parameters U.. k, and A. (The 
constant A arises from integration following a separation of variables. See Section 3.1 and 
the exercises.) It will take three pieces of data to specify all three constants. An initial 
condition of the form U (0) = Up gives an initial value problem whose solution is then 
U(t) = U; +e" (Ug — U,), leaving just U, and k to be determined to specify the parameters 
of the model. 


Notice carefully that no assumptions were made about the body cooling or warming. 
Some texts make this distinction; take k positive; adjust the sign in the exponential or in 
the difference U — U,; and generate two versions of the model, one for heating and one for 


EXAMPLE 2.4 


EXAMPLE 2.5 


EXAMPLE 2.6 
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cooling. This is an unnecessary distinction: use one form of the differential equation and 
let the data determine the value of k. 


At 1:27 P.M. a medical examiner (M.E.) notes the temperature of the body of a deceased 
person is 80°F, and the environment in which the body has been located is at 71°F. Being 
careful not to alter the surrounding temperature, the examiner waits 20 minutes and again 
checks the body's temperature, finding it to be 78°F. Show how the examiner estimates the 
time of death for the deceased. 

Observation yields two data points (t, U) = (0, 80) and (20, 78) on the curve that is a 
solution to Newton's law of cooling. In addition, U,, the surrounding temperature, is noted 
as 71°F. Hence, all three constants in the model can be determined, and the time at which 
the body's temperature was 98.6°F can be calculated. 

Starting with the solution in the form U (t) = 71 + Ae", the M.E. forms the two alge- 
braic equations 


71--A — 80 and 71-- Ae” — 78 
whose solution is A — 9, k — E In z. Hence, the equation for the model is U (t) = 71 + 


9e 0/2010/9 — 71 + Bv, The M.E. then determines the time at which the body's 
temperature was 98.6 by solving the equation U (t) = 98.6 for t = —89.17842108 and 
concludes that 89.2 minutes prior to 1:27 P.M. the deceased expired. s 


From [56], we pose the following problem: 


At the spring picnic a cup of coffee is brewed; milk is added, bringing the coffee's 
temperature to 180°F; and the cup is set on the picnic table because a volleyball 
game just started. Seven minutes later the temperature of the coffee is 150°F; seven 
minutes after that, 127?F. What is the temperature that spring day? 


Three pieces of data have been given, namely, the data points (0, 180), (7, 150), and 
(14, 127). This is enough information to convert U (t) = U, + Ae" to the three equations 


U,+A=180 U,+Ae*=150  U,4 Ae!* — 127 


in the three unknowns A, k, and U,. The solution is U; = 380, k= + In B, A= 290: so 


the ambient temperature, assumed constant during this experiment, is T = 51.4°F—a bit 


chilly for a spring picnic. E 


Also from [56], we pose this final problem: 


At the fall picnic, on a day when the temperature was a balmy 74°F, a cold drink 
was taken from the cooler just as the volleyball game was starting. The drink was 
set on the picnic table, and seven minutes later its temperature was 50°F. Seven 
minutes after that, its temperature was 60°F. How cold is the inside of the cooler? 


Again, three pieces of data are given; two pieces are the data points (7, 50) and (14, 60), 
and one piece of data is the ambient temperature Us = 74°F, We can form two equations in 
the two unknowns A and k, thereby determining the model, from which we then calculate 
U (0). On the other hand, we can incorporate the value of U (0) — x in a third equation, and 
solve for all three unknowns at once. Therefore, solve the equations 


7A--A 2x 74+Ae*=50 74+ Ae!* = 60 


A y H H 
obtaining A = —28. k = ;In NE: = 20. The temperature in the cooler is a frosty 
20 © 32.9°F! * 
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EXERCISES 2.4—Part A 


A1. Using the techniques of elementary calculus, separate variables in 
Newton's law of cooling to obtain QU/(U — U,) = kdt. 
Antidifferentiate (integrate) both sides, then solve for 
U(t) = U; + Ae". 

A2. To U (t) = U, + Ae" apply the initial condition U (0) = Uo, 
thereby determining the constant A. 

A3. Show that if the three data points used to fit Newton’s law of 
cooling to observations are taken at equally spaced time intervals, 
then the system of equations reduces to a quadratic in e*"!. In 
particular, let the times of the observations be tj, t = 2t, t3 = 3f 


EXERCISES 2.4—Part B 


A4. 


and form the three equations e;, e2, e. Then, let e; = ei — e? 
and e5 = e; — es and divide the corresponding sides of e, and es. 
This will lead to an equation linear in e". Solving this equation 
for e"! gives k via a logarithm, from which A and U, can then 

be found. 


Write a differential equation modeling heat flow for which the rate 
of change of a body's temperature is directly proportional to the 
square of the difference in temperatures between the body and its 
surroundings. 


B1. A cool object of unknown temperature is placed in a warm 
environment, also of unknown temperature. Three observations of 
the object's temperature are then taken. If the observed 
temperatures U (t) are U(2) = 8, U(5) = 15, U (11) = 23, find the 
initial temperature of the object and the temperature of the warm 
environment. Graph the object's temperature as a function of time. 
Hint: Form three equations in the three unknown parameters in the 
general solution of Newton's law of cooling and solve using 
Maple's fsolve command or the equivalent. Even though the object 
is warming, the constant k will be negative! 


B2. A warm object of unknown temperature is placed in a cool 
environment, also of unknown temperature. Three observations of 
the object's temperature are then taken. If the observed 
temperatures U (t) are U(1) = 100, U(5) = 75, U (12) = 47, find 
the initial temperature of the object and the temperature of the cool 
environment. Graph the object's temperature as a function of time. 


Chapter Review 


1. In words, state the hypothesis that leads to the law of exponential 
growth. 


" 


A population obeys the exponential law P(t) = 10e". Use the 
following examples to show that no assumptions need be made 
about the sign of r, the growth-rate constant, since that information 
follows from observational data. 


(a) If P(1) = 20, findr. (b) If P(1) = 5, find r. 
3. Explain the “Rule of 72." 


4. What is the half-life of an exponentially decaying quantity? How 
can it be estimated from the Rule of 72? 


5. What is the doubling time for an exponentially growing quantity? 
How can it be estimated from the Rule of 72? 


6. Explain the term self-limiting growth. 


7. What is the carrying capacity in the logistic model? 


B3. 


B4. 


10. 


11. 


12. 


13. 


Hint: Form three equations in the three unknown parameters in the 
general solution of Newton's law of cooling and solve using 
Maple's fsolve command or the equivalent. The constant k will 
again be negative! 

If, in Exercise B2, U (12) — 30, the solution of the three equations 
in three unknowns yields an ambient temperature higher than the 
initial temperature. Compute the solution for these three data 
points and conclude that although the Newton's law of cooling 
curve can be fit to this data, the data could not have been generated 
from any real physical system cooling according to that law. 
Example 2.4 is predicated on the assumption that the normal body 
temperature for a human being is 98.6°F. This happens to be a 
myth. Normal body temperatures can range as low as 96?F and as 
high as 99°F, If this variation in initial temperature is taken into 
account, how much difference in predicted time of death could 
there be in the conclusion of Example 2.4? 


. What is an equilibrium solution? 


. Formulate a mixing-tank problem in which the volume of fluid in 


the tank remains constant. Write a differential equation modeling 
the physical process. 

Why make the assumption of "instantaneous mixing" for the fluid 
in the tank? 


Formulate a mixing-tank problem in which the volume of fluid in 
the tank decreases. Write a differential equation modeling the 
physical process. For how long is the differential equation valid? 
Formulate a mixing-tank problem in which the volume of the fluid 
in the tank increases. Write a differential equation modeling the 
physical process. For how long is the differential equation valid? 


In words, state Newton's law for heat flow between an object and a 
surrounding heat-sink? 


14. 


15. 


What is the differential equation which expresses the content of 
Newton's law for heat flow? 


The solution to a model of exponential growth contains the 
exponential e” in which r, the growth-rate constant, is positive. For 
exponential decay, r is negative. It is tempting, but wrong, to 
impose this same type of conclusion on the solution of Newton's 
heat-flow problem. Recall that for the warming soft drink in 
Example 2.6, k — i In 3 < 0. To see why this difference exists, 
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let U; = 0 in Newton’s model. 

(a) Show U (t) = Upe* for any Up in Newton’s model. 

(b) If Uo = 10, show that cooling must occur and that k is negative. 

(c) If Uo = —10, show that warming must occur, but k is again 
negative. 


(d) What is the difference between the population model and the 
heat-transfer model that accounts for this anomaly? 


Chapter 3 


Methods for Solving 
First-Order ODEs 


INTRODUCTION Practitioners of every trade, art, or science must learn 
the fundamental techniques of their disciplines. The sculptor must know how to carve, the 
carpenter how to cut and join wood, and the lab technician how to acquire and interpret data. 
A study of differential equations likewise includes a component of methods and techniques. 

In this chapter we learn some of the analytic techniques for obtaining solutions of 
first-order differential equations. Some, like separation of variables, might be familiar from 
elementary calculus. Others, like variation of parameters for a linear equation, will more 
likely be new. However, we hope the reader does not lose sight of the forest because of the 
trees. These techniques for solving differential equations are not the end-all and be-all of 
the discipline. 

Techniques are just tools for determining how solutions of differential equations behave. 
Itis the behavior of the solution, reflecting the behavior of a modeled physical system, that 
is the forest. Methods of solution are just the trees. 

Computer software, and even calculators, can provide analytic solutions, as well as 
numeric ones. But, like using a calculator to learn arithmetic, technology should not replace 
understanding. While we heartily endorse use of technology as a labor-saving strategy, 
we also counsel that basic techniques not be ignored. These techniques can be learned in 
conjunction with technology, much like arithmetic, and even algebra, can be learned in 
conjunction with a calculator. 


Separation of Variables 


Variable-Separable Equations 


A differential equation that can be put into the form f(y)y'(x) = g(x) is said to be a 
separable ordinary differential equation. The equations for exponential growth and decay, 
the logistic model, the mixing tank with constant volume, and Newton's law of cooling are 
all separable differential equations. Any such equation can be solved by multiplication by the 
differential dx, yielding f (y)y' dx = g(x) dx. Since dy, the differential of y(x) is defined 
to be y' dx, the equation really reads f (y) dy = g(x) dx. Integrating both sides, we find 


[ (o E fewa +C (3.1) 


EXAMPLE 3.1 


EXAMPLE 3.2 
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where C is an arbitrary constant of integration. Solving the differential equation has been 
reduced to evaluating the integrals in (3.1) and perhaps applying some algebra that puts 
the solution into the explicit form y = y(x). Finally, if the separable differential equation 
arises in the context of an initial value problem, then, as verified in Exercise A1, the initial 
condition y(xo) = yo can be incorporated into the integrals via 


f fA) dt = I gt) dt (3.2) 
Yo Xo 


Exponential growth The equation for exponential growth is a prototypical separable 
equation. Its solution should be mastered by every student of differential equations. In 
detail, the calculus and algebra for solving this equation begin with writing the equation 
P'(t) = kP (t) in the separated form A = k. Multiplication by the differential dt yields 
PE = k dt, from which : — k dt follows by the definition of the differential. Integrating 
both sides, namely, f ue = f kdt + C, gives In|P| = kt + C. The solution of the differ- 
ential equation has been effected. Isolating P(t) is now effected by algebra. 

Exponentiate both sides to obtain e!!?! = e+ = ek eC, and hence |P| = efe = 
ae" , where eC, never zero, has been replaced with the different arbitrary constant, a. Since 
P, a population, is nonnegative, drop the absolute value. (Were P a negative quantity, the 


solution could still be written as P(t) = be", where now b < 0.) Applying the initial 


condition P(0) = Po finally yields P(t) = Poe. 4 
Logisticequation The logistic equation e = k P(t)(a— P (t)) is also variable separable, 
the separated form being Pow = k. Multiplication by the differential dt yields > of pj 


k dt, an integrable form leading to 


1 
(In|P| - In|a— P) = kt + C 
a 


Exponentiating is simplified if the equation is multiplied through by a and the two logarithms 
on the left are combined, producing 


In 


d kt + 
— akt +c 
a—P 


where c — aC. Exponentiating now yields Zl = ee, Replacing e^ with b yields 
IL = be“*' and dropping the absolute value on the left, justified by renaming b to A, a 
constant that might contain any minus sign arising from dropping the absolute value, leads 
to -2> = Ae"". Solving for P(t) = aAe"" /(1 + Ae"*) completes the solution, except 
perhaps for applying the initial condition P(0) = Po ¥ 0, in which case Py = oa SO 
A = -2y and P(t) = a Poe" /(a — Po + Poe’). Some texts, however, multiply top and 
bottom by e^^* to put the solution into the form 
à Py 


Po + (a — Py)e-**t 


P(t) = 


dx 
x(a—x) 


Evaluation of the integral f 
of the integrand. Thus, 


can be obtained by a partial fraction decomposition 


1 l a 


a a 


x(a — x) x a—x 


and the integration to logarithms is immediate. A much more complicated solution can 


36 Chapter 3 Methods for Solving First-Order ODEs 


be based on completion of the square in the denominator, and integration to an inverse 
hyperbolic tangent, a function convertible to logarithms. This virtuosity in computation is 
left to the exercises. $ 


EXAMPLE 3.3 Aroutine textbook exercise Do not believe that the essence of differential equations is 
simply mastery of solution techniques. The goal is insight into the behavior of solutions, 
and this can sometimes require more than just rote application of a mantra such as "separate 
variables and integrate both sides." 

Taken from a recent calculus text, the differential equation 2 = T can be solved 
mentally by separation of variables, leading to the implicit solution y + y? = pe +c. (See 
[56] or [57].) Graphs of y (x), obtained as the level curves of f(x, y) = y + y? — ix, and 
seen in Figure 3.1, appear to approach an oblique asymptote. Validation of this observation 
requires skills far beyond the routine steps of solving the differential equation itself. 

For example, to obtain y(x) explicitly, a cubic equation must be solved, leading to 
yx) = $ — &, where 


A= 1/36x3-4-108c + 12/12 + 9x6 + 54x?c + 81c? 


yj... 108 12 S4c — 8lc? 
=x) +1 49e $4". a2 
X x X 


x? 


FIGURE 3.1 Level curves of 
f =y? + y — lx) are solutions of 


2 3 
: 270 3 For large x, A — x </72, so y Lx- E, where L = B Thus, y' > L, a constant, and 
dais indeed the solutions of the differential equation tend toward the oblique asymptote y — Lx. 


Z 
“~~ 


EXERCISES 3.1—Part A 


A1. Show that the solution y(x) defined by (3.2) passes through the A4. Obtain the general solution of 3 y? = (x? Dy +4. 


point (xo, yo). AS. The law of mass action in Section 1.1 leads to separable differential 
A2. Verify the partial fraction decomposition Ts ue + — used equations of the form x’ = k(a — x)(b — x). Obtain the solution. 


to perform the integration in Example 3.2. 


A3. Find a method for solving a cubic equation and use it to obtain 
y(x) = 4 — 2 in Example 3.3. 


EXERCISES 3.1—Part B 


B1. Evaluate the integral f i 5 by completing the square in the (d) Plot the solution of the initial value problem. 
denominator and integrating to an inverse hyperbolic tangent. 
Convert this function to its logarithmic equivalent, and show the 


result agrees with integrating by partial fractions. 


(e) Solve the initial value problem by including the initial data in 
the integrations used in the separation of variables. Thus, 
y! f(y) = g(x), y(xo) = yo, has the solution i fdt = 
For each of Exercises B2—7: P» g(t) dt. 


(a) Separate variables and obtain a general solution. B2.xy 25?5,y()21 B3. (3-x)y 2yy()21 


(b) Plot representative members of the family of solutions defined B4. (y +2) —3xyy, y(3 25 B5. àyy/— e", y2) 23 
by the general solution. B6. (e* +3)y' = y?, yO) 21 B7. yy 2e?', y(0) 21 
(c) Apply the data to the general solution, thereby obtaining the 
solution to the given initial value problem. 
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Equations with Homogeneous Coefficients 


Polynomials Homogeneous of Degree k 


If m and n are integers, the total degree of the product x" y" is k = m +n. Polynomials in 
x and y having all terms of the same total degree k are said to be homogeneous of degree 
k. For example, the polynomial p(x, y) = 3x*y? — 5xy? + 7x? y? has each of its terms of 
total degree 6 and is therefore said to be homogeneous of degree 6. As a consequence, we 
clearly have p(Ax, Ay) = A5 p(x, y). 


Functions Homogeneous of Degree k 


As a generalization of the polynomial case, we define an arbitrary function f(x, y) to be 
homogeneous of degree k if it satisfies the equation 


f (Ax, Ay) = A f (x, y) 


is homogeneous of degree 1 because 


3 
H y 
For example, the function f (x, y) = Sy AF 


(ay)? y? 
àx, ày) = = A+ -—Af(x, 
FORAY) = ga 30303) 409€ ^ 33 Say eae eH 
whereas the function g(x, y) — c is homogeneous of degree zero because 


3(Ax)-FA(Ay)  3x+4y 
5(Ax) — 7(Ay) ~ 5x — Ty 


(Ax, Ay) = =f gis, y) = g(x, y) (3.3) 


Differential Equations with Coefficients Homogeneous 
of Degree Zero 
A first-order differential equation of the form y'(x) = F(x, y) in which the function F (x, y) 


is homogeneous of degree zero will become variable-separable under the change of variables 
y(x) = xv(x). This is so because 
F(x, Ay) =A} F(x, y) = F(x,y) => F(x, xv) = x Fd, v) =h(v) 

where, on the right, x plays the role of A. In effect, the degree-zero homogeneous function 
depends on the single variable v = ~. For example, if the function g(x, y) in (3.3) were 
to have its numerator and denominator both divided by x, then every appearance of the 
variable y would be in the form * as shown by 

3x +4y 3442. 3-4v 

Sx—Ty 5-72 5-7 


The change of variables y(x) = xv(x) converts the form y'(x) = F(x, y) to xv'(x) + 
v(x) = F(1, v(x)), which has the separated form POT = L, For example, the differential 
equation y'(x) = g(x, y), under the change of variables y(x) = xv(x), becomes v(x) + 
xv'(x) — 2 a separable differential equation in x and v. Separation of variables is 
effected by moving v(x) from the left to the right side of the equation, adding fractions on 


the right, and making the appropriate divisions. Thus, 

3+ 4v(x) >, 989 —39433 (5 — 7v) dv dx 
— —v(x) w= = 

5 — Tv(x) 5 — 7v Tv2 —v +3 x 


xv'(x) = 
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Integration of both sides is now possible, yielding 


J/83 


or 


9 


— arctan 


/83 


9 14v — 1 1 5 
—— arctan (=>) ni^ In(7v^ — v -3) 2 Inx +c 


V83 


144 —1 1 y»? y 
( J/8 ) ;"("Q) > SLE Fc 


(3.4) 


upon replacing v(x) with ~. 


Differential Equations with Coefficients Homogeneous 


of Degree k £ 0 


A first-order differential equation of the form f (x, y)y'(x) + g(x, y) = 0 in which both 
f (x, y) and g(x, y) are homogeneous of the same degree is also variable-separable under 
the same change of variables y(x) = xv(x). This is so because in the then-equivalent differ- 


ential equation y'(x) = F(x, y) 2 — 


f(x,y) 


za y. the function F(x, y) would be homogeneous 


of degree zero. Hence, this differential equation is equivalent to the first case discussed 


previously. 


Any elation evinced by the certainty that a differential equation with homogeneous 
coefficients becomes variable-separable under the change of variables y(x) = xv(x) is 
tempered by the realization that the resulting integrals may be difficult, or even impossible, 
to evaluate in closed form. Even when successful, the integrations often leave in their wake 
an implicitly defined solution such as the one in (3.4). 


EXERCISES 3.2—Part A 


A1. Show that for any f(z), the function F(x, y) = x*f(2) is 
homogeneous of degree k. 

A2. Show that if F(x, y) is homogeneous of degree k in x and y, then 
F can be written as F — x* f( 7). (Some texts take this as the 
definition of homogeneity.) 

A3. Using Exercise A2, show that if F(x, y) is homogeneous of degree 
k in x and y, then x 2E +y Us = kF, a result known as Euler's 
theorem for homogeneous functions. 


EXERCISES 3.2-Part B 


A4. Give an example of a polynomial p(x, y) that is homogeneous of 
degree 2. Then, use it to illustrate Euler's theorem as stated in 
Exercise A3. 

; ; E ; ; 

AS. Use the function f(x, y) — Drm CR to illustrate Euler's 

theorem as stated in Exercise A3. 


B1. If F(x, y) is homogeneous in x and y, show that the differential 
equation y" f (x) + F(x, y)(y — xy’) = 0 is separable under the 
change of variables y(x) = xv(x). 


In Exercises B2-5: 
(a) Obtain a general solution via Maple's dsolve command (or the 
equivalent). 


(b) Plot representative members of the family of curves contained 
in the general solution. 


(c) Apply the initial condition to the general solution to obtain the 
solution of the given IVP; and graph this solution. 


(d) Make the change of variables y(x) — xv(x) to reduce the 
differential equation to a separable form, and solve. Show that 
the resulting general solution is equivalent to the one found in 
part (a). 

B2. (5x -2y)y' 23y - x, yd) 21 

B3. (Sy? — x))y' = xy, y(1) 21 

B4. (2:2 + 3y”)y’ = 5xy, y(2) =1 

B5. (5x? + 3y)xy' + (x? + ?)y 0, y(1) 21 


dy ax+by+c 


Equations of the form = = — can be reduced to homogeneous 
dx px+qy+r e j 


equations provided the equations ax + by + c = 0. px + qy 


r=í 


3.3 Exact Equations 


have a unique solution (x, y) = (h,k). The change of variables x = B6. v' 3x +2y —5 B7. v 8x -3y 41 

MM , «Ide oe it atinn dw _ attbw y = >— — ey = —_— 
t T h, J} =w + k then yields the new differential equation F3 = eim 7x — 6y +4 "m 
which is homogeneous. (In particular, the second transformation equation x+2y 


defines w = w(y(x)), while the first defines x = x(t) so that together we B8. y' 
have w — w(y(x(t))), from which it follows that en ES 2, The algebra 


on the right-hand side of the differential equation is obvious.) Use this 


3x — 4y +9 
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technique to solve the equations in Exercises B6- 8. 


FIGURE 3.2 Surface corresponding to 
the function f(x, y) = 2x? + 3y? 


FIGURE 3.3 Level curves for 
f(x, y) = 2x? + 3y? 


Exact Equations 


Level Curves 


If z = f(x, y) defines a surface, then its level curves (or contours) are curves y(x) that 
satisfy f(x, y(x)) = c, where c is a constant. In effect, the level curves are obtained by 
solving the equation f(x, y) = c for y = y(x). 

For example, the surface defined by the function f(x, y) = 2x? + 3y? is shown in 
Figure 3.2, where the level curves have been drawn right on the surface itself. The level 
curves themselves, which appear in Figure 3.3, can be obtained by solving the equation 
2x? + 3y? —cfor y(x) — ++ V —6x? + 3c, which are the two branches, upper and lower, 
for the ellipses shown in the contour plot. 


Differential Equation for Level Curves 


Suppose the function z = f(x, y) has level curves given by y = y(x) and that these level 
curves have been found by solving the equation f(x, y) = c for y(x). Then, if y = y(x) 
is substituted back into the equation, the identity f(x, y(x)) = c results. If this identity is 
differentiated with respect to x, we get 


fx + fyy’ =0 (3.5) 


as a differential equation satisfied by the level curves. Thus, starting with f(x, y), we have 
level curves y(x) that are solutions of the differential equation (3.5). 

For the function f(x, y) = 2x? 4-3y?, the differential equation defining its level curves 
is 4x + 6yy’ = 0 and its solution is given implicitly by f(x, y) = 2x? + 3y? — c. 


Exact Equations and First Integrals 


A differential equation of the form (3.5) that arises as the equation for the level curves of the 
function f(x, y) is called an exact differential equation, and the function f(x, y) is called 
a first integral for the differential equation. Thus, the level curves of the first integral are 
the solution curves for the corresponding exact equation. 

For example, the differential equation 4x + 6yy' = 0 is an exact equation, and the 
function f (x, y) = 2x? + 3y? is a first integral for it. 

In general, the partial derivatives f, and f, are functions of x and y. Hence, it is possible 
to represent the exact equation in either of the forms 


M(x,y)- N(x,y)y 20 or M(x, y)dx + N(x, y)dy 20 (3.6) 
where, clearly, 
fy =M(x,y) and f, 2 NG, y) (3.7) 


For the exact equation 4x + 6yy' = 0, we then have M (x, y) = 4x and N(x, y) = 6y. 
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EXAMPLE 3.4 


EXAMPLE 3.5 


Condition for Exactness 


Not every differential equation of the form (3.6) is exact. According to the definition, the 
equation is exact only if M(x, y) = fx and N(x, y) = f, for some function f(x, y). If 
M(x, y) and N(x, y) were picked at random, the resulting differential equation would not 
necessarily be exact since these two functions need not be the partial derivatives of the 
same function f (x, y). Hence, we seek a condition that determines whether or not a given 
differential equation is exact. 

If we start with the function f(x, y) and generate the exact equation M + N d = 0, 
then we know for sure that (3.7) is valid. If the second partial derivatives of f(x, y) are 
continuous, we are guaranteed that the mixed second-order partial derivatives (the “cross- 
partials”) are equal. Thus, we are guaranteed 


9? f a? 
z ^ = Fey = fy = f 
QyOx OxQy 


Consequently, we would also have My, = Nx, which is precisely the same relationship 
between the mixed second partial derivatives f,, and fy. 

It turns out that if M, N, M,, and N, are continuous in a simply connected region, 
then the condition M, = N, completely characterizes the exact equation and, therefore, 
guarantees the existence of a first integral f(x, y), whose level curves are the solution of 
the equation. 

Loosely speaking, a simply connected region is one with “no holes." A circle or rect- 
angle is simply connected, but an annulus is not. Every closed curve in a simply connected 
region can be continuously shrunk to a point. In an annulus, a circle surrounding the “hole” 
cannot be shrunk to a point. 

Of the following two differential equations, the first one is not exact but the second is. 


Given the functions 


y, xy y, xy 
M = yarctan — + ———, and N = x arctan — + ——— 
x x+y x x+y 


the differential equation M dx + N dy = 0 can be tested for exactness by computing the 
partial derivatives 
3x?y + xy? y xy—xy3 


y 
M, = arctan — + ——————— and N, = arctan — — ————— 
` x (x2+ y?)2 E xo (x2 + y?)2 


Since M, — Ny = any #0, it is clear that My # N, and the differential equation 


(x?+y?)2 
M dx + N dy = Q is not exact. * 


Given the functions 


x? —Ixy — 2y? 2x? + Ixy — y? 
M= mi dine. n and N— EL. adir 
(x — y»? (x — y) * 


the differential equation M dx + N dy = 0 can be tested for exactness by computing the 
partial derivatives 


6xy 6xy 


M,———— al Ke 
(x — y)3 (x — y»? 


That M, = N, is obvious. Hence, the differential equation M dx + N dy = 0 is an exact 
differential equation. $ 


EXAMPLE 3.6 
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Constructing the First Integral 


Once it’s clear that the equation M dx + N dy = O is exact, the obvious question is “how 
can the first integral f(x, y) be found?" Exactness means (3.7) holds for some function 
f (x, y). Thus, integrate the first equation with respect to x, holding y constant, to find an 
expression for f (x, y). When adding the constant of integration, make it a function of y, 
since y was held constant in the integration. Thus, 


fay) = J M(x, y) dx + g(y) 


If this really is f(x, y), then differentiation with respect to y should reproduce N(x, y). 
This yields a condition on g'(y), from which g(y) is then determined. The process is 
demonstrated in the following example. 


For the exact differential equation in Example 3.5, integrate M (x, y) to obtain 
y) 


x? —2xy — 2y? 3y* 
fe.» [eo EL i of 1 


(x — y» um 


Since f, — N, we obtain 


6xy —3 y? 


(x — y 


2x? + 2xy — y? 


(x — y» 


+g O) = 


from which g'(y) = 2 and g (y) = 2y follow. Consequently, we have f(x, y) = x + zx + 


— x?txy+y? 
2yz -——- 


EXERCISES 3.3- Part A 


9$. 
Sd 


Al. Verify that f (x, y), the first integral constructed in Example 3.6, A4. Sketch the surface z = x? + y?; sketch its level curves, and write 
satisfies f, = M and f, = N. them explicitly as y — y(x). What exact differential equation do 
A2. Rephrase the procedure for finding a first integral of an exact these level curves satisfy? 
equation, showing how to start with an integral of N (x, y). Apply AS. Put y' = ? into the form M dx + N dy = 0 and test for exactness, 
your algorithm to the exact equation solved in Example 3.6. If it is exact, obtain a first integral. If it is not exact, solve it by 
A3. Show that 2x y? + 3x? y? y = 0 is exact, and find a first integral some other means, write the solution in the form f (x, y) = c, and 
£ . dt 2X} 2X y^ = » & - 
From the first integral, explicitly obtain the solution curves compare f, dx + fydy = 0 to M dx + N dy — 0. 
y — y): 
EXERCISES 3.3- Part B 
" : ^ ; TN 4 
B1. Put the differential equation y’ = ET into the form M dx+ Be sies 16x —35* —3 B7. y'= 4xy? — 9y* +5 
N dy = 0. What condition must p and q satisfy for the equation ` 12x y? ` 6xy?(6y — x) 
to be exact? ; Ax?y ; y(8xy? + 5y? — 3x? — 2053 y?) 
à "T i 3 à B8. y = —— —À 9. y = "3-2 f 2 WEN: 
In each of Exercises B2-13 show that the given differential equation is 9y* +x x(15x35y? — 12xy? — 15y? + x?) 
exact, and obtain the general solution in the form f(x, y) — c, where , 00x + 9x2? — 2y , y(5+ 12x + 12xy) 
f (x, y) is a first integral. Plot several level curves for this first integral. B10. y = 3 — 9x3 y2 + 2x Bll. y = 5x + 6x? + 12yx? + 8y 
2 3 — 18xy? — 9x? 2(6xy + 4 + 9xy° 10 — 3y?—14x + 27x? 
B2. y = -POTH B3. y = 2 ey = B12. y = : xa = = ) B13. y = 2 ETA 
i 27y? — 9x — 8x? ` 15xy? — 18x?y — 5 Sx" (23: 9y^) 6xy 
B4. y' = 7y? + 30x? — 15yx? BS. y = y—4x+ 8xy? 


12y — 14xy + 5x? —ox(0 + 12xy?) 
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EXAMPLE 3.7 
EXAMPLE 3.8 
U 
A 
1.5 
1 
0.5 
t t >t 
0 5 10 15 


FIGURE 3.4 Numeric solutions of 
Newton’s law of cooling with variable 
ambient temperature 


20 
15 
10 
5 
— | >t 
0 10 20 


FIGURE 3.5 Numeric solutions for a 
constant-volume mixing tank into which 
salt flows at a variable rate 


Integrating Factors and the First-Order Linear Equation 


Newton’s law for heat transfer between a body and its surroundings has the rate of change 
of temperature of the body proportional to the difference of temperature between the body 
and its surroundings. From Section 2.4, this law is expressed by the differential equation 
L = k(U (t) — U,). As we have seen, if U, is constant, the equation is variable-separable. 

Suppose, however, that the surrounding temperature varies periodically about a constant 


value. Then, we would have a differential equation such as 


U' = —5[U (t) — (1 + cos r)] (3.8) 


where we have taken k = —1 and U,(t) = 1 — ib cos t. This equation is neither separable 


nor exact. However, some insight into the behavior of this system can be obtained from the 
computer-generated numerical solutions in Figure 3.4. After an initial transitory phase, the 
solutions seem to settle into periodically varying temperatures. To determine the nature of 
these “steady-state” temperatures, we need an explicit solution. ES 


If a constant-volume mixing tank contains 100 gal of brine, has a flow-through rate of 10 
gal/min, and is fed with incoming brine containing i Ib of salt per gallon, the techniques of 
Section 2.3 lead to the separable differential equation E —2— ix). 

Suppose, however, that the content of the inflow varied periodically so that it was 


i + i cos t. Then, the differential equation would be 


x'(t) = 2 + cost — ix) (3.9) 


which is neither separable nor exact. As of yet, we do not have a solution technique for 
such an equation, but numeric solutions for different initial amounts of salt in the tank are 
shown in Figure 3.5. Instead of an exponential rise to the steady-state value of x. = 20. 
the amount of salt in the tank varies at what appears to be a periodic rate. The exact nature 
of this variation would require an exact solution to discover. 

Also in Section 2.3, we saw variable-volume mixing tanks governed by the differential 
equations 


dx 2 dx 2 
= 12 x(t) and = 12 x(t) (3.10) 
dt 200 + 2t dt 800 — t 
In the first, the volume of brine in the tank was increasing, while in the second, decreasing. 
Neither equation is separable, neither equation is exact. ES 


We need a technique for solving equations like those in Examples 3.7 and 3.8. 
The First-Order Linear Equation 


TERMINOLOGY Table 3.1 contains the equations from Examples 3.7 and 3.8, rewritten in 
the form 


y(x) + p(x) y(x) = r(x) (3.11) 


the standard form of the first-order linear equation. As in Section 1.2, if r(x) = 0, the 
linear equation is called homogeneous. If r(x) Æ 0, the linear equation is nonhomogeneous 
(inhomogeneous in some texts). The homogeneous equation is variable-separable. The 
nonhomogeneous equation requires new solution techniques. 
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THE Homoceneous Equation The first-order linear homogeneous equation is of the 


U'-iU- icicost form y'(x) + p(x)y(x) = 0. Consequently, its solution, by separation of variables, is 
i A y(x) = ce- J PO) dx, 

xi + bx =2 + cost ” 

Pon d cxf THE NONHOMOGENEOUS Equation The solution of the nonhomogeneous first-order lin- 
100 +t ear equation (3.11) is 

Sj 
xl m 19 T x " i 
x + 800 — "ii =2 y(x) = gi p(x) dx (/ e! PG) dX E(x) dx F3 J (3.12) 


TABLE 3.1 Equations of Examples 3.7 a result obtained by the following steps. 


and 3.8 rewritten in standard form of 


: K ` p(x) dx 
first-order linear equation ` 


Obtain the integrating factor e! 
Multiply (3.11) by the integrating factor, obtaining (y’ + py)e/ ?4* = ref P4», 


Write this as 4 (yel pdx) — rel pk a step justified in the derivation that follows 
Examples 3.9 and 3.10. 


4. Integrate both sides, obtaining ye! P% = f re! Pady +c. 


5. Solve for y, obtaining (3.12). 


This algorithm is motivated and derived right after the following two examples. 


EXAMPLE 3.9 The differential equation xy'(x) + 2y(x) = e* is a first-order linear equation whose stan- 
dard form would be 
9 e 


Ppor 
X X 


IN 


and r(x) = e*/x. Consequently, the integrating factor 


from which we recognize p(x) = $ 


1S 


5 


Ix dx 7) (2 
e! 2/xdx . PLE = e^ = x 


If the standard form of the equation is multiplied by the integrating factor, the left side is 
then the derivative of the product y (x)x?. Hence, 
x 


x 


d 5 zë 
—(y(x)x )-x 
dx 


— = xe 

x 
Integrating both sides yields y(x)x? = f xe* dx + c, from which we obtain y(x)x? = 
xe* — e* +c. Isolating y(x) gives the solution y(x) = (xe* — e* + c)/x?. E 


EXAMPLE 3.10 Slightly varying the equation in Example 3.9, we have y'(x) + 2xy(x) = sinx, which 
leads to integrals that cannot be evaluated in closed form. This should be expected as 
the norm rather than the exception. With p(x) = 2x and r(x) = sin x, the integrating 
factor is e/ 2*4* = e* and the solution is y(x) = e*t e* sinx dx + c), for which an 
antiderivative expressed in terms of elementary functions is not known. $ 


THE FIRST-ORDER LINEAR NONHOMOGENEOUS EQUATION Is Nor SEPARABLE The non- 
homogeneous equation, in general, is not separable. Putting (3.11) into the form 


dy 
: - = dx 
r(x) — p(x)y(x) 


does not achieve a separation of variables—there are x’s on the left, along with the y’s. 
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THE FIRST-ORDER LINEAR NONHOMOGENEOUS EQUATION Is NorExact Equation (3.11) 
is not exact, which we see by putting it into the form M(x, y) dx + N(x, y) dy = 0, and 
obtaining 

(p(x)y — r(x)) dx + dy =0 
With M = p(x)y —r(x) and N = 1, so that M, = p(x) and N, = 0, it is unlikely that the 
equation is exact, since rarely will p(x) = 0. 


Integrating Factors 


DEFINITION 3.1 


A function u(x) with the property that 
u(x)(M(x, y) dx + N(x, y) dy) =0 


is exact is called an integrating factor for the differential equation M(x, y)dx + 
N(x, y) dy = 0. We want, therefore, (u(x) M(x, y))y = (u(x) N(x, y)), to hold. 


INTEGRATING FACTOR FOR THE FIRST-ORDER LINEAR EquaTion The differential form 
of (3.11) has M = py —r and N = 1, so u(x), an integrating factor for the first-order 
linear equation, must satisfy u(x) p(x) = u'(x), a separable differential equation whose 
solution is u(x) = e/ ")4*, The integrating factor is the reciprocal of the solution of the 
homogeneous equation! 

We next observe that multiplication of (3.11) by the integrating factor u(x) = ef p(x) dx 
converts the left side to the exact derivative of the product y (x)e/ Pœ dx, that is, 


d ARTS ; P Lf : . 
= (vane! db] =y el p(x) dx 3 yael p(x)dx p(x) 


Therefore the differential equation becomes 


d (vee! dun. B al P(r) dx (x) 
dx 


An integration of both sides then yields 


y(xjef 2 dx = (J eledi) dx +4 c) 


Isolating y(x) by multiplying through by e^ J PO 4x yields 


y(x) = VEIEOLE (fe PO) Any) dx di e) = end uu fof PIX) dx y. (e) dx +4 ce | px) dx 


(3.13) 
EXERCISES 3.4—Part A 
A1. Obtain the general solution of (3.8). Does the exact solution tend A2. Obtain the general solution of (3.9). Does the exact solution tend 
toward a periodic function? If so, does this limiting periodic toward a periodic function? If so, does this limiting periodic 


function have the same period as U,? function have the same period as the perturbation in the inflow? 
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A3. Obtain the general solution of the leftmost equation in (3.10). 
A4. Obtain the general solution of the rightmost equation in (3.10). 


AS. Use the condition (uM), = (uN), to determine u(x), an 
integrating factor for the equation y dx — x dy = 0. Use this 


EXERCISES 3.4—Part B 


integrating factor to convert the differential equation to an exact 
equation, and obtain its general solution by the techniques of 
Section 3.3. 


B1. What condition would the integrating factor u(x, y) have to satisfy 
to render the equation (2x + 3y) dx + (5x + 7y) dy = 0 exact? 


In Exercises B2-13, put the given equation into the standard form (3.11) 
and solve as a first-order linear equation. Graph representative members 
of the family of curves contained in the general solutions so found. 
B2. x* -- 11x? + (y' + 10) x? + 2xy =0 
B3. x?y/ — (7 - 2y)x —3+ 10x7! 20 
B4. 2y — 8x° — 8x* + 7x? + 6x? E xy =0 
B5. (y + 12)x — 2y + 8x7! 4x? 20 
B6. 1y — 8x7? + 16352 — 2x? + xy’ + yx 20 
B7.2y - 552 — 8x? + 9x? + xy’ 20 
B8. 10x3 — 6x? + (y' Dx + ly =0 
B9. 10x? — 4x? + (y - Dx -3— fy 20 
B10. 24x cosx + y'cosx — ysinx 4-5cosx — 0 
B11. 24x? — 4y' + y'3? — 2xy — 6x* 20 
B12. y — 12x? — 4x? — 18x + 2y' -2y'x - 1020 
B13. 10x? + 5x - 2y' — y'x + ly —6=0 
B14. Brine containing c = 5 Ib of salt per gallon that flows into a 


700-gal tank at a fixed rate of rı = 3 gal/s is instantly mixed with 
the existing contents of the tank, and the fluid in the tank is 


B15. 


B16. 


B17. 


B18. 


drained at the rate of r; = 1 gal/s. The tank initially contained 
V = 100 gal in which 20 Ib of salt were dissolved. Formulate and 
solve an initial value problem for the amount of salt in the tank at 
any time f. Plot the solution, and determine the amount of salt in 
the tank at the moment it overflows. Check the answer using 
Maple’s dsolve command (or the equivalent). 
Repeat Exercise B14 if the parameters are c = 2, rı = 8, m = 5, 
— 200 and the 700-gal tank initially contained pure water. 
Repeat Exercise B14 if the parameters are c = 1, r} = 6, r = 2, 
and V — 100 for a 1000-gal tank in which 150 Ib of salt were 
initially dissolved. 
Brine containing c — 3 Ib of salt per gallon that flows at a fixed 
rate of r; = 3 gal/s into an initially full 500-gal tank in which 
75 lb of salt were initially dissolved is instantly mixed with the 
existing contents of the tank, and the fluid in the tank is drained at 
the rate of r; — 4 gal/s. Formulate and solve an initial value 
problem for the amount of salt in the tank at any time f. Plot the 
solution and determine the limiting concentration of the fluid in 
the tank at the moment it empties. Check the answer using 
Maple's dsolve command (or the equivalent). 


Repeat Exercise B17 if the parameters are c — 2, rı = 1, and 


r2 = 5 for a 900-gal tank that is initially filled with pure water. 


Variation of Parameters and the First-Order 
Linear Equation 


Solution of the First-Order Linear ODE 


In Section 3.4, the general solution of the first-order, linear, nonhomogeneous differential 
equation (3.11) was found to be (3.13). Denoting the general solution by yg, we next write 
(3.13) in the form y, = ys + Yp, where 


yh = ce f Pœ) dx (3.14) 


is the homogeneous solution, the solution of the homogeneous equation y’ + py = 0, and 


yp = ard p(x) dx } al PQ) dt (y) dx 


is the particular solution, one solution of the full nonhomogeneous equation (3.11). Thus, 
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we have 


Yg = g7 J pax (/ ef P0) dx (y) dx 4- e) 


= ge^ | Pœ ds 4 eS pG)dx J ef POA (x) dx = Yn + Yp 


(3.15) 


The resolution of the general solution into the two components yp and yp is a charac- 
teristic of linear equations, both algebraic and differential. In Chapter 5 the second-order 
linear differential equation will be shown to have a solution with the very same structure. 


The Homogeneous Solution 


The homogeneous solution, namely yp, is the solution of the homogeneous equation formed 
by setting r(x), the right-hand side of the differential equation, equal to zero. Thus, the 
homogeneous equation is y'(x) + p(x)y(x) = 0, a variable-separable equation whose 
solution is (3.14). The homogeneous solution always houses the arbitrary constants of 
integration. For a first-order equation, there is just one such constant. The homogeneous 
solution for an nth-order linear equation would have n arbitrary constants. 


The Particular Solution—Variation of Parameters 


The particular solution is any one solution of the nonhomogeneous equation. We will find 
a particular solution by the technique called variation of parameters, a technique we will 
use again in Chapter 5 when we find particular solutions of second-order linear equations. 

Look for a particular solution in which c, the arbitrary constant, is taken as a function, 
say, u(x). The parameter c is therefore taken as a variable—hence, the name, variation of 
parameters. 'Thus, seek a particular solution of the form 


Yp = u(x)yn(x) 
and determine u(x) by “brute force,” setting y(x) = yp in the nonhomogeneous differential 
equation. This substitution into the differential equation yields 
u^ yp + uy, + uyap(x) = r(x) 
which we write as 
u(y, + Pyn) cuya =F 
Since y, + pyn = 0 for the homogeneous solution yp, we are left with u^yy = r, from which 
we determine u(x) = f r (x)/ yn(x) dx. Consequently, we obtain yp = y; f r(x)/ yn(x) dx. 
Recalling (3.14) and noting that 1/y, = ef Pœ dx we recover (3.15), the general solution 
to the first-order linear equation. 


In Section 2.3 the differential equations 
x(t) 2 12— € -— and x'(t) = 12— NAT 
200 + 2t 800 — t 
were used to model the amount of salt in mixing tanks with increasing and decreasing 
volumes, respectively. The solutions to initial value problems containing these equations 
and the initial condition x(0) = 0 were x(t) = 200167 and 


100+ 
" = 3 5 3 4 B 439 3.2 
xm = 309,600,000,000 | 102,400,000" + 63,0004 80! + Dt (3.16) 


respectively. Each of these equations is a first-order linear, nonhomogeneous equation ame- 
nable to the analysis of Section 3.4 as well as to the techniques of this present section. 
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Writing the first equation in the form x'(f) + p(t)x(t) = r(t), we find p(t) = 


1 
1004-t 


and r(t) = 12, giving the integrating factor ef /(00*04' — 100 + f, Thus, 


x(t)(100 +t) = [100+ t)12 dt = 1200t + 6t +c 


leads to x(t) = 


12001+6t?+¢ 
100-+1 


. Application of the condition x(0) = 0 leads to c = 0 and the 


solution on the left in (3.16). 


Alternatively, the homogeneous solution is x, = ce- / 1/00 


0--)dt _ c s 
= iu while the 


particular solution, computed by the recipe 


t 12(100 + t 
mam f ) di : j = ) qi 


1200r--6r? 


again 1s Just 15517 


solution is the sum xh + Xp = pO + 


EXERCISES 3.5—Part A 


x  100+¢ c 


so the solution techniques produce the same results since the general 


c 1200r +6t? r3 
100+1 


Al. By separation of variables, the general solution of the 
homogeneous linear equation y’ + py = 0 is yy = ce 
Suppose an antiderivative of p(x) is P(x). Show that the general 
solution is unaffected by using the most general antiderivative, 
P(x) +a. 


f poo dx 


a EE T. F — f pQ) dA 
A2. Show that yp = ce~/?4* is equivalent to yp = Ae jag PO) AA 


where c and A are both arbitrary constants. Hint: Let P(x) be an 
antiderivative of p(x). 

A3. Show that y(x) = 0 is the only solution of the completely 
homogeneous IVP y' + py = 0, y(xo) = 0. Hint: Show that it 
is a solution, then invoke the uniqueness theorem from 
Section 1.4. 


EXERCISES 3.5—Part B 


A4. Suppose u(x) and v(x) are both solutions of the IVP 
y' + py =r, y(xo) = yo. Show that w = u — v satisfies the 
completely homogeneous IVP w’ + pw = 0, w(xo) = 0 and, 
hence, by Exercise A3, w = 0, sou = v. 


AS. Use variation of parameters to obtain a particular solution to 
xy’ +2y = x? sinx. 

A6. Let y, be the homogeneous solution of the first-order linear ODE 
(3.11), and let y be one specific solution contained in the family 
denoted by yn. If yp is a particular solution, show that Y = yy + y 
is also a particular solution. Hence, the particular solution of a 
linear ODE can contain an additive term that is properly a member 
of the family forming the homogeneous solution. 


B1. An object initially at 3°F is placed in an environment whose 
temperature is given by U, = 1 + e™. After one minute, the 
temperature of the object is 2?F. Use Newton's law of cooling to 
write a differential equation governing the cooling process. 
Obtain and graph its solution. 

B2. An object initially at 0°F is placed in an environment whose 
temperature is given by U, = 1 — ie. After one minute, the 
temperature of the object is 1^F. Use Newton's law of cooling to 
write a differential equation governing this thermal process. 
Obtain and graph its solution. 


B3. A mixing tank contains 100 gal of water in which 50 Ib of salt 


have been dissolved. Brine enters and leaves at a rate of 5 gal/min. 


The incoming brine contains 2 + te * Ib of salt per gallon. 
Formulate and solve an IVP governing the amount of salt in the 
tank at any time t. Graph the solution and determine the limiting 
amount of salt in the tank. Compare this solution to that of a 


system in which the incoming bring contains 2 Ib of salt per 
gallon. Explain these results. 


In Exercises B4—13, obtain the general solution by constructing the 
homogeneous and particular solutions and adding appropriately. Use 
the method of variation of parameters to construct the particular solu- 
tions. Compare the resulting general solution to that produced by the 
integrating-factor method. Check the results using a computer algebra 
system. Plot representative members of the family of curves defined by 
the general solution. 


B4. 7x3 — 6x? + xy -2y 20 

B5. x?y' — 2xy + 14 3x! + 11x ? 20 
B6. 2y — 3x^ +x? 2x? + xy' 20 

B7. xy — 16 — 2y — 2x7! + 15x 220 
B8. 9x2? + 7x? + xy! + ly =o 
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B9. 2y cos 2x — 16x sin 2x + y'sin2x — 3 sin 2x = 0 B19. xy’ + 3x — jy +11=0 
B10. 5x? cos x — 4x cos x + y’cosx — y sin x — 19cosx = 0 B20. 17x72? + 7302 + SO? E xy y =0 
B11. 9x? + 9x + y' -2y — 14 20 B21. 3./x = 7x7/? + xy — y 20 
B12. 2:3 — 4x? + xy -2y 20 B22. 3x? cos x + 6x cosx + y'cosx — ysinx — 4cosx = 0 
B13. 4x? — 55? + xy' +x + iy =0 B23. 6x? cosh x — x cosh x + y' cosh x + y sinh x = 0 
Using a technique that includes variation of parameters, obtain an analytic B24. y'  x?y' -2xy - x — x° + 6x? + 6x4 =0 
solution for Exercises B14—18. B25. 2y — y' -2xy - x +x? - xi c x^ «0 
B14. Exercise 5B, Section 2.3 B15. Exercise 6B, Section 2.3 B26. x^y' — 4y' — 2xy + 20 — 21x? + 28x — 7x? + 4x4 =0 
B16. Exercise 7B, Section 2.3 B17. Exercise 8B, Section 2.3 B27. 12x? — 2x? + 4x + 2y' -2xy' - y - 1020 
B18. Exercise 9B, Section 2.3 B28. 1y — 28x? + 2y' - xy - 1420 


In Exercises B19—28, use variation of parameters as part of the technique 
for finding the general solution of the given equation. 


The Bernoulli Equation 


EXAMPLE 3.12 Consider the following specific logistic model for population growth, namely, y(t) = 
3y(2 — y), a separable differential equation with solution y(t) = 2/(1 + 2ce 9'). Writing 
the equation in the form y' — 6y — —3y? suggests that while this is not a linear equation, if 
the exponent on the right-hand side could be changed to either 0 or 1, the equation would 
indeed become a linear equation since y? = 1 and y! = y. In this form, the separable 
equation is called a Bernoulli equation for which the change of variables y(t) = z(t)*, for 
some k to be determined, leads to a first-order linear equation in z(t). 


In fact, carrying out this change of variables leads to 
kz dog! — 6z“ = —3zk 

and, after division by kz*—!, to 
2. „2k-(k-1) Lo 3 ea 

k 3 k^ 
from which we see that k + 1 = 0 ork + 1 = 1. The choice k + 1 = 1 means k = 0, in 
which case we would have made the meaningless change of variables y(t) = z(t)? = 1. 
Hence, we choose k + 1 = 0 and k = —1. The resulting equation, z' + 6z = 3, is now 


linear in z(t), with z(t) = ce-9 + 1 and y(t) = =2/(1 + 2ce). Ld 


4 


a| u 


A. 
z(t) 


The Bernoulli Equation 
The general Bernoulli equation 
y(t) + p(t)y() =r OyO" 


under the change of variables y(t) = z(t)*, becomes a first-order linear equation in z(t) if 
k= B Indeed, this substitution yields 


and division by kz*-! gives 


"2 P T as-&k-0 _ P kon 


k k 
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Setting k(s — 1) + 1 = 0 to make the equation in z(t) linear requires, as claimed, k = —L. 


1—s 
After solving for z(t), we get y(t) = z(r) / ^», 


In the Bernoulli equation y'(t) + 5y(t) = y(t)’, the substitution y(t) = z(r) /"-9 = 
z(r) /0—9 = za)" leads to —1z ??z' 4-57? = z 37, Divide through by —1z?? 


to get z’ — 10z = —2, the solution of which is z(t) = ce!?' + i Since y(t) = z(t) 2, we 


finally obtain y(t) = 1/v ce!™ + i $ 


EXERCISES 3.6—Part A 


A1. Let z(t) satisfy the first-order linear equation z’ + p(1 — s)z = 
r(1— s), and set y(t) = z1/0-9. Show that y(t) satisfies the 
Bernoulli equation y'(t) + p(t)y(t) 2 r(t)y(t). 

In Exercises A2—6, put the given differential equation into the form of 

a Bernoulli equation y' + p(x)y = r(x)y'. Set y = z* and, without 

resorting to a formula, determine the value of k leading to an equation 

linear in z(t). 


EXERCISES 3.6-Part B 


A2. (y! + 9y?)x? — 2xy — 16x*y? =0 

A3. 64x? — xy'y? + 12x — 8y* =0 

A4. x?^y' + Ax?y + 10xy? 4-18? —0 

AS. x*y!  x?y — y? y? — 532 = 0 

A6. 36:22? — 439243 + xy’ — 2./xy? — y 20 


B1. Solve the logistic equation y' = y(1 — y) as a separable equation 
and as a Bernoulli equation. 

B2. Show that y' = y(1 — y) — h, the logistic equation with constant 
harvesting, can be solved as a separable equation but not as a 
Bernoulli equation. 


In Exercises B3-12, show that the given differential equation is a 
Bernoulli equation, transform it to a linear equation, and obtain the gen- 
eral solution by the method of either Section 3.4 or 3.5. Confirm the 
solution with a computer algebra system, and plot representative mem- 
bers of the one-parameter family of curves represented by the general 
solution. 


B3. 2x?y? + 5x?y? + xy! — 14xy? — iy =0 

B4. 10x?y?? + 4xy’ — 44xy? + y + Ay)? =0 

B5. 36x07? — 6x7/? + xy'y? + 3y? — 27x7/? =0 

B6. x32y?? + 3x7y’ - xy =0 

B7. 4x?y? cos x + 13xy? cos x + y' cosx + y sin x — 3y?cosx = 0 

B8. y^y'sinh x + +y* cosh x — sinh x = 0 

B9. y' -- x?y' + xy + iy! + ix2y* =0 
B10. 2xy' — y -2xy? 20 BIL. x?y’+ y! +2xy -2xy? 20 
B12. y' -3y — 6xy!^ =0 


Chapter Review 


1. Give an example of a variable-separable ODE. Obtain its solution. 


2. Give an example of an ODE with homogeneous coefficients. Obtain 
its solution. 


3. Give an example of an exact ODE. Obtain its solution. 
4. Give an example of an ODE that is not exact. Why is it not exact? 


5. What is an integrating factor? Describe it in words, then give an 
example. 
6. Give an example of an ODE that is not exact but for which an 


integrating factor can be found to make it exact. Show how the 
integrating factor leads to a solution of the equation. 


7. Give an example of a first-order linear ODE, nonhomogeneous and 
with constant coefficients. Obtain an integrating factor. Show that 
the integrating factor makes the equation exact. Use the equation's 
exactness to obtain a solution. 


8. What is the homogeneous solution for the example in Question 7? 
What is the particular solution? How do the homogeneous and 
particular solutions lead to the general solution? 


9. Give an example of a Bernoulli equation. Obtain its solution. 


10. Is every Bernoulli equation linear? Is every first-order linear 
equation a Bernoulli equation? 


Chapter 4 


Numeric Methods for Solving 
First-Order ODEs 


INTRODUCTION This chapter does two things. It presents a collection 
of numeric methods for solving first-order differential equations, and it discusses how to 
interpret these methods and the solutions they generate. 

Problems in modern engineering and science are sufficiently complex to yield only to 
numeric computation. Analytic techniques provide a basic understanding of how solutions 
to differential equations behave, but the ability to compute solutions to otherwise intractable 
equations is an essential skill. That is why we make numeric methods available early in our 
study of differential equations. 

Our discussion includes Euler’s method, methods based on Taylor series, Runge-Kutta, 
multistep, and predictor-corrector methods. Each of these is an interesting study showing 
how a central idea about computing a solution numerically is expressed in a reliable algo- 
rithm. However, we will rely on technology and preprogrammed packages to implement 
these algorithms. It is rare that the beginner will write code as effective as that provided in 
a professionally written package, and we encourage readers to use the most convenient and 
effective technology they can find. 

However, reliance on such hardware and software should not be an excuse for failing to 
learn the essential ideas associated with these numeric methods. The concept of a method’s 
order and the difference between per-step and global truncation errors are brought out in 
the discussion of Euler’s method and the fourth-order Runge—Kutta techniques. The ideas 
of stability, error monitoring, and adaptivity are brought out in the other sections of the 
chapter. 


Fixed-Step Methods—Order and Error 
Fixed-Step Methods 


The initial value problem a = f(t, y(t)), y(to) = yo is solved numerically by fixed-step 
methods that compute values yz, approximations to y(ft;), at uniformly spaced grid points 
tk = to + kh. The stepsize h remains fixed during the computation. Euler’s method is 
studied because it is simple; however, it is not adequate for many problems in science 


and engineering. (Accuracy can sometimes be achieved only at the expense of very small 


+—> t 
0 1 
FIGURE 4.1 Exact solution (solid) and 
Euler solution (dotted), h = 0.1, for the 
IVP y =ft+y, 

y(0) 20 
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stepsizes, leading to an excessive amount of computation.) Members of the family of Runge- 
Kutta methods supercede Euler’s method. In particular, the fourth-order Runge—Kutta (rk4) 
method is one of the more widely used fixed-step methods. 


FORMULAE: EuLER’s MerHop The recipe for computing a numeric solution by Euler’s 
method can be expressed through the following equations where the initial point (fo, yo) is 
the "starting" point: 


fy = to + kh Vert = Yk + Af (tk, Yk) k—0; 1,52 


FORMULAE: FOURTH-ORDER RuNcE-KurTA METHOD The computation of a numerical 
solution by the rk4 method is a bit more involved, requiring, as it does, four function evalu- 
ations for each step. The benefit of this increased computational effort is greater accuracy. 


: h I 
Fi = hf (tk, ye) F, = hf (wee 5n) 


h 1 
F; =hf (i+ 5.0454) F4 = hf (thas, ye + F3) 


Yid = Ye + 2(Fi +2F)+2F34+ Fa) k=0,1,... 


Both Euler’s method and the rk4 algorithm will be demonstrated later in this section. 


Packaged Solvers 


A generation ago, obtaining a numeric solution of a differential equation required pro- 
gramming in a language like FORTRAN, execution in batch mode via punch-cards, and no 
graphics. Technology has progressed so rapidly that numeric solvers are readily available 
in software packages for computers and even on hand-held calculators. These professional 
numeric solvers are efficiently programmed and implemented, often specifically tailored to 
the hardware on which they run. We call such systems packaged solvers and presume that 
the typical reader uses such tools instead of writing computer code from “scratch.” 


Mope IVP To illustrate the behavior of a typical packaged solver for numeric solutions 
to first-order differential equations, we take 
y=f(,y)=tt+y  y00-0 (4.1) 


with exact solution y(t) = e' —t — 1, asa model IVP for testing the Euler and rk4 algorithms. 
The graph of this solution appears as the solid curve in Figure 4.1. 


Euter’s MetHop In Figure 4.1 the solid and dotted curves are, respectively, the exact 
and Euler (h = 0.1) solutions for the test IVP. The computations from which the dotted 
curve was drawn are 


yı = yo thf (fo, yo) =0+0.100+ 0) — 0 

yo yi t Af (tj, y1) = 0 + 0.1(0.1 + 0) = 0.01 

ya = y2 thf (to, y2) = 0.01 + 0.1(0.2 + 0.01) = 0.031 
These, and other values calculated by the Euler algorithm (h = 0.1), are listed in the second 
column of Table 4.1, in which the fourth column contains y(f;), the exact values obtained 


from y(t), the exact solution. The growing inaccuracy of the Euler values can be seen by 
comparing the second and fourth columns. 
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tk yy (Euler) yx (rk4) y(t.) (Exact) 
0.0 0 0 0 

0.1 0 0.005170833 0.005170918 
0.2 0.01 0.021402571 0.021402758 
0.3 0.031 0.049858497 0.049858808 
0.4 0.0641 0.091824240 0.091824698 
0.5 0.11051 0.148720639 0.148721271 
0.6 0.171561 0.222117962 0.222118800 
0.7 0.2487171 0.313751627 0.313752707 
0.8 0.34358881 0.425539563 0.425540928 
0.9 0.457947691 0.559601414 0.559603111 
1.0 0.5937424601 0.718279744 0.718281828 


—————————————— 
TABLE 4.1 Euler, rk4, and exact values for the IVP y =t+y, 
y(0) = 0 


FOURTH-ORDER RuNcEe-KurTA Computing function values with the rk4 algorithm is 
considerably more tedious. For example, when k = 0 and A = 0.1, rk4 determines yi by 
the following arithmetic 


1 
Fi — hf (to, yg) = 1909 +0) =0 
PEE ee ee ce $1 
dd VE IS NEUE. = 200 
1 


t EY iri, 21 
md s 3*3 7 15 20 ` 400) ~ 4000 


"-——— l (s | 21 )- 421 

diis " A JO (10 ` 4000 40000 
(o 2 2x2 =k 1241 
6 i ~ 240000 


1 
1 = yo + Z(Fi +2F +2F; + F4) = 
a i "200 * 4000 ^ 40000 
The third column of Table 4.1 contains this and other y; values computed by the fourth-order 
Runge-Kutta algorithm, again with h = 0.1. Even a cursory glance at this table reveals the 
greater accuracy of this method. In fact, these values are accurate enough that graphs of the 
approximate and exact solutions are indistinguishable. 


Order of a Method 


DEFINITION 4.1 


If a numerical procedure uses the fixed stepsize h to compute Vapprox as an approxi- 
mation tO yea, the exact value, in such a way as to obey a relationship of the form 
Yexact = Yapprox + C h*, we say the procedure is of order k. 


In essence, this definition says the truncation error C h* is proportional to the kth power 
of the stepsize. Truncation error is inherent in the structure of the algorithm and would be 
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present even if its calculations were done in exact arithmetic. Truncation error is therefore 
independent of roundoff error, the error that occurs because calculations are done on a 
computing device carrying only a finite number of digits. (See Section 37.1 for a more 
extensive discussion of roundoff error.) 

Methods for solving differential equations numerically have two types of truncation 
error: the per-step error and the global error (which is an accumulation of error after n 
steps). Respectively, the global errors for the Euler and rk4 methods are proportional to A 
and h*, so 

Yexact = Euler + Mh and Yexact = Vrk4 + Nh* 


We illustrate the validity of these statements in the next two examples. 


ORDER: EuterR METHOD’ We will use the model IVP (4.1) for a test of the order of the 
Euler method. Using appropriate computer software, we evaluate the exact solution at t = 1 
and find Yexact(1) = 0.71828 182845904523560, correct to 20 decimal places. 

We then compute yg (1) numerically, with h = 0.1/2*, k —0,1,..., and check the 
constancy of M = (yexaa (1) — YEuler(1))/A, displaying the results in the second row of 
Table 4.2. The values of M are reasonably constant, indicating that the Euler method has 
a global truncation error proportional to the stepsize h, making the method a first-order 
method. 


h 0.1 0.1 0.1 0.1 0.1 0.1 0.1 
1 2 8 16 32 64 


M 1.245 1.300 1.329 1.344 1.351 1.355 1.357 
N 0.0208 0.0217 0.0222 0.0224 0.0225 0.0226 0.0226 


TABLE 4.2 Constancy of M (Euler's method) and N (rk4) 


ORDER: FOURTH-ORDER RUNGE—KuTTA METHOD To show the rk4 method is fourth 
order, we have to show the constancy of N = (Yexact(1) — ya4(1))/ A^. Thus, we compute, 
with decreasing stepsizes, values for y,x4(1) and record results in the third row of Table 
4.2. The values for N are reasonably constant, thereby supporting the claim that rk4 is a 
fourth-order method. 


Error Estimation 


If the truncation error of a numerical method is known to obey a rule of the form Yexact = 
Yapprox F Ch* and two values of Yapprox are computed for stepsizes h and 2, Yapprox (h) 
and Yapprox (5) are, respectively, a less and a more accurate approximation of yea. the 
“correct” value. From these two approximations alone, an estimate of the accuracy of the 
better approximation can be deduced. This simple observation is at the heart of adaptive 
procedures for both numeric integration and numeric solving of differential equations. In 
an adaptive procedure, the stepsize is halved and a test is made of the accuracy of the 
more accurate approximation. If it is within prescribed error bounds, the value is accepted. 
Otherwise, it is rejected and recomputed with a still smaller stepsize. 
The adaptive relationship 


(4.2) 


" h 
h ) Yapprox ( 


) = Yapprox (2) 
Yexact — approx 5 k 


c—1 


nsis 
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h 
Yexact — approx 3 


says that the error in the better approximation is the difference between the better and worse 
approximations divided by a factor dependent on the known order of the numeric method. 
The expression follows from the order statements 


; h h\* 
Yexact = Yapprox Ut) + Ch* and Yexact = Yapprox (5) +C (5) (4.3) 


by eliminating Ch* to get 


1 ; h 
Yexact = (z=) (2! approx (5) — Yapprox 2 (4.4) 


and then subtracting Yapprox ($) from both sides. 

The result in (4.4) is the formula for Richardson extrapolation, which computes a 
weighted average of the better and worse approximations and, if the equations in (4.3) are 
exact, returns Vexact. Logically, the weighting favors the more exact value. This extrapolation 
scheme is used when differentiating numerically, is found in the Romberg method of numeric 
integration, and is also used in some numeric differential equation solvers. See Sections 
42.2 and 43.2 for details. 


MONITORING ERROR: EULER METHOD We apply (4.2), the fundamental result on error 
monitoring, to the Euler method, using the values of yguter(1) computed earlier with h = 
61/9. | 80,1,.... Since each was computed with half the stepsize of its predecessor. 
we can test (4.2) with k — 1 by evaluating both sides and listing the results in Table 4.3. 
Note that the denominator on the right is 1. The increasing match of the two columns in the 
table supports the validity of the adaptive error estimate (4.2). 


J'approx (4) — Yapprox (h) 
2k —1 


;) approx (4) = Yapprox (A) 
2 


Jexact — approx (5 2k —]1 


0.06498412331462510143 
0.03321799006907250388 
0.01679688770570813701 
0.00844625215126835539 
0.00423518475136823752 
0.00212062051103751173 


TABLE 4.3 Adaptive error estimate for Euler's method 


0.129901411 x 1076 
0.847576814 x 1075 
0.541258890 x 107? 
0.341947077 x 10-1? 
0.214870130 x 107"! 
0.134655680 x 10? 


0.13580271 x 1075 
0.86661892 x 1075 
0.54730581 x 107? 
0.34385198 x 107! 
0.21546779 x 107" 
0.13484276 x 107? 


0.05955524504442013397 
0.03176613324555259755 
0.01642110236336436687 
0.00835063555443978162 
0.00421106739990011787 
0.00211456424033072579 


TABLE 4.4 Adaptive error estimate for rk4 


MONITORING Error: FOURTH-ORDER RuucE-KurTA METHOD We apply (4.2), the fun- 
damental result on error monitoring, to the fourth-order Runge-Kutta method, using the 
values of y,x4(1) computed earlier with h = 0.1/2/, j = 0, 1,.... Since each was com- 
puted with half the stepsize of its predecessor, we can test (4.2) with k — 4 by evaluating 
both sides and listing the results in Table 4.4. Note that the denominator on the right is 15. 
The increasing match of the two columns in the table supports the validity of (4.2). 

The error-monitoring formula (4.2) is essential when the exact solution is not known. It 
provides a means for determining the accuracy of a numeric result without comparing it to 
the unknown exact answer. Within an integration routine, it allows for an automatic return 
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of an answer correct to within a prescribed tolerance. In an algorithm for solving differenti al 
equations numerically, it can be used to increase stepsize and, hence, the overall speed of 
the computation, by taking larger steps where possible and then automatically reducing the 
stepsize where needed. 


EXERCISES 4.1- Part A 


Al. Use Euler’s algorithm with A = 0.1 to obtain y; and y» forthe IVP. A4. Use (4.2) to obtain (4.4). 


y 2P-y.y0)-l. AS. Using h = $, apply Euler's method to y' = —20y, y(0) 2 1, 
A2. Use the rk4 algorithm with A — 0.1 to obtain y; for the IVP of computing yk, k =1,..., 5, in exact arithmetic. The exact 

Exercise Al. solution to this IVP is y(t) = e^?*'. Can you find a stepsize h for 
A3. Use (4.3) to obtain (4.2). which Euler's method gives reasonable values for this problem? 


EXERCISES 4.1-Part B 


B1. The IVP y’ = f(t, y), y(0) = 0, is to be solved, with y(1) being (h) With k — 4, test the error estimation formula (4.2). 
the goal of the calculation. (i) With k — 4, test the validity of (4.4), Richardson's 
(a) If rk4 is used with h = 0.1, how many function evaluations extrapolation formula. 
will take place? B2. 3685 y 3p 10ty nS (91* E 512 - 5)y’ =0, y(—7) = 4; y(—6) 
(b) What accuracy can be expected for the answer computed as B3. 3213 — (28y? + 6y)y' 20, y(6) = —7; y (D) 


er part (a)? 2 58 " 5 
ae B4. 1212 y3 — 443 + (120? + 27y*)y’ = 0, y(—4) = —4; y(-3) 


B5. 9y — 241? y3 + (18t — 24r*y*)y’ = 0, (8) = —6; y) 
B6. t+ (1+ y)y' =0, (0 = 2, y2) 


(c) How many function evaluations would it take Euler's method 
to compute y(1) with the same accuracy? 


(d) What accuracy can be expected for y(1) if itis computed with 


Euler's method using the same number of function B7. 84-18? — 27y?y' 20, y(8 = 2; y(9) 
evaluations as in part (a)? B8. 3ty — (1y? + 6t7)y’ = 0, y(1) = 1; yQ) 
In each of Exercises B2-18: B9. 4t + (10y — 9)y’ = 0, y(1) = 2; v (1.5) 

(a) Use a computer algebra system or one of the methods of B10. 9 + (2t — 5y)y' = 0, yQ) = 1; y@) 
Chapter 3 to obtain the indicated function value. If using a B11. 5t — 7? + (y + Dy’ = 0, y( = 2; y(2) 
computer algebra system, it might be necessary to obtain a B12. 7? — 62 + ty’ +2y = 0, y(1) = 2; y(2) See Exercise B4, 
general solution to which the initial condition is then applied. Section 3.5. l 

(b) Use Euler's method with h = 0.1 to approximate the indicated B13, /2y/ — 2ry + 14 — 3t! 1172 20, y(1) = 1; y@) See 
function value. Exercise B5, Section 3.5. 

(c) Test the order of the global truncation error by computing, at B14. 2y — 3^ + P 28 + ty’ 20, y(-2) = 4; y (7D See Exercise 
the indicated point, the (supposedly constant) ratio B6, Section 3.5. 


(Yexact — Yapprox)/h*, k = 1, forh = (5)',s =1,2,.... (For 
some IVPs, the global truncation error in the Euler method can 
be O(h*), k > 1) 

(d) With k = 1, test the error estimation formula (4.2). 

(e) With k = 1, test the validity of (4.4), Richardson’s 
extrapolation formula. 


B15. ty’ — 16 — 2y — 2:t-! + 15t-? = 0, y(1) = 3; y(2) See Exercise 
B7, Section 3.5. 

B16. 9/2 + 79? + ty’ + 1y =0, y(1) = 1; y(2) See Exercise B8, 
Section 3.5. 

B17. 64? — ty? + 12t — 8y* 20, y(D = 1; yQ) 


B18. £y + A2 y + 10ry? + 18y? 20, y(2) = 1; yG 
(f) Use rk4 to obtain the indicated function value. Py BP uie y@) y@) 
(g) Test the order of the global truncation error by computing, at 

the indicated point, the (supposedly constant) ratio 

(Yexact = Vinnie P, k= 4, forh = GY ,$8 = 1. S ase 
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0 


FIGURE 4.2  Euler's method gives the 
tangent-line approximation 


EXAMPLE 4.1 


EXAMPLE 4.2 


| The Euler Method 


Rationale 


The basis for the calculations in Euler's method is the tangent line approximation of a 
function g(t). Given a function g(t), a linear approximation, that is, an approximation 
along the tangent line constructed at (fo, g(fo)), is given by y(t) = g(to) + g'(to)(t — 
to). Letting h = t — to so t =f +h, we can write this expansion as y(to +h) = g(to) + 
g'(to)h. Generalizing from f, to t, and writing y+ for g(to + kh), we have 


fj =totkh yer = ye + hg (te) 


Given the initial value problem y’ = f (t, y(t)), y(fo) = yo, this tangent line approxi- 
mation becomes the Euler algorithm 


th=tot+kh — yg = ye hf(t y) k=0,1,... 


Figure 4.2 illustrates this tangent line approximation for the curve defined by the function 
y(t). The height y(fo + h) is approximated by the height yo + /y'(t9), which is on the tan- 
gent line (constructed at (to, yo)) above t = fo +h. 


To apply the Euler algorithm to the initial value problem y’ = t + y; y(0) = 0, determine 
the t-values at which the solution y(t) is to be approximated numerically. Taking h = nr we 
get t, =0+k(4) = 4. The very first y-value is given as initial data, namely, yo = 0. The 
remaining y-values must be computed by the Euler algorithm. Thus, with f(t, y) =t + y. 


we get 
yı = yo thf (to, yo) =0 + 35 (0-0) =0 
yi — yi Rf (ti, y) =0+ i5 (45 0) = qi 
ys = ya thf (fa. y2) = qi 36 (16 + 19) = 109 
ya = ys thf (ts, y3) = + i (is T rix) = 10000 


Clearly, continuing to work in exact arithmetic will become increasingly more difficult, 
and continuing to work “by hand" will soon become impossible. A computer implementation 
of these calculations is found, therefore, in the accompanying Maple worksheet. E 


EN 


Let us apply Euler's method to the IVP y' = —10y, y(0) = 1, taking h = 15. 


exact arithmetic, we get 
yi = yo - hf (fo, yo) 2 1+ $10 x 1) 20 
y2 = yı cthf(ti, y) =0 + i (C10 x 0) =0 


Working in 


ys = yo thf (b, y) = 0+ 75(-10 x 0) =0 


that is, we get y(t) = 0. Since the actual solution of this IVP is y(t) = e~', we can see 


there are difficulties with Euler's method. Both this IVP and the one in Exercise A5, Section 
4.] can be explained by the following analysis. e 


Consider the IVP y' = Ay, y(0) = 1, for which Euler’s method gives 


Yer = Yk + Ayr) = (1 + hà)yk 
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Since y; = (14- hA)yo = (123- AA) and y» = (1 2- h2)yi = (12- AA)(1 3-44) = (107 hAY?, 
we generalize and declare that y; = (1 + ha)*. Thus, when A = —10 and h = i» we 
will compute y; = 0 for every k. If A = —20 and h = i5, then y, = (1 — 2)* = (-1)*. 
The restriction this analysis places on the stepsize h is detailed in the exercises. Equations 
such as these for which the stepsize is controlled by a term that ceases to contribute to the 


solution are called stiff and require special numeric routines. An additional discussion of 


stiffness appears in Section 4.4. 


EXERCISES 4.2-Part A 


Al. 


A2. 


A3. 


Apply Euler's method to the initial value problem y' — Ay, 

y(0) = yo, showing that with positive stepsize / the general step 
amounts to computing yx; = yy(1 + àh), k 20,1,.... 

Show that the difference equation yy,; = y,(1 + AA), 

k=; lissas has solution y; = yo(1 + AA)*. This can be done by 
writing the y; for k = 0, 1, 2, and then generalizing. 

If A > 0, then the exponential solution in Exercise Al will grow in 
magnitude, and so will the solution y = yo(1 + AA)*, although the 
latter solution might grow more slowly. If A < 0, then the 


EXERCISES 4.2-Part B 


A4. 


AS. 


exponential solution tends to 0 but y, only tends to zero if 

|I + Ah| < 1. Show that the solution of this inequality is 

Q«h« de (Euler's method is said to be conditionally stable [42] 
because of this restriction on stepsize.) 


Use Exercises A1—3 to explain the outcome in Exercise A5, 
Section 4.1. 


Is the result in Example 4.2 inconsistent with Exercises A1—3? 
Explain. 


B1. 


B2. 


B3. 


B4. 


BS. 


B6. 


Using h = 0.15 and then h = 0.25, obtain the Euler solution of B7. In the differential equation y = f(t, y), the role of the constant 7. 
the IVP y' = —10y, y(0) = 1. Fort < 1.5, compare with the in Exercise A1 is played by a Using stepsizes h = 0.008 and 
exact solution y = e7 '™. Explain these results in light of h = 0.009, apply Euler’s method to the initial value problem 
Exercises A1-3. y! + 3t?y = t°, y(0) 22 on the interval 0 < t < 10. If 
For the IVP in Exercise B1, determine analytically or empirically | ^g AR ^* VU e on the oem tenes pe e E tele 
a stepsize h for which Euler's method gives, on [0, 1], an error no ei p played by ay? UNDE : M Pi an — NOMEN 
i Euler’s method remains stable for this problem. 
worse than 0.01. 
B8. In light of Exercise B7, estimate the largest stepsize that can be 
Use Euler's method to solve the initial value problem y' + 15y = : T à : sips qoi ile Lo 
2 i ; « used in Euler's method when solving the initial value problem 
30t^ + 49t + 18, y(0) = 2. First, use a stepsize of h = 0.1 and JL ot}? ' FÉ i 
A : i à y c e"*^y = 1, y(00 = Lon the interval O < t < 10. Test your 
solve on the interval 0 < t < 10; then use a stepsize of h = 0.2. : by ; i E can 
. : Um deduction empirically by applying Euler's method with several 
Solve the equation exactly, and identify the homogeneous ih e 
; ; à ; ; different stepsizes. 
solution and the particular solution. Explain the behavior of the 
solution in light of these two components. Explain the numeric Use Euler's method to obtain a numeric solution to the IVP in each of Ex- 
results in light of the condition articulated in Exercise A3. (The ercises B9-15. In B9-11, h = 1,0 < t < 200. In BI2-14, h = 0.1, 1 < 
differential equation in this problem is stiff.) x < 2. In BIS, = 0.1, 0 < x < 1. Sketch the numeric solution and 
; : — ; compare to the exact solution obtained earlier. 
Repeat Exercise B3 for the initial value problem y' 4- 18y — 
29490—t y0) = 3 B9. Exercise Bl, Section 2.3 B10. Exercise B5, Section 2.3 
(T1 ? - 
Repeat Exercise B3 for the initial value problem y’ + 50y = B11. Exercise B8, Section 2.3 B12. Exercise B2, Section 3.2 
100 + 101, y(0) = 1, but use A = 0.039 and h = 0.041. B13. Exercise B3, Section 3.3, and use the initial condition y(1) = 1. 
Repeat Exercise B3 for the initial value problem y’ + 100y = t, B14. Exercise B3, Section 3.4, and use the initial condition y(1) — 1. 
y(0) = 5, but use h = 0.019 and h = 0.021. B15. Exercise B1, Section 3.6, and use the initial condition y(0) = 2. 
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1 Taylor Series Methods 


Taylor Series from the ODE 


There are two ways in which a Taylor series can be used to construct an approximation to the 
solution of a differential equation. One can either use the differential equation to generate 
Taylor polynomials that approximate the solution, or one can use a Taylor polynomial as 
part of a numeric integration scheme for solving an associated initial value problem. We 
will illustrate both techniques, first examining a process whereby the differential equation 
y! = f (t, y(t)) is used recursively to generate Taylor polynomials. For simplicity, we will 
include an initial condition, thus illustrating how to solve an initial value problem. 

Since the coefficients of the Taylor series for y(t) contain derivatives of y (t), construc- 
tion of a Taylor polynomial for y(t) requires computing y" (a), y" (a), etc., where (a, y(a)) 
is a known initial point. Using the chain rule (or implicit differentiation), these derivatives 
can be computed from the differential equation itself. In general, for the differential equation 


/ 


y' = f(t, y(t)), the second and third derivatives would be 
df Of | of dy 


y" = ~I = = ES , 
à A : j dt dt dydt ft fy 
"WESS l 
= Í = 3 Ut alr yf) = fu T fiy f Jr nu + KA F f (ft * ff) 
2+ H For example, if f (t, y) = —ty?, these second and third derivatives would be 
y'2—y-20y  y"-6n)-6ny 
it In principle, given the initial condition y(a) = ya, all derivatives y 9, if they exist, 
could be computed in this fashion, and y(t) represented by the Taylor series 
a (k) 
y" (a) ; 
| " >: y(t) =) - a) 
0 | 2 3 k-0 07 
FIGURE 4.3 Exact solution (solid) and Unfortunately, except for the most trivial examples, the required differentiations quickly 


Taylor approximation (dotted) for the IVP become too tedious to carry out by hand. Computer algebra systems can provide sym- 
y ed quies d bolic differentiations, making it possible to examine this series expansion process with a 
significant number of terms. 


EXAMPLE 4.3 The exact solution of the initial value problem y' = —ty?, y(1) = 1 is y(t) = zu E 
1—(t—1)-4 i —-1?- i — 1) + i — D? + ---. Figure 4.3, showing graphs of 
the exact solution (solid line) and of the fifth-degree Taylor approximation (dotted line), 
reveals the shortcoming of the method. The series solution, being a Taylor polynomial, 
will typically agree well with the exact solution in a neighborhood of the initial point but 
then diverge for values of the independent variable that are outside this neighborhood. This 
Observation inspires a different use of the Taylor polynomial, one in which the neighborhood 
about the initial point is deliberately kept small but the solution is extended numerically by 


. . 6 . . i$. 
iterating the series-building process. "e 


Numeric Taylor Methods 


The IVP of Example 4.3 can be solved with the following second-order fixed-step method. 
Truncate the series in that example, keeping just terms through second order but use this 
result to compute just y(a +h). The point (a +h, y(a + h)) is then taken as a new initial 


EXAMPLE 4.4 
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point and the second-order Taylor polynomial again calculated, this time at t = a +h. This 
process is repeated at each point of the grid t = a + kh, k = 1,2,..., N. 
Thus, the numeric Taylor method with global truncation error of order two is given by 


y 


Hn" s 
Yi = Yk t Rf (tk, Yk) + ZF (tes yk) — yo = (to) 
As seen in the previous section, the derivative f' gives y" and is computed either by the 
chain rule or by implicit differentiation. 
For the initial value problem y’(t) = —ty”, y(1) = 1, we take tj = 1 + kh and f'(t, y) = 
y? Qi? y — 1) to obtain 
Yi = Ye — h (1+ (k - 3) 5h) y? - I2 kh? y? 


The computation of y; and y2, for h = 0.1, are 


x ; 1 1 2 1 3 , 21 52524. ae, | 181 
yi = yo — w (1+ 35) 96 + 700% = Yo — HOM + TOON = H = 0.905 


Y2= 1 — sg (1+ 56) 97 + w (5) X = yı — 301 + qoi = 0.81978 

On the interval [1, 3], the numeric solution computed with stepsize h = 0.1 differs from 
the exact solution by less than 0.0004. Hence, if the numeric solution were included in 
Figure 4.3, it would be indistinguishable from the exact solution's solid line. Thus, the 
numeric solution that uses the Taylor series expression for a stepsize h and then repeats 
the calculation of the Taylor expansion is far more accurate than the Taylor polynomial 
alone. The Taylor polynomial approximates y(t) well only near t = 1; as t exceeds 1.5, the 
approximation begins to fail. 

The maximum global error of —0.0003601022 occurs at t = 3 since y(3) = 1 —):2 
and y2 = 0.2003601022. Recomputing with the stepsize cut in half, that is, with h = 5° 
we find y4o = 0.2000852413 and a global error of —0.0000852413. Dividing the first error 


by (4 y and the second by (47. we get —0.03601022 and —0.034096520, respectively. 


10 
The approximate equality of these two numbers supports the claim that the errors obey 


x 
Yexact = Yapprox + Ch* 


and, hence, that we have computed with a second-order method. 4 
EXERCISES 4.3-Part A 
Al. Using the differential equation y' = — y, generate a Taylor series A4. For the differential equation xy" + y' + y = e*, show that a Taylor 


A2. 


A3. 


solution satisfying y(0) — i. 


Using the differential equation y' — xy, generate a Taylor series 


solution satisfying y(0) = 1. 


Using the differential equation y" + xy’ + y = e*, generate a 
Taylor series solution satisfying y(0) = 1, y'(0) = —1. 


EXERCISES 4.3-Part B 


series cannot be generated at x = 0, no matter what the initial 
conditions. The point x = 0 is a singular point for the given DE. 
AS. Legendre's equation (1 — x2) y" — 2xy' + 2y = 0 has x = +1 as 
singular points. Show that y(x) — x is a solution that has a Taylor 
series expansion at x — 1. Does this contradict Exercise A4? 


B1. 


The IVP y" + 4y’ + 13y = 0, y(0) = 1, y'(0) = 0, models the (b) Expand the exact solution y(t) = e^? (cos 3t + Z sin3r) ina 
motion of a car's shock absorber displaced one unit and released. Maclaurin series and compare it to part (a). 
(a) Generate a fifth-degree Taylor series solution at t = 0 and (c) Graph the series solution and the exact solution. 


sketch its graph. 
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B2. Brine containing 2 Ib of salt per gallon flows into a 200-gal tank 
at a rate of 5 gal/min, mixes instantly, and flows out at a rate of 
8 gal/min. If the tank initially contained 50 gal of water: 


(f) On the same set of axes, plot the exact solution, the Taylor 
polynomial, and the two numeric solutions in parts (c) and (d). 


_ 86 + 100)y 


(a) Formulate an IVP governing the amount of salt in the tank. B3. y' = s szoa? —7) = 4; terminal point (—6, y(—6)). and 
(b) Obtain an exact solution to the IVP. degree p = 3 
d the exact solution i ies about t = 0. 166 ! i 
(c) Expand the exact solution in a series abou B4. y = i 388] = — D etd point C7, nD, and depres 
(d) Generate a Maclaurin series solution directly from the 14y? + 3y 
differential equation. pes 
(e) Compare the series and exact solutions. B5. y = SE, y(8) = 2; terminal point (9, y(9)), and degree 
ary” 
In Exercises B3-9: p22 — 
i , ion ¢ from i 2 3ty — 1027 
(a) Obtain an exact solution and, from it, an accurate value at the B6. y = Y —  y(1) = 1; terminal point (2, y (2)), and degree 
indicated terminal point. If using a computer algebra system, ' Ty? + 6t? 
applying the initial condition to an exact solution might be p=2 
2 Fate fors à ty à; 
appropriate for some IVEs. B7. y' = ——, y) = 3; terminal point (3, y(3)), and degree p = 1 
(b) At the initial point, expand the exact solution in a Taylor DS 
polynomial of degree p. , 7t? —Sty . . 
à > : : : B8. y' = — —— — , y(1) = 2; terminal point (2, y (2)), and degree 
(c) Build a Taylor series numeric method of degree p and use it to . ye +t 
calculate the value at the terminal point, using a stepsize of p=2 
h = 0.1. Determine the error at the terminal point. , 36 y + 10ty . 
. p : . B9. y = — —, y(1) = 2; terminal point (2, y (2)), and degree 
(d) Using h = 0.05, recalculate the value at the terminal point and 5 — 5t? — 91^ 
again determine the error. p=2 


(e) Test the order of the method by examining the constancy of 
(Yexact — Yapprox )/ h? for h = 0.1/2*, E 0.1 es 


Runge-Kutta Methods 


Generating Runge-Kutta Methods 


Methods patterned after the work of the German mathematicians Carl Runge (1856-1927) 
and M. W. Kutta (1867-1944) are called Runge-Kutta methods. For each given global 
truncation order, there exists a family of Runge-Kutta methods. The family of second- 
order methods for the differential equation y'(f) = f(t, y(t)) obtains y(t + h) from y(t) 
by adding to it a weighted average of two estimates of the actual increment. Thus, we write 


y(t +h) = y(t) - aihf + aohf (t + ph, y+ qhf) (4.5) 


and the Taylor expansion 


h? 
y(t +h) = y(t) - hy'(t) + —y"(t) Hct 


Writing y’(t) as f and y"(r) as € f (t, y(t)) = E + a 2 = fi fyf, the Taylor expansion 


dt 
becomes 
hk? h? 
yt +h) = yt) v hf(t, y) + T. y)+ gi Wht, y) t: 


The term Af (t, y) is written as Ef -— Ef, so we get 


} I 
Oth) 2 yt) € 7 f zU thf e hff + (4.6) 


FIGURE 4.4 Second-order Runge-Kutta 
methods are parametrized by a; > 3. Solid 
curve is p = q = =, while dashed line is 
a, = l — a5. 
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The terms in the brackets are the start of the Taylor expansion 
fE+thyt+thfy=ft+hf t hff, 
so we replace that term with 
f+ ph, y + qhf) = f + phfi + qhff, +--+- 
and write (4.5) as 
yt +h) = y(t) +ahf + aohL f + phf, + qhff,] (4.7) 


thereby obtaining two forms of y(t + h), namely, (4.6) and (4.7). 

In these two equations, equating coefficients of f yields the equation a; + a? = 1, 
equating coefficients of f, yields the equation paz = 1 and equating coefficients of fy 
yields the equation qa? = ; Expressing p, q, and ajin terms of a2, we get a; = 1 — a 
and p = q = +. Various choices of a» therefore generate different second-order methods. 
In fact, in order to keep f£; and f; + ph in the interval [t, tj,1], we must have p < 1, 


requiring, therefore, a» > b, 


A Spectrum of Runge-Kutta Methods 


Figure 4.4 is a first step in analyzing the variety of methods just created. In it, the dashed 
line and solid curve are graphs of a; and p = q, respectively, as functions of a2, consistent 
with the restriction a; > 1. Specifying a» determines p, q, and a, and thereby determines 
a second-order Runge-Kutta method. For example, if a vertical line is drawn at a? = 1 
in Figure 4.4, its intersection with the dashed line a, = 1 — a? determines a, = 0 and its 
intersection with the solid curve p = q = z} determines p = q = 3. This gives method B 
in Table 4.5. 

Using the notation f; = f (tk, yy), Table 4.5 lists methods A, B, and C, three of the 
more common members of the family of second-order Runge-Kutta methods, along with 
methods D and E, two methods not of this family. Method D is a multipoint method and 
requires both yo and y; to start. Method E is implicit since yy; appears on both sides of 
the equation. The reasons for including them in Table 4.5 becomes clear upon inspecting 
Table 4.6. 


Method az Computational Formula 
i h " " 
A P TEL 5 + f (thai, Yk t Af] 
! h Ji 
B 1 yj = Ye hf | tk + 2 + z% 
3 h 2 2 
C 7 Yen = Ye + a [fe + 3f (te + $A, ye + Fhfx) | 
D Yk+2 = yk + 2hfia 
h 
E Yi = Ye + lfe + fei 


TABLE 4.5 Second-order methods, including three from Runge-Kutta family 
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Method Midpoint Rule Improved Euler Modified Euler Heun 
A [12, p. 414]! [16, p. 280] [11, p. 46] 
[51, p. 1037P? [38, p. 404] [12, p. 414]! 
[80, p. 74] [49, p. 582] 
[82, p. 566] [51, p. 1037P? 
[60, p. 437] 
[82, p. 566]? 
B [16, p. 279] [12, p. 417] 
[49, p. 582] 
[60, p. 437] 
[66, p. 206] 
c [16, p. 280] 
D [13, p. 368] 


E [13, p. 372] 


TABLE 4.6 Nomenclature for the five methods in Table 4.5 


The nomenclature for these methods is quite tangled in the literature. A scan of nearly 
a dozen texts yields the names Midpoint, Improved Euler, Modified Euler, and Heun, listed 
in Table 4.6. There is clearly no uniformity in naming the common second-order Runge- 
Kutta methods. Reference [16] designates method C as Heun's method, but no other text 
even mentions method C. Reference [13] gives an implicit method as the Improved Euler 
method, and [16] calls method B the Midpoint Rule, while [12], [49], [60], and [66] all 
call the same method the Modified Euler method. But [16] and [38] both call method A the 
Modified Euler method! Great care must therefore be taken when consulting different texts. 


Method A 
The exact solution of the IVP 

y = ft y=- yn)Dz2l (4.8) 
IS y, = X To use method A, take h = p and fj; = 1 + kh so that ti = 1 +h = i then 
find y; to be 


h 
= yo + z Lf (to. yo) + f (to +h, yo + hf (to, yo))] 


< 
| 


2 8.109 o 
-ied[2- (4 (1+ 5c0))] = 23$ = 0.90545 


For the exact solution we find y,(1 +h) = E = 0.904977. 


Method B 
P4 


Again taking h = 15 and applying method B to (4.8), we find y, to be 


h h 
yr yo * Af | to + 50+ 5 (fo. yo) 


=1+ i | (1+ 36) (+z. 5y'] = [42 = 0.9052375 
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Method C 


Once again taking h = i and applying method C to (4.8), we find y; to be 


h 2 2. 
yı = yo + 1 [ro yo) +3f @ + 3^ yo + 3^f (to, »)| 


=1+4/ 1-3(-D (1+ 4) (1+ à Dy] = $38 = 0.905311 


™ 45,000 


Method D 


Method D is not self-starting since it requires both y, and yz; to compute yg+2. Hence, it 
is a multipoint method and requires some other method for determining yı. In practice, a 
single-step method is used; but for simplicity, if we take y; as the exact value zm. we find 


y» for the IVP (4.8) to be 


y» — yo 2hf (ti, y) 21 i ( (14 5) (^) = PA = 0.819824 


Method E 


To apply method E to the initial value problem (4.8), note that the algorithm is 


I 
Yk+1 = Yk + =F (te, Yk) + f as Yk+1)] 


Since the unknown yz+ı appears on both sides of an algebraic equation, it must be computed 
l 


as the solution of that equation at each step. For example, to compute y; with h = 75, we 
would have to solve the equation y; — g = Hy for yı. This is a quadratic equation and 


admits the exact solution y; = Ulm va The complication we now face is deciding 
which solution is appropriate in this context. Moreover, rarely will the differential equation 
be so amenable as to admit exact solutions. Hence, we solve the equation numerically to 
obtain y; = 0.9049578236 by restricting the solver to solutions in the interval (0, 2), in 
keeping with the initial condition y(1) = 1. 

Iterating this process for ten steps gives yio = 0.3997464021. The exact solution is 
y. Q2) = E = 0.4, so the global truncation error at this point is —0.0002535979. If we repeat 
these same calculations with the stepsize cut in half, we find y2ọ = 0.3999367065, so 
the global truncation error is now —0.0000632935. Dividing the first error by (iy and 
the second by Lr. we get —0.02535979 and —0.02531740000, respectively. The near- 
equality of these two numbers suggests that, indeed, method E is second order. 


Stiff Equations and the Backward Euler Method 


The astute reader will wonder, *Why use an implicit method if it introduces the additional 
complication of solving an algebraic equation at each step?" Our answer will be to remind 
the reader of the difficulties posed for the Euler algorithm by the stiff equations in Section 
4.2. Surprisingly, a “backward” form of the Euler algorithm, namely, 


Yk41 = Yk + hfe k = 0, 1 CETT) N = 1 
another example of an implicit method, fares much better with the stiff equation on the 
interval f < t < to + kN. 
We illustrate with the initial value problem y' = f(t, y) = i^— 100y, y(0) 2 yo — nr 
Recall from Section 4.2 that for a stiff equation, the stepsize h in Euler's method is restricted 
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y y y 
0.01 0.01 0.01 
0.008 
0 t 
1 

$ p t 7 Te t —0.008 
FIGURE 4.5 Forward Euler FIGURE 4.6 Exact solution of IVP FIGURE 4.7 Forward Euler solution of 
solution of IVP y 210? — 100y, (0) = Ww IVP y' = £? — 100y, y(0) = m with 
y = t — 100y, y(0) = Tm using h = 0.02 
h — 0.01 


byO < h < 2/|f,| = 7 = 0.02. A forward Euler solution with stepsize h = 0.01 is 
graphed in Figure 4.5; and the exact solution, y(t) = 45 — zo; + sgg goo (1 - 4999e 1), is 
0.01 graphed in Figure 4.6. For a stepsize of h = 0.01, Euler's method is well behaved. However, 
for the stepsize h = 0.02, the situation is quite the contrary, as seen in Figure 4.7. 

To demonstrate the behavior of the backward Euler method, and hence justify the 
introduction of Dom methods, we compute the solution on the interval [0, 1] using a 
stepsize ofh = D The equation to be solved at each step of the backward Euler algorithm is 


> 5d 


Vert = Ye d hf (K+ Wh, yea) = yk + hE + 1)? 1? — 100 yx 41] 


which when k = 0 becomes y; = Tm — 10y;. In this instance, the equation is linear, so 


3 1{— t 
02 04 06 08 1 


FIGURE 4.8 Backward Euler solution of 


IVP y =? — 100y, y(0) = jl; there is but the one solution, y; = ix. Continuing with similar calculations, we obtain 


Figure 4.8, which indicates the stable nature of the backward Euler method and reveals 
some of the attractions of implicit methods. 


EXERCISES 4.4—Part A 


A1. Use method A and h = 5 to obtain yı and yz for the IVP A4. Use metod D and h = i to obtain y» and ys for the IVP 
y =t+y,y(l)=2. y= tyz yN 2 22. 

A2. Use method B and h = u to obtain y; and yz for the IVP A5. Use ada E and k = B to obtain y; and y» for the IVP 
y ey, y@) = 1. y=t-—y*, yO) = 1. 

A3. Use method C and h = $ to obtain yı and y» for the IVP A6. Use the backward Euler method and h = Ww to obtain y; and y; 
y =ty, yd) 23. for the IVP y' = t — 50y, y(1) = 1. 


EXERCISES 4.4—Part B 


B1. Apply method E to the initial value problem y' — ay, y(0) — yo, will the solution y, = (2 + ah)/(2 — ah)" yo, although the latter 
showing that with positive stepsize / the general step amounts to solution might grow more slowly. If a « 0, then the exponential 
computing yj,; = Ie qp ke). T. solution tends to zero but y, only tends to zero if im < 1. Show 


2tah y that this inequality is then satisfied for any a < 0. 
2—ah 75? 


B2. Show that the difference equation Yk}; = 


k=0,1,..., has solution y, = ((2 + ah)/(2 — ah))* yo. B5. Use method E to solve, on the interval 0 < t < 10, the initial 
value problem y’ + 15y = 301? + 49t + 18, y(0) = 2. By 
experimenting with the stepsize h, determine if it is indeed true 


. "M . . that this method is stable for any reasonable value of h. (See 
B4. If a > 0, then the exponential solution in Exercise A3 will grow Exercise B3, Section 4.2.) 


in magnitude (assuming forward integration with h > 0), and so 


B3. Show that the exact solution to the initial value problem in 
Exercise B1 is y(t) = yoe“. 


B6. 


B7. 


B8. 


B9. 


B10. 


B11. 


B12. 


Repeat Exercise B5 for the initial value problem y' + 18y 
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placed on the stepsize h. Verify this empirically for the initial 


2290 , y(0) = 3. (See Exercise B4, Section 4.2.) value problem of Exercise B6. 

Repeat Exercise B5 for the initial value problem y' + 50y = B13. Repeat Exercise B12 for the initial value problem of Exercise B7. 
100t + 101, y(0) = 1. (See Exercise B5, Section 4.2.) B14. Repeat Exercise B12 for the initial value problem of Exercise B8. 
Repeat Exercise B5 for the initial value problem y’ + 100y = t, B15. Use the IVP y’ = t? + 2y, y(1) = 2, to verify empirically that 
y(0) = 5. (See Exercise B6, Section 4.2.) method A is second order. Use h = 0.1/2*, k =0,1,..., and 
Apply the backward Euler method to the initial value problem compare values at t = 2. 

y =ay, y(0) = yo, showing that with positive stepsize h the B16. Use the IVP y = 3t?y, y(1) = 1, to verify empirically that 
general step amounts to computing yk+ı = y./(1 — aA), method B is second order. Use h = 0.1/2*, k = 0, 1,..., and 
K=O) Lb. compare values at t = 2. 

Show that the difference equation yy,1 = y,/(1 — ah), B17. Use the IVP y' = 2t + 3y, y(2) = —1, to verify empirically that 


k — 0, 1,..., has solution y; = (1/(1 — aA)) yo. 


method C is second order. Use h = 0.1/2*, k = 0, 1,..., and 
compare values at f = 3. 


Show that the exact solution to the initial value problem in 


Exercise B9 is y(t) = yoe”. 


B18. Use the IVP y' = ty, y(1) = —1, to verify empirically that 
method D is second order. Use h = 0.1/2*, k = 0, 1,..., and 


If a « 0, then the exponential solution in Exercise B11 will compare values at t = 2. Use the exact solution to obtain yy. 


decrease to zero (assuming forward integration with h > 0), and 
so will the solution y, = (1/(1 — ah))* yo. The inequality 
| < | is satisfied for any a < 0, so there is no restriction 


| 1 
1—ah 


B19. Use the IVP y' = 3ry?, y(1) = —1, to verify empirically that 
method E is second order. Use h = 0.1/2*, k = 0, 1, ..., and 
compare values at t = 2. 


Adams-Bashforth Multistep Methods 


The Euler, Taylor, and Runge-Kutta methods of the previous lessons are all single-step 
methods because they compute yz+ı using only the value of y;. Since y; can thereby be 
computed from the initial value yo, such methods are called “self-starting.” 

Methods that compute y;..; from p previous values of y, namely, Yk, yii...» Yk- pat. 
are called multistep methods. In particular, a multistep method using p previous values is 
called a p-step method. The expectation is that using several previously calculated values 
will be more accurate than using just one. However, p-step methods are not self-starting 
and require the use of some other method to generate the p — 1 starting values in addition to 
yo. (Writing method D in Table 4.5 as ye) = yk-1 + 2hf (tk, yy) shows it to be a multistep 
method with p = 2.) 

A class of multistep methods based on the integration of interpolating polynomials is 
called the class of Adams—Bashforth methods. This lesson demonstrates the construction 
of two such methods: the third- and fourth-order Adams-Bashforth algorithms. 


The Adams-Bashforth method, globally of third order, is a three-step method that computes 
Yn+1 from the three previous values y, Yn—1, Yn—2. In essence, the slope field f(t, y) in the 
differential equation y' = f(t, y) is approximated by p»(t), a quadratic polynomial that 
interpolates, or passes through, the three points (tn, fa), (t; — h, fn 1). (t — 2h, fa-2). 
This polynomial is then integrated between ft, and tn+1 = f, + h, the inspiration deriving 


from 
Yn+1 Ini 
Yn+1 — Yn = | dy = J f(t, y(t)) dt 
Yn t, 


n 
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and resulting in the (global) third-order Adams—Bashforth algorithm 


ty +h 
h h 
met = int fo prle)dt = y+ Oha- lhat BA) 49) 
7 


n 


The interpolating polynomial is po(t) = A2t? + Bot + C2, where the coefficients are de- 
fined by 


1 
A: = — n-2 — 2 fn-1 t+ fn 
2 aad fn-1 + fn) 


1 
2 2l 5 ((h = 21a) Ind xm A(t, m Rd + (3h — 2tn) fa) 
Zn 


l 
C2 = apa Un in ; h) fn—2 zi 2t, (2h = lo) fni T h(2h e 312J fn) 
an| 


Empirical Error Analysis 


The Adams-Bashforth three-step method, derived via a quadratic interpolating polynomial, 
has local truncation error of order four and global truncation order of three. We test these 
claims empirically with the initial value problem y' = f(t, y) = —ty?, y(1) = 1, whose ex- 
act solution is y(t) = m Set h = 0.2 and note that it takes three starting points, namely, 
(to, yo). (ti, y1), and (f, y2). Only the first point is known, so we generate the second and 
third from the exact solution. (In practice, a self-starting method such as a Runge-Kutta 
method would be used.) From these three points, compute fo = f (to. yo). fi = (ti, yi). 
fa = (te, ya); and from the Adams-Bashforth formula, obtain y3 as an approximation to 
y(1.6). 

We are really interested in the h-dependence of the ratio C; = (y(t) — y) / I^, the 
constancy of which signals a global truncation error of order three. Hence, after completing 
98 steps of the calculation (thereby arriving at tioo = 21 where we have computed y100), we 
obtain —Ü — 0.00018. Set — H — 0.1 and recompute, after 198 steps, y»oo 
as an approximation to y (21), obtaining the ratio numm — 0.00016. The relative 
equality of the two values of C; supports the claim that we created an Adams-Bashforth 
method of global truncation order three. 


Fourth-Order Adams-Bashforth 


An Adams-Bashforth method of global truncation order four is obtained by interpolating 
the four points (tn, fa), (t, — h, fa 1). (t; — 2h, f, 2), and (t, — 3h, fn—3), with p3(t), a 
cubic polynomial that is integrated between f, and £,,4 = f, +h, yielding 


ty +h h . 
Yn+1 = Yn + J p3(T) dt= Yn + 24 99 n E 59 fr- T 37 fn-2 =, 9 fn—3) (4.10) 
t p 


n 


The cubic interpolating polynomial is p3(t) = A31? + Bst? + C3t + D3, where the coeffi- 
cients are given by 


A3 


1 
T n =8 n— 3 n-2 = n= 
zai = 3fa-1 H3 fa-2 — faa) 


1 


B3 = [(tn 2h) f, Gt, 5h) fia E Gt, = 4h) fs 2 = (th mE A) tne 3] 


2h3 


(3t2 — 12ht, + 115?) f, 


4.5 Adams-Bashforth Multistep Methods 67 


Gr; — 10ht + 65^) f, 


ee 6h? 2h? 
" Q2—8hrn + 3h*) fy» — Qi? — 6ht, + 2h?) fs 
2h? 6h? 
Fy (3 — 6ht? +1 LR 6h?) f, ! t, (t — 5ht, T 6h?) f. 
` 6h? 2h? 


t, (t2 — Aht, + 3h?) fn—2 " t, (t2 — 3ht, + 2h?) fa-3 


TESTING THE ORDER 


2h? 6h? 


An empirical test of the order of the method just created is sum- 


marized in Table 4.7 where, for the IVP used previously, fifteen-digit approximates for 
y(21) are computed with stepsizes h = 0.1/2*, k = 0, 1,..., 7. The relative constancy of 
the ratios in the fourth column of Table 4.7 supports the claim that the Adams-Bashforth 


method is of order four. 


k 0.1 ; zy ~ Jn k 0.1 zi ~ Jn 
zk Yn 014 2k Yn 0.144 
(s (5) 
0 u 0.00452489721025165 0.0001033 4 a 0.00452488687793556 0.0000705 
1 M 0.00452488740964568 0.0000851 5 21 0.00452488687783468 0.0000695 
2 a 0.00452488690773257 0.0000766 6 u 0.00452488687782847 0.0000690 
3 - 0.00452488687959708 0.0000725 T a 0.00452488687782808 0.0000687 


TABLE 4.7 — Fourth-order Adams—Bashforth 


EXERCISES 4.5—Part A 


A1. The second-order Adams-Bashforth multistep method is given by 
Yn+1 = Yn + 43 f, — f, 1). Use this method with h = 5 to obtain 
y2 for the IVP y’ = t?y?, y(1) = i. Use the exact solution to 
obtain the starting value, y;. l 

A2. Use the third-order Adams—Bashforth method (4.9) with h = 5 to 
obtain y; for the IVP y' = ty?, y(1) = i. Since this is not a 
self-starting method, obtain y, and yz from the exact solution. 


A3. Use the fourth-order Adams—Bashforth method (4.10) with h = 5 
to obtain y4 for the IVP y' = y?, y(1) = L, Use the exact solution 


to obtain the starting values y;, y», and ys. 


EXERCISES 4.5- Part B 


A4. Interpolate the quadratic polynomial p = ax? + bx + x through 
the three points (0, 3), (1, 1), (2, 5). Hint: By substitution, form 
three equations in a, b, c and then solve. 


AS. Let p(t) linearly interpolate the two points (tn, fa) and 
(t, — h, f, .,). Integrate p, between t, and t,,,; = t, + h, thereby 
obtaining the second-order Adams-Bashforth multistep method 
Yn+1 = Yn + Efa — fni). 


B1. In the programming language of your choice, implement the 
second-order Adams—Bashforth algorithm given in Exercise Al. 
Use the initial value problem ry’ + y = £?, y(1) = 1 to validate 
your code. Use the exact solution to obtain the starting value y;, 
and take h = 0.02. 


B2. Obtain empirical evidence that the Adams-Bashforth method 
explored in Exercise Al is indeed of second order. Hint: Use the 
IVP in Exercise B1 and compute y(2), with several decreasing 
stepsizes. 
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B3. In the programming language of your choice, implement the Ye = eir]. + cork, where rjand r3 are solutions of the 
fifth-order Adams-Bashforth method y,,; = y, + = (1901 f, — characteristic equation r? + pr + q = 0. Show that this 
2774 fn—1 + 2616 f,-2 — 1274 fa-3 + 251 f, 4). Test your characteristic equation arises from the substitution y, — rE. 


implementation on the IVP of Exercise B1, again using the exact 


: i B8. For the difference equation derived in Exercise B6, set ah = A: 
solution to generate starting values. 


then find the characteristic equation and its two roots. Plot the two 


B4. Obtain empirical evidence that the Adams-Bashforth method roots as a function of A and include on the graph the horizontal 
programmed in Exercise B3 is indeed of fifth order. Hint: Use the lines +1. 
IVP in Exercise B1 and compute y(2), with several decreasing 


B9. Analyze the graph in Exercise B8 as follows. If a « 0, then the 
solution of the test equation in Exercise B6 is y(t) = yoe”, which 
remains bounded. Consequently, the roots r; and r; must satisfy 
Ir;| € 1, j = 1, 2, if the solution of the difference equation is to 
track the solution of the test equation. Show that these inequalities 


stepsizes. 
B5. Use a computer algebra system to derive the fifth-order 


Adams-Bashforth method by constructing and integrating the 
appropriate interpolating polynomial. 


Exercises B6-9 anticipate a discussion of stability that appears in force the constraint h < 7; When a < 0. 


Section 4.7. . ; , 
Exercise B9 says that an equation that appears stiff to the Euler method 


B6. The stability of a multistep method is determined by applying the will appear stiff to the second-order Adams-Bashforth method con- 
method to the test equation y’ = ay, y(0) = yo. Show that forthe structed in Exercise A1. In Exercises B10—13, test this assertion on the 


second-order Adams-Bashforth method, this leads to the given stiff equations from Section 4.4. Determine the largest value of h 

constant-coefficient second-order difference equation allowed by the restriction derived in Exercise B9, and use an h less than 
3 $ 

Yn41 — (1 + ah) y, + Ë y,-1 = 0 or, equivalently, that value and an A greater than that value. 


Vitae eio ee 
Jn42 — (1 + 5aB) yi ys = 0. B10. Exercise B5, Section 4.4 B11. Exercise B6, Section 4.4 


B7. A constant-coefficient second-order difference equation of the B12. Exercise B7. SectionadA B13. Exercise BE Section 44 
form yn42 + PYn+1 + 4Yn = 0 has a solution of the form 


Adams-Moulton Predictor-Corrector Methods 


Predictor-Corrector Methods 


Multistep methods in which two formulas are used in tandem, first to “predict” y,,, and 
then to "correct" the prediction, are called predictor-corrector methods. These methods 
are also generated by interpolation-and-extrapolation calculations similar to those used to 
generate the Adams-Bashforth methods. However, multistep predictor-corrector methods 
so generated are called Adams-Moulton or Adams-Bashforth-Moulton methods. 

Since these are multistep methods, they are not self-starting. A self-starting method of 
comparable order must be used to generate the additional starting values needed. Although 
it would seem to be a bother to use a self-starting method such as a Runge-Kutta method 
to start a calculation and then switch to some other algorithm, there are two characteristics 
of the Adams-Moulton methods that recommend them to practitioners. 

First, from an adroit use of the predicted and corrected values one can deduce a measure 
of the per-step error. Instead of computing with stepsize h and ^ to estimate errors, the 
predicted and corrected values yield an error estimate. Í 

Second, a desired error tolerance can be maintained with fewer function evaluations 
than with a Runge-Kutta algorithm of comparable order. Hence, in spite of the added 
complexity, Adams—Moulton predictor-corrector methods are useful. 

Later in the section we derive the fourth-order Adams—Moulton predictor-corrector 
method, whose formulae are 


h ; 
Yn+1,p = Yn d 24 (55 fn — 59 fr 4 3T fag = 9 $3) (4.11a) 


h 
Yn+1,c = Yn + zg Om +19 fn — 5fn-1- fa-2) (4.11b) 


EXAMPLE 4.5 


k Yk fk 


1 -i 

0.9049773756 | —0.9008824553 
0.8196721311 —0.8062348830 
0.7434944238 | —0.7186191457 


[e] 


TABLE 4.8  Fourth-order Adams- 
Moulton solution to IVP y' = —ty’, 
yd) =1 
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with local error terms obeying 
5.5 
Yn+1 = Yn+1.p + Cph y (cy) Yn+1 = Ynedc + Ce h’ y^ (cr) 


where yn+1,p is the predicted value, yn+1,¢ is the corrected value, Cy = 34, and C, = — 35. 
The terms involving the fifth derivatives are the per-step (local) truncation errors, so the 


method is globally of fourth order. 


MONITORING THEERROR Thereasonable assumption that y9 (e) E y9 (ez) = a leads to 


‘ 251 | 19 \ (Cha =i 
Yn+1,p — Yatle = (C. — Cy)h a= 720 720 C = — = 9 [error i ID. Yn41, c] 


and finally to 
CRM EET , = ds 
error ID Yn+1,c = 535 [Yntip — Yn+icl = T42 Yn, p — Yn+1,c] (4.12) 


From the predicted and corrected values of y„+ı we can estimate the error in the corrected 
value. Herein lies the attraction of the Adams—Moulton predictor-corrector schemes. 


Fhe initial value problem y' = f(t, y) = —ty?, y(1) = 1, has exact solution MORES m. 
Designate (1, 1), the initial point, by (to, yo), set h = 0.1, and index the next three starting 
points by 1, 2, and 3. We then get for y, and f; = f (tk, ye), k =0,..., 3, the values shown 
in Table 4.8. 


Then, from the Adams—Moulton predictor formula we get 
Yap = ¥3 + $35 fs — 59 fa + 37 fi — 9 fo) = 0.6756242332 


The predicted value is now used to determine f4 = f(t4, y4) = —0.6390553463. The 
corrector formula can now be used to determine 


Ya = ys + H Ofa + 19 fs — 5 fo + fi) = 0.6756820491 


The exact value of y(1.4) is 0.6756756756, so the error in y4, is —0.63735 x 107. 
whereas y4p — Vac = —0. pinnae The ratio (error in y4,c)/(Y4,p — Y4.c) = zo is 
slightly larger than the expected ; Bi This means the error in the corrected value is a 
bit worse than expected but still within the bounds of the error-monitoring rule. In fact, if 
we calculate uz Op — y4,c) we find —0.4071542253 x 1075, comparing favorably with 
«t 


the computed value of the error in ya... 


Derivation of Fourth-Order Adams—Moulton Method 


The fourth-order Adams—Bashforth formula for y,,;, derived in Section 4.5, is the predictor, 
Yn+1,p- To obtain the corrector formula, interpolate the four points (f, + kh, fn+x), k = 
—2, ..., 1, with a cubic polynomial p2(t) and integrate it between t, and t, + h to obtain 


ty +h h 
Yn+1,c = Yn «f p2(t) dt = Yn T z4 9 fn + 19 f, = 3 fe de Sn—2) 
t Zi 


n 


Since the region of integration is within the span of the interpolated points, it is not an 
extrapolation, in contrast to the esgodom gean to the predictor (4.1 1a). The interpolating 
polynomial has the form p2(t) = si I e ctt, where each coefficient c; is given by 
a sum [m 2 dn fnk, With the a's listed in Table 4.9. For example, the table gives 


C3 = Jari 3s 4 T 3 2-4 Fao: 
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An+1 an An-1 An-2 
C3 1 —3 3 —1 
C2 3(h — t.) —6h + 9t, 3(h — 3t,) 3t, 
Ci 2h? — 6ht, + 32 3(h? + 4ht, — 312) —6h? — 6ht, + 9r k? — 3) 
co —2h?t, + 3ht? — t? 6h? — 3h?t, — 6ht? + 35 6h*t, + 3ht? — 359 Wt, +t 


TABLE 4.9 Coefficients for interpolating polynomial p(t) 


Obtaining the Error Expressions 


If the polynomial p(t) that interpolates the points (tk, f (tk)), k = 0,1,2,..., N, is inte- 
grated between t = a and t = b to obtain 


b N 
J p(t)dt =Y wf t) 
a k=0 


then the error of the approximation is of the form C f *' (c), for some c in the smallest 
interval containing a, b, and all the sampled nodes tg, and 


N 

1 p^? _ a? — 
) Wl, 
k=0 


(N + 1)! N+2 
provided pm — fy) does not change sign in the open interval (a, b). (See [60, p. 374].) 
In the derivation of both the aforementioned predictor and the corrector formulas, an 
interpolating polynomial was integrated between a = f, and b = 1,41 for N = 3. Clearly, 
the proviso on the sign of Taf t — ty) is satisfied between f, and t,41, so the error estimate 
involving C is valid. We therefore show that this estimate yields the errors stated in the first 
section. Note, however, that now f = y’, so f 9 = y®. 


(ies 


Table 4.10 contains the weights wz, k = 0,...,3, for both the predictor and corrector 
formulas. Taking a = t, implies t, = a—h, t, 5 = a—2h;t,.3 = a —3h and calculation 
; _ 251,5 _ _ 19 45 
then gives Cp = 5g% and C, = —zx5h*. 
Wo W1 w2 Wa 
Predictor weights -ih Zh 2h Sh 
Corrector weights ah -Zh Bh 2h 


TABLE 4.10 Predictor and corrector weights 


EXERCISES 4.6—Part A 


Al. Use (4.1 1a) and (4.11b) to obtain y4 for the IVP 
y! = Py?, y(1) = 4. Generate starting values with the exact 


solution, and take h = a 


A2. For the calculation in Exercise A1, determine the error in y4 and 
use it to test the validity of the error estimate (4.12). 
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A3. The second-order Adams-Bashforth-Moulton predictor-corrector A4. For the calculation in Exercise A3, determine the error in y; and 
algorithm is given by use it to test the validity of (Ce/(Ce — Cp)) yiip — Yi.) asa 
—: * 8 - fa) gres a the per wis error. | mE 
£ AS. If (4.11b) is used without (4.11a), the resulting method is implicit. 
h : For the IVP y' = —ty?, y(1) = 1, demonstrate how to calculate y4 
Yero = Ye + 2 U Ue, Jeep) + Jk) via this technique. Use h = i and generate starting values from 
with per-step error estimates 2 y" (cy)/? and — ;5 y" (c.)/? for the the exact solution. 
predictor and corrector steps, respectively. Use this algorithm to 
obtain y» for the IVP of Exercise Al. Generate starting values with 
the exact solution, and take  — $- 
EXERCISES 4.6—Part B 
B1. Use Table 4.9 to write the interpolating polynomial p»(t) when B9. Derive the per-step error estimates 2 y 9 (cy)h^ and =A y (c)h* 
tn = 0 and h = 1. Show that it does indeed interpolate the points for the predictor and corrector steps, respectively, in the algorithm 
(th + kh, faro) = (Ks fua), k = —2,..., l of Exercise B7. 
B2. By forming the appropriate interpolating polynomials and B10. Use the method of Exercise B7 to solve the IVP y' = £? + y?, 
integrating, obtain the second-order Adams-Bashforth-Moulton »(0) 2 1. 
predictor-corrector algorithm/given in Exercise A3. B11. Using the IVP in Exercise B5, show empirically that the method 
B3. In the language of your choice, implement the algorithm given in of Exercise B7 is globally a third-order method. 
Exercise A3. Test the code on the initial value problem B12. Implement as an implicit method, the third-order corrector 
y' = —ty?, y(1) = 1. Use the exact solution to compute starting formula from Exercise B7 and test it on the initial value problem 
values. from Exercise B5. Use the exact solution to obtain any required 
B4. Derive the per-step error estimates zy" (cy)? and — i" (c)? starting values. 
for the predictor and corrector steps, respectively, in the algorithm $13, Show that the implicit method in Exercise B12 is conditionally 
of Exercise A3. stable by applying it to the test equation y’ = ay, y(0) = yo as 
B5. Using the IVP y’ = ry, y(1) = i empirically test, atk = 1, was explained in Exercises B6—9, Section 4.5. The difference 
(C./(Cc — Cp))(Yk+1,p — Yk+1,c) as a measure of the per-step error equation (1 — )yk+i — (1+ M )yx + 2 yii = 0 should result, 
in the algorithm of Exercise A3. as should the characteristic equation (1 — Sah yp? = (U+ 2ah yp p 
B6. Using the initial value problem in Exercise B5, show empirically “+ = 0 when y, = r* is tried for a solution. Solve this 
that the method of Exercise A3 is globally a second-order method. characteristic equation for the roots r; and rz and, along with 
B7. By formine the ; deint ition wel Eds aif horizontal lines of heights +1, plot these roots as a function of 
. By forming the appropriate interpolating polynomials an - ] : c 
integrating, obtain the third-order Adams- Bashforth-Moulton ah. From this graph, determine that both roots satisfy |r| < 1 if 
ds P —6 « ah <0. 
predictor-corrector algorithm 
h : B14. Devise and execute an empirical test to show that for the method 
Yk+lp = Ye + 12 99 f — l6fi-i + 5fi-2) in Exercise B12, h < a is required for numeric stability. (Figure 
i 4.7 shows the result of a computation that is numerically 
Vette = Yk + Of e Yap) + 8fk — fii) unstable.) 


B8. 


Repeat Exercise B5 for the algorithm in Exercise B7 and the 
index k — 2. 


Milne's Method 
Milne's Algorithm 


Not every multistep method built by interpolation and integration is satisfactory. Milne's 
method, like the Adams-Bashforth and Adams-Moulton methods, approximates f (f, y) 
with interpolating polynomials and, like the Adams-Moulton, is a predictor-corrector 
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EXAMPLE 4.6 


method. However, it will prove to be conditionally stable, in the sense that it can give 
unbounded solutions to equations with bounded solutions [42]. 
The Milne algorithm is defined by the formulas 


4h . . 
Yn+1,p = Ya-3 + 3 Qf E fü T 2 fr) (4.13a) 


h 
Yn+1,c = Yn-1 + 3 na + 4 fn + fia) (4.13b) 


with local error terms obeying 


5 


" SO fin n - E) 
Yn+1 = Yn+i,p ar Cph y! (c1) Yn+1 = Yn+l.c P Cch y (c2) 


where Yn+1,p is the predicted value, Yn+1,¢ is the corrected value, Cp = z, and Ce = —g 
The terms involving the fifth derivatives are the per-step (local) truncation errors, so the 
method is globally of fourth order. 

The reasonable assumption that y 9 (c1) = y 9) (c5) = a leads to 


! | 28\ (C.ASa\ -2 
Yn+1,p — Yn+1,c = (C. — Cy) a= 90 90 C. = = [error in yy41.«] 


and finally to 
55 " 1 
error ID. Yn41,c = 39 [Yn+1,p ag Yn+1,c] (4.14) 


From the predicted and corrected values of y,,,; we can estimate the error in the corrected 
value as one twenty-ninth of the difference between the predicted and corrected values. 
Herein lies the seductive attraction of the Milne scheme. However, we will show this method, 
unlike the Adams—Moulton method, to be unstable for some stepsizes. 


We illustrate Milne’s algorithm for solving the familiar initial value problem y’ = f(t, y) = 


—ty?, y(1) = 1, whose exact solution, y(t) = AZ is used to generate y, and f; = 
Ts VOR = iu 3, since Milne's method, a multistep method, is not self-starting. 


Thus, with a stepsize of h — 0.1, we formulate Table 4.11, from which follows 
Yap = Yo + $(0.1) Qf — fo + 2 fi) = 0.6756308910 


Using y4,, for y4, we estimate f4 as f (f4, y4,5), obtaining f4 = —0.6390679413. Applying 
the corrector formula, we obtain the corrected value of y4 as 


Yae = Yo + S fa - 4 fs + fo) = 0.6756794842 


k Yk fk 

0 1 

1 0.9049773755442163 —0.9008824552 
2 0.8196721310063224 —0.8062348828 
3 0.7434944235687798 —0.7186191453 


TABLE 4.11 Starting values for Milne's method applied to 
IVP y' = -ty’, y(1) 21 


As with the Adams—Moulton method, we test the claim that the error in the corrected 
value is a known multiple of the difference in the values of the predicted and corrected y's. 


FIGURE 4.9 Characteristic roots R, 
(solid) and R, (dashed) for Milne’s method 
applied to y’ = ay 
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The error in the corrected value is y(1.4) — y4, = s — 0.6756794842 = —0.38088 x 1075, 
whereas the difference between the predicted and corrected values is 0.6756308910 — 
0.6756794842 = —4.85932 x 1075. Hence, we expect the ratio 255532 — 12.76 to be 29, 
but get half that. The error is therefore about twice what was expected but still within the 


spirit of the error-monitoring philosophy. ^ 


Stability of Milne's Method 


As explored in the exercises for Section 4.5, the stability or instability for a numerical 
method of solving an ODE is usually established by examining its behavior when applied 
to the test-equation y' = f(t, y) = ay. Milne's corrector formula (4.13b) applied to the 
test-equation yields 


1 ah Aah | 1 ah 20 
3 Yn+1 3 Yn ta NX] = 


ah 


= 
E, 


after bringing all terms to the left and grouping. Replacing “ with the constant r, we then 


have 


(1 — r)ysa1 — 4ryn — (1 + r)yn-1 = 0 (4.15) 


a linear, constant-coefficient, second-order difference equation whose solution is a sequence 
of numbers, Yes k = 0, 1,.... 
We look for a solution of (4.15) in the form y, = A". Substitution into (4.15) and 
division by A"-' gives the quadratic (1 — r)A? — 4rà — (1 + r) = 0, whose solutions are 
2r — J3r? + 1 2r + 3r? +1 
Ri = and R5 = ———————— 
l-r ]—r 
The most general solution for y, in Milne's method is then a sequence whose members are 
of the form 


Yn = C1 Rī T c; R5 


for constants cı and c2. Therefore, the behavior of this sequence is determined by the roots 
R, and R3, which are graphed in Figure 4.9: R, as the solid line and Rz as the dashed line. 

Where |Ri| < 1, we see |R2| > 1, and vice versa. Powers of one root will grow while 
powers of the other root will decay. If the solution of the DE being solved by Milne's 
corrector really grows, then the corrector will track it. If the solution of the DE decays, 
the corrector will always generate a solution with a growing component. Hence, Milne's 
corrector is called weakly stable. Milne's method, consisting of the predictor and corrector, 
turns out to be conditionally stable, that is, stable only for restricted stepsizes. 


Derivation 


The quadratic polynomial pı(t) that interpolates the three points (f, + kh, f; 44), k = 
—2, —1, 0, is integrated on the interval t, — 3h < t < t, +h, thereby extrapolating back 
one step and forward one step. In fact, integrating y' = f(t, y) to obtain y,41 — Yn-3 = 
fir, f(t, yO) dt ~ f$, pi(t) dt leads to (4.132). 

The quadratic polynomial p»(t) that interpolates the three points (t + kh, fa+k), k = 
—1,0, 1, is integrated, without extrapolation, on the interval t, — h < t < t, + h. In fact, 
integrating y' = f(t, y) to obtain y,4; — Yn-1 = jT F(t, yt) dt zm [s p» (t) dt leads 
to (4.13b). 

The coefficients of the interpolating polynomials pit) gis (Ai? + Bit + Ci), i = 1,2, 
are listed in Table 4.12. 
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A, Ji E oy Si fi 
Bi (3h — 213)]5 mE 4(h E 15) fai + (h = Rtn) fna 
C; = QI? — 3ht, +12) fa + (Aht, — 212) f... — (ht, — t) fra 


Il 


Il 


TABLE 4.12 


EXERCISES 4.7—Part A 
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A = fara 2fs cf 
(h = 2th) fiii + At, fn E (h + 253) Fe 
—t,(h — th) fayi t 208 — t2) fa + (ht, + 02) f 


Coefficients for quadratic interpolating polynomials p; (t) and p(t) 


A1. Use Milne's method with h = u to obtain y4 for the IVP 
y20y,yl- i. Use the exact solution to obtain any starting 
values needed. 

A2. 


A3. 


Obtain y, exactly, and use this value to test the validity of (4.14). 


Show that x, = (—2)* is the solution of the difference equation 
Xk+1 + 2x, = 0 and the initial condition x9 = 1. Write out the first 
few terms of the sequence x;. 


A4. Solve2x,,; — 3x, = 0, xo = i by requiring x, — Ar* to satisfy 
the equation for r, constant. Write out the first few terms of the 


sequence x, that solves this problem. 


EXERCISES 4.7—Part B 


AS. Solve the problem of Exercise A4 by writing the difference 
equation as xy,; = ix then computing x, from xo, etc. 


A6. Solve xy,» + xy41 — 6x, = 0, xo = 2, xı = 3, by requiring 

xy — Ar* to satisfy the equation for r, constant. This leads to a 
quadratic in r, with two roots r; and r2. The general solution is 
then x, = arf + bri. Determine a and b so that xo and x, assume 
the appropriate initial values. Write out the first few terms of the 


sequence x+ that solves this problem. 


AT. Solve the problem of Exercise A6 by solving the difference 


equation for x42, then computing x» from xo and x, etc. 


B1. In the language of your choice, code Milne's method and test it on 
the initial value problem y’ = —10y, y(1) = 1. Show that even 
with a stepsize of h = 0.1, the method diverges for t large enough. 


B2. Using h = 0.1, apply Milne's method to the IVP in Exercise B3, 
Section 4.1. For the case n = 3, test the validity of the error- 


tracking formula (4.14). 


B3. Investigate the stability of Milne's method when applied to any of 
the initial value problems in Exercises B2-18, Section 4.1. Thus, 
use h = 0.1 and see if for t < 10 there is any evidence that the 


calculation becomes unstable. 
In each of Exercises B4— 8: 


(a) Use a computer algebra system to solve the given initial value 
problem for the difference equation. 


(b) List and plot the first ten members of the solution sequence, 
expressing each as a sequence of real numbers. 

(c) Use the difference equation itself to calculate, in order, 

P s PEPPE X10. 

(d) Construct the solution by assuming x, = Ar*, obtaining the 
characteristic equation for r and applying the initial 
conditions to the general solution x; = arf + br, where 
ri, i = 1,2, are the roots of the characteristic equation. 


B4. x45 — Stagi + 6x, 20, X = 1, x = 1 
BS. 6Xn42 + 5X41 + Xn = 0, xo = 1, x) = 1 
B6. xn42 + Xn41 — 6X, 20, xo = 1, x = 1 
B7. Xn42 — 4Xn41 + 13%, 20, xo = 1; x1 = 1 
B8. Xn42 — x, B Xn =0, nal nsl 


rkf45, the Runge-Kutta-Fehlberg Method 


Adaptive Methods 


Throughout the previous discussions of numeric methods for solving initial value problems, 
we have stressed error estimation and demonstrated strategies for determining how accurate 
a computed answer is, even when the exact answer is not known. One strategy for this com- 
5. Doing this with the fourth-order Runge-Kutta 


putes y,+1 from y, using stepsizes h and 


4.8 rkf45, the Runge—Kutta—Fehlberg Method 75 


algorithm requires four function evaluations with stepsize / and seven with stepsize ^. That 
two points coincide when recomputing y,.,; suggests there may be members of the Runge- 
Kutta family of methods whereby the 11 function evaluations required for recomputing with 
reduced stepsize can be reduced by an adroit placement of the evaluation points. 

The Runge-Kutta-Fehlbergmethod combines fourth-order and fifth-order Runge-Kutta 
techniques to effect the step reduction strategy with only two additional function evalua- 
tions. Thus, rkf45 is a (global) fifth-order method requiring six evaluations of the function 
f(t, y) in the differential equation y’ = f(t, y). It provides a fifth-order approximation of 
the solution and an estimate of the error at each step. It is the default numeric method in 
Maple. 

Sophisticated procedures for solving differential equations both monitor error at each 
step and adjust the stepsize if the per-step error is greater than some prescribed limit. 
Numeric methods that adjust stepsize are called adaptive methods and are used for solving 
differential equations and evaluating integrals. Not only is the error monitored at each step, 
but stepsize automatically changes if the error is not small and increases if it appears the 
error tolerance is being easily maintained. Incidentally, Maple’s default numeric integration 
scheme is also adaptive. (See Chapter 43.) 


The rkf45 Formulae 
The rkf45 formalism consists of the following nine formulas. Six function evaluations 
are involved in the computation of Fi, F2, ..., Fs. From these values, y,.,1 4, with global 


truncation error of order four, is computed as an approximation to y(t,+1). It is not directly 
used for computing y,+1,5 which is taken as y(f;41); Yn+1,5 has a global truncation error 
of order five. The error expression is merely the difference y,,1,5 — Yn+1,4 and is used to 
determine the accuracy of Yn+1.5- 


Fi = hf (ta, Yn) 
F-hf (i + 7 Yn + =) 
Fy =hf (« " 3h. -— 3F 4. =) 
a B 
F, = hf (« + = Yn + ey SEDES ! s ] 
` ! i 2197 2197 2197 
Fs =hf (sn Se — 8Fy 3680F3 _ se) 
216 513 4104 
mens s Ee t tg) 
25F, 1408F; 2197F, Fs 
Ynt1d = In 7,16 ^ 2565 ^ 414 5 
""— — 6656F;  28561F, 9F; 2Fs 


135 12825 56430 50 35 
Fy 128F; 2197F, Fs  2Fg 
360 4275 75240 50 55 


Error = 


EXAMPLE 4.7 Taking h = 0.1, we apply the rkf45 algorithm to the familiar initial value problem y' = 


2, 


re and then summarize the 


f(t, y) = —ty?, y(1) = 1, whose exact solution is y(t) = 
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results in Table 4.13. The actual error appears to be about an order of magnitude smaller than 
the estimated error. Hence, the method's error estimator is conservative, claiming greater 


error than there really is. 


tk y(t) Yk,5 |yx,s — y (tx) Error 

1.1 0.9049773756 0.9049773731 2.5 x 107? 9.2 x 1073 
15 0.8196721311 0.8196721268 4.3 x 107? 8.7 x 10-5 
1.3 0.7434944238 0.7434944184 5.4 x 107? 7.8 x 1073 
1.4 0.6756756757 0.6756756698 5.9 x 107? 6.6 x 10-8 
1.5 0.6153846154 0.6153846094 6.0 x 107? 5.5 x 107? 
1.6 0.5617977528 0.5617977468 6.0 x 107? 4.5 x 1073 


TABLE 4.13  rkf45 applied to IVP y' = —1y?, y(1) = 1 


EXERCISES 4.8 


1. In the programming language of your choice, implement a 
nonadaptive version of the rkf45 algorithm. 


error-tracking expression y,.1,5 — Yn41,4 by comparing its value with 
the error in the numeric solution. Use the exact solution to establish 


2. For any of the initial value problems in Exercises B2-18, Section the actual error made in the numeric solution. 


4.1, use your code from Exercise | to test the validity of the 


Chapter Review 


1. What does it mean to say a numeric method for solving a 10. Give an example of a numeric Taylor method, and implement it for 
differential equation is a "fixed-step" method? an IVP of your choice. Compute the first two function values after 


2. What is the truncation error for a fixed-step method? the initial value. 


3. What is the order of the truncation error of a fixed-step method? 11. What is an implicit method, and how does it differ from an 


: i 5 “explicit” method like Euler’s? 
4. What is the global order of Euler's method? What is the global order o arque ee 


of the rk4 method? What does this say about the two methods? 12. Using the backward Euler method, obtain the first two functions 


lues i VP of hoice. 
5. State the formula by which error in a fixed-step method can be values tian IVP of Ru udi 


monitored. 13. What is a multistep method? 


14. What characterizes the class of multistep methods known as 
Adams-Bashforth methods? 


6. State the formulae for Euler’s method. 


7. Describe in words what Euler’s method actually does. 


. ; ; " " 15. What is a predictor-correct thod? Why are such methods used? 
8. Give an example of an IVP, and implement the first three steps of Ce ee ee ee ere T 


Euler's method for this example. 16. What does it mean to say that a method for numerically solving an 
IVP is stable? Are all the methods of this chapter stable? 


9. Give an example where, from the differential equation and the i . m i : 
initial condition, a Taylor series solution of an IVP is generated 17. Describe the concept of adaptivity for numeric solvers of IVPs. 
termwise by repeated differentiation. 


How is adaptivity achieved? How is it implemented? 


Chapter 5 


Second-Order Differential 
Equations 


INTRODUCTION The second-order linear differential equation with constant 
coefficients is the mathematical expression of a significant spectrum of physical processes. 
For example, it can be applied to both mechanical and electrical systems, readily modeling 
the vibrations of a damped spring-mass system or the oscillations of the electric current in 
a circuit containing resistance, inductance, and capacitance. 

The chapter begins by modeling mechanical and electrical systems with the second- 
order, constant-coefficient, linear differential equation and continues with the physical in- 
terpretation of initial conditions typically imposed on spring-mass mechanical systems. A 
summary of physical outcomes and their mathematical counterparts is then provided. 

The solution process for the homogeneous case is studied and culminates in an example 
of oscillatory motion experienced by a floating cylinder. The nonhomogeneous equation 
modeling forced or driven motion is studied next, opening the door to a study of resonance 
experienced by certain forced systems. 

The Euler equation is a useful example of a linear equation with nonconstant coefficients 
and an exact solution that can be written in terms of the elementary functions. 

The use of the Green's function for solving the initial value problem appears in an 
optional final section. 


Springs °w’ Things 


Mechanical Models 


The vibrations of an object attached to a spring, and the flow of current in an RLC electric 
circuit containing resistance, inductance, and capacitance, are modeled by second-order 
linear differential equations with the same form. Only the physical meaning of the equations’ 
constant coefficients distinguishes the two models. The mathematical properties of the 
solutions of both ODEs are the same. Hence, understanding the behavior of one model 
gives insight into the behavior of the other. 

Since the mechanical system is easier to visualize (electrons are not visible!) it is 
reasonable to study spring-mass systems first. The mechanical system we study consists of 
a spring, hung from the ceiling, and an attached object of mass m. The object is assumed to 
move only in the vertical direction. When the particle comes to rest, its position is denoted 
as the equilibrium position. 
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— Equilibrium 


FIGURE 5.1 Coordinate systems for 
spring-mass system 


A coordinate system in which y(t) denotes vertical displacement from equilibrium is 
then used, the convention being that displacements upward are positive and displacements 
downward are negative. Upward displacements (y(t) > 0) compress the spring, while 
downward displacements (y(t) < 0) stretch the spring. 

When resting at the equilibrium position, the object experiences no net force. The 
downward pull of gravity is balanced by the residual stretch of the spring as it sagged under 
the object's weight while the object sank to equilibrium just after being attached to the 
spring. See Figure 5.1. 


THE Forces The differential equation for the motion of a particle is obtained by applying 
Newton's Second Law (F = ma) to the system. In Newton's law, the symbol F represents 
external forces acting on the particle. These forces include: 


e  Hooke's law restorative force applied to the particle by the spring. 
*  Viscous (frictional) forces. 


* External driving forces like magnets, air blasts, vibrations of the ceiling support, etc. 


Hooke'sLaw  Anelastic force is said to be governed by Hooke's law when the stretch 
generated by the force is directly proportional to the force. Mathematically, this is the sim- 
plest relation between the applied force and the displacement. It is a linear relationship and 
can be thought of as an assumption or as a linearization of a more complicated relationship. 
However, experimental evidence shows that many elastic bodies support Hooke's law, at 
least in restricted ranges of displacement. 

The force exerted on an object by the spring is such an elastic force. The spring in 
our discussion exerts on the particle a force that is directly proportional to the amount of 
stretch. If 1 pound of force stretches the spring 3 inches, then 2 pounds of force will stretch 
the spring 6 inches. Thus, including a sign to record the direction of displacement and 
consequently, the force, we have 


Force of spring on object = —ky (t) 


The constant k is called the spring constant and has units of force per unit length. (In 
English units, it would be pounds per inch or an equivalent.) The minus sign says that the 
pull exerted by the spring opposes the displacement. If the object is moved upward 2 inches 
(so y(t) = 2) the spring pushes downward on the object and the force of the spring on the 
object is —2k pounds. The minus sign, in our coordinate system, shows the force to be 
downward. 


Viscous Forces Viscosity refers to the “stickiness” of fluids. Molasses has a higher 
viscosity, is "stickier," and exerts more retarding force than water. Viscosity of a fluid is 
quantized by measuring the amount of time it takes for a standard ball-bearing to fall a fixed 
distance through the fluid. 

An object moving in air has its motion restricted by collisions with the gas molecules 
composing the air. The resistive force so developed is called a damping force. In the spring- 
mass model we are developing, air-damping is generally included with any internal friction 
within the spring itself and a single term in the model is used to account for the frictional 
forces in the system. 

One way to model the force of viscous damping is to assume it proportional to the 
velocity and directed so as to oppose the motion. (Perhaps the reader has experienced the 
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force of air pressing against an open palm extended out the window of a moving automobile. 
The faster the auto goes, the more force is felt pushing back against the hand. What more 
natural way to model this force than to assume it is proportional to the speed of the auto?) 
Thus, 


Force of viscous damping = —by’ (t) 


The minus sign indicates that the resistive force opposes the motion. If the object is moving 
upward (y'(t) > 0) the air resistance generated by the air molecules pushes downward 
against the object. Hence, the viscous force is negative and directed downward. The damping 
coefficient b has units force/velocity or, in the English system of units, something like 
poundslinches-per-second. 

This linear model of viscous damping is not the only possibility. In the design of aircraft 
and ship hulls, the drag forces of air and water are often-táken as quadratic in the velocity. 
Thus, for certain flow regimes the fluid's drag is taken as proportional to —|y'(1)] y(t). The 
added complexity of determining the direction of the motion if (y'(1))? is used makes the 
absolute value preferable but still much harder to deal with than our simpler linear model. 
(Spring-mass systems with nonlinear damping cannot be solved analytically. Hence, they 
are treated in Unit Three.) 


Driving Forces Forces applied to the mass from sources other than the spring are 
called driving forces. Such forces would include the action of an electromagnet sitting under 
the mass (assumed to be magnetic), air blasts shot at the mass, or the periodic oscillation 
of the support of the spring. Such forces will be designated as f(t) and must be included 
in the sum of all external forces acting on the object. 


NeEwtTon’s SECOND Law Newton’s Second Law of motion states that when a force is 
applied to a particle, the particle experiences an acceleration directly proportional to the 
force. The constant of proportionality is the mass m. The more massive the particle, the 
less effective the force is in changing the particle’s acceleration. This is the content of 
the statement F = ma, the one-dimensional form of the second law. The acceleration is 
denoted by a and is given by a = y(t). The applied forces are all included in F. Hence, 
F = ma becomes F = my’ (t) or my” (t) = —ky(t) — by'(t) + f(t). Thus, we will study 
the differential equation 


my" (t) + by (t) --ky(t) = f(t) m,b,k > 0 


This fundamental differential equation of science and engineering is a linear second- 
order nonhomogeneous differential equation. If we assume that the mass, damping coeffi- 
cient, and spring constant all remain constant during the motion, we then have an equation 
with constant coefficients. The properties of such an equation, and its solutions, are the 
typical starting point for many more exotic studies of systems wherein frictional heating 
changes the damping and/or the stiffness of the spring. Equations with variable coefficients 
share characteristics with their constant-coefficient cousins, but the greater sophistication 
requires equally more sophisticated solution techniques. 

If f(t) zz 0 we say the motion is forced or driven; otherwise, we say the motion is 
free. If b 4 0 we say the motion is damped; otherwise we say the motion is undamped. The 
relative amount of damping, that is, the relative size of b, determines three types of damped 
motion, namely, overdamped, critically damped, and underdamped. These distinctions, and 
their consequences, are the subject of the rest of this unit. 
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Electrical Models 


R The electric circuit in Figure 5.2—in which a voltage source generating an "electromotive 
force" E(t), aresistor with value R, an inductor with value L, and a capacitor with value C. 
are connected in a loop—supports a current whose value is i (t). The connections between 
the value of the parameters R, L, and C and the current i (t) resulting from the voltage 
source E(t) are quantized in the differential equation 


i 
EY Ri! + — = E' 
r FA C 


FIGURE 5.2 The basic RLC electric 


Si This is again a linear, second-order, constant-coefficient ordinary differential equa- 
circuit 


tion. The analogy between this electric circuit and the damped mechanical oscillator is 
inescapable. The inductance L plays the role of the mass m; the resistance R plays the role 
of the damping coefficient b; and the reciprocal of the capacitance plays the role of the 


spring constant k. 


EXERCISES 5.1—Part A 


Al. Formulate a differential equation governing the motion of an 
object weighing 1 Ib that stretches a vertical spring 33 in when 
attached and experiences a resistive force whose magnitude is 
one-sixteenth the object’s speed. 


A2. Formulate a differential equation for the object in Exercise Al if 


the resistive force is three times the square of the speed. 


A3. Verify by substitution that the differential equation y" + 2y' + 
10y = 0 has general solution y(t) = e^' (A cos 3t + B sin 3t), 
where A and B are arbitrary constants. 


A4. Show that the solution of the initial value problem consisting of 
the ODE in Exercise A1, along with the initial conditions 


y(0) = —3, y'(0) = 0 is given by y(t) = —e™ (3 cos 3t + sin 3t). 


Thus, check that the solution satisfies both the differential 
equation and the initial conditions. 

AS. Plot the solution given in Exercise A4. Estimate the first and 
second times at which y(t) = 0. 


EXERCISES 5.1—Part B 


A6. Is the motion of the spring-mass system modeled by the IVP in 
Exercise A4 underdamped, overdamped, or critically damped? 
Provide a qualitative description of the motion of the object. 

A7. Determine o and ¢ so that 3 cos 3t + sin 3t = a cos(3t — $) is an 
identity in t. Hint: Expand the trigonometric term on the right, 
and match coefficients of cos 3t and of sin 3t. 


A8. What does Exercise A7 say about the system modeled in Exercise 
A4? 

A9. Determine the values of a and b so that 3 cos(2t — arctan 1) = 
a cos 2t + bsin 2t is an identity in t. Hint: Simply expand the 
trigonometric term on the left side. 

A10. Demonstrate how to use the initial conditions in Exercise A4 to 

determine the constants A and B in the general solution given in 
Exercise A3. 


B1. Use a computer algebra system to obtain the general solution of 
y" + 6y' -13y =0. 

B2. Use the solution found in Exercise B1 to obtain the solution of the 
IVP y" + 6y' + 13y = 0, y(0) = 1, y'(0) = —1. Verify the 
calculation by using the computer algebra system to solve the IVP 
directly. 


B3. Plot the solution found in Exercise B2, and calculate the first value 
of t > 0 for which y(t) = 0. 


B4. Use a computer algebra system to obtain the general solution of the 
equation formulated in Exercise A1. 

B5. Apply the initial conditions y(0) = 1, y'(0) = —1 to the solution 
obtained in Exercise B4. Plot the resulting solution and determine 
the first time beyond which the magnitude of the solution remains 
below 0.2. 


( 1 ) 3y" 


2y"+5y'+7y =0 


(2) Py"-F y'sint — 4e'y «t 


(3) y" d 
(4) y" + 


(5 o» 


2(y' + y 4 tcos2t 
Eyy” =s 0 
Hy Bym-e* 


(6) cosy" +y +y=0 


TABLE 5.1 
ODEs 


Examples of higher order 
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The Initial Value Problem 


The Differential Equation 


A model for the mechanical system consisting of a damped spring, attached to a mass m, 
meeting linear viscous damping, and acted on by an external force f (t) is the differential 
equation 


my" (t) + by (t) 4- ky(t) = ft) (5.1) 


a linear, second-order, constant-coefficient, nonhomogeneous ordinary differential equa- 
tion. If the mass is initially displaced by an amount o and tossed with a velocity B, then 
initial conditions of the form 


yO)=a y(0-p 


are included with the differential equation to form the initial value problem that is at the 
heart of the Newtonian view of the universe, the universe as the great clockwork. If the initial 
state of the system is known and the laws governing its progression in time are correct, then 
the solution of the initial value problem reveals the fate of the universe. The indeterminacy 
of quantum mechanics unleashed on physics at the turn of the 20th century effectively 
squelched this world view of Newtonian physics. However, the initial value problem has 
not lost its importance in the science and engineering of the macroscopic world. 

Each modifier used to describe the differential equation reveals specific information 
about the system, the equation, and the nature of the solution. This unit develops an intuition 
for the implications of each term. Although the terms order, linear, and homogeneous have 
been met earlier in the context of the equation f(t, y, y') = 0, we repeat them here in the 
context of the equation f (t, y, y’, t”) = 0. 


SECOND ORDER When the highest derivative appearing in the differential equation is y", 
the equation is said to be of second order. Equations (2), (3), (5), and (6) in Table 5.1 are 
all second order. Equations (1) and (4) are third order. 


LINEAR vs. NONLINEAR Linear equations have y and its derivatives appearing in a "linear 
pattern." In Table 5.1, equations (1) and (2) are linear. The other four equations are nonlin- 
ear. Equation (1) has constant coefficients, whereas equation (2) has variable coefficients. 
Equation (3) is nonlinear because of the term ( y», equation (4) because of the product yy", 
equation (5) because of the term ( y")?, and equation (6) because of the term cos y". The 
physics captured in a linear equation is distinctly different from that captured in a nonlinear 
equation. 


HOMOGENEOUS vs. NONHOMOGENEOUS A linear ODE is said to be homogeneous if, 
when y and all its derivatives are isolated on the left side of the equation, the right side is 
just zero. Equation (1) in Table 5.1 is homogeneous. Although equations (4) and (6) seem 
to have zero as a right-hand side, they are not called homogeneous because they are not 
linear equations. 

A linear ODE that is not homogeneous is nonhomogeneous (or inhomogeneous). Equa- 
tion (2) in Table 5.1 is nonhomogeneous. Although equations (3) and (5) seem to have non- 
zero right sides, they are not called nonhomogeneous because they are not linear equations. 
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The Spring Constant 


A spring specifically designed as a coil of steel can come with a range of stiffnesses. Given 
a spring, a simple test can be used to determine its spring constant k. Thus, if a weight of 
2 lb stretches a spring 3 in, 


2]b 21b 2 
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If this test were actually done with an unstretched spring and the spring were allowed to 
come to rest with the weight attached, the equilibrium position attained would be designated 
as y = 0 and subsequent motions measured from this point. The gravitational force acting 
on the object is thus balanced by the initial stretch of the spring, and the two forces are in 
equilibrium and do not show up again in the spring-mass equation since they would only 
cancel out again. 

Not all “springs” are wound coils of steel wire. The girders of a steel-framed building, 
the wings on an airplane, or the framework of the Statue of Liberty can all be modeled as 
spring-mass systems. The "spring constant" for such systems is a measure of the stiffness 
of the structure and can be a scalar or even a matrix. Chapter 12 treats such linear systems 
of differential equations. 


Driving Forces 


If an external driving force f (t) such as a magnetic force, wind, earthquake, and vibrations 
of the ceiling support, act on the system, then Newton's Second Law (F — ma) becomes 
my" (t) = —by'(t) — ky(t) + f (t) and, hence, (5.1). Such systems are said to be forced 
or driven. The force f (t) is said to be the forcing term or the driving term. The motion 
governed by a nonhomogeneous differential equation is said to be forced (or driven) motion. 

The ODE governing a spring-mass system with no forcing function is necessarily 
homogeneous, and the resulting motion is described as free motion. 


Initial Conditions 


Forthe coordinate system in which motion upward is positive, Table 5.2 matches the physical 
description of the initial conditions with the corresponding mathematical formalism. A 
positive initial velocity means the object was launched (or "tossed") upward or was in 
motion upward at the instant the clock for the observations was started. The word "released" 
typically means that the initial velocity was zero, that is, the object was simply displaced 
and allowed to go into motion under the action of just the spring and external force. No 
other agent added to its motion at t = 0. 


y0) 2» 0 y(0) « 0 y(0) 20 
y'(0) > 0 Pull up, toss up Pull down, toss up From equilibrium toss up 
y(0) «0 Pull up, toss down Pull down, toss down From equilibrium toss down 
y'(0) 20 Pull up, just release Pull down, just release From equilibrium just release 


TABLE 5.2 Initial conditions for second-order ODEs 


5.2 The Initial Value Problem 83 


Engineering at a Glance 


A great deal of mechanical, civil, and even electrical engineering, in addition to a great deal 
of physics, lurks in the initial value problem posed in this section. An understanding of 
the underlying mathematics supports an understanding of the science in this wide variety 
of fields. Hence, Table 5.3 outlines the mathematics of this chapter and the corresponding 
concepts in science and engineering to which this material relates. 


Free motion (homogeneous ODE) Forced motion (monhomogeneous ODE) 
Undamped (b — 0) Transient state (TV set warming up) 
Damped (b #0) Steady state (TV set warmed up) 

Overdamped (b? > 4mk) Not resonating (b? > 2mk) 

Critically damped (b? = 4mk) Resonating (b? < 2mk) 

Underdamped (b? < 4mk Unreal resonance (b — 0) 
Real resonance (b #0) 


TABLE 5.3 Overview of spring-mass systems 


During the course of the chapter, the concepts of overdamping, critical damping, and 
underdamping will be developed. The notion of resonance, and the restrictions on the 
parameters b, m, and k that result in these different motions, will also be developed. 


Free Overdamped Motion 


We conclude this lesson with an example of free overdamped motion. Thus, we consider a 
spring-mass system with no driving term and enough damping to warrant the name over- 
damped. 


EXAMPLE 5.1 A weight of 16 Ib stretches a spring 8 in. A viscous force with damping coefficient 7 Ib/ft/s 
acts so as to oppose the motion. We will solve for the motion of the object if it is initially 
pulled down 3 in from equilibrium and released. 

The spring constant is determined first as 


16lb 161b 
k = —— = = 24 lb/ft 
8 in Š ft 
The spring constant was computed in Ib/ft because we next use g = 32 ft/s? in determining 
the mass. In English units, weight is a force, and mass is given by m = * = 35 = 5 slug. 


The use of g = 32 ft/s? determines the units for the problem. Distances now have to be in 
feet and time must be in seconds. The resulting IVP is 


0.25 iy' +7y’+24y=0 or y"414y' 4-48y =0 


and the associated initial conditions are y(0) — E = , and y'(0) = 0. The solution of this 
>; initial value problem, y(t) = e7*' — 2e7*', is graphed in Figure 5.3, revealing that the initial 
displacement gradually diminishes with no oscillations ever taking place. This motion is | 
FIGURE 5.3. Overdamped motion therefore described as “overdamped” since there is sufficient damping for no vibrations to 
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occur. This behavior is consistent with the negative exponentials comprising the solution. 
The reason for a solution with this structure is revealed later in the chapter where solution 
techniques are examined. E 


EXERCISES 5.2-Part A 


Al. Which of the following equations are linear and which are 
nonlinear? 


(a) y" + ey" — 5y' - fy — sint 


(b) y" + Syy” — 5y' + ty’ -8y 20 
a ay nt . H 9 

(c — +y sint —2y"+ y° =3 
att 


A2. Which of the equations in Exercise Al are homogeneous and 


which are nonhomogeneous? 


A3. 
A4. 


AS. 


A6. 


What is the order of each of the equations in Exercise A1? 


A weight of 3 Ib stretches a spring 11 in. What is the spring 
constant in (a) pounds per inch; (b) in pounds per foot? 
Mechanical work is defined by the integral ft f dx, where f isa 
force. Calculate the work done (in foot-pounds) when the spring in 
Exercise A4 is stretched from its natural length to 9 in beyond its 
natural (unstretched) length. 

A mass of i slugs stretches a 5-in spring to 13 in. Calculate the 
spring constant in pounds per inch. 


EXERCISES 5.2-Part B 


B1. A spring hangs from the ceiling at point A. A 4-Ib weight stretches — B2. 
the spring to point B in such a way that the length AB is i ft 
greater than the natural length of the spring. If the weight is further 
drawn to a position 5 in below B and released, find its velocity (if 
we neglect air resistance) as it passes the position B. (Formulate 
the initial value problem, solve using a computer algebra system, 


plot the solution, and answer the question posed.) 


For the system in Exercise B1, what is the acceleration of the 
weight when it reaches its maximum height above B? 


B3. On the same set of axes, plot the position, velocity, and 
acceleration as functions of time for two cycles of the oscillation. 


Label each curve and the axes. 


/. Overview of the Solution Process 


Introduction 


The initial value problem y" + 14y' J- 48y = 0, y(0) = L, y'(0) = 0, posed in Section 5.2, 


has solution y(t) = e-9 — 3&8 


a ‘a sum of exponential terms. The form of this solution 
suggests a technique of "guessing at an exponential" as the solution. We will refer to this 
educated guess as the exponential guess technique, formalized by assuming, for the second- 
order, linear, homogeneous differential equation with constant coefficients, a solution of the 
form y(t) = e". That such a guess is justified leads to the only possible solution and solves 
all such homogeneous linear equations with constant coefficients is the subject of this section 


and the next. 


First-Order Motivation for Exponential Guess 


The exponential guess is not a wild guess. There is good reason for suspecting this might be 
the form of the solution, as our experience with the first-order linear differential equation 
shows. Consider, for example, the equation 2y' + 3y = 0 whose solution is y(t) = Ce-?^, 
an obvious exponential, obtainable via the technique of separation of variables. 
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The Characteristic Equation 


To carry out the exponential guess, substitute y(t) = e^ into the differential equation y" + 
14y' + 48y = 0, obtaining 
we + 14Xe + 48e" = e" (A? + 14x + 48) «0 
Since e" Æ 0, we obtain the characteristic equation 
+ 14. +48 = (4 +6)(A +8) 20 


Thus, the exponential guess leads to the characteristic equation, a polynomial whose coef- 
ficients turn out to match those of the original differential equation. 


The Characteristic Roots 


The roots of the characteristic equation are called the characteristic roots. Here, these roots 
are A = —8, —6. For each characteristic root we have a possible solution to the differen- 
tial equation. The second-order differential equation gives rise to a quadratic characteristic 
equation having two characteristic roots. Hence, there are two possible solutions to the dif- 
ferential equation; and these two possible solutions, as a pair, are said to form a fundamental 
set of solutions. 


The Fundamental Set 


The set of solutions arising from the exponential guess is called a fundamental set. For this 
example, the set containing the two solutions y; = e^?' and y; = e^*', namely, (e^?', e79'), 
is the fundamental set. Typically, the fundamental set for an nth-order linear differential 
equation contains z distinct solutions. (We will have more to say about this notion of 
distinctness later.) 


General Solution 
Having obtained a fundamental set of solutions, form 


Ya = Ae 8 + Be“ 


the most general linear combination (linear sum) of its members. This sum is called the 
general solution because it contains all possible specific solutions within the two-parameter 
family it represents. For each specification of the constants A and B, the general solution 
reduces to a specific solution. 

In general, the nth-order linear ODE with constant coefficients will have an nth-order 
polynomial equation as its characteristic equation and will therefore have n characteristic 
roots. A fundamental set for such an equation will therefore have n members, and the general 
solution will consist of a linear combination of these n solutions. Thus, the general solution 
of the nth-order linear ODE with constant coefficients has n arbitrary constants. 


Application of Initial Data 


To find that specific solution of the ODE that satisfies the initial conditions, apply the initial 
data. This then generates two equations in the two unknowns A and B, namely, 


A+B=j and —8A—6B-0 


whose solution is A = —3, B = 1. Hence, the solution of the IVP is y(t) = e7“ — že 
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EXAMPLE 5.2 


Interpretation of the Solution 


The graph of this solution appeared in Figure 5.3 of the previous section where the motion 
described by the IVP was called overdamped. There are no oscillations for this damped 
spring-mass system. The mass moves in a resistive enough medium that the initial displace- 
ment is damped out without any oscillations taking place. 

As we reflect on the nature of this solution and its relation to the physical system that it 
models, we are led to ask: “Why can we guess at a solution and not look for other possible 
solutions?” The answer lies in the following existence and uniqueness theorem. 


Existence and Uniqueness Theorem 


We will rely on the following existence and uniqueness theorem to justify the exponential 
guess. If there is but one solution to the initial value problem, then it makes little difference 
how we were led to it. No matter how we obtained it, it is the only one, and all "other" 
solutions must be equivalent to the one we found. 


THEOREM 5.1 


The solution to the Initial Value Problem (IVP) 
YOtPoOyOrq@yO=f0 ya)=a yeas 


exists and is unique in a closed interval containing t = a provided p(t), q(t), and 
f (t) are continuous in that interval. 


For a proof of this theorem, see [80, p. 725] or [14, p. 409]. See also Exercise B8 for a 
proof of uniqueness. 


The differential equation 
ty" —3ty’+3y = 12 (5.2) 
along with the initial conditions 
y(0)=4 and y'(0)—5 


forms an IVP for which the solution is y(t) = 4 + 5t + C^, where C is any constant. 
The solution is not unique since both the differential equation and the initial conditions are 
satisfied for any value of the constant C. Thus, there are multiple solutions possible for this 
IVP. To see why the solution is not unique, scrutinize the hypotheses of Theorem 5.1. 

The standard form of the differential equation hypothesized in the existence and unique- 
ness theorem has leading coefficient 1. If (5.2) is divided by ??, we have 
tm E. 

t t? t? 
from which we see that none of p(t) = —2, q(t) = 3t, f(t) = 12t~? are continuous 
in any neighborhood of t = 0. The differential equation does not satisfy the hypotheses of 
the theorem, and the solution is not unique. Moreover, if the initial condition were changed 
to y(0) = a Æ 4, there would be no solution, since at t = 0, the general solution of the 
differential equation, namely, y(t) = 4 + ct + Ct’, can satisfy only the initial condition 
y(0) = 4. Consequently, without the guarantee provided by the existence and uniqueness 
theorem, an initial value problem can have many solutions or no solution at all. $ 


y 
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Additional Comments on Linear Combinations 
of “Distinct” Solutions 


Given the set of functions (e! , sin(t), t°}, a linear combination is the linear sum 
ae’ + bsin(t) + c? 


The word linear is a mathematical term denoting the two properties hiding in 2x — 3y = 0, 
the equation of a straight line through the origin. In the equation of the line, the variables 
are multiplied by constants and joined by addition or subtraction. That structure typifies the 
linear form. Writing that line as y = 3x, we are led to examine the function f(t) = 3r, 
which then has the algebraic property | i 


f(ax by) = 3(ax + by) = asx + biy = af (x) ^- bf(y) 


A function describing a line through the origin then has the algebraic property of linearity, 
namely, 


f (ax + by) —- af (x) - bf (y) 


The function “goes past constants” and “acts separately on summands.” 

As a consequence, the derivative operator and the integral operator of elementary 
calculus are called linear operators, since they both treat constants and summands just the 
way the linear function does. The action of the linear function "goes past" the addition in 
ax + by and “passes through" the scalar multiplications by a and b. Differentiation and 
integration treat the expression au(x) + bv(x) the same way, yielding au'(x) + bv'(x) and 
a f udx +b f v dx, respectively. 

Consequently, a sum of the functions u(t) and v(t) in the form f = au(t) + bv(t) 
inherits the name linear combination because of the way constants and additions are em- 
ployed. 

The notion of the “distinctness” of the solutions found by the exponential guess is a 
“linear distinctness." We want the members of the fundamental set to be “different and 
distinct” but need to give a meaning to “differentness.” The meaning given is “distinct in 
a linear sort of way." By this it is meant that no linear combination of the members of the 
fundamental set can add to zero for all ¢ in an interval J (except if all the coefficients were 
taken as zero). If such a (nonzero) linear combination existed, then one member would be 
expressible, in a linear way, in terms of the others, and the members of the set would not 
be "linearly distinct." 

For example, if 


aU (t) + bV (t) -- cW(t) =0 


has, for all ¢ in an interval 7, a solution in which the three constants a, b, c are not all 
zero, then one of the functions U (t), V(t), W(t) can be isolated in terms of the other two. 
Suppose, for example, that at least a Æ 0, so that 


b c 
U(t) = ——V(t) — —W(t) 
a a 


Since U (t) is thereby expressed in “a linear way" in terms of V (t) and W(t), we would 
judge these three functions as not being linearly distinct on the interval /. 

Alternatively, consider the linear combination a cos x + b sin x, which can only vanish 
identically in x if a = b = 0. We then declare cos x and sin x to be linearly independent 
for all x, even though cos x and sin x are functionally related by cos(x — >) = sin x. 


Additional discussion of the notion of “linear distinctness” or “linear independence” 
can be found in Section 5.4. 
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Superposition Statements 


A major engineering principle is that linear systems allow superposition. Linear systems, 
in a sense, behave like linear operators, namely, they “map across sums and differences, 
and through scalar multiplication.” There are two mathematical reflections of this idea: one 
for homogeneous differential equations, stated next, and one for nonhomogeneous differ- 
ential equations, appearing in Section 5.10. The statement for homogeneous equations is 
important mathematically, while the statement for nonhomogeneous equations is important 
scientifically. 


SUPERPOSITION FOR HoMoGENEOUs Equations Superposition for the homogeneous 
differential equation can be expressed by the statement 


a linear combination of solutions of a homogeneous linear differential equation is 
again itself a solution. 


For the differential equation y" + 14y' + 48y = 0 solved previously, we found two 
different solutions, y; = e7% and y; = e~®. Then any linear combination of the form 
z(t) = ay; + by; = ae™™ + be is itself again a solution of the differential equation. In 
fact, this most general linear combination is called the general solution yg. Thus, for the 
homogeneous linear differential equation, any linear combination of solutions is itself a 


solution. 


EXERCISES 5.3—Part A 


A1. Use separation of variables to solve the first-order linear ODE 
Ty! + Sy = 0. An exponential solution should result. 


A2. Apply the exponential guess to the ODE in Exercise Al. Thus, 
substitute y(t) = e^ into the DE and show that à must be the 
very same number found by separation of variables. 


A3. Show that the ODE y" + 10y' + 29y = 0 is satisfied by both 
yi =e sin2t and y; = e^? cos 2t. Then show that u = ay; + 
by, = e^ (asin 2t + b cos2t) is also a solution of the ODE. This 
demonstrates the superposition principle, whereby the sum of 


solutions is again a solution for linear ODEs. 
A4. Repeat Exercise A3 for the ODE 1? y" — 9ty' + 21y = 0, which 
has a fundamental set consisting of the two solutions f° and f”. 
AS. Suppose u(t) and v(t) are solutions of the homogeneous DE 
y" + p(t)y’ + q(t)y = 0. Show that the linear combination w = 
au(t) + bv(t) is also a solution. Thus, a general verification of 
superposition for homogeneous equations is given. 


A6. Suppose u(t) and v(t) are solutions of 
y" + p(t)y’ + q(t)y = f(t). Show that the linear combination 


EXERCISES 5.3-Part B 


w = au(t) + bv(t),a +b £1, is not a solution of the 
nonhomogeneous DE. Thus, care must be taken with the term 
superposition. In the form stated in this section, it properly 
applies only to homogeneous DEs. 


For each of Exercises A7-10: 
(a) Apply the exponential guess to obtain the characteristic 
equation. 


(b) Solve the characteristic equation to obtain the characteristic 
roots. 


(c) Form a fundamental set. 


(d) Form the most general linear combination of members of the 
fundamental set, thereby obtaining the general solution of the 
given differential equation. 


A7. y" -9y' --20y 20 A8. y" - Ay' -3y 0 
A9. y," —5y'-6y 20 A10. 15y" -31y' 4-14y 20 


B1. Use the exponential guess to obtain the characteristic equation and 
roots, a fundamental set, and the general solution for 70y 
79y” — 63y' + 36y = 0. Solving the characteristic equation, which 
is a cubic, should be done with appropriate technology. 


n 


B2. From first principles (the exponential guess), solve the IVP 
y" + Ty’ + 12y = 0, y(0) = —2, y'(0) = 1. Include the following 
steps in your solution. 


B3. 


B4. 


(a) Obtain the characteristic equation and roots, a fundamental set, 
and the general solution as a linear combination of the 
members of the fundamental set. 


(b) Apply the initial data to the general solution to obtain the 
solution of the given IVP. 


(c) Solve the IVP with a computer algebra system. 


(d) Plot the solution and calculate the positive time at which y(t) 
has the value —1. 


Repeat steps (a)-(c) of Exercise B2 for the IVP y" + 11y' 4- 

30y = 0, y(0) = 0, y'(0) = 2. In part (d), calculate the maximum 
value attained by y(t) and the time at which this maximum is 
attained. 

A spring-mass system is governed by the IVP 3y” + by’ + 5y = 0, 
y(0) = 1, y/(0) = 0. Either analytically or empirically, determine 
that value of the damping coefficient b > 0 above which the 
motion is overdamped. Hint: Obtain the characteristic roots in 
terms of b. What is the smallest value of b for which the 
characteristic roots are real? 
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B5. 


B6. 


B7. 


B8. 


A spring-mass system is governed by the IVP 3y” + Sy’ + ky = 0, 
»(0) = 1, y'(0) = 0. Either analytically or empirically, determine 
that value of the spring constant k > 0 below which the motion is 
overdamped. 

A spring-mass system is governed by the IVP my" +5y’+7y — 0, 
y(0) = 1, y'(0) = 0. Either analytically or empirically, determine 
that value of the mass m > 0 below which the motion is 
overdamped. 

Solve the IVP y" + 3y' -- 2y = 0, y(0) = 1, y'(0) = 3, and plot its 
solution. The solution, a sum of exponentials with negative powers, 
represents the motion of an overdamped system. Is it true that such 
motions always decay to zero monotonically? 


The IVP in Theorem 5.1 is called completely homogeneous if 
f(t) =a = B = 0. Assume that the only solution of the 
completely homogeneous IVP is y(t) = 0. If u(t) and v(t) are two 
solutions of the nonhomogeneous IVP, show that u — v is a 
solution of the completely homogeneous IVP and, therefore, the 
zero solution. Hence, conclude the solution of the 
nonhomogeneous IVP is unique. 


‘Linear Dependence and Independence 


Linear Dependence 


As we saw in Section 5.3, the set of functions {u(t), v(t), w(t)} is linearly dependent on 
an interval / if one is a linear combination (sum) of the others over that interval. Linearly 
dependent functions are not distinct in a linear sense. One function can be expressed in 
terms of the others using a linear expression. 

The set (sin f, In t, In t?) is linearly dependent for t > 0. Fort > 0, the function In /? is 
just 2 In t, so one of the functions can be expressed in terms of the others. As a consequence, 
there is a nontrivial linear combination of the three functions that adds up to zero. In fact, 
that linear combination has coefficients, not all zero, a = 0, b = 1, c = i and 


asint - blnt - clnt? = 0sint - Int — t Int? = lnt — lnt =0 
2 


The Wronskian 


The Wronskian of the functions (u(t), v(t), w(t)} is the determinant (see Section 12.4) of 
the matrix 


and its utility lies in the theorem 
Linear Dependence on J = Wronskian = 0 for all t in J (5.3) 


Thus, functions that are linearly dependent on 7 will have a zero Wronskian on J, a con- 
clusion easily reached by the following reasoning. 

If the three functions u(t), v(t), w(t) are linearly dependent on 7, then there is a linear 
combination that is identically zero as an identity in t. Thus, that linear combination, and 
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EXAMPLE 5.3 


EXAMPLE 5.4 


its first two derivatives, will all be zero on the interval 7; and we have three equations in 
three unknowns to use for determining the coefficients 
au(t) + bv(t) + cw(t) =0 
au' (t) + bv'(t) + cw'(t) 20 
au (t) + bv" (t) + cw" (t) 20 
This is a homogeneous set of three equations in the three unknowns a, b, and c; in particular. 


we know that at least one of these constants is nonzero. In matrix terms, we have the 
homogeneous equations Ax = 0 


u w a 0 
u v w b|21l0 
u n v" w” c 0 


Since x Æ 0, the determinant of A must be zero. (See Exercise A7, or Theorem 12.1, Section 
12.6.) But the determinant of A is just the Wronskian. 


Linear Independence 


The negation of linear dependence is linear independence. Functions that are linearly 
independent are distinct in a linear sense. No linear combination adds up to zero except 
by taking all the constants zero. The set {f, t°} is linearly independent on any interval 7 
because the only linear combination that equals zero for all t in Z is the one for which all 
the coefficients are zero. Thus, at + bt? = 0, as an identity in f, can only be satisfied if 
a=b=0. 

The set (sint, cost} is linearly independent on any interval / because there is no 
nontrivial linear combination that equals zero. As an identity in f, a sint + b cost = 0 can 
only be satisfied if a = b = 0. However, for t > 0, the set (In ż, In /?) is linearly dependent 
because a nontrivial linear combination does equal zero. In fact, there are many solutions 
satisfying the identity alnt + bInt* = 0, namely, a = —2b because Int? = 2n: for 
t>0. 

The contrapositive of the statement “A = B" is the equally valid statement “not B => 
not A.” For example, the statement “If a ball is to be used in a pro baseball game, then it 
must be white” is equivalent to “A ball that is not white cannot be used in a pro baseball 
game.” 

The contrapositive of (5.3) is the equivalent statement “Wronskian Æ 0 for at least one 
t in an interval / = Linear Independence on the interval 7.” 


Prior calculations convinced us that cos ¢ and sin ¢ are linearly independent on any interval 
I. Their Wronskian is the determinant of 


cost sint 

—sint cost 
which is 1. Since the Wronskian is not zero, the functions are not linearly dependent, that 
is, they are linearly independent. 


We have already convinced ourselves that (t, t?) is a linearly independent set on any interval 
I. The Wronskian is the determinant of 


EXAMPLE 5.5 
y 
Á 
fi aii 
t ail I x 
-1 : 1 
fh aA 


FIGURE 5.4  Linearly independent 
functions whose Wronskian is zero 
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which is f?. In any interval, even one that includes the origin, there is at least one t for which 
the Wronskian is not zero. Hence, the set is linearly independent on any interval 7. e 


Caution The two statements “Linear Dependence on J = Wronskian = 0 on 7” and 
“Wronskian Æ 0 for at least one t in J = Linear Independence on 7” are equivalent. The 
converse of the first statement, namely, “Wronskian = 0 on J = Linear Dependence on 7” 
is neither logically equivalent to either of the given (true) statements, nor mathematically 
true. It’s a false statement. 


The functions 


"ue i ? ift>0 
=f and = j apa 
fi f [i ift «0 
are linearly independent on any (open) interval containing zero, but their Wronskian is zero 
in every interval. Figure 5.4 showing fı as the solid curve and fù as the dotted, suggests 


that indeed the functions are linearly independent. The derivative 


, 0] 2t if1z0 
h= —2t ift<0 


lets us calculate the Wronskian fı f; — f, f» as zero. The Wronskian is zero on any interval 
. . . . os H . q . >, 
but the functions are linearly independent on an interval containing zero in its interior. %* 


In summary, the theorem (5.3) is equivalent to the contrapositive, “If the Wronskian 
is not zero for at least one ¢ in the interval /, then the functions are linearly independent 
on the interval 7." The converse, “If the functions are linearly independent on /, then the 
Wronskian is not zero on J,” is a false statement. 


A1. Verify that (172, 172), t > 0, is a fundamental set (i.e., each 
member is a solution, and the set is linearly independent) for the 
differential equation 1? y" + 6ty' + 6y = 0. 


AS. Write a second-order linear, homogeneous differential equation 
with constant coefficients for which (e^, e?) is a fundamental set. 


A6. Write a third-order linear, homogeneous differential equation with 


A2. 


A3. 


A4. 


Verify that (217? — 51, 5t? + 217?) is also a fundamental set for 
the differential equation in Exercise A1. 

Verify that {e~', e~'} is a fundamental set for the differential 
equation y" + 3y' + 2y = 0. 

Verify that (5e^' — 7e^?', 4e! + 3e^?') is also a fundamental set 
for the differential equation in Exercise A3. 


EXERCISES 5.4—Part B 


AT. 


constant coefficients for which (e?', e~*’, e^) is a fundamental set. 
LetA —[2' 29], and x = (5), x # 0. If Ax = 0, show ay, = 


a>, = 0, and hence det(A) = 0. 


B1. Answer true or false, and give a reason: The fundamental set for a 


linear ODE is unique. 


For the functions given in Exercises B2—4, establish linear independence 
on the interval (0, 1) by 


(a) Showing that a general linear combination of the functions, 
set equal to zero, forces the coefficients to be zero. 


(b) Showing the Wronskian (simplified) is not zero. 


B2. {te' sint, te’ cost, t7e"} 


B3. {e*,e%} B4. (e^9', e7", e?) 


B5. Solve the IVP y" + 3y' + 2y = 0, y(0) = —3, y'(0) = —1. 


B6. 


Follow steps (a)-(d) spelled out in Exercise B2, Section 5.3. For 
part (d), determine the minimum value attained by y and the time 
at which this minimum is reached. 

Solve the IVP y" + 4y = 0, y(0) = 1, y'(0) = 1, by seeking a 
solution of the form y(t) = A cos(wt — $). The constant A > 0 is 
the amplitude of the motion, and the constant ¢, —7 < $ < 7, is 
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B7. 


B8. 


B9. 


B10. 
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the phase angle. These two parameters are determined by the 
initial conditions. The angular frequency œ > Q is determined by 
making the trial solution fit the ODE. Plot the solution and on it 
indicate which feature represents the amplitude A, which feature 
represents the angular frequency w, and which feature represents 
the phase angle ¢. 

If {u(t), v(t)} is known to be a fundamental set for a second-order 
linear ODE, what condition must a, b, c, d satisfy if {au + bv, 

cu + dv} is also to be a fundamental set for the same equation? 


Let u(x) and v(x) be differentiable on the interval 7, and let W be 


their Wronskian. Show that “ = uv” — vu". 


dx 

Let p(x) and q(x) be continuous on the interval 7, and let u(x) 
and v(x) be solutions of y" + p(x)y' + q(x)y = 00n 7. If a is 
the DE satisfied by u and f is the DE satisfied by v, obtain 

uf — va and show, using Exercise B8, that it is equivalent to 

e + p(x)W = 0, where W is the Wronskian of u and v. Show 
that W = ce- / ?9)4* (called Abel's formula), where c is a 
constant. Hence, the Wronskian for solutions of the second-order 
linear ODE y" + p(x)y' + q(x)y = 0 is either zero or nonzero. If 
it is zero at a single point in 7, it is identically zero on J. If it is 
nonzero at a single point in 7, it is nonzero on 7. 


Use the results in Exercise B9 to make a statement about the 
linear dependence or independence of two solutions of the 
second-order linear ODE in Exercise B9. 


Use of the Wronskian for showing the linear independence of functions 
requires that the functions be sufficiently differentiable for the Wronskian 
to exist. Alternatively, the continuous functions f(x), k =1,..., n, 


are linearly dependent on J = [a, b] if the Grammian, the determinant of 
the matrix a;; = [i fi GO f; (x) dx, is zero, and linearly independent if it 
is nonzero. In Exercises B11—13, use the Grammian to establish, on the 
interval / — [0, 1], the linear dependence or independence of the given 
functions. 


B11. 
B12. 
B13. 
B14. 


B15. 


B16. 


B17. 


The functions in Exercise B2 
The functions in Exercise B3 
The functions in Exercise B4 


Use a computer algebra system and brute force computation to 
show that Abel’s formula in Exercise B9 generalizes to the linear 
third-order ODE. 


a(x) a(x) a(x) 
Let w(x) be the determinant |5i(x) bz) ba(x)| and show that 
al) aoa) clx) 
, a dj ay a4 dj @ a @ a 
dja ds atẹ b D + |b) b bs. Hint: Expand 
! O a G Cc) a G a & & 


w by the first row, then differentiate. 


Let W be the Wronskian of the differentiable functions 
u(x), v(x), w(x). Using the result in Exercise B15, show that 


u vU w 


aw 
dx — 


Suppose the functions u(x), v(x), w(x) in Exercise B16 are 
solutions of y" + py” + qy' +ry = 0. Use the result in Exercise 
B16 to establish that £ = — pW. Hence, it is possible to 


establish Abel’s formula for the linear third-order ODE without 
the computational intensity experienced in Exercise B14. 


Free Undamped Motion 


The Harmonic Oscillator 


Consider the spring-mass system whose motion is governed by the IVP y" + 16y = 0, 
y(0) 2 —1, y'(0) = I. This is a system in which viscous damping has been neglected. 
Initially, the mass is pulled down, tossed upward, and subsequently moves according to 
the solution y(t) = isin 4t — cos 4t, graphed in Figure 5.5. Observe the trigonometric 
functions comprising the solution and the periodic motion shown in Figure 5.5. The solu- 


= 


FIGURE 5.5 


il 


y 


tion is purely oscillatory, a motion described in physics as harmonic motion. Indeed, our 
system is an example of a harmonic oscillator, a spring-mass system without damping. But 


what happened to the exponential guess and uniqueness? How can exponentials yield the 
oscillatory behavior this solution exhibits? 


Solutions of the IVP 
l6y = 0, y(0) = —1, y'(00 21 


The Scientists’ Solution 


Because this harmonic oscillator does not seem to follow the pattern of the exponential 
guess, scientists often make the alternative guess 


y(t) = Acos ot + B sin ot 
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one involving just trigonometric functions. Substitution into the differential equation gives 
16(A cos wt + B sin æt) — w (A cos ot + B sin ot) = (16 — o?)y(t) 20 


Ruling out the trivial solution y(t) = 0, we have no other choice but to take w = +4. Be- 
cause cos f is an even function, that is, cos(—t) = cost, and sin: is an odd function, that 
is, sin(—t) = —sinf, we need only make use of one of these values of œw. (The func- 
tions (cos(-Eot), sin(+wt)} are linearly dependent, whereas the functions (cos œt, sin wt} 
are linearly independent.) The constants A and B in the resulting general solution y; = 
A cos 4t 4- B sin 4t are determined by the initial conditions to be A — —1 and B — —i, thus 
re-creating the solution stated previously. However, we still do not know why no exponential 
solution appeared, but we do know that {cos 4t, sin 4t} must be a fundamental set. 


Solution by the Exponential Guess 


Both curious and determined, we plunge ahead with the exponential guess, y(t) = e^, 
obtaining A?e^ + 16e^' = 0. The characteristic equation is A? + 16 = 0, so the character- 
istic roots are à = +4i, and a fundamental set consists of the two imaginary exponentials 
{et g "n, 

Not only do we have to deal with multiple fundamental sets, we also have to deal 
with imaginary exponentials that are not the most obvious objects for students with just 
a background in Calculus. There must be some connection between these imaginary ex- 
ponentials and the trigonometric functions that appeared in the earlier solutions, and there 
must be some connection between the two fundamental sets if the uniqueness theorem is to 
be believed. 


Euler’s Formulas 


The link between imaginary exponentials and trigonometric functions is expressed via 
Euler's formulas, the two identities in the leftmost column of Table 5.4. A proof, based on 
Taylor expansions, is deferred to the exercises. However, we observe that one-half the sum, 
and E times the difference, isolates cos@ and sin 6, respectively, as listed in the middle 
column of Table 5.4. This middle column therefore defines the trigonometric functions cos 0 
and sin 0 in terms of imaginary exponentials. The rightmost column of Table 5.4 lists the 
definitions of the hyperbolic functions, which are given in terms of real exponentials. 


Euler's Formulas Trigonometric Functions Hyperbolic Functions 
2. gl? pete e* e 
e'* =cos@ + isin cos@ = —= coshx = = ~ 
ei? —g i8 e = e* 
e'’ =cos@ —isin@ sin@ = ———— sinh x = 
2i 2 


TABLE 5.4 — Euler's formulas, trigonometric and hyperbolic functions 


New Fundamental Sets from Old 


Given the fundamental set (e**, e~*"} form a new and equivalent fundamental set by taking 
two different linear combinations of its members. The justification for taking linear combi- 
nations of solutions is the Superposition Principle for homogeneous equations from Section 
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5.3, where we saw that linear combinations of solutions of the homogeneous equation are 
again solutions of the homogeneous equation. 
The following linear combinations of the imaginary exponentials, by virtue of Euler’s 
formulas, are “real” trigonometric functions 
i efit E le fit = 1 (ett! 3E er) = cos 4t 
Tos ] ls 
Ait —4it Ait —4it š 

—e™ — —e = —(e™ —e™") = sin 4t 

2i 2i 2i 
But more important, they are guaranteed to be solutions by virtue of the Superposition Prin- 
ciple. So, instead of using the fundamental set (e*, e^, use the equivalent fundamental 
set {cos 4t, sin 4t) and write the general solution as yg = A cos 4t + B sin 4t. 


Yet Another Form 


It is common in engineering to cast the solution y(t) = — cos 4t + i sin 4t into the form 
y(t) = acos(4t — $), where a is the amplitude of the motion and ¢ is the phase angle. 
The amplitude is the maximum height reached by the oscillator, and the phase angle is the 
amount by which the graph of cos 4t is translated to the right. The equivalence is established 
by writing A cos 4t + B sin 4t as 


A 
V A? + B? | cos(4t) ——— 
(: id A? + B? 


based on the trigonometric formula 


+ sin(4t) ) = acos(4t — ¢) 


B 
vV A? + B? 


cos(x) cos(y) + sin(x) sin(y) = cos(x — y) 


and the identifications 


a=v A? + B? cos(ġ) = a sin($) = F 


A? + B? 
Amplitude: a . , B . " "T" 
TN It is tempting to declare @ = arctan 7, but since the range of the arctangent function is 
Period: T = — (—5, >), the temptation must be avoided. The phase angle ó lies in the interval (—z, zr], 
à; i so we must consider the signs of both cos $ and sin $. 
w 
Frequency: We For the problem at hand, we find a — x and $ = x — arctan i 
Angular (circular) x 
frequency: m Terminology for a cos(wt-ġ) 
Putting the harmonic oscillator's solution into the form y(t) = a cos(4t — $) allows an easy 
TABLE 5.5 Engineering parameters for detection of the engineering parameters listed in Table 5.5. However, the reader is cautioned 
harmonic oscillator that some texts use the term frequency where they should use angular frequency. 


EXERCISES 5.5-Part A 


A1. Using Euler's formulas and taking linear combinations, convert A3. Verify that both members of {cos 3t, sin 3t} are solutions of 
the fundamental set {e*”’, e7?') to the equivalent fundamental set y! -9y =0. 
{cos 3f, sin 3t]. Show clearly the linear combinations required to 
convert these complex exponentials to trigonometric functions. true that e3 = cos 32? 


Compute the Wronskian of the new fundamental set and show it ; L "TS i 
is s i AS. Evaluate e^" at t = Ł, Kimi. ossa 10, obtaining floating-point 


complex numbers in the form a + bi. 


A4. Evaluate e? and cos3t at t = =. Are they the same number? Is it 
8 y 


A2. Verify that both members of (e? , e~"} are solutions of 
y" -9y =0. 


A6. 


AT. 


A8. 


A9. 


State the amplitude, period, frequency, and angular frequency of 
3cos2t — 5 sin 2t. Hint: Write it as a cos(2t — $). 


The sum and difference of the complex numbers a + bi and 

c + di are defined by (a +c) + i (b + d), that is, by separately 
adding and subtracting the real and imaginary parts. Evaluate in 
floating-point form, each side of $e” + 1e? = cos2, verifying 
its validity. i 


The conjugate of the complex number z = a + bi is the complex 
number Z = a — bi. For each of the following, obtain both z + z 
and z — Z. 

(a)z=24+3i (b)z=3-—2i 

(c) —5+7i  (dz--—4-—3i 

The product of the complex numbers a 4- bi and c 4- di is defined 
as (ac — bd) 4- i(ad 4- bc). This is obtained by multiplying the 
two numbers as a product of binomials and noting that i? = —1. 
(Multiplying two complex numbers requires forming all four 
possible products with the real and imaginary parts, just like 
multiplying the two real binomials (x + o) (y + £).) Obtain the 
product of each of the following pairs of complex numbers. 


(a) z —3- 2i, Z2 =4+5i 
(b) z = —V2+iV3, z; = 142i 


Z= 


EXERCISES 5.5—Part B 


A10. 


All. 


A12. 


5.6 Free Damped Motion 


(c) zi 
(e) zi 
The reciprocal of a complex number is obtained by writing 
1 l 
a+bi a-bia—bi a+b? 
which removes the complex number from the denominator. 
Obtain the reciprocal of each of the following complex numbers. 


(a 4—5i (b)i (03-T7i 


Division by a complex number becomes multiplication by its 
reciprocal, as, for example, in 


a+ bi, z; =a — bi 


a — bi a — bi 


l+i l-i2-i 3+i 
2+i 2+i2—i 5 
Express each of the following quotients in the form a + bi. 
1 4- 2i 342i 4 — 5i 
a b c 
@ —; (b) ; © 3 


For each of the following, evaluate both the left and right sides in 
floating-point form to verify the equality. 


5 ; . l 5 mS : 
(a) >e” — —e? =sin2 (b) le^? — ec? = sin V2 
2i 2i 2i 


B1. 


B2. 


A typical verification of Euler's formulas uses series expansions of 
€", cos t, sin t. The following steps illustrate the essence of the 
verification. 


(a) Use a computer algebra system to obtain a 10-term Maclaurin 
expansion of e”. 

(b) Separate the result in part (a) into its real and imaginary parts. 

(c) Obtain Maclaurin expansions of cos t and sin f. 

(d) Show that the expansion in part (c) match the expansions 
representing the real and imaginary parts of e". 

Solve the IVP y" + 4y = 0, y(0) = —2, y'(0) = —1, by 

performing the following steps: 


(a) Use a computer algebra system to obtain the solution. 


Overview of Damping 


(b) Starting with an exponential guess, obtain the fundamental set 
in terms of imaginary exponentials. 

(c) Show the specific linear combinations of the imaginary 
exponentials that yield an equivalent fundamental set 
containing trigonometric functions. 

(d) Obtain the general solution in terms of the new fundamental set 
of trigonometric functions. 

(e) Apply the initial conditions to the general solution. This 
process should result in the same solution found in part (a). 

(f) Express your solution in the form A cos(wt — 4). 

(g) Plot the solution to this IVP and indicate on the graph which 
features correspond to the amplitude A, the angular frequency 
w, and the phase angle $. 


Free Damped Motion 


The linear, second-order, constant-coefficient equation governing the motion of the undriven 
(free) damped oscillator for which damping is assumed proportional to the velocity is 
my" + by! + ky = 0. The characteristic equation arising from the exponential guess y(t) = 


e* is mà? + bA + k = 0 and the characteristic roots are A = == 


xA b*—4mk 


2m 
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The nature of the roots, and hence of the solution, is determined by the discriminant, 
b? — 4mk. Consequently, there are three possible behaviors for a damped oscillator, be- 
haviors corresponding to the mathematical possibilities for the characteristic roots. These 
outcomes are collected in Table 5.6. 


Discriminant Motion Characteristic Roots 
b? > 4mk Overdamped Real, distinct 
b? = 4mk Critically damped Real, repeated 
b? < 4mk Underdamped Complex conjugates 


TABLE 5.6 Characteristic roots and the discriminant 


ExAMPLES This section develops the examples in Table 5.7, which illustrates a system 
exhibiting three distinct behaviors characterized by the amount of damping. The critically 
damped case is the boundary between underdamping and overdamping. However, some 
engineers claim that in the real world, the critically damped case does not occur since the 
parameters of a physical system cannot be established precisely enough to attain exact 
equality in the discriminant. 


Motion Equation Characteristic Roots 
Overdamped y" + 10y’+ 16y 0 À = —2, —8 
Critically damped y" + 8y' +16y=0 à = —4, —4 
Underdamped y" + 4y’ + loy =0 A= -242V3i 


TABLE 5.7 Examples of damped systems 


VARIATION WITH DaMPING The differential equation for a spring-mass system with mass 
m = 1, spring constant k = 16, and unspecified damping b is y" + by’ + 16y = 0. Dis- 
d placing the mass one unit upward and releasing it from rest so that the initial conditions are 


0 | $ 1 
ZN 2 3 — y(0) = 1, y'(0) = 0, yields the solution 
ASS 
= BNE (b Ji. /p2 — 64)e (Ch b^ —65)/24 (b — af B2 — 64)e (Cb- V b^ 69/2 


bz8 


OO S 
SB 


x 2 / b — 64 2/b — 64 
10 The surface shown in Figure 5.6 is a three-dimensional plot of the solution surface insofar as 
it depends on both ¢ and the damping coefficient b. Plane sections b = constant represent 
solutions corresponding to fixed values of b. Superimposed on the surface are the four 
0 solution curves y; (t), b = 0, 4, 8, 10. (Actually, yg(t) = limps y,(t).) In order, the curves 
FIGURE 5.6 — Solution surface y,(t) and represent undamped, underdamped, critically damped, and overdamped motions. 
solution curves corresponding to 
b e, ds B IB Overdamping 


The initial value problem y" + 10y' 4- 16y = 0, y(0) = 1, y'(0) = 0 models an overdamped 
spring-mass system in which the mass is displaced one unit upward and released from rest. 
The solution, 


y(t) = 50e? — e) 


"IGURE 5.7 Critically damped (solid) 
and overdamped (dotted) solutions 


Underdamped solution 
(solid) and its exponential envelopes 
(dotted) 


GURE 5.9 Exponential envelopes 
f "1/5 for cos 2t 
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whose graph is the rightmost curve in the surface shown in Figure 5.6, does not oscillate, the 
damping coefficient b = 10 being too large to permit them. Mathematically, this is because 
the solution is a linear combination of the two distinct exponential terms e7% and e^, 


arising from the characteristic equation A? + 10A + 16 = 0 whose roots are A = —2, —8. 


The case of critical damping in which the roots of the characteristic equation are repeated 
divides the cases of overdamped and underdamped motions. Critical damping, characterized 
by b? = 4mk, falls at the interface of the two regions wherein P? is either greater or less than 
4mk. Critical damping, representing the minimum damping that will just prevent oscillation 
from occurring, is "unstable." Small changes in the system parameters can result in either 
overdamped or underdamped motions, which are very different. 

To examine the implications of critical damping, consider the initial value problem 
y" + 8y’ + 16y = 0, y(0) = 1, y'(0) = 0 for which the exponential guess gives A? + 8A + 
16 = 0 as the characteristic equation and à = —4, —4 as the characteristic roots. If we use 
the same root twice, we will not have a fundamental set with two distinct solutions. We will 
see in Section 5.7 that an appropriate fundamental set is (e^, te^), so the solution of the 
initial value problem is y(t) = e~* + Ate. 

Figure 5.7 compares this solution (solid curve) with the overdamped solution 1 3 (4e 

781) (dotted curve) for which the damping parameter had the value b = 10. The dashed 

upper curve is the curve for overdamping, while the solid lower curve is the curve for 
critical damping. The solid curve shows the mass closer to equilibrium at any instant f. 
Truly, overdamping leads to motion that is both devoid of oscillations and also “stickier” 
than motion subjected to critical damping. 


—2t . 


The initial value problem y" +4y’+ 16y = 0, y(0) = I, y'(0) = 0 models an underdamped 
spring-mass system in which the mass is displaced one unit upward and released from rest. 
The solution, 


y(t) = e?" (cos24/3t + A sin 2/3r) 


whose graph is the solid curve in Figure 5.8, exhibits decaying oscillations, the damping 
coefficient b — 4 not being large enough to suppress them completely. This solution is a 
linear combination of the members of the fundamental set (e^?' cos 24/31, e7” sin 24/31) 
arising from the characteristic equation A? + 44 + 16 = 0 whose roots are À = —2 + 23i. 
(The details appear in the following paragraph.) Figure 5.8 also shows as dotted curves the 
exponential envelopes Ee that bound the oscillations. In general, the underdamped 
solution is a sinusoid (sine or cosine function) modulated by an exponential envelope. 
Figure 5.9, showing graphs of e^'? cos 2r and the envelopes +e~‘/°, demonstrates this 
more dramatically. 


SOLUTION BY EXPONENTIAL Guess The exponential guess for the underdamped equation 
in Table 5.7 is implemented by substituting y = e^' into the differential equation, obtaining 
the characteristic equation A? + 44 + 16 = 0, the characteristic roots 4 = —2 + 24/3i, and 
the exponential solutions 


(—242,/3i)t _ ,—2t 24BBit 


ERENT 
y =e =e “e ene 2N3it 


and 


98 Chapter 5 Second-Order Differential Equations 


In fact, the essence of the underdamped case is the appearance of complex conjugate charac- 
teristic roots and the ensuing imaginary exponentials. But, remembering Euler’s formulas, 
n-» 


we take the linear combinations “42 = e~?! cos 2,/3t and A e^? sin 24/3t to obtain 
—4 is the determinant of the matrix 


e? cos 24/3t e^? sin24/3t 
—2e 7 (cos 24/3t + /3sin24/3t)  —2e7?' (sin24/3t — V3 cos 24/31) 


The nonzero value of the Wronskian guarantees these two solutions are linearly independent, 


real solutions whose Wronskian, 24/3e 


so we can construct the general solution 


Yg = € ?' (A cos 2V3t + B sin24/3r) 


Applying the initial data to this solution leads to the two equations A = 1 and —2A + 
24/3B — 0, from which we get B — Na and 


CONVERSION TO THE FORM A cos(wt — $) 


3 


y(t) =e ? ( cos 2/3t + a sin 2/31) 


We wish to put the solution into the form 


acos(wt — $) where the angular frequency is w = 24/3. From Section 5.5 we determine 


12+ (4) = a and $ = arctan (2) = 2 


V3 


so y(t) = e7” cos(24/3t — 2). From this form of the solution, the engineering parameters 


V3 


of period (T = 255 frequency (+ = 


2/3 


2n 


), angular frequency (24/3), and phase angle 


($ = 2) are more easily discerned. 


EXERCISES 5.6—Part A 


Al. Assume each given ODE governs a damped oscillator. Compute 
the characteristic roots and determine from them the nature of the 
motion (underdamped, overdamped, critically damped) of the 
oscillator. State the period, frequency, and angular frequency for 
each underdamped system. 


(a) 3y" + 5y' -2y 20 
(c) 3y" + 6y' -3y 20 


(b) 3y" + 5y’+4y 20 


A2. Each of the following differential equations governs an 
underdamped oscillator. For each, show how to proceed from 


exponential guess to a fundamental set with complex exponentials, 


to a fundamental set with real functions, to the general solution. 
(b) 36y” + 36y' + 13y 20 
(d) 9y" + 6y' + 10y 20 


(a) y" -2y' -5y 20 
(c) 2y" -2y'-y 20 
(e) 16y" + 8y' - 17y 20 


A3. If a spring-mass system has mass M and spring constant K , can 
the damping be adjusted so the system is exactly critically 


A4. 


AS. 


damped? Answer yes or no, and give evidence! If the answer is 
"yes" give the value of b that results in critical damping. 


A 16-Ib weight suspended from a spring vibrates freely, the 
resistance being numerically equal to twice the speed (in feet per 
seconds) at any instant. If the period of the motion is 6 s, what is 
the spring constant k (in pounds per foot)? 

A damped oscillator must be built so that its motion is governed by 
the solution y = e^? (cos 4t + sin 4t). From this solution you can 
see that the motion obeys y(0) = 1, y'(0) = 1. Does this solution 
uniquely determine the system; that is, can m, b, and k be uniquely 
calculated just from the solution? Hint: my" + by' + ky = 0 => 
mì? +brA+k= 02A- EY Pom The fundamental set then 
contains eC^*v^ -4mE)/2m* Now, if you understand how the 
exponentials lead to the solution y(t), you should be able to trace a 
path from the —3 and the 4 in y(t) to the m, b, and k in the 
members of the fundamental set. 
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CVEDCICEC E G 
B1. A mass of m slugs is suspended from a spring whose constant is 8 (e) Exhibit your solution and graph it. 
Ib/ft. The motion of the mass is subject to a resistance (pounds) (f) Solve the IVP using a computer algebra system, making sure 
numerically equal to four times the speed (in feet per seconds). If the two solutions agree. 


the motion is to have a period of 4 s, what must the mass be? It turns 
out there are two values of m that work. Find both as floating point 
numbers. Their symbolic representation is messy. If you compute 
only one positive value for the mass, you need to re-examine your 
treatment of any square roots appearing in your solution. 


The IVPs in Exercises B2-6 govern underdamped oscillators. For each: 


(a) Start with the exponential guess, and find the characteristic 


equation and its roots. 


(g) Put the solution to this IVP into the form Ae” cos(ct — $), 
stating clearly the values of the period, frequency, angular 
frequency, and phase angle. 

(h) On the same set of axes plot the solution and the enveloping 
curves Ae", — Ae". 

(i) Find the time that must elapse for Ae"', the amplitude of the 
displacement y(t), to remain less than 0.1. 


B2. y" +2y’ +5y 20, y(0) = 2, y'(0) 23 


(b) Write the fundamental solutions as complex exponentials and B3. y" 4-8y/ + 25 20, y(0) = —3, y' (0) 21 


show how to convert these to equivalent solutions given in 


terms of trig functions. 


(c) Write the general solution from the new fundamental set. 


(d) Apply the initial data by forming and solving two equations in 


two unknowns. 


B4. y" + 8y' - 41y 20, yO) = 5, y'(0) = —4 
B5. y" + 10y' -41y 20, y(0) = —2, (005 
B6. 9y” + 12y + 85y = 0, y(0) = 3, y'(0) = —5 


Reduction of Order and Higher Order Equations 


Reduction of order is a general technique for finding a second solution of a linear ODE 
when a first solution is known. We will use it to determine why, in the repeated root case of 
critical damping, the second solution is te^. Note, however, that the method is used to find 
a second solution from a first solution in settings other than critical damping. In fact, the 
essence of the technique was seen in Section 3.5 where the variation of parameters concept 
was first explored for linear, first-order equations. Moreover, this same idea will shortly 
surface as the formal Variation of Parameters method in Section 5.9. 
We use the following example to illustrate the reduction of order technique. 


Obtain the general solution to the differential equation y" + 8y' + 16y = 0, the differential 
equation of critical damping from Section 5.6. The characteristic equation A? -- 84 -- 16 = 0 
has the repeated roots A = —4, —4, giving us the exponential solution y; = e~“. To find a 
second distinct solution we try 

y» = u(t)y1(t) = u(t)e ^ 
a product of the known solution with the unknown function u(t) as a coefficient. This is 
the essence of the technique, looking for a second solution as the product of an unknown 
function with a known solution. Substitution of y» into the differential equation leads to 


(ue-*)" + 8(ue~*)’ + 16ue7^* —0 


a differential equation for the unknown function u(t). Simplifying this differential equation 
to u"e-^ = 0 gives u(t) = a + bt, since the exponential factor is not zero. 

Constructing the general solution as y; = Ae + B(a + bt)e ^ is worth a moment’s 
thought. In the presence of Ae ^. the term Bae ^ is redundant, so u(t) need only have 
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EXAMPLE 5.7 


EXAMPLE 5.8 


EXAMPLE 5.9 


been taken as u(t) = te~*’. The general solution is the more efficient 


y, = Ae ^ + Bte ^ = (A+ Br)e* 


e 
75 


and the fundamental set is best simplified to {e~*, te~*}. e 
For the general second-order linear equation 

y" + p(y' +q(t)y =0 (5.4) 
with one solution y; (1), a second trial solution of the form y» = u(t); leads to 

u(y, + py; tay) t u^yy - u/(2yj + pyi) = 0 (5.5) 
Since y; is a solution of (5.4), the first term on the left in (5.5) is zero, leaving 

u^yi tu’ (2y;, + py1) = 0 
to determine u(r). Setting u’ = v, this equation becomes 

v'yi + v(2y;, + pyi) = 0 (5.6) 


an equation of order one less than that of the original equation. Hence, the name, reduction 
of order. (Note that (5.6) is a first-order linear equation that can be solved by the methods 
of Sections 3.4 and 3.5.) $ 


Higher Order Equations 


Reduction of order applies to higher order equations, and the following five examples show 
both the technique and the solution of higher order linear equations. 


Solve the initial value problem y” — 4y” + y' + 6y = 0, y(0) = 1, y'(0) = —2, y"(0) = 8. 
(Notice that for the third-order differential equation there are three initial conditions.) 
The exponential guess y = &^' leads to the characteristic equation 
3-43 4+446= A-A-A 20 


whose roots are, clearly, 4 = 2, 3, — 1. The fundamental set is therefore (e?' , e°, e7') and 
its Wronskian, 12e*', is the determinant of the matrix 


? = 
e el et 

2 x 
2g! 38! —e™ 
4e” 9e” et 


Since the Wronskian is nonzero, the three exponential solutions are linearly distinct (inde- 
pendent), so we can build the general solution as the linear combination yg = Ae? + Be + 
Ce". Application of the initial data to this general solution leads to the three equations 


A+B+C=1 2A-3B—C—-2 4A+9B+C=8 
whose solution—A = —3, B = C = 2—yields y(t) = —3e” + 2e? -- 2e^ as the solution 
of the initial value problem. “ 
Obtain the general solution of the fourth-order differential equation 


y — Ty + 18y" — 20y’ + 8y =0 (5.7) 


The exponential guess y = e^! leads to the characteristic equation 


a4 = 793 + 18a? — 200 +8 = A — D) —2)? 20 


EXAMPLE 5.10 


EXAMPLE 5.11 


EXAMPLE 5.12 
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so the characteristic roots are then à = 1, 2, 2, 2. The repeated root A = 2 occurs three times. 
Hence, the fundamental set will be (e', e”, te”, :?e?'). Each repetition of the root à = 2 
must be accompanied by multiplication of a successively higher power of the independent 
variable t. Indeed, to see this, substitute y» = u(r)e”! into (5.7), obtaining e” (u +u) = 
0, so u = a + bt + ct? + de. (See Exercise Al.) The fundamental set follows from 
reasoning seen in Example 5.6. 

The Wronskian, 2e”, the determinant of the matrix 


el et tert tre! 
e 2e” (t + 2)e?! (2t? + 21e? 
e 4e" (At 4)e? (4t? + 8t + 2)e? 


e Be” (8t+12)e” (842 + 24t + 12)e? 


is nonzero, so the members of this fundamental set are linearly independent and the general 
solution can be written as y, = ae’ + (b+ ct + dt*)e”. 


Obtain the general solution to the differential equation y? + 2y® + y" = 0. 
By inspection we can see the characteristic equation is 


at 423 40? = 120027 4204-1) 20 1? 20 


and, consequently, the characteristic roots are à = 0,0, —1, —1. The fundamental set 
contains e" = 1 and re" = t as well as e™ and te™. The Wronskian, e^?', the determinant 
of the matrix 


1 t an te 
0 1 —-e* (l—tye™ 
0 0 et (t—2)et 
0 0 —-e* (3—D0e"' 


is nonzero, so the members of the fundamental set are linearly independent. Hence, the 
general solution is yg = a + bt + (c + dt)e"*. 4 


Obtain the general solution to the differential equation y" — 3y” + 9y' + 13y = 0. 
The exponential guess y = e^! produces the characteristic equation A? — 3A? + 94 + 

13 = 0, whose roots are A = —1, 2 + 3i. The fundamental set will undoubtedly contain the 
solution e" because of the characteristic root A = —1. In addition, the imaginary exponen- 
tials y; = e? tD! = ee" and y, = eC" = e%e-3"', through the linear combinations 
yı + i = e” cos3t and x» — ty = e” sin3t, complete the fundamental set to 
le^ , e” cos 3t, e” sin 3t}. The Wronskian, the determinant of the matrix 

e* — e”cos3t e” sin 3t 

—e™ . e*(2cos3t —3sin3t) — e? (3cos3t 4-2 sin3t) 
e" —e”(5cos3t + 12sin3t) &?"(12cos3t — 5sin 3t) 


is the nonzero 54e% , so the members of the fundamental set are linearly independent. The 
general solution is therefore y, = Ae~' + Be” cos3t + ce” sin3t. $ 


Obtain the general solution of the differential equation y? + 8y” + 16y = 0. 

The exponential guess y = e^' leads to the characteristic equation A* + 8A? + 16 = 
(A? + 4? = 0, whose roots are 4 = +2i, +2i. The first time the complex conjugate pair 
of roots appears, the fundamental set contains cos 2f and sin 2t. The next time this pair 
of roots appears, the solutions associated have to be multiplied by t. (See Exercise A3.) 
Hence, the next two members of the fundamental set are t cos 2f and t sin 2t. The complete 
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fundamental set is then (cos 2f, sin 2t, t cos 2t, t sin 2t}. The Wronskian is the determinant 


of the matrix 
cos 2t 
—2 sin 2t 
—4 cos 2t 


8 sin 2f 


sin 2f t cos 2t t sin 2t 
2cos2t —2tsin2t + cos 2t 2t cos 2t + sin 2t 
—4sin2t —4tcos2t—4sin2t —4t sin2t + 4cos2t 
—8 cos 2t 8tsin2t—12cos2t —8t cos2t — 12 sin 2t 


and has value 64 Æ 0, so the four members of the fundamental set and the general solution 


can be constructed as the linear combination yg 


a, sin 2t). 


EXERCISES 5.7—Part A 


à, COS 2f + a» sin2t + t(a3 cos 2t + 


e$. 
ksd 


Al. 


A2. 


A3. 


Show that the differential equation u + u° = 0 can be integrated 
three times, resulting in a first-order linear equation in u, whose 
solution is then u = a + bt + ct? + de^! as claimed in Example 5.9. 


Show that u as given in Exercise A1 leads to the fundamental set 
given in Example 5.9. 


Apply the reduction of order technique to the equation of Example 
5.12, setting y; = e™'u(t). Show this leads to an equation in u(t) 
whose characteristic equation is A2 (A? + 8iA — 16) = 0 and, 
hence, tou = a + bt + ce~*' + dte~*.. Show from this that the 
fundamental set is as given in the example. 


EXERCISES 5.7—Part B 


A4. 


AS. 


A6. 


AT. 


A linear constant-coefficient ODE has characteristic roots 0, 0, 1, 
1, 1. What is a fundamental set for this equation? What is the 
general solution? 

A linear constant-coefficient ODE has characteristic roots —1 + i, 


—1 +i. For this equation, write a fundamental set that contains 
only real functions. Write the general solution. 


A linear constant-coefficient ODE has characteristic roots —1, —1, 
—] Æ 2i. Write the general solution in terms of real functions. 


A linear constant-coefficient ODE has characteristic roots 0, 0, 
0 + 3i. Write the general solution in terms of real functions. 


B1. 


B2. 


B3. 


The ODE y" + 6y' + 9y = 0 has characteristic roots A = —3, —3. 
Hence, the exponential guess yields only the one solution 

yı = e^*'. Use the method of reduction of order to find the second 
distinct solution y; = te~*’. Then, compute the Wronskian and 
show it 1s not zero. 


Show that the ODE x?y" — 5xy' + 9y = 0 has y = x? as one 
solution. (Do this by substitution back into the ODE.) Use 
reduction of order to find the second distinct solution, x? In x. Do 
this by trying y; = x?^u(x) and substituting back into the ODE. The 
function u(x) satisfies by a differential equation that can be solved 
with a computer algebra system or by one of the methods of 
Chapter 3. Finally, compute the Wronskian of (y;, y2} and show it 
is nonzero. 


Consider the IVP y® + 6y 9 + 15y” + 18y’ + 10y = 0, 
y(0) = 3, y'(0) = —3, y/(0) = 2, y"(0) = 1. 


B4. 


B5. 


(a) Use a computer algebra system to solve the equation. 

(b) Plot the solution. 

(c) Use the exponential guess to obtain the characteristic equation. 
(d) Obtain the characteristic roots. 


(e) Write the fundamental set (with only real functions) and show 
the Wronskian is nonzero. 


(f) From your fundamental set, construct the general solution. 


(g) Apply the initial data to the general solution; obtain and solve 
the appropriate four equations in four unknowns. Be sure the 
resulting solution agrees with the solution found in part (a). 


Repeat Exercise B3 for the initial data of Exercise B3 and the ODE 
y? + 6y9 + 18y" + 30y’ + 25y = 0. 


Repeat Exercise B3 for the initial data of Exercise B3 and the ODE 
y? + Ay + 11y" + 14y’ + 10y = 0. 


H 


Plane 1 


Plane 2 


FIGURE 5.10 Cylinder floating at 


equilibrium 


FIGURE 5.11 Coordinate system for 


bobbing cylinder 
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The Bobbing Cylinder 


Introduction 


Undamped free motion for a spring-mass system is modeled by the differential equation 
my" + ky = 0. Such a system is called a harmonic oscillator because the solution can be 
put into the form y(t) = acos(wt — $), where œw = VE is the angular frequency. But 
nature provides more instances of harmonic oscillators than just spring-mass systems. In 
this section we examine the motion of a floating cylinder that bobs under the influence of 
buoyancy, a system governed by an equation of the form y" + w*y = 0, and therefore is a 
harmonic oscillator. 


Problem Statement 


A cylinder of height H, radius R, and weight f floats with its axis vertical in a fluid whose 
weight per unit volume is pw. If h is the height, at equilibrium, of the submerged part of the 
cylinder, describe the motion of the cylinder subsequent to its being pushed down into the 
fluid and released. 

Figure 5.10 shows the water line as Plane 1, the base of the cylinder as Plane 2, the 
height H, the depth of submersion h, and the radius R. 


Analysis 


This mechanical problem yields to Newton’s Second Law, F = ma. The secret is realizing 
that the weight of the cylinder is a force balanced by the buoyant forceexerted by the fluid. 
And this buoyant force is governed by Archimedes Principle, namely, 


Buoyant force on cylinder — Weight of fluid displaced 
Fp = WF 
The equilibrium and the nonequilibrium configurations must be considered. At equi- 
librium, where the amount of the cylinder beneath the surface of the fluid is measured by 


h, the volume of the submerged part is given by 7R7h. The weight of the fluid displaced by 
this submerged volume is 


Wy = aR hp, 
Consequently, the buoyant force at equlibrium is given by 
i= aR hpu 


By Archimedes Principle, at equilibrium, the buoyant force F, = w p balances f, the weight 
of the cylinder. Hence 


TR hpu = Jy 


This key equality links f, the weight of the cylinder, with h, the amount of the cylinder 
submerged at equilibrium. 

Next, consider the nonequilibrium configuration. For this, paint a line around the cylin- 
der at the equilibrium “water” line. Let y(t) denote the amount by which this line on the 
cylinder is displaced above or below the surface of the fluid. Take y(t) positive if the cylin- 
der rises (the ring is visible) and negative if the cylinder descends (only the fish see the 
ring). Figure 5.11 depicts this configuration. 
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Now, F;(t), the time-dependent buoyant force on the cylinder is proportional to the 
length h — y(t). Thus, 


F(t) = x R^[h — y(t) low 
We are ready to invoke F = ma = my" (t), the one-dimensional form of Newton's Second 
Law, where m, the mass of the cylinder, is given by m = £, with g being the acceleration 
of gravity. Thus, summing forces on the cylinder, we have 


-f+ FG - fy" 


which becomes 


—f +72R*[h— y(t)]o, = Lyr 


But from Archimedes Law at equilibrium we found that f = mR? p„h. Making this substi- 
tution and expanding the brackets, we find 


=a pyh +R puh -aR pyy(t) = Ly") 


8 
which collapses to 


—7R* pyy(t) = Lyra) 


Hence, we have the equation y" + z R^ p, gy/f = 0, which we write as y" + «y = 0 by 
defining 
Tk 

f 


We therefore have simple harmonic motion governed by the initial value problem for un- 
damped free motion 


S 
Il 
> 


y'*toy-20 yO=y  y(0)—v 


Solution 


The solution to this initial value problem is y(t) = yocos ox + “ sin cot, which says the 
cylinder bobs with periodic motion whose angular frequency is œ and whose period is 


y ; J vito? y ; 
P= a, The solution can also be written as y(t) = MM cos(wt — $), where ¢ is 
wyo 


determined by 
vo 
p 9 9 p) 
J/ Vp + @ yg J/ Vp + @ yg 
vo 


The reader is again cautioned not to define $ as arctan SA since the range of the arctangent 
function is (Fs 2 not (—z, 2]. A negative value for the initial displacement yo results 
in a second-quadrant phase angle; while a negative for vo, the initial velocity, results in a 
third-quadrant angle. These angles would not be correctly obtained by a naive use of the 


arctangent function. 


sing = and cosó = 


A cylinder of radius R = 2 in bobs, with a period of 1 s, in water whose weight per cubic 
foot is pẹ = 62.5 Ib. Using the gravitational constant g = 32 ft/s?, find f, the weight of 
the cylinder, and find the equilibrium height h. 
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This problem is realistic in that from an observable period, estimated by careful counting 
in the presence of a wristwatch, information about the cylinder can be deduced. The period 


is T = Z = F, so 
OC: Pw _ 2 ][|z(62.5)(32) 
MM f n0 F 


from which we determine f = 1.105242660 Ib as the weight of the cylinder. To find the 
equilibrium height ^, use the equilibrium relationship f = zx R?o, or 1.105242660 = 


D Eh 62.5h, from which we obtain h = 0.2026423672 ft or 2.43 in. $ 


EXERCISES 5.8-Part A 


Al. A cylinder weighing 22 Ib/f? floats, with axis vertical, in water 
weighing 62.5 1b/ft*. The height of the cylinder is H = 5 ft. 
Compute the period and the amplitude of the bobbing if initially 
the cylinder is first raised so that the bottom is level with the 
surface of the water and then released. 


A2. A cylinder with its axis vertical bobs in a liquid with weight per 
unit volume po. What is oo if the period of the motion is four-fifths 
the period for the same cylinder bobbing in water for which 
Pw = 62.5 lb/ft? 

A3. A cylinder whose cross-section is an isosceles triangle with sides 5 
in, 5 in, and 6 in has height H = 20 in and weight 5 Ib. After being 
pushed down so that its top is level with the surface of the water 
and released, the cylinder bobs, with axis vertical, in water whose 
weight per unit volume is 62.5 Ib/ft?. Solve for the motion y(t), 


EXERCISES 5.8—Part B 


A4. 


AS. 


where y(t) is the position relative to equilibrium. Plot the solution. 
Determine, and state clearly, the period and amplitude of the 
motion. 


A cylinder with rectangular cross-section of dimension a x b (feet) 
and with height H (feet) and weight w (pounds) bobs in a fluid 
whose weight per unit volume is p Ib/ft*. Develop a model for the 
motion. 


A harmonic oscillator is set into motion with the initial conditions 
y(0) = a, y'(0) = f, and its solution is written in the form 

y —acos(ot — $), with a > 0. Determine the quadrant in which 
the phase angle ó lies if 

(a)a>ObutB <0  (b)o «Oandf <0 

(c) a « Obut 8 > 0 


B1. A circular cylinder tall enough to bob has a radius of 6 in and a 
weight of 18 Ib. It floats, with its axis vertical, in water whose 
weight is 62.5 Ib/ft*. It is raised 3 in above equilibrium and pushed 
downward with an initial velocity of 4 in/s. 

(a) Solve for the motion y(t), where y(t) is the displacement 
relative to the equilibrium position. (Be sure to use correct 
units.) 

(b) Plot the solution. 


(c) Determine, and clearly state, the period and the amplitude of 
the motion. 

(d) Add linear damping to the system so that the governing 
differential equation contains the term by’(t). Obtain the 
solution in terms of b, the damping coefficient which is to be 
small enough that the system is underdamped. 


(e) Find, and plot, the angular frequency as a function of b. 


B2. 
B3. 


(f) Find B, the value of b at which critical damping occurs. 

(g) How sensitive is T, the period, to the damping coefficient? 
Compute the period for b — iB and compare it to the period 
found in part (c) where b = 0. 

(h) Plot a graph of the period as a function of the damping 
coefficient b. 

(i) How sensitive is œ, the angular frequency, to the damping 
coefficient? Compute the angular frequency for b — 0 and 
b= iB : 

Develop a model for a bobbing cylinder with elliptic cross-section. 

Solve the IVP y" + 10y = 0, y(0) = 2, y'(0) 3. Write the 

solution in the form y — a cos(ot — $), and determine the 

amplitude, period, angular frequency, frequency, and phase angle. 

Graph the solution and, on the graph, indicate the amplitude, 

period, and phase angle. 
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B4. The “harmonic oscillator” y = 2 cos(wt — 7) has the slowly B5. The “harmonic oscillator” y = 3 cos(@t — £) has the periodically 
decreasing angular frequency w = 1 + 2e7"/'?, Graph the motion varying angular frequency w = 2 + i cos 4. Graph the motion and 
and describe the behavior of the system. describe the behavior of the system. 


Forced Motion and Variation of Parameters 
Forced Motion: Overview 


e When a spring-mass system is “driven” or “forced” by an external forcing function 
f (t) such as a magnet, an air-blast, or the shaking of an off-balance rotating shaft, the 
governing differential equation is the nonhomogeneous equation 


my" + by +ky = f(t) 


* The general solution of this nonhomogeneous differential equation splits into two parts 
(see Sections 3.4 and 3.5) 


Yg = Yn + Yp 


© yp, is the homogeneous solution. Containing two arbitrary constants, it is the general 
solution of the homogeneous equation my” + by' + ky = 0. 

©  ypisone particular solution to the full nonhomogeneous equation my” + by’ + ky = 
f(t). It contains no arbitrary constants. 


* There are two methods for finding the particular solution yp, namely, 


1. Variation of Parameters. 
2. Undetermined Coefficients. 


* Variation of Parameters always applies but can be computationally intractable. 
*  Undetermined Coefficients always works for the cases to which it applies. 


* We call the method of Variation of Parameters the "Atomic Cannon 21-12" because, 
in principle, it always applies. No matter what the problem, it is valid. In addition, we 
designate it “21-12” because those numbers appear as subscripts in the Variation of 
Parameters formula. Unfortunately, this formula can result in difficult, if not impossible, 
integrations. 

e We call the method of Undetermined Coefficients “Guess ’n’ Test" because in it, we 
guess at the form of a solution and then use brute force to determine the coefficients in 
our guess. The algebra in this method is far simpler than the calculus in the alternative. 
Unfortunately, this method applies to a restricted class of driving forces f (t). However, 
this class includes many functions that arise in engineering and scientific applications, 
making the method of Undetermined Coefficients worth learning. 


Variation of Parameters 


The Variation of Parameters formula for a particular solution is stated as a theorem. 


EXAMPLE 5.14 


EXAMPLE 5.15 
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THEOREM 5.2 VARIATION OF PARAMETERS 


1l. y" py -tq)y =r) 
2. {y1(t), y2(t)} is a fundamental set for this equation. 
3. W(t) is the Wronskian for this fundamental set. 
yır (t) yar (t) 

dt — yı 
W(t) ` W (t) 


= y =» dt 


This formula for the particular solution yp contains the subscripts 2, 1, 1, 2, in that 
order, separated in the middle by a minus sign. What else to call the method but 21-12 
(twenty-one twelve)? 

Students invariably fail to notice that the differential equation to which this method 
applies starts with y". It does not start with a(t) times y", it starts with y". To apply this 
formula, care must be exerted to ensure that r(t) is what results in the given differential 
equation after division through by any lead coefficient y" might have. 


Obtain a particular solution for the inhomogeneous differential equation y" + y = sect. 
First, two independent solutions of the homogeneous differential equation, y" 4- y — 0, 
must be found. The exponential guess will work for this constant-coefficient linear equation, 
so the characteristic equation is A? +1 = 0, the characteristic roots are A = +i, and the 
desired solutions are yj = cost and y» = sint. The Wronskian of these two functions is 
the determinant of the matrix 
cost sint 
E sint = 


which evaluates to W = 1. The right-hand side of the nonhomogeneous differential equation 
is r(t) = sect. Hence, the Variation of Parameters formula dictates 


. cost sec f sin t sect 
yp = sint EE dt — cost — dt 


= sinr f dr — cost f anrat = r sint — cost In [cost «S 


Obtain the general solution of the differential equation y" + y = sect tant. 

Since the homogeneous equation y" + y = Q is the same as in Example 5.14, we 
reuse y, = cost, y2 = sint, and W = 1. However, r(t) = sect tant, so the Variation of 
Parameters formula gives 


. cost sect tant sin t sect tant 
Yp sint dt — cost —M o 


=sint f tantar - cost f a i 


= — sinź In | cost| — cos ż (tan t — arctan (tan ź)) 


= — sin ź ln | cos ź| — sint + f cos t 


108 


Chapter 5 Second-Order Differential Equations 


EXAMPLE 5.16 


Simplifying arctan(tan ft) to t is valid only on the principal branch of the arctangent func- 
tion. Recall, for example, that arctan(tan 10) = 10 — 32 4 10. Here, however, the correct 
simplification to f — kz would generate ¢ cost and a constant multiple of cost already a 
member of the homogeneous solution. Any such constant multiple of cost and the term 
—sin f are already included in the homogeneous solution, so they need not be included in 
the particular solution. Consequently, we may take yp = —sintIn|cost| + f cost as the 
particular solution. (See Exercise A1.) E 


Use Variation of Parameters to obtain a particular solution for the differential equation 
y" -- Ay' + 16y = 6cos2t. 

To implement the method of Variation of Parameters, we need two independent so- 
lutions of the homogeneous equation. Thus, we have the exponential guess y = e^, the 
characteristic equation A2 +42 + 16 = 0, the characteristic roots à = —2 + 24/3i, and the 
solutions y; = e7” cos 24/3t and yo = e^? sin 24/31. The Wronskian W = 24/3e-^ was 
computed in the example of underdamped motion in Section 5.6. Hence, the Variation of 
Parameters formula becomes 


5 -2t 24/3t) 6 cos 2t 
yp = e^? sin 2V31 / d tae 
24/3e-*t 


= sin(24/3t) 6 2t 
Lg cosa $i f e™ sin(2 V3) 6cos dt 
24/3e-^t 


The two integrals in (5.8) are extremely tedious to calculate and, after significant ap- 
plications of algebra, trigonometry, and calculus (see the accompanying Maple worksheet). 
give the particular solution as 


(5.8) 


Yp = = cos 2t + = sin 2t 


The driving term for this nonhomogeneous differential equation is 6 cos 21. The particular 
solution has the simple form a cos 2t + b sin 2t. So, although Variation of Parameters led 
to difficult integrals in this example, there seems to be a connection between the driving 
term and the resulting particular solution that might be exploited to our advantage. Indeed. 
in Section 5.10, this connection between the form of the driving term and the form of 
the particular solution will lead to the computationally simpler method of Undetermined 
Coefficients. For the moment, we should note that Variation of Parameters can easily lead 
to integrals that are difficult, if not impossible, to evaluate. OG 


Derivation of Variation of Parameters Formula 


Given the equation y" + p(t)y’ + q(t)y = r(t), let y,(t) and y2(t) be solutions of the 
homogeneous equation y" + p(t)y’ + q(t)y = 0. Thus, both 


yi t+ POy, q()yi =0 and yy + py, t q(t)yo =0 
hold identically. We then seek a particular solution in the form 
Yp = u(t) yi (t) + v(t) y2(t) 


reminiscent of the technique for first-order equations in Section 3.5 and for its cousin, 
reduction of order, in Section 5.7. Substitution into the differential equation will require 
computing both y, and Yp- In fact, 


Yp = uly + uy, + v'y2 + vy; 
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contains derivatives of the unknown functions u(t) and v(t). Since Yp will contain the 
second derivatives u” and v”, we are interested in any device that would eliminate these 
two terms from the calculations. We therefore constrain these functions with the condition 

u'yi vy; =0 (5.9) 
so that 


Yp = uy, — vy; Yp = uy, ne u'y! $ vy, + vy% 


knowing that if this approach succeeds, it is ultimately validated by Theorem 5.1, the 
uniqueness theorem in Section 5.3. 
Marshalling expressions, we have 


uy, +u yi 4- v'y5 + vy? + p(t)(uy, + vy5) + q(t)(uyi + vy2) = r (t) 
u(y! + pyi t qy) + v? + pya +qy2) + u'yi  v'y; =r (t) 
u{0} + v(0) + u'yi +v yi = r(t) 
u'yi + vy, =r(t) (5.10) 
The third equation is a consequence of y; and y»? being solutions of the homogeneous 
equation. The last equation and (5.9), the seemingly arbitrary condition imposed on yp, 


give two equations for the unknown derivatives u’ and v’. Writing W for the Wronskian 
uv’ — u'v, we find 


' yar yir 
ui = —: and v = — 5.11 
wW W (5.11) 
and hence 
y yır 
u=- | Za and v= | —d 
W 
so that yp = uyi + vy = [- f I dt]lyı + Lf p dtly = y f ie dt — yı f Wo dt. 
EXERCISES 5.9-Part A 
A]. Verify that yp = — sint In | cos t| + t cost is a particular solution A4. Use Variation of Parameters to obtain a particular solution for 


of y" + y = sect tan t. To make the manipulations simpler, 
assume, for example, that f is restricted to an interval such as 
(—%, £), allowing the absolute value to be dropped from the 


cosine term. 
A2. Show that the solution of (5.9) and (5.10) is given by (5.11). 


A3. Use Variation of Parameters to obtain a particular solution for 
yi +y =2. 


EXERCISES 5.9-Part B 


y" 4 4y =t. 

AS. Use Variation of Parameters to obtain a particular solution for 
y" +3y' +2y — r(t), if 
(a) r(t) 23 (b) r(t) 2t (c) r(t) 2 e* 

A6. Explain clearly why the Variation of Parameters formula can be 


x for t yor " z 
written yp(t) = y» f, ¥ dx — yı f, %7 dx for any fixed a in an 


a 


appropriate interval. 


B1. Use Variation of Parameters to obtain a particular solution to each 
of the following nonhomogeneous Euler equations. 


(a) x2y" +7xy' +8y =x — (b) xy" + 6xy' Ay = x? 
(c) x?y/" + 8xy' + 10y 2 x? — (d) x?y" — 5xy’ + 8y = x? cosx 


(e) xy" —6xy’+6y=x7e* — (f) x?y” — 6xy' + 10y = xí sin x 


In Exercises B2-7: 


(a) Use a computer algebra system to generate a general solution. 


(b) State yy and y; as contained in the general solution found in 
part (a). 


110 


B2. 
B4. y 
B6. x 
B8. 


B9. 


B10. 
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(c) Extract the members of the fundamental set used to construct 
yn in part (a). 
(d) Compute the Wronskian for the fundamental set in part (c). 


(e) Apply the Variation of Parameters formula, exhibiting and 
evaluating the required integrals. 


(f) Resolve any discrepancies between the two versions of yp. 

Note any terms that are redundant for the general solution. 
B3. y" + 4y’ + 8y = cos2t 

"4+ 6y’+13y=sint BS. y" -2y' + 10y = e! 

2y" + 10xy' +20y =x B7. x?y" — 5xy' +9y =x 


Consider the IVP 
4y" + 6y' + 9y = 3cos2t, y(0) = 


y" + 4y = tan? 2t 


sin 3t 


—2, y'(0) 2 3. 


(a) Solve with a computer algebra system and plot the resulting 
solution. 


(b) Solve by completing all the steps in a traditional solution. 
Thus, start with the exponential guess, obtain the 
characteristic equation, characteristic roots, fundamental set, 
homogeneous solution, Wronskian, particular solution by 
Variation of Parameters, and general solution to which the 


data is to be applied. Resolve any discrepancies between your 


solution and the solution found in part (a). 
Given the IVP Sy” + 4y' + 4y = 3 sin 2t, y(0) = —3, y'(0) 22 
(a) Use a computer algebra system to obtain the solution, and 
plot it. 
(b) From the solution in part (a), extract the particular solution. 


Construct, from first principles, the solution to the IVP in 
Exercise B9. Thus: 


(a) Obtain, from the characteristic equation, the fundamental set 
and the homogeneous solution. 
(b) Obtain the particular solution via Variation of Parameters. Be 


sure to reconcile your particular solution with that found in 
Exercise B9, part (b). 


B11. 


B12. 


(c) Write the general solution. 

(d) Apply the data to the general solution, constructing and 
solving two equations in two unknowns. Exhibit the resulting 
solution for the IVP. Reconcile your solution with that found 
in Exercise B9. 

Apply Variation of Parameters to the third-order ODE 


x? y" — 11x?y” + 46xy’ — 70y & x via the following steps. 


(a) Use a computer algebra system to obtain a general solution 
Extract the particular solution and the fundamental set 
bi yo, y3}. 

(b) Write yp = u(x)yi + v(x)y» + w(x) ys, and impose the 
conditions C; : u'y; + v'yo + E — 0 and C5 
w'y} = 0 that prevent u”, v", w” from appearing in y; 
mubstiuin yp into the differential equation, simplifying »: y; and 

yp with C; and C; prior to obtaining yj'. The differential 
equation itself then gives a third condition C3. 


: u'yi Tv ys 


(c) Solve the three equations Cz, k = 1, 2, 3, for u’, v’, and u 


(d) Integrate to find u(x), v(x), w(x). 

(e) Substitute these values into y, and show you have the same 
particular solution found in part (a). 

Were the recipe in Exercise B11 to be carried out symbolically for 

the general third-order inhomogeneous ODE y" + a(x)y" + 


b(x)y' + c(x)y = r(x), the resulting Variation of Parameters 
formula wodd be 
y» yal T » a r 
Yp = Jı / ~5|—dx — y | 3| — dx 
Y, ¥3| W NX 33) W 


where the determinant E is actually the Wronskian 


W (yi, yj) and W is the Wronskian of the fundamental set 
bris yo. y3}. Apply this formula to the ODE in Exercise B11 and 
show it results in the same particular solution already found. 


Forced Motion and Undetermined Coefficients 


EXAMPLE 5.17 


Consider the differential equation 


y" +4y’ + 16y = 6cos 2t (5.12) 


whose particular solution we found by Variation of Parameters in Example 5.16, Section 
5.9. The characteristic equation A? + 44 + 16 = 0, a consequence of making an expo- 
nential guess, is written by inspection, and the char acteristic roots are A = —2+2,/3i. A 


fundamental set consisting of real functions is then { 


2t cos 2 /at, e7% sin 23r). 


We next observe that 6 cos 21 is a solution of the ie ia equation y" + 4y = 0. 
This inspires us to differentiate (5.12) twice and add four times (5.12) itself. This calculation 


04+ 

0 H a 
427 4% fo Ys F 10 

-0.44 , 


FIGURE 5.12 In Example 5.17, solution 
(solid) rapidly tends towards y, (dotted) 
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can be expressed as 


5 


? p 
(< ! +4) (y" + 4y’ + 16y) = (z +4) 6 cos 2t 
dt? dt? 


and it gives 
y? 4- Ay" + (44 16)y” + 16y' + 64y = 0 (5.13) 
the characteristic equation for which is 
A4 +403 + 2007 + 16A + 64 = (A? +4)? +42 + 16) =0 


The characteristic roots for (5.13) are therefore +2i and —2 + 24/3i. The first set of roots 
are associated with the driving term 6 cos 2f on the right in (5.12), while the second set 
are the characteristic roots for the homogeneous version of (5.12). The general solution for 
(5.13) would be built from the fundamental set for (5.12) and from {cos 2t, sin 2t}, which 
arises from the nonhomogeneous term in (5.12). Since these two “fundamental sets” are 
distinct, we do not have a repeated root case for (5.13) and its general solution does not 
contain any terms multiplied by powers of t. 

The particular solution of (5.12) will contain that part of the general solution of (5.13) 
that is not part of the homogeneous solution of (5.12). Hence, for (5.12) we “guess” at a 
particular solution of the form yp = a cos 2t +b sin 2t. Substituting this yp into (5.12) gives 


(12a + 8b) cos2t + (12b — 8a) sin 2t = 6cos2t 


which must be an identity in t. For this to be so, the coefficients of the trig terms on each 
side of the equation must match exactly. This matching condition yields the two equations 


12a 4-80 — 6 and 12b — 8a = 0 


. . Q . . . . 
whose solution isa = 2, b = +. The particular solution is then y, = 2 cos 2t + & sin 2f, 
6 13 Yp = 26 13 


found with considerably less effort than invested in the Variation of Parameters calculation. 
Having found the particular solution, we can write the general solution as the sum of 
the homogeneous solution and the particular solution,obtaining 


Yg = Ae™™ cos 24/3t + Be™ sin24/3t + 3 cos 2t + 4 sin 21 


Initial data is applied to the general solution. For example, if y(0) = 1, y'(0) = 1, we would 
form the two equations 

A+ -1 and —2A+8+42V3B=1 
whose solution is A = z, p= 4/3 
be 


so that the solution to the initial value problem would 


—2t 


»(t) = Íg (17c052v3t + 8V3 sin 231) + 3, cos2t + $ sin 2t 


Figure 5.12 contains a graph of this solution (solid) and a graph of yp (dotted), revealing 
the rapid onset of the steady-state motion that is the system's response to the driving force 
6cos 2t. Initially, there is a transient phase where the system is reacting to the initial 
conditions and, eventually, a steady-state phase where it is reacting just to the driving 
term. Since the homogeneous solution contains the factor e~*’, the homogeneous solution 
constitutes the transient portion of the solution. The particular solution yields the steady- 
state portion. $ 


For many of the initial value problems of science and engineering, the method of Unde- 
termined Coefficients is computationally simpler that the method of Variation of Parameters, 
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even in the context of a computer algebra system. The algebra of Undetermined Coefficients 
might be tedious, but the calculus of Variation of Parameters might be impossible. 


Applicability of Undetermined Coefficients 


Variation of Parameters always applies but is never certain to escape the confines of difficult 
integrations. Undetermined Coefficients, however, will always succeed. But Undetermined 
Coefficients only applies under the conditions 


1. the ODE is linear with constant coefficients. 


2. r(t), the driving term, is a linear combination of terms that are themselves pieces of so- 
lutions of linear ODEs with constant coefficients. Thus, the terms in r (t) must be obtain- 
able from the exponential guess e^' and can include terms that arise from repeated roots. 


Table 5.8 lists particular examples of terms r (t) can contain if Undetermined Coeffi- 
cients is to work. The characteristic root A = 0 puts e% = 1 into the fundamental set. Hence, 
a viable r(t) can contain a constant multiple of 1. Moreover, if the root A = 0 is repeated, 
then te" = t would be in the fundamental set, so r (t) can contain a constant multiple of t. 
Likewise, r (f) can contain a linear combination of powers of t, and hence, a polynomial in 
t is a viable part of r (1). 


À Multiplicity 1 Multiplicity 2 Multiplicity 3 
eel te" zat f^ a ae 
e te nel 
; ; (3t) ; t cos(3t) E t? cos(3t) 
3 23it cos( 43it 2 ,+3it A 
nd TUE rm AF t sinat) Fe 7 sint) 
. Ri er 3r) — te? cos(at) € 12e? cos(3t) 
243 (243i)t p cos( Q33i) 2 ,Q33i)t . OSA 
' " ^ sin(3t) = = | te sin(3r) > 1 26% sin(3r) 


TABLE 5.8 Sample nonhomogeneous terms for which Undetermined Coefficients will work 


The real characteristic root A = 3 puts e*' into the fundamental set. Hence, a viable 
r(t) can contain a constant multiple of a real exponential of the form e^', where a is a real 
number. Likewise, if the root A = 3 is repeated, then te?! will be in the fundamental set, so 
r(t) could therefore contain a constant multiple of te*’. In fact, with additional repetition 
of the root 4 = 3, r (t) could contain a linear combination of {e%", te*’, te}, which could 
appear as the fragment (2 — 5t + 7:2)e?'. 

The pure imaginary pair of conjugate roots à = +37 would put both cos 3¢ and sin 3; 
into the fundamental set. Hence, r(t) can contain a linear combination of cos3t and 
sin 3t. For example, r(t) could contain 2 cos 3t — 5 sin3t or 2 cos 3t + Osin3t = 2cos3t 
or 0 cos3t + 5sin3t = 5 sin 3r. If the roots A = 43i are repeated, then t cos 3¢ and t sin 3t 
as well as cos 3t and sin 3t can appear in the fundamental set. Hence, r(t) can contain trig 
terms multiplied by powers of t. 

Finally, the complex conjugate pair of roots A = 2 + 3i puts e” cos 3t and e” sin 3t into 
the fundamental set, so r (t) can contain a linear combination such as e” (3 cos 3t — 5 sin 31) 
or e” (3 cos 3t +0 sin 3t) = 3e” cos 3t or e” (0 cos 3t — 5 sin 3t) = —5e” sin 3t. Of course, 
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if the roots A = 2 + 3i are repeated, then r (t) can contain linear combinations of te” cos 3t 
and te” sin 3t. 

In Table 5.9, the “characteristic roots” of the general solution of which r (1) is a fragment 
are called latent roots. Success with the method of Undetermined Coefficients hinges on 
being able to reverse-engineer the full list of all possible latent roots from the evidence 
of the fragment of the solution, which remains as r(t). Motivation for this is given by the 
relation between (5.12) and (5.13) in Example 5.17. 


r(t) Latent Roots Yp 
(1) 2e* + cos 5t 3, 5i ae* + bcos5t + csin 5t 
(2) —3 — 4sin5t 0, 457 a+bcos5t+csin5t 
(3) e^ —2sint +3cost —1, +i ae'+bcost+csint 
(4) e^ +e cost —1,-3+i ae +e" (bcost + csint) 
(5) 12+ te 0, 0, 0, 2, 2 a+bt+ct? 4- e (a+ Bt) 
(6) t cos2t +2i, +2i a cos 2t + bsin2t + t(c cos2t + d sin 2t) 
(7) te^ cos2t —3 € 2i, —3 + 2i €^? (a cos 2t + b sin2t) + te^? (c cos2t + d sin 2t) 
(8 +77 0,0,0 à t bt t ci? 
(9) e? — 32e —2, —2, —2 (a + bt + ct2)e? 
(10) sint — 2t cost $ SEL acost+bsint + t(ccost 4- d sint) 


TABLE 5.9 Examples of nonhomogeneous terms and the form of yp they require 


Thus, the left column in Table 5.9 gives examples of possible expressions for r (t) that 
are viable candidates for Undetermined Coefficients. The middle column in the table gives 
the latent roots, those characteristic roots that would appear if the nonhomogeneous DE 
were manipulated to become homogeneous, as we did in Example 5.17. The right column 
of the table, the full form for yp determined by the given r (t), is the most general solution 
possible from the latent roots in the middle column. That is why success with Undetermined 
Coefficients hinges on being able to “think backward” and visualize the characteristic roots 
responsible for a general solution of which r (t) is but a fragment. 

In the first and second examples where just a single trig term appears, the list of latent 
roots contains the conjugate pair listed. Thus, the particular solution must contain both a 
sine and a cosine. In each of these two examples, there is an additional real latent root, so 
that in addition to the trig terms in yp, there are real exponential terms. In the first case, yp 
contains a constant multiple of e*’; while in the second, a multiple of e = 1. 

In the third example, r(t) contains both sin and cost. The latent roots include the 
single conjugate pair +i, and yp contains the single linear combination b cos f + c sin f. 

In the fourth example, r(t) contains e^? cos t, but the latent roots contain the complex 
conjugate pair —3 + i and yy contains the linear combination e^? (b cost + csint). 

In the fifth example, the 1? term could only have appeared as a solution to a constant- 
coefficient, linear, homogeneous differential equation if the characteristic roots included 
0, 0, 0. Hence, these three roots appear as latent roots, and yp must contain a linear com- 
bination of 1, t, t?. In addition, r(t) contains te?', which could only have arisen from the 
repeated root A = 2, 2. Hence, yp must contain a linear combination of e” and te”. 
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EXAMPLE 5.18 


EXAMPLE 5.19 


In the sixth example, the product of t with cos 2f signals that the pair of conjugate roots 
+2i had to occur twice. Hence, yy must contain a linear combination of cos 2f and sin 2f as 
well as a linear combination of t cos 2f and t sin 2f. 

The seventh example is like the sixth, whereby the factor t signals the complex conjugate 
pair —3 + 2i must occur twice. Hence, yy must contain a linear combination of e^ cos 2t 
and e^ sin 2t as well as a linear combination of te^ cos 21 and re~™ sin 2t. 

In the eighth example, where both t and t? appear in r (t), the list of latent roots need 
only include enough Os to account for t*. It would be overkill to attribute 0, 0 to the t and 
then another 0, 0, 0 to the t*. Hence, yp contains a linear combination of 1, t, t? and not of 
the five terms 1, t, 17, £?, t^. 

The ninth example is like the eighth, whereby e~~” and t?e^?' appearing in r (t) generate 
the latent roots —2, —2, —2, just enough to account for the term t7e~*! and not one —2 for 
e^?! and another three for t?e~7'. Hence, yp contains a linear combination of just the three 
terms e^? , te^?! , te”, 

Finally, the tenth example is again like the eighth and ninth, whereby all of r(t) is 
accounted for by the latent roots +i, +i. It would be a mistake to look at the term sin t and 
count ci, then look at the term cos t, and count +i, +i because of the factor t. The terms 
in r(t) must be looked at collectively, not in isolation. 


The Tricky Case 


There is one subtlety in determining the form of the particular solution for Undetermined 
Coefficients. The case arises when a latent root hiding in r(t) is also a characteristic root. 
In fact, suppose the root p is a characteristic root 2 times and is also a latent root 3 times. 
The guess for the particular solution would then be yp = e” (a + bt + ct?)t? instead of just 
yp = e” (a 4- bt + ct?). The special rule is 


increase, by the multiplicity of the characteristic root, the powers on the t's that 
the latent roots dictate. 


Determine the form of the particular solution for 
y'—t-ce -tsint 


wherein the characteristic equation is A2 = 0; the characteristic roots are à = 0, 0, and the 
latent roots of r (1) are 0, 0, 1, +i, +i. The guess for yp is 


yp = (er + cot)t? + cse! + (c4 cos(t) + cs sin(t)) + t(cg cos(t) + c7 sin(t)) 


Because the characteristic roots already include 0 and 0, the latent roots 0 and 0, dicated 
by the term f, must be counted as the third and fourth appearance of à = 0. Hence, corre- 
sponding to 7 in r (f), we need not 1 and t in yp but 1? and t°. The repeated pair of complex 
conjugate roots in the list of latent roots means there will be, in yp, a sine and cosine term, 
and f times a sine and cosine pair. o 


Determine the form of the particular solution for 
n / 2f . 
y —2y +y=t e +sint 


wherein the characteristic equation is à? — 2A + 1 = (à — 1)? = 0, the characteristic roots 
are A = 1, 1, and the latent roots of r (t) are 1, 1, 1, +i. The guess for yp is 


Yp = e'(a +bt + ct?)t? + a cost) + B sin(t) 


Because the latent roots 1, 1, 1 are repetitions of the characteristic roots 1, 1, the particular 


EXAMPLE 5.20 


EXAMPLE 5.21 
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solution must contain, not just e = 1, te” = t, and t?e = 17, but each of these terms 
with their exponents on ¢ two powers higher. In effect, when counting the latent roots, count 
their repetitions amongst the characteristic roots first and continue the count for the latent 


roots. The guess for the particular solution is built from this higher number of repetitions. 
4 


Solve the initial value problem y" — y' = 4e~ + 3e”, y(0) = 0, y'(0) = —1, y"(0) = 2. 

The characteristic equation is A — à = AQ2 — 1) = 0, the characteristic roots are 
A = 0, 1, —1, and the homogeneous solution is yp = A + Be! + Ce. The latent roots for 
r(t) are —1 and 2. Hence, —1 is a “repeated” root, so the form of the particular solution will 
be yp = ae” + bte~ and not ae” + be^. Substitution of yp into the differential equation 
yields 


6ae^ + 2be = 4e™ + 3e” 
from which matching of coefficients of like exponentials results in the two equations 
2b=4 and 6a=3 
and the solution a = 5, b = 2. That gives the particular solution yp = 4e” + 2re~ and the 
general solution 
Yg = A + Be c Ce" + 1e + 2te™ 
Finally, applying the initial data to the general solution generates the three equations 


A+B+C+3=0 B-C+3=-1 B+C-2=2 


whose solution is A = = B — 0, C = 4; hence, the solution of the initial value problem 


is y(t) — -$ 4e" je? + 2te™. o 


SUPERPOSITION FOR NONHOMOGENEOUS Equations In Section 5.3 we saw the Superpo- 
sition Principle that for homogeneous linear equations, the sum of two solutions was again 
a solution. For nonhomogeneous linear DES, there is a different superposition principle that 
we can now make because we know how to solve nonhomogeneous equations. 


The solution of a linear equation driven by a forcing function that is a sum of 
inputs is the sum of responses to the individual and isolated inputs. 


Table 5.10 shows the solutions to the three initial value problems y" + 14y' + 48y = 
fk), k = 1,2,3, y(0) = y'(0) = 0. If the system is driven by fA) = H) + fa(t), 
the response, y,(t), is the sum of the solutions y2(t) and y3(t), themselves responses to 
the driving terms f2(t) and f3(t), respectively. The driving term /)(t) can be decomposed 
into its individual summands and the response to each summand computed. The response 


à Me s €. 
to fi (t) is then the sum of the responses to the individual components in f| (f). kd 
Driving Term Response 
: 71 ZI 4 13 ,— 19 ,- 
filt) = 5sint 4-3cost Yilt) = 33g; COST + 3355 SINT — ze oF 4 ane a 
" : 70 285. + 5 os 5 ,— 
fht) = 5sint y(t) = s ost + 205 Sint + iue P eve 
: " _ 141 42 a; 18 ,-6 24 ,-8 
fs(t) = 3cost y3(t) = 345g COST + agg Sint — Ge" + ge 


TABLE 5.10 Superposition for nonhomogeneous equations 
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EXERCISES 5.10—Part A 


A1. Given r(t) and the characteristics roots, provide a correct form (i) r(t) = e” — 3t?e*7,A 20,0, 2, 2 
for yp. (D r(t) = cost — 2t sint, A = 0, 32i 
A2. Let yg, k = 1, 2, 3, be the respective solutions of y" + 3y'4- 
2y = f(t), y(0) = y'(0) = 0, where fi(t) =t + sint, fo(t) — r. 
(b)r(r) = —3 — 4cos 2t, A = —3, 4 and fi(f) = sin t. Verify superposition for nonhomogeneous 
(c) r(t) =e —3sint, à = —1,1 equations by showing y;(t) = y»(t) + y3(t) since 
AO = fot) + A. 


A3. Does superposition hold if the initial conditions in Exercise A2 are 


(a) r(t) = 2e? + cos 5t — sin 5t, à = 3, —1 + 5i 


(d) r(r) 2 e' - e?' sint, A = —3, +i 


(e) r(t) =t +3te”, à =0,0,2 replaced with y(0) = 1, y'(0) = 0? 
(f) r(t) = tsin3t, A = 0, 3,3 A4. For y" + 2y' + 2y = cos 2r, obtain yp; then put it into the form 
Acos(2t — $). 


(g) r(t) = te* sint, 4 —4,4 


(h) r(t) = 3t - 40, =0,1,2 AS. Obtain yp for y" + 2y' + 2y = cos wt by starting with 
r(t) F -4t^,4 —0,1,2 


yp = Acos(ot — ¢). 


EXERCISES 5.10-Part B 


B1. Consider the nonhomogeneous equation y" + 2y' + 2y = Apply this operator to the given differential equation, 
e sint. obtaining a new, homogeneous DE. 
(a) Obtain the latent roots for r(t). (g) Obtain the characteristic roots for the DE formed in part (f), 


and construct the general solution corresponding to these 
roots. Show that y, guessed at in part (c) is a part of this 
general solution. 


(b) Construct a characteristic polynomial in A corresponding to 
the latent roots. 


(c) Replace each A in part (b) with the differentiation operator 


d/dt, that is, with A" becomes d" /dt", and apply the B2. y" + Ay' + 4y = 5sin3t, y(0) = —3, (00 = 1 
resulting operator to the given ODE. The resulting equation B3. 4y" + Ay! + y = 3sin2t — cos 2t, y(0) = —2, y'(0) «3 
should now be homogeneous. B4. y" 4- 2y' +2y = 3sin5t, y(0) = 0, y'(0) =3 


(d) Obtain the characteristic equation and characteristic roots for BS. y" + 2y’ +2y = e", y(0) = —5, y (0) = —4 
the homogeneous equation in part (c). Show that the roots are 
the union of the characteristic roots and the latent roots for the 


B6. y® — 5y" + 4y = 3, y(0) = 0, y'(0) = 0, y"(0) = 0, y"(0) = 0 


original second-order equation. B7. y" -3y' -2y 21 -2te', y(0) = —1, y'(00 = 1 
(e) Write the general solution corresponding to the roots in part B8. y" + 25y = 3t sin 5t, y(0) = 2, y'(0) = —1 
(d), and show that it contains the y, that would have been B9. y" + 6y' + 13y = Ste? sin 2t, y(0) = 0, y'(0) = 1 
written from the latent roots found in part (a). B10. yO + y® = sint — 4? + 2t — 5, y(0) = 1, y'(0) = —1, 
For the IVPs in Exercises B2-11: y’(0) = 3, y”(0) = 0, y® (0) = —1 “ 
(a) Use a computer algebra system to obtain and plot the solution. B11. y" + 2y’+2y = 5? — 7t + 3, y(0) = —2, y'(0) 23 
(b) Obtain the characteristic roots and the latent roots hiding in B12. A capacitor with capacitance C = zi farad, an inductor with 
r (t). Distinguish carefully between both sets of roots. coefficient of inductance L — $ henry, and a resistor with 
resistance R = | ohm are connected in series. If at t = 0, the 


(c) Write the homogeneous solution and the correct guess for the 


particular solution current i equals zero, and the charge on the capacitor is 1 


coulomb, find the current and the charge in the circuit due to the 
discharge of the capacitor. Hint: From Section 5.1, the current 
obeys Li" + Ri’ + Li = E'(t). Here, E = 0, i (0) = 0, and (from 
(e) Form the general solution and apply the initial data to produce [11]), i^(0) = E9-O8-«0 77 where q(t) is the charge, obtained 


the correct solution to the IVP. Resolve any discrepancies with from i(1) as q(1) = q(0) 4 f sind 
| the solution found in part (a). : did i 


() the T Me 1 ial in th B13. For large t, find the limiting current in the RLC circuit for which 
rom the latent roots, construct a polynomial in the L R=20,C = 20 and E(t) = 5cos(100). 


differentiation operator d/dt, that is, with A" becomes d" /dt". 


(d) Obtain the correct particular solution by completing the 
calculations of the method of Undetermined Coefficients. 


^ do" 
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IGURE 5.13 Resonant solution (solid) 
and envelopes +£ for zero damping 
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Resonance 


Resonance can be characterized as that physical phenomenon whereby Mother Nature seems 
to overreact to a lesser, but periodic, stimulus. This overreaction to a small stimulus is called 
a temper tantrum in a child, “having a fit" in an adult, and “resonance” in Mother Nature. 
The response is simply out of proportion to the stimulus. 

Of course, we are just creating imagery to focus attention. However, anyone who has 
seen the four-minute film clip of the Tacoma Narrows Bridge, Tacoma, Washington, twisting 
in the wind and collapsing in 1940 would need no additional metaphors for resonance, the 
phenomenon responsible for such a ruinous end to a magnificent work of engineering. 

Resonance is quantized within the driven damped oscillator. A linear, damped oscillator 
is driven with a sinusoidal input having a variable angular frequency. The response of the 
system is observed as a function of the driving input frequency. The frequency for which the 
response is greatest is called the resonant frequency, a frequency at which the magnitude 
of the system's response can be far larger than the magnitude of the input driving force. 

We distinguish two cases of resonance. If damping is assumed to be zero, the system is 
a fiction, since even at supercooled temperatures, friction does not disappear entirely. The 
resonance model in which no damping term appears has characteristics that just cannot be 
found in nature since a frictionless system is just not found in nature. For this reason, this 
model is called "unreal resonance." 

The more realistic model for resonance includes frictional damping and is called *real 
resonance." 


The undamped oscillator with mass m = 1 and spring constant k = 16, driven by a periodic 
force of amplitude 1 and angular frequency w = 4, is modeled by the differential equation 
y" --16y = cos 4t. If this system goes into motion with the inert initial conditions y(0) = 0, 
y'(0) = 0, we can describe the resulting motions by the solution y(t) = $ sin 4t, graphed as 
the solid curve in Figure 5.13. The oscillations of the system grow without bound, getting 
ever larger and larger. Of course, this is not what happens in reality where some frictional 
damping always exists. In this model with no damping, the envelope of the oscillations is 
linear, as shown by the dotted lines in Figure 5.13. 

Fortunately, this unreal resonance is never seen in nature since nothing in nature takes 
place without frictional losses. But to see why the model predicts these unbounded motions, 
obtain the characteristic roots A = +4i from the characteristic equation A? + 16 = 0. The 
latent roots from the driving term r (t) are themselves +4/, so the particular solution will 
contain f (a cos 4t + b sin 4t). Driving the system at its natural (angular) frequency w = 4 
means the trig terms in the particular solution are multiplied by ¢. Physically, this corre- 
spondence means every imposed push lines up exactly with the natural peak in the motion, 
and the oscillations increase without bound. 

The natural frequency of the undamped system is determined by the homogeneous equa- 
tion my" + ky = 0. The characteristic equation is mA? + k = 0, so the characteristic roots 


areA = +v Ej, These roots are complex, so the fundamental set will be {cos v Eg. sin V Er). 


Clearly, oy = V E becomes the natural (angular) frequency since that is the frequency this 
system must necessarily exhibit if no external driving forces act on it. Driving the undamped 
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FIGURE 5.14 Response amplitude vs. 
frequency of the driving function 


system at its natural (angular) frequency then causes it to resonate, a resonance that predicts 
unbounded motions. 

However, in real life, there is always damping. Hence, we next consider the same system 
(m = 1, k = 16) but add some damping to explore the case of real resonance. We will drive 
the system with a cosine term for which the frequency is not specified and seek to study the 
response of the system as a function of the driving frequency. 


Real Resonance 


Consider the damped oscillator for which the mass, damping coefficient, and spring constant 
are m = 1, b = 4, k = 16, respectively, and for which the driving term is cos wt. A mode! 
for this system is the differential equation 
y" -- Ay' + 16y = cos wt 

with characteristic equation A? + 44. + 16 = 0 and characteristic roots A = —2 + 24/3i. 
The natural (angular) frequency for the system is wy = 24/3, the fundamental set is 
(e? cos wyt, e7” sinwyt}, and the homogeneous solution is y; = e^? (cı cos wyt + 
C5 Sin wyt). 

At steady state when the term e7” has done its work and effectively becomes zero, the 
homogeneous solution hardly contributes to the general solution. The steady-state solution 
is essentially the particular solution, which we write in the form yp = A cos(wt — $). Using 
the differential equation to determine A and $, we have 


—Ao cos(wt — p) — 4Aw sin(wt — p) + 16A cos(wt — p) = cos wt 
or, expanding the trig terms, we have 
(A(16 — o?) cos ġ + 4Ao sin $} cos wt 
+ (A(16 — o?) sin ó — 4Ao cos ó] cos ot = cos wt 


By matching coefficients of cos wt and sin wt on both sides of (5.14), we find 


1 
A= 
V o* — 16w? + 256 
. 4w 
sing = 
V o* — 16w? + 256 
16— o 
cos @ = 


Vw* — 16w? + 256 


The phase angle $ is determined jointly by the second and third equations. However, we are 
really only interested in the amplitude of the motion, graphed as a function of the driving 
frequency o in Figure 5.14. For some value of the driving frequency o, the magnitude of the 
steady-state’s amplitude peaks. The driving frequency for which this amplitude is a maxi- 
mum is called the resonant frequency, which can be found exactly by solving the equation 


dA 2w(w* — 8) 


do (wt — 16m? + 256)3/2 


for the resonant frequency wg = 4/8 = 24/2. 

The natural frequency is 24/3, slightly larger than the resonant frequency 24/2. For 
unreal (undamped) resonance, the natural frequency and the resonant frequency are the 
same. For real (damped) resonance, the resonant frequency is slightly smaller than the 
natural frequency. 


FIGURE 5.15 Graphs of yp(¢) for 
w = $, 2/2, 4, as the dashed, solid, and 
dotted curves, respectively 
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FIGURE 5.16 Amplitude vs. driving 
frequency for five values of damping 
parameter b 
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As a function of t and c, the particular solution is 


cos (wt — arctan ; c) 


Jp = — Jo — lon? + 256 


Figure 5.15 shows yp(t) for the three values œ = 3, 24/2, 4, as the dashed, solid, 


and dotted curves, respectively. The accompanying Maple worksheet contains a complete 
animation of showing how yp(t) varies continuously with c. 


DEPENDENCE OF RESONANCE ON DAMPING It is important to quantify the resonant fre- 
quency’s dependence on damping. Hence, let the preceding damped oscillator now have vari- 
able damping b so that the system is modeled by the differential equation y" + by’ + 16y = 
cos wt. As before, we want the system's steady-state response to the driving term, from 
which we will extract the value of the driving frequency w maximizing the amplitude of 
the response. Again taking the particular solution as yp = A cos(wt — 6), the differential 
equation yields 
—Ao cos(wt — $) — bAw sin(wt — $) + 16A cos(wt — $) = cos(ot) 


from which, after expanding the trig terms and matching coefficients of cos wf and sin ot, 


we find 
l 


A= 
Vot + (D? — 32)w? + 256 
4w 
Jot + (D? — 32)w? + 256 
16 — o 
Jot + (D? — 32)w? + 256 


sing = 


cos ġ = 


Again interested in how A, the amplitude of the steady-state response, varies with 
driving frequency w, we give the damping coefficient b the values 1,2,..., 5 and plot 
the resulting resonance curves in Figure 5.16. The more the damping, the smaller the 
maximum peak at resonance; and the less the damping, the greater the resonant peak. Also, 
if the damping is great enough there is no resonance peak at all. Hence, sufficient damping 
precludes resonance. 

Figure 5.17 is another way of visualizing the dependence of the response amplitude 
A(b, œw) on both damping and input driving frequency. The function A(b, o) is plotted 
as a surface over the bw-plane. The plane sections b = constant are the curves seen in 
Figure 5.16. Both Figures 5.16 and 5.17 suggest that as the driving frequency w is increased 
well past the resonant frequency, the amplitude of the steady-state response goes to zero. 


FIGURE 5.17 Amplitude as a function of 
driving frequency and damping 
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Analytically, showing that lim,.,, A = 0 is a routine exercise in elementary calculus. 
Physically, this means that for high enough driving frequency, the system cannot react to 
the rapidity of the swings being imposed on it and the system becomes “paralyzed.” Sc 
if you have a motor shaking itself to pieces because of resonance, either add damping or 
increase the driving speed! 

Finally, we obtain an expression for the resonant frequency as a function of the damping 
parameter b by again solving the equation 


dA ca? + b? — 32) 
= - — =0 for og = 164 — 2p? 
do (wt + (D? — 32)? + 256)??? 2 
Formulae for the dependence of the resonant frequency on all three parameters of mass, 
damping coefficient, and spring constant are obtained next. 


DEPENDENCE OF RESONANCE ON m, b, AND k Complete formulae for the dependence of 
the resonant frequency on mass, damping, and spring constant can be obtained by finding 
the steady-state (particular) solution of the differential equation my” + by’ + ky = cos wt 

Assuming the particular solution yy = A cos(wt — 4$), the differential equation yields 


—mAo? cos(wt — b) — bAwsin(wt — $) + kAcos(ot — $) = cos(wt) 


from which, by expanding the trig terms and matching coefficients of cos wf and sin wr, we 
get 
E 1 
7 V m2o* + (b? — 2mk)a? + k? 
The resonant frequency, the solution of 
dA o(2m?o? + b? — 2mk) 
do | (mwt + (b2 — 2mk)o? + k?)3/2 


"E b2 EE 
Cg — = => 
m 2m? 2m? 


The first form for cg is more prevalent in texts, but the second makes it easier to see that 
b? < 2mk is necessary for resonance. 


A 


is 


Resonance Wrap-Up 


Here are some questions about resonance and oscillations in damped spring-mass sys- 
tems. Answering them will help clarify the connections, formulas, and insights generated 
throughout this unit. The answers are given later in this section. 


Questions 


e Can overdamped and critically damped systems be made to resonate? 
e Can every underdamped system be made to resonate? 
e What is the threshold of damping above which there can be no resonance? 


e What is the threshold of damping above which there are no transient oscillations? 


DarA To answer these questions we recall formulae for the natural frequency and the 
resonant frequency. The quadratic formula for the characteristic roots of the characteristic 


0 2mk 4mk 


resonance p? 
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critically 
damped 


FIGURE 5.18 Which systems can be 
made to resonate? 
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equation gives the natural frequency 


—b + Jb? — 4mk | 4mk — b? 
A= => on = | ——— 
2m 4m? 


From b? — 4mk, the discriminant of the characteristic equation, we can classify the motion 
as a function of damping 


b? =4mk | critically damped 
b? >4mk overdamped 
b? <4mk | underdamped 


V2mk—b? 


2m? 


The resonant frequency is cg = , from which we draw the two inferences 


0 <b? <4mk = underdamped 


5 
0 « b^ < 2mk = resonance 


Figure 5.18 summarizes all this data on a b*-number line. 
Answers 


e  Overdamped, critically damped, and “half” the underdamped systems cannot be made 
to resonate. In particular, 


0 — D? <2mk = underdamped, with resonance possible 


2mk < b? < 4mk = underdamped, but resonance not possible 


We quote the word “half” because systems for which b? < 4mk are all underdamped 
but only those for which b? < 2mk have a positive resonant frequency. In Figure 5.18 
the underdamped systems for which resonance is possible appears to be “half” of the 
underdamped systems. Thus, the answer to the first question is “no, overdamped and 
critically damped systems cannot be made to resonate.” 


e The answer to the second question is “no, not every underdamped system can be made 
to resonate.” 


e The answer to the third question is “b? = 2mk is the threshold above which a system 
cannot be made to resonate.” 


e  Andthe answer to the last question is “b? = 4mk is the threshold above which a system 
cannot be made to oscillate." 


A]. For the system governed by the ODE 3y” + 7y = cos wt, find A4. For the damped oscillator driven by cos wf, and with m = 1, 


(a) wy, the natural frequency. (b) œg, the resonant frequency. 


(c) y(t) for w = œg. 


A2. For the system governed by 3y" + 3y' 4 


amplitude at resonance. 


A3. For the system governed by 3y" 4- 6y' 4 


b= ip k= x find ox, cg, and the magnitude of the amplitude 
at resonance. Even in the presence of damping, this system's 
response at resonance is considerably larger than the magnitude of 


+ 7y = cos æt, find the the driving force. 
natural and resonant frequencies and the magnitude of the AS 


. From first principles, derive a formula for the resonant frequency 
of the system my" + by’ + ky = sin wt. Compare to the formula 


+ 7y = cos œt, find the derived for the damped oscillator driven by cos o. 


natural and resonant frequencies and the magnitude of the 


amplitude at resonance. 
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EXERCISES 5.11—Part B 


B1. 


Show that all three of the following expressions for the resonant 
frequency are equivalent: 


Jm — b? 
OR = 
2m? 


/4mk — 2b? " p 


2m m 2m? 


For the systems governed by the ODEs in Exercises B2-4: 


B2. 
B4. 
B5. 


B6. 


B7. 


B8. 


B9. 


(a) Find the natural frequency. 


(b) Find the resonant frequency by going through the steps of 
finding the magnitude of the steady-state response (the 
particular solution) and maximizing by differentiation. 


(c) Plot a graph of the magnitude of the steady-state amplitude 
vs. driving frequency o. 

3y” + 6y' + 10y = cos wt 

4y" + Ty' + 11y = cos øt 


B3. 8y” + 13y' + 25y = cos wt 


If b? < 4mk, obtain a formula for the natural frequency of the 
general system governed by the equation my” + by’ -- ky = 
COS wt. 

Obtain one of the expressions for wg given in Exercise B1 by 
applying the techniques of Exercises B2-4 to the equation in 
Exercise B5. (In Exercise B7, you will need A = f (o), the 
expression for amplitude, so be sure to isolate this part of the 
computation and save it.) 


In the expression for A = f (œ) found in Exercise B6, set m = 8 
and k = 13. For each value of b = 1,2,..., 8, obtain the 
corresponding function f (c). Plot all eight functions on the same 
set of axes, being sure to label each curve with its value of b. 


For each of the eight resonance curves in Exercise B7 compute 
the resonant frequency wp and then plot a graph of these resonant 
frequencies vs. their corresponding values of damping b. This 
should be equivalent to taking the expression for resonant 
frequency found in Exercise B6, setting m = 8 and k = 13 and 
plotting the resulting expression as a function of b. 


In Exercise B6, you computed both A = f (œ), amplitude at 
steady state, and wr, the frequency at which f (c) is maximized. 


The Euler Equation 


B10. 


B11. 


B12. 


B13. 


Obtain an expression for f (wg), the maximum amplitude the 
system attains at resonance. 


With m = 8 and k = 13 as in Exercise B7, plot, as a function of b 
for b in the interval [1, 8], the expression for f (cq) found in 
Exercise B9. This graph shows how the “maximum amplitude at 
resonance" varies with damping (at fixed mass and spring 
constant). 

With m fixed at 8 and k fixed at 13, plot, as a function of b for b in 
the interval [1, 8], the natural frequency wy. This graph shows 
how the natural frequency varies with damping (at fixed mass and 
spring constant). 

With m fixed at 8 and k fixed at 13, plot, as a function of b for b in 
the interval [1, 8], @y/@p, the ratio of natural frequency to 
resonant frequency. From the graph, draw a valid engineering 
conclusion about the relationship between natural frequency and 
resonant frequency as damping varies at fixed mass and spring 
constant. 

With m fixed at 8 and k fixed at 13, plot the surface f (c, b). This 
surface shows the response amplitude, at steady state, of a forced 
system with fixed mass and spring constant. The surface captures 
the dependence of this response amplitude on both damping and 
input driving frequency. 


. Given the IVP x?y" + 3xy’ + 6y = x-!, y(1) 22, y'(1) 2 —1. 


use a computer algebra system to obtain and plot the solution. 


. From first principles, provide a solution to the IVP in Exercise 


B14. 


(a) From a fundamental set determined from Exercise 14 part (a), 
obtain yn, the homogeneous solution. Verify that your choice 
for yy actually works. 


(b) Obtain the Wronskian. 
(c) Obtain the particular solution by Variation of Parameters. 
(d) Form the general solution. 


(e) Apply the data. The solution should agree with that found in 
Exercise B14. 


Euler's Differential Equation 


Attributed to Euler, the differential equation 1?y" + aty' + by = 0,t 4 0, is a useful 
example of a linear, nonconstant-coefficient differential equation with a known explicit 


solution, namely, 


ott Jal) =e 1 —G—«/ == 
y(t) = cL a+4/ (a—1) 38)... n pA a (a—1)?—4b) 


In addition, it actually arises in the solution of Laplace's partial differential equation in polar 
and spherical coordinates (Sections 29.1 and 29.4, explicitly; Section 29.5, implicitly). The 


b 
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FIGURE 5.19 Discriminant for Euler’s 
equation 
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EXAMPLE 5.23 
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5.12 The Euler Equation 


solution is a linear combination of two terms, each of which is t, the independent variable, 
raised to a constant power, as we will shortly verify. 


Transformation to Constant-Coefficient Equivalent 


For t > 0, the change of variables t = e*, that is, x = Inf, converts Euler's equation to 
a linear, constant-coefficient equation in the new variable Y (x). In particular, this change 
of variables is implemented by carefully clarifying all variables appearing. Thus, y(t) = 
y(t(x)) = Y(x) = Y(x(t)) or y(t) = Y(x(t)), to which we apply differentiation by the 
chain rule, obtaining 

dy dYdx ayl 

dt dxdt  dxt 


d'y d AREE 1 d&Y dx (1 Z 1\_aYfıi 1 dY 
dt? dtNdx/ t dxdt\t) | dx? dt Nt dx \ P) dx2NXP t? dx 


Substitution of these expressions for the derivatives transforms the Euler equation to 
Y 
dx? 
an equation with constant coefficients. This connection to the constant-coefficient equation 


explains the solution technique for Euler's equation. Next, we describe the Euler-equation 
analog to the exponential guess. 


dY 
+ (a — 1) — +bY =0 
dx 


Analog of Exponential Guess 


If t of the Euler equation is related to x of the constant-coefficient cousin by t = e*, 
then e^* = f^. Hence, the Euler equation should yield to the “power guess" much like the 
constant-coefficient equation yielded to the exponential guessof the characteristic equation 
is then A?+(a—LA+b=0, obtained from [AA — D £7] + ar[are ] + 
bt^ = t*[A(A — 1) -- aX + b] = 0, and the analog of the characteristic root is 


is ms P 


Just as the constant-coefficient equation had three classes of solutions corresponding 
to the discriminant of the characteristic equation, so too can we categorize the solutions of 
Euler's equation by the discriminant (a — 1)? — 4b. If b < ia — 1), this discriminant is 
positive and A is real. The boundary between regions where the discriminant is positive or 
negative is the parabola b — b(a) — L(a — 1)? in the ab-plane. On this boundary curve, 
the roots are equal; below it, real; and above it, complex. See Figure 5.19. Corresponding 
to the three possibilities for the discriminant, we consider the following three examples. 


With a — —4, b — 6 the discriminant is 1, so the roots will be real and distinct. Euler's 
equation will be £? y" — 4ty’ + 6y = 0 and the “power guess” y(t) = 1^ leads to A? — 5A + 
6 = 0. Consequently, 4 = 2, 3 and y(t) = cit? + ct’. E 


With a = —3, b = 13 the discriminant is —36, so the roots will be the complex conjugate 
pair A = 2 + 3i and a fundamental set will contain t+’! = 171°" and (273 = 12175, 
Exponentiation of complex numbers, discussed at length in Section 35.6, is defined by 
tP = efnt — cos(B Int) +i sin(B Int) 
tP =e Pint — oos(B Int) — i sin(B Int) 
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for t > 0, so the linear combinations 


TENE fn iom 
- ad + g~ = cos(B lnt) and m = pr = sin(f Int) 


are now real-valued functions. Hence, the general solution to the Euler equation ty" — 
+ 


3ty’ + 13y = 0 can be expressed as y(t) = cıt? cos(3 Int) + cof? sin(3 Int). aos 


EXAMPLE 5.24 If a = 3,b = 1 the Euler equation is (y + 3ty' + y = 0 and the roots à = —1, —1 
are determined by the “power guess” y(t) = t*. We are thus in the repeated-root case and 
initially have but the one solution y; = L, A second solution can be found by the reduction of 
order technique of Section 5.7. However, we should anticipate the result by analogy with the 
constant-coefficient equation where the solution e** generates the companion xe**. Since 
x = Int, a second independent solution for the Euler equation should be In(t)y; = int 


Reduction of order puts y(t) = u(t)yi = ne into the Euler equation, resulting in 
tu"--u' = 0 forthe determination of u(t). Setting v(t) = u'(t) gives the equationtv’+v = 0, 
from which we get v(t) = T and then u(t) = cı Int + cz, as expected. $ 
EXERCISES 5.12—Part A 
A1. Evaluate each of the following as a floating-point number in the (c) 52y" —3ty' -2y 20 (d) y” +5ty’+y 20 
form a 4- bi. (e) 67? y" + 2ty’+y 20 
@4i?  (b)7" (Q2 @3t* (e) 5+ A3. Obtain a fundamental set for each of the following. 


A2. For each of the following, write the general solution in terms of 


(a) 2y" —ty’+y=0 (b) Py" -3ty' -y 20 
real-valued functions. 


(c) ?2y'—5ty'--9y 20 (d) 42y" — 8ty' + 9y 20 


Det. a y T€ Q PE 7 Te á 
(a) 2t^y 4ty --S5y 20  (b)3rt^y Sty’ 4-8y =0 (©) 93y" — 3ty’ +.4y =0 


EXERCISES 5.12—Part B 


B1. Use the “power guess” y(t) = t^ to obtain the general solution of differential equation, and then restore the variable f in this 
the third-order Euler’s equation f? y" + 21? y" — 14ty' + 24y = 0. general solution, being sure the transformed solution agrees 
B2. Using the change of variables t = e", transform the equation in with the solution found in parts (a) and (b). 
Exercise B1 to one with constant coefficients. Solve the constant B4. ty" —2ty’+2y=0 BS. ty” —ty'-y 50 
coefficient equation and transform the solution back to y(t), B6. ty" ty -2y 20 B7. Êy” +5ty' +4y=0 


showing it agrees with the results of Exercise B1. BS. 2y” +3ty' Sy 20 BO. ?y”—6y=0 


B10. 62y" +5ty’-y=0 B11. 4?y" - y 20 
1 B12. ?2y"—5ty'--13y 20 B13. 9y" + 3ty' + y 20 
(a)rt-cexnex»0 r= x> (Qirolx-0 B14. y" —3ty' +8y=0 B15. Py” —9ty' -21y =0 
ai= 2g si rawa iara B16. 4?y" — 8ty' +9y 20 B17. 362y" + 13y =0 

x? 2 B18. 36r2y” + 12ty'+13y=0 B19. 6y" +. 7ty’ — 12y 20 
For the Euler differential equations in Exercises B4—26: B20. 2," -7:ty --4ly 20 B21. 5y” 4-7ty' -2y =0 


(a) Obtain the general solution using a computer algebra system. B22. 91?y" + 39ty’+25y=0 B23. t? y" + Aty' -2y =Int 


B3. Using each of the following, obtain the transform of the 
differential equation 1? y" + aty’ + by = 0, where t > 0. 


(b) Use the “power guess” (and Variation of Parameters where B24. fy" +9ty' +7y 21?t — B25. Py" + 7ty' -3y =t? 
necessary) to obtain the general solution in terms of real B26 


f . y" — Sty’ + 5y =1-2? 
functions. 


(c) Make the change of variables t = e* to obtain a 
constant-coefficient equation in the variable x. Solve this new 


EXAMPLE 5.25 
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The Green's Function Technique for IVPS 


Motivation 


The solution of the initial value problem y’(t) = r(t), y(0) = 0 is given by the integral 
y(t) = h r(x)dx, which therefore provides a closed-form expression for a class of IVPs. 
In IVPs of this class, the differential equation is the simple 4 y(t) = r(t) wherein the 
differential operator 4 acts on y(t) on the left of the equation. Writing the solution as 
an integral shows that it is possible to “invert” the differential operator by an integration, 
thereby obtaining an explicit representation of y(t). 

In this section, we seek to write the solution of a more complex initial value problem 


such as 
y”+2y'+10y=r(t) y(0)=y'(0) =0 (5.15) 


in the form of an integral y(t) = [A G (t, x)r (x) dx, where the function G (t, x) is called the 
Green's function (after George Green, 1793—1841) for the given differential equation. The 
Green's function is the "kernel" of the integral operator that inverts the differential operator 
defining the left side of the differential equation. 

In (5.15), the differential operator acting on y(t) is more complicated than simply £, It 
is the operator A = L +24 + 10, for which the inverse is no longer just simple integration. 
The inverse of the operator A is an integral with the function G (t, x) as the “kernel” or 
"core" of the integrand. Thus, differentiation is again inverted by an integration, but the 
more complicated differential operator in (5.15) requires a more complicated integration 
than that which suffices for y' — r. 

The following example illustrates how to construct the Green's function for the IVP 
(5.15). 


The solution of the IVP (5.15) is 


—t t t 
y(t) = — (| cos(3u) sin(3t)e"r(u) du -f cos(3t) sin(3ue"r(w) du) 

< 0 0 
which is actually just yp, the particular solution as determined by the Variation of Parameters 
formula. In fact, the characteristic equation is A? + 2A + 10 = 0, the characteristic roots 
are A = —1 + 3i, the fundamental set is {e~' cos 3t, e^! sin 3t}, the homogeneous solution 
is yg = e~'(Acos 3t + B sin 3t), the Wronskian is W = 3e~*', and by the Variation of 
Parameters formula the particular solution can be written as 


ET et cos 3t | "TT e™ sin3t , 
Yp = e™ sin 3t aoe "des cos 3t mm C 


If we replace the indefinite integrals with definite integrals, we introduce, at worst, 
multiples of y; and y2 that we can lump in with the homogeneous solution. For example, if 


yt) _ 
wo 0 4 = (tn) 
then 
AU C. assu EN UNION i 
»( f Wx)’ (x) dx = y2(t)[@(t) — &(0)] = » f wo 0 + Cy2(t) 


for some constant C. The term Cy2(t) can be moved into the homogeneous solution, which 
already contains a constant multiple of y2(t). Consequently, we are free to write the particular 
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solution as 


T "iQ B * ya(x) 
» =) | we) V9 ni) f wre 


and the general solution as 


y = (Ai + By) v |! eor) ds - (0 Í ee r(x) dx 
Applying the initial conditions, we obtain the two equations 
Ayi(0) + By2(0) =0 and Ay;(0) + By3(0) = 0 (5.16) 
whose solution is A = B = Oif 
yi(0)y3(0) — y,(O)y2(0) # 0 (5.17) 


But the left side of (5.17) is the Wronskian evaluated at t = 0. Since y, and yp are inde- 
pendent, the Wronskian is nonzero, even at t = 0. Hence, A = B = 0, and the solution to 
the initial value problem is just the particular solution, which we now write as 


_ fl yay — xi (yo) 
y(t) >] WG) r(x)dx 
This suggests defining the functions 
AL REE) — xii») 5. fo itx f 
iiim d W(x) and OA) ae a) ix at 


so we may write the solution to the initial value problem as 


y(t) =} G(t, x)r(x) dx 
0 


Since x < t throughout the interval of integration, G(t, x) = g(t, x) and the integral 
reproduces the variation of parameters solution for yy. The function G (t, x) is called the 
Green’s function for the initial value problem. 


Properties of the Green’s Function 
The Green’s function for the example of the previous section requires us to form 
g(t,x) = i sin(3(t — x))e- €—9? 


and hence 


0 ifx >t 
6a) = t sinG(t —x)e "7? ifx«t 
Figure 5.20(a), showing a graph of the Green's function as a surface over the tx-plane, 
suggests that along the line  — x the function has a sharp edge. The function is continuous, 
but not differentiable, along this line. Shortly, we will see that fort 4 x, G(t, x) isa solution 
of the differential equation, but along t = x the derivative E is discontinuous. 


EVALUATING y(f) Toevaluate y(t) atsomet = to, the integral y(t) = T G (to, x)r(x) dx 
is evaluated by integrating along the line t = f from x = 0 to x = tọ on the 45°-line x = t. 
The line segment along which the integration takes place lies under the "rounded" portion 
of the surface shown in Figure 5.20(a). 


dG dG 


THE DERIVATIVE r3 Figure 5.20(b) contains a plot of the derivative 77, graphed as a 


surface over the tx-plane. This derivative has a finite jump along the line t = x. The amount 
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The Green's function in (a) is continuous along the line t = x. Its derivative £2 along t = x 


dt 


is discontinuous, as shown in (b). 


of this jump, for this example, is 1. In fact, this jump in the derivative is actually given by 
the limit from the right less the limit from the left, that is, by 
: . dG 
lim — — lim — 
txt dt t>x- dt 
In the final portion of this section we will generalize this result for an arbitrary second-order 
linear differential equation ao(t) y" (f) + a, (t) y'(t) + a2(£) y(t) = r (t) to 
' . dG 1 
lim lim = — 
t>xt dt tox dt ao(x) 


= I 


(5.18) 


G(t, x) As A SOLUTION OF THE HOMOGENEOUS DIFFERENTIAL EQUATION By direct cal- 
culation, it can be shown that over any region that does not include points of the line x = t, 


the Green's function G (ft, x) is a solution of the homogeneous differential equation from 
which it came. Because the derivative u is discontinuous, G (t, x) cannot be a classical 


solution of this equation on the rectangle x > 0,t > 0. However, the Green's function 
G (t, x) is a solution of the homogeneous differential equation except along t = x, satisfies 
G(0, x) = 0, 3 =o = 0, and by (5.18), EH mL xe The Green's function is therefore 
said to be a generalized solution of the IVP. (See Section 6.11 for a further discussion of 


the Green's function.) 


Generalization 


If ao(0) Æ 0, the general second-order linear initial value problem 
ag(t) y" (t) 4- a() y () +a(t)yt)=r(t) — y(0) =y 0 20 (5.19) 
is solved by 


yi (x) yix) 


y= f Wena” -»o f Wwe 


_ [ RAY) — vi (yx) 
0 W (x)ao(x) 
enters each denominator when we divide the ODE in (5.19) by ao(x), 


ze 3 . As we did earlier, defining the functions 


z yo(t) yi x) — yi (t) yx) 
W (x)ao(x) 


r(x) dx 


1 
The factor zu 


making the right side become 


0 ifx t 
g(t,x) ifx <t 


g(t, x) and G(t,x) = | 
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lets us write the solution to (5.19) as y(t) = P4 G (t, x)r (x) dx. Therefore, G (t, x) is the 
Green's function for (5.19). Computing 


. dG . dG 1 
lim lim = 
t>xt dt t2x- dt ao(x) 


for G (t, x) establishes (5.18). 


EXERCISES 5.13-Part A 


A1. Given the IVP y" + 3y' --2y = te, y(0) = y'(0) = 0: 
(a) Solve by finding yz = yp + yp and applying the initial 
conditions. A2 


(b) Solve by finding the Green's function G(t, x) and computing 
h G (t, x)r(x) dx. 


EXERCISES 5.13-Part B 


(c) Show that the solutions in parts (a) and (b) agree. 
(d) Verify (5.18). 

. Repeat Exercise A1 for the IVP r?y” — Sty’ + Sy —1— P^, 
y(1) = y'(1) = 0. In part (b), the solution by Green's function 
would be y(t) = kh G(t, x) dx. 


ag(x) 


B1. If (5.17) holds, show that A = B = 0 is the only solution of B3. 
(5.16). B4. 


For initial value problems in Exercises B2-12: B5. 
B6. 


(a) Use a computer algebra system to obtain the solution. 


y" + 5y' + 6y = cos2t, y(0) = 0, y'(00) = 0 
y" +4y’+5y =1+4+1, y(0) 20, y'(0) 20 
y’+4y’+5y = e~ cost, y(0) = 0, y'(0) 20 
y" +4y' +4y = sin2t, y(0) = 0, y'(0) 20 


(b) Obtain G(t, x), the Green's function. B7. Gy! + YTy + 12y = 5cos3t, y(0) =0, y (3) = 0 

(c) Obtain the solution to the IVP from the representation B8. 15y" + 13y’ + 2y = 4te™ cost, y(0) = 0, y'(0) = 0 
y(t) = n G(t, X) dx. B9. 51? y" + 7ty' +4y 230, y(1) 20, y'(1) 20 

(d) Plot the Green's function as a surface over the tx-plane. B10. 6t?y” + 5ty’ — y 220, y(1) 20, y (1) 20 

(e) Plot 2o as a surface in the /x-plane. B11. 6:2y" + 7ty’ — 12y = 5t, (1) = 0, y'(1) 0 

(f) Show that in accord with (5.18), Uu jumps =a acrosst =x. B12. t?y” — 6ty' + 6y = tt, y(1) = 0, y'(1) =0 


B2. y" -3y' -2y =tsint, y(0) = 0, y'(0) 20 


Chapter Review 


1. In the context of a spring-mass system, interpret each term in the 
ODE 3y" + 5y' + 2y = 7cost. 

2. A spring hangs vertically from a support. To its other end is 4. 
attached a mass. In a coordinate system measuring displacement 
upward as positive, what initial conditions model the mass 


(a) being released from rest three units above equilibrium? 


(b) being tossed upward after being pulled two units below 
equilibrium? 

(c) being tossed downward from a position three units above 

equilibrium? 6 

3. A spring hangs vertically from a support. A weight of 1 Ib, attached i 

to the spring, stretches it 3 in, at which point the system is at 


equilibrium. Formulate an IVP that models the motion of the weight 
if it is released from rest at a position 3 in above equilibrium. 


The spring-mass system in Question 3, immersed in an oil bath, 
experiences a frictional force whose magnitude is one-half the 
velocity of the weight. Formulate an IVP that models the motion of 
the weight if it is tossed downward from a position 3 in below 
equilibrium. 


. What is the characteristic equation for the ODE in Question 1? 


What are the characteristic roots? What is the homogeneous 
solution for the equation? 


Is t? y" + 3ty' + 4y = 0a linear ODE? 
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. Form a linear combination of the functions cos ft and sin f. Is this the 


most general linear combination possible with these two functions? 


8. Define linear dependence. 


9. Define linear independence. 


. Express 2e 


. Show that (cos? t, sin? t} are linearly independent but functionally 


dependent. 


. State Euler's formulas. 


. Express 2e* in the rectangular form a + bi. 


73i in rectangular form. 


. Explain how the fundamental set (e? , e?/') can be replaced with 


the fundamental set {cos 2t, sin 2t}. 


. Demonstrate how the fundamental set (e 7?*??!, e—?-39"} can be 


—2t 


replaced with the fundamental set {e~* cos 3t, e~~ sin 3t}. 


. For each of the following, explain the term, give an example of a 


second-order linear ODE whose solution exhibits the given motion, 
and explain the connection between the motion and the 
characteristic roots. 


(a) free overdamped motion 
(b) free underdamped motion 


(c) free critically damped motion 


. The ODE for a spring-mass system has a characteristic root 


—2 + 3i. To the extent possible, find the mass, spring constant, and 
damping coefficient. 


. The homogeneous solution for a spring-mass system is 


y =e ‘(cos 2t — 3sin2t). To the extent possible, find the mass, 
spring constant, and damping coefficient. 


. A fourth-order linear ODE with constant coefficients has 


characteristic roots —2, —2, —2, —2. What is its homogeneous 
solution? 


. A fourth-order linear ODE with constant coefficients has 


characteristic roots —1 +i, —1 + i. What is its homogeneous 
solution? 


. An undamped harmonic oscillator is observed to vibrate with an 


amplitude of 5 and a period of 2. To what extent is the mass and 
spring constant for the system determined? To what extent is the 
initial position and initial velocity determined? 


. In each of the following, the solution of an IVP with a 


homogeneous ODE is given. Find a possible general solution. 
(a) y = 2te™ —5sint (b) y = 3t cos2t — 1 

(c) y=: —2t--5 (d) y «2cos5t + 3 sin 5t 

(e) y 22cos5t-F5sin3t (Ë) y =t cost + sint 


. In the method of undetermined coefficients, what is the appropriate 


form for the particular solution in each of the following ODEs? 
(b) y" -2y't-y — 1 sint 
(d) y" + 5y' + 6y = sin 2t + 3cos2t 


(a) y" +2y' +y = te^ 
(c) y" +2y' + y = te” 


24. 
25. 
26. 


27. 


28. 


29. 


30. 


31. 


32. 


33. 


34. 


35: 


36. 
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(e) y” +5y' +6y =t +t (f) y” +5y + 6y = 3e” 
(g) y" + 5y’ + 6y = e^! 4 3re?t 

(b) y" + 2y’ +2y =e” cost 

() y" --2y' +2y =e sin2t 


(D y" +2y -2y =e” (3cost +5sint) 


Give a verbal description of resonance. 
Give a mathematical description of resonance. 


Give the resonant and natural frequencies for the systems described 
by each of the following ODEs. 


(a) 2y" 3y +4y =O) 
(c) 4y" + 5y' c 4y = FO 
(e) y” -2y' +2y = f() 

Write a pair of possible characteristic roots for 


(b) 3y" c 2y' +y = f(t) 
(d) 2y" - 3y' +3y = f (t) 


(a) a critically damped oscillator. 

(b) an overdamped oscillator. 

(c) an underdamped oscillator. 

(d) an undamped harmonic oscillator. 

(e) an underdamped oscillator experiencing resonance. 

(f) an undamped harmonic oscillator experiencing resonance. 


Give a verbal description of the term steady state. Define it 
mathematically. Give a physical example of a system in its steady 
state. 


Give a verbal description of the term transient phase. Define it in 
mathematical terms. Give a physical example of a system in its 
transient phase. 

Define the terms homogeneous solution, particular solution, and 
general solution. What is the connection between these three terms. 


Answer true or false, and give a reason. 


(a) The homogeneous solution of a forced oscillator always decays 
to zero. 

(b) The homogeneous solution of a damped forced oscillator 
always decays to zero. 

The homogeneous solution for £? y" + 4ty' + 2y = 4/1 is 

y =at! + bt^?. Find a particular solution. 

State the general second-order Euler equation. Transform it to an 

equation with constant coefficients. 

Find the Green's function G (t, x) for the [VP 

y" + 3y’ + 2y 2 r(t), yO) = y'(0) — 0. 

Use the Green's function method to solve the IVP in Question 34 if 

r(t) — t. 

Explain how the Green's function allows us to generalize the 

integration process which solves the IVP y’ = r(t), y(0) = 0. 
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Chapter 6 


The Laplace Transform 


INTRODUCTION The Laplace transform is an example of an integral transform 
that will convert a differential equation into an algebraic equation. There are four operational 
rules that relate the transform of derivatives and integrals with multiplication and division. 
In addition, there are two shifting laws that relate multiplication by an exponential with 
translation. While not strictly necessary, a third shifting law sometimes appearing in the 
literature is also included. 

The Laplace transform is an effective tool for solving constant-coefficient, linear differ- 
ential equations. In particular, it readily handles equations in which the driving term (forcing 
function) is piecewise defined. It does this in conjunction with the Second Shifting Law and 
the Heaviside (unit-step) function, which represents the piecewise-defined function. 

The trigonometric functions sine and cosine are common periodic forcing terms in 
engineering systems. Although we discover the Laplace transform of these two functions 
almost immediately, there is a special formula for obtaining the transform of a general 
periodic function. This formula is very useful when solving equations governing spring- 
mass systems driven by periodic functions for which there is no analytic formula. 

Just as the derivative of a product is not the product of the derivatives, so too is the 
Laplace transform of the product of two functions not the product of the individual trans- 
forms. However, the Laplace transform of the convolution of two functions, a special type 
of multiplication for functions, is the product of the individual transforms. This convolu- 
tion theorem is used to invert some Laplace transforms and to obtain convolutions without 
evaluating the convolution integral. 

The last two sections of the chapter discuss (x), the Dirac delta "function," and its 
relation to the Green's function. Although a complete description of ô(x) is well beyond 
the scope of this text, the object itself proves to be so useful that it is hard to ignore it, even 
in a first course in differential equations. 

The algebraic equation x? + 1 = 0 has no solution in the real numbers, but inventing the 
complex numbers allows this equation to have the solutions x = +i. Similarly, there is no 
pointwise-defined function f(x) whose Laplace transform is 1. The fabrication of such an 
object, à (x), takes us outside the realm of pointwise-defined functions, and into the domain 
of “distributions,” where the solution of a BVP such as y" +2y’+ 10y = d(x — t), y(0) = 
y(1) = 0, is actually a Green's function. 


Definition and Examples 


Introduction 


The Laplace transform F (s) is given by the following. 


Laplace 
IVP for y(t) | ————— 
transform 
y(t) «4—— —— 
Invert Y(s) 


Algebraic 


equation 
in Y(s) 


FIGURE 6.1 Schematic: Solution of IVP 


by Laplace transform 


EXAMPLE 6.1 


EXAMPLE 6.2 
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DEFINITION 6.1 


FG) - fe» f f (e^ dt (6.1) 
0 


It is an integral transform of f (t) in which, by the defining integral, the variable t is 
“integrated out" so that only s remains. The input to this integral is a function f (t); and the 
output is a function F(s), called the Laplace transform of f (t). We adopt the convention 
that if the input function is f(t), then its Laplace transform, L[ f (t)], will be denoted by 
F(s). The variable ¢ is typically time, and we speak of f(t) as being defined in the time 
domain. Similarly, we speak of F (s) as being defined in the transform domain, sometimes 


called the frequency domain. 
Because the upper limit of integration is infinite, the integral is improper and must be 


evaluated by the limiting process 


oo T 
j fe" dt = lim Í f (De dt 
0 T—oo 0 


The principle use of the Laplace transform is the conversion of differential equations, 
into algebraic equations, which are then easier to solve. The schematic in Figure 6.1 diagrams 
the process for solving an initial value problem. The IVP is transformed to an algebraic 
equation in Y (s), the Laplace transform of y(t), the solution of the IVP. An algebraic 
equation is solved for Y (s), and an inversion process maps Y(s) back to y(t). Before 
giving an example of this process in Section 6.2, we first calculate the following elementary 
transforms. 


The Laplace transform of the function f(t) = 1 is an improper integral that converges if 
s > 0. Thus, 


oo T 1 —sT 1 

—st ; —st . e 
un ro | le ^" dt = lim f e " dt — — — lim == 
0 T—co Jo AY Too S M 


S 


exists because limr.,5, e~*’ = 0 under the assumption on s. kod 


o 
117 
$S*--o* 


The Laplace transform of f(t) = sin ot is the function F(s) = 
improper integral that converges if s > 0. Thus, 


again given by an 


oo T 
L[sin or] = F (s) = f sin(wt)e *' dt = lim | sin(ot)e *' dt 
0 T—oo Jo 


et w 
= lim (co cos oT + ssinoT) = 
s$2--o9? T>% s? +o? s? +o? 


exists because limz.,4, e~*? = 0 under the assumption on s and c cos T + s sin øT is 
bounded as a function of T. 

Similarly, for f(t) = cos ct, we find F(s) = pig provided s > 0. Under the as- 
sumption on s, the improper integral in 


oo T 
L[cos ot] = F(s) = f cos(ot)e * dt = lim Í cos(wt)e dt 
0 0 


T—oo 
—sT 


s . e i 
= + lim — ;(osincT —scoswT) = 
+ wr 


S 


5 


s2 + o? 
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EXAMPLE 6.3 


Pss 


+>— Sy t 
0 1 2 


FIGURE 6.2 Piecewise continuous f (t) 
in Example 6.3 


EXAMPLE 6.4 


1 2 3 4 3 


FIGURE 6.3 Piecewise continuous f (t) 
in Example 6.4 


A. >x 
0 1 2 


FIGURE 6.4 Comparison of e™* (solid) 
and 1 — x (dotted) 


converges, this time because csincT — s coswT is a bounded function of T, and 
. mes + 
limr_..e7! = 0. e 


Not every function can be expressed by simple analytic formulas. For example, the piecewise 
continuous function 
1 iftxl 


f= |, ift>1 


graphed in Figure 6.2 requires two rules for its definition. Hence, its Laplace transform is 
given by 


1-—e“ " 


oo 1 oo 
F(s) = L[f(t)] = Í fe dt= Í le^ dt «f Oe dt = 7 t 
0 0 1 


In Section 6.5 we will express such piecewise-defined functions with the Heaviside 
function (after Oliver Heaviside, 1850-1925). 


Figure 6.3 is a graph of the piecewise-defined function 


w= 0 ift<2 
fes 1 ift>2 


whose Laplace transform is given by the improper integral 
co 2 oo 
F(s) 2 Lf] = f fOe dt = f 0e^* dt «f le^* dt 
0 0 2 


a! oad RÀ 
. T 2d e? . e sT ews 

= lim & “g= — lim = 
T-oo Jo $ Too S AY 


which converges, provided s > 0. ks 


Existence of Laplace Transforms 


Not every function has a Laplace transform. Some functions grow too quickly for finite 
values of t, and some functions grow too quickly at infinity. In particular, the function 


0 t=0 
1 
0 ISt 


is too large for finite t, whereas the function f? = e' i grows too quickly as t approaches 
infinity. 

Indeed, to compute the Laplace transform of f(t) the integral [^ (e ^3 /t) dt must be 
evaluated. However, its integrand is unbounded, and it does not exist as a Riemann integral. 
Figure 6.4 suggests that e~* > 1 — x on x > 0 (the minimum for g(x) = e~* — (1 — x) 
occurs at x = 0 since g’(0) = 0 and g"(0) = 1), so for 0 < t < 1 and s > 0 we have 
1 — st < e^. Thus, for t, s > 0 we find 


I gcst l1—st . 
f dt > dt = — lim In(t) — s = oo 
0 t 0 f t—0* 


To compute the Laplace transform of f(t) the integral fj" ee’ dt = [O° ef) dt 


must be evaluated. However, for t > s +€, € > 0, we find e't79 > e*', so h et-9 dt > 


t +> t 
0 1 2 3 


FIGURE 6.5 Comparison of e” (dashed) 
and e" (solid) 
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i. e*' dt = oo; so again, the improper integral, and hence F(s), fail to exist. Figure 6.5 
(where f; is graphed as a solid line and e” as the dashed line) suggests that eventually 
e > e for any positive œ because e" = e“ att = a. In fact, for any positive K anda, 
fa grows faster than K e*' because lim; >o fo/Ke™ = lim; e 9 /K = oo. 

Functions like fı fail to be piecewise continuous on [0, oo), that is, they fail to be 
continuous at all but a finite number of points that are either jump or removable disconti- 
nuities. Functions like f? fail to be of exponential order; that is, they fail to be bounded by 
an exponential of the form K e?', a > 0. Ruling out these two shortcomings leaves us with 
those functions that have Laplace transforms. This distillation is formalized in the following 
existence theorem for Laplace transforms. 


THEOREM 6.1 


1. f(£) is piecewise continuous on [0, co). 
2. f(t) is of exponential order (| f(t)| < Ke% for some K anda > 0) 


=> F(s)-—.ELf(t)|-— | f(t)e™ dt exists for s > a. 
0 


Proof 
If f (t) is of exponential order, then | f (t)| < Ke fort > T and somea > 0. Consequently, 
oo oo T oo 
fi fe dt} < / |f (e " dt = i |f (1e *' dt + Í |f (e *' dt 
0 0 0 T 
On the finite interval [0, T], f(t) is bounded by a constant M because of piecewise con- 
tinuity. On the unbounded interval [T, oo), by the assumption of exponential order, it is 
Í= eT eT (@-s) 
where, for s > a, each integral on the right is finite and therefore exists. 


bounded by K e*'. Hence, we have 
oo oo T oo 
fi f@e™ dt) < / |f (le dt < Í Me™ dt + | Ke“e dt 
0 0 0 p 
-M———--K 
5 

The conditions of piecewise continuity and exponential order are sufficient to guarantee 

the existence of the Laplace transform but not necessary. The function f(t) = 3 is not 


c= a 


piecewise continuous on [0, oo) because lim,.9+ f(t) = co. Yet, its Laplace transform 
LXX ay: 
F(s)= e exists. 


5 


Al. Does f(t) = t^?,t > 0, have a Laplace transform? Explain. A4. Without integrating, obtain L[3 sin(5t + Ẹ)]. 
A2. If L[1] = 1, what is L[3]? Explain. AS. If F(s) = 45. find f(t). — A6. If F(s) = 355, find fo. 
A3. Without integrating, obtain L[cos(2t — 1)]. Hint: Expand the A7. If F(s) = xm find f(t). 


trigonometric function. 
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EXERCISES 6.1—Part B 


B1. Use the definition (6.1) to obtain the Laplace transform of 
(a) f() 2t b) f() =e” 
For the functions given in Exercises B2-1 1, obtain the Laplace transforms 


(a) using the definition (6.1). 


(b) using a computer algebra system; be sure to reconcile the 
answer with the results in part (a). 


B2. f(r) 26: —13 B3. f(t) 2 52 +3t—4 
B4. f(t) 22te^" BS. f(t) = 3? sin3t 
B6. f(t) 2 4e? cos5t — B7. f(t) = Vt 


t 
B8. f(t) = 2te * cos P] B9. f (t) = sint cost 


B10. f(t) = cost B11. f(t) 2 t + sint 


In Exercises B12—16, a function f (t) is depicted by a graph in which the 
rightmost segment extends to infinity. For each: 
(a) Construct an analytic formula for the function. 


(b) Obtain the Laplace transform by applying the integral 
definition. 


B12. See Figure 6.6. 


0 1 2 3 4 5 6 
FIGURE 6.6 Exercise B12 


B13. See Figure 6.7. 


f 
A 
4-4 
(2, 3) 
3+ 
2-T- 
1+ 
<1} _} + >t 
0 1 23 4 5 67 8 
FIGURE 6.7 Exercise B13 


B14. See Figure 6.8. 


FIGURE 6.8 Exercise B14 


B15. See Figure 6.9. 


pe 


7 
6 G, 5) 
5+ 
4+ 
3+ 
2+ 
14 
0 ——|—-1—_} > 1 
ex] 8 9 10 
-2 (7, 22) 
-3 
-4+ 
-5+ 
FIGURE 6.9 Exercise B15 
B16. See Figure 6.10. 
f 
A 
24 
" (2, 1) 
1 2N3 4 5 6 
0 ! t I—]1 t 
-l+ 
=) 
34 
-4+ 
-5+ (5,25) 


FIGURE 6.10 Exercise B16 


6.2 Transform of Derivatives 135 


Transform of Derivatives 


Laplace Transform of Derivatives 


As depicted in Figure 6.1, our primary interest in the Laplace transform is its use in solving 
initial value problems. Hence, we need to know how to take the transform of a derivative. 
Now in Section 6.1 we discovered that L[sin t] — zu and L[cost] — SÉ The functions 
sin t and cos f are related by differentiation, and their transforms by a factor of s. Specifically, 
we note 


| us] pes] 5 : ) L[sin t] 
— sin = COS = = = sS sın 
dt s2? +1 s? +1 


d 1 
L E cos: | = L[-sint] = -7 =s (a A ;) — 1 — sL[cos t] — cos(0) 


which are both manifestations of the operational law 


Liy ®©] = sL[y(0)] — »(0) 


Thus, differentiation in the time domain is related to multiplication by s in the transform 
domain (also called the frequency domain). The Laplace transform of the derivative y'(f) is 
essentially s times the transform of y(t). Of course, there's a detail, namely, the subtraction 
of the value y(0), but the basic connection is: differentiation of the function is related to 
multiplication of the function's transform by s. 

The following display, in which Y (s) is the transform of y(t), articulates this rule for the 
first and higher derivatives. We make the observation that “the powers on s descend, while 
the order of the derivatives ascends" before moving to a derivation based on integration by 
parts 


Liy (0)] 2 5Y (s) — yO) 
L[y"(t)] = s?Y (s) — sy) — y'(0) 
Liy” (t)] = SY (s) — s?y(0) — sy (0) — y"(0) 
Lly® O] =s*¥(s) — 5$y(0) — s*y'(0) — sy"(0) — y"(0) 


Derivation Integration by parts, applied to a definite integral, takes the form 


b b 
/ udv = uv]? — J vdu (6.2) 


Taking u = s *' and applying (6.2) to the integral defining the Laplace transform of the 
derivative y’(t), we get 


S 


LY = [ y (ne dt =e“ y(t) 19° -f —sy(t)e^ dt 
0 0 


: | im. se! y(r) — »(5) 4 sY(s) = sY (s) — y(0) 


Since the integral defining a Laplace transform is improper, we have evaluated the boundary 
term at infinity by taking the appropriate limit, which exists under the assumption that y (1) is 
of exponential order. In particular, |y(t)| < Ke*' fort > T means |e~ y(t)| < Ke tS, 
so the limit in question is zero provided s > a. 
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Transform Solution to an Initial Value Problem 


As motivation for studying the Laplace transform, we solve the initial value problem 
y” + y = 1, y(0) = y'(0) = 1 by Laplace transform techniques. We begin by taking the 
transform of both sides of the differential equation, obtaining, in light of the result on 
transforming derivatives, 


2 1 2 l 
sY (s) —sy(0) — y (0) + Y (s) 2 — andhence (s^ — 1)Y(s)— s — 1 = : 
s : 


The unknown in this equation is now Y (s) = L[y(t)], the Laplace transform of the unknown 
function y(t). So, instead of having to solve a differential equation to determine y(t), we 
need only solve an algebraic equation for Y (s), getting 
sts+1 1 1 
Y(s) adipex uo NONO T cm + 5 
s(s^ +1) s sl 
where the fractions on the right are obtained by a partial fraction decomposition. (See the 
exercises for a review of this technique.) By inspection and memory, we notice that we have 
already met both of the transforms, the first being the transform of 1 and the second the 
transform of sin t. Hence, (6.3) determines y(t) = 1 + sin f. 

That is the basic idea behind using the Laplace transform for solving initial value 
problems. Clearly, the more transforms we know, and the more we know about the behavior 
of the Laplace transform in general, the greater the range of initial value problems we can 
solve with this technique. So, it is to these objectives we now turn. 


(6.3) 


Transform of t" 


Recall that we have already obtained, by direct integration, L[r?] = L[1] = H, Using the rule 
for the transform of a derivative, we can determine the transforms of t, t°, t°, . . . , eventually 
generalizing to the transform of t". Table 6.1 shows how the transform of t^, k = 1,.... 4. 
can be recursively computed from the transform of t*—!. 


1 1 
S es Iti -i zo) 2-8] ED] -—— 
5 dt s? 
un silii -iumsum-il 
2 2 dt 2 "E 
i ; lida). GP s Sg 
—— = ad = — —(t^ L—— " L = = 
3 Lir] =L ET ] 5 4t ] 2 Lir] 
3-2-1 3 ra" B. Vn p 8d 
= ST = —-— =- L ee c NEA 
L[^] =L E (t ] gee T= LF] 5 
TABLE 6.1 Transforms of t”, n =0,..., 3 


The generalization for n, a nonnegative integer, is then inferred to be 


ny _ 
L{t je gl 


a result that can be proved by induction. A further generalization to the case of n = a > 0 


6.2. Transform of Derivatives 137 


Tr(a) would be 
A T (a 4- 1) 
— UT c 
10 L = [t°] = — (6.4) 
8 where, for a > 0, 
6+ nS. 
Tr(a) = f e z^ dz (6.5) 
4 p 0* 
a+ is the gamma function, which, because I (a + 1) = aT (a), reduces to the factorial function 
when a is the positive integer n. Indeed, since (6.5) gives l'(1) = 1, when n is a positive 
t +++} a š 
0 1 2 3 4 integer we have 
FIGURE 6.11 The gamma function T(n 4-1) =n (n) = n(n — 1) (n —2) =. =n(n—1)--- (1x T(1)) 2n! 
T'(a),a>0 
Figure 6.11 contains a graph of T (a) for a > 0. 
grap 
Finally, recall that in Section 6.1 we saw the transform L[r-!/?] = xt which we 
f F(s) can now obtain from (6.4) by taking n = —5 and using T (4) = yr. Thus, L[r-!?] = 
T(—1/24-1) r(1/2) Jn 
1 s-U7* — “siz — s 
1 -,s>0 
AY 
1 Transform of e” 
t —,s>0 
s? The Laplace transform of f(t) = e” is determined from the defining integral 
p? «S 0 oo oo 1 
s L[e^'] =} ete di =) g 9798 dt = — 
n! 0 0 5—a 
" nal? 520 . ; r ON " a. 
s either by fully evaluating the integral or by recognizing that with s — a treated as s, it is 
sin est -—— MÀ the same as the integral for the transform of 1. Since fj" e^ dt = +, it is immediate that 
set o? m" e G-90t dt a 
s 0 A . f 
cos wt Aga’ s>0 We can immediately determine the transforms of sinh(wt) and cosh(or) as follows: 
‘i 1 : e” — got 1 1 1 w 
e?! ,$»dà L[sinh(cot)] = L = = —— 
s—a 2 2|s—o sta s? — w? 
w 
sinh wt > =, 5 >W er A 1 1 l b 
SP NP L[cosh(ot)] = L | ——— | = = ES - ; 
s 2 2|s—o sco s2? — w? 
cosh wt ———,.$» 0 
$2 = w2 
Table of Transforms 
TABLE 6.2 Table of Laplace transforms Table 6.2 is a summary of the transforms we have learned. 
EXERCISES 6.2—Part A 
A1. To obtain the partial fraction decomposition in (6.3), write (a) S39 (b) 6s? + 5s +14 
DH = 4 4 BC and multiply through by s(s? + 1) to obtain s(s? — 3) s(s? +7) 
s? +s +1 = A(s? +1) +s(Bs +C) = (A+ B)s?+Cs+A, © s +l gi a e d 
which must be an identity in s. Matching coefficients of like s?(s? +4) s?(s? +4) 
powers of s gives the three equations A+ B = 1, C— 1, A— I, . _ 
whose solution is A = 1, B = 0, C = 1. To obtain the partial A2. Use (6.5) to verify that '(1) = 1. 
fraction decomposition of each of the following fractions. (A A3. Use (6.5) and integration by parts to verify T (a + 1) = 


repeated factor s? in the denominator requires 4 as well as 5.) aT (a). a > 0. 
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A4. Use the result in Exercises A2 and 3 to verify that T (10) = 9!. 


AS. For each of the following IVPs, obtain Y (s), the Laplace transform 
of the solution y(t). 


(a) 3y” + 4y’+ 5y =t, y (00 = 1, y'(0) = —1 
(b) 2y" +3y' + 6y = e7”, y(0) = 2, y'(0) = —3 
(c) 5y” + 8y' + 3y = cos 2t, y(0) = —2, y'(0) = 1 


EXERCISES 6.2—Part B 


A6. By inspection, determine f (1), the inverse Laplace transform for 
P p es afe oe : a+b _ a b 
each of the following. Hint: where applicable, 54 = —— + g7 


(c) F(s) = 


s2—4 s+4 


ä 


2s +3 5 
— b) F(s) = 
45 (b) F(s) 


(a) F(s) = 


B1. Using the well-known properties of the integral, show that 
Llaf (t) + bg (t)] = aLLfG)] + bL[g)]. 
In Exercises B2—6, obtain the Laplace transform F (s) using 
(a) a computer algebra system's built-in command. 


(b) the linearity of the transform and the special properties of 
each function, not the definition (6.1). 


(c) the definition (6.1). 

B2. f(t) = sin(3t — 5) Hint: Use a trigonometric formula for the 
sum/difference of two angles. 

B3. f(t) = 4cos(2t + 7) 

B4. f(t) 2 3e*^? Hint: Use a special property of the exponential 


(c) Obtain the transform of f” (t). 
(d) Demonstrate the validity of the formula L[ f"(t)] = s? F (s) — 
sf (0) — f'(0). 
B10. f(t) 2te B11. f(t) = tsin5t 
B12. f(t) = te” cos3t B13. f(t) = 4P +5 — 7t —9 


In Exercises B14—16, solve the given IVP by 


(a) obtaining the Laplace transform of the ODE, solving for the 
transform of the unknown solution, and inverting. 


(b) using a symbolic differential equation solver in a computer 
algebra system. Show that the two solutions agree. 


B14. y" + 4y’ +4y = 2sin3r, y(0) = —2, y'(0) 23 


function. 
B5. f(t) = sin? (3t — 1) Hint: Use a half-angle formula. 


| B6. f(t) = cos? (5t + 2) 
| In Exercises B17-19, obtain f (t) by 
In Exercises B7—9, invert each Laplace transform F (s) by 


B15. y" + 6y' + 9y = 3cos5t, y(0) = 1, y'(0) = —2 
B16. y" + 4y’ + 13y = 5e7?', y(0) 23, y/(0) = — 1 


(a) using a computer algebra system’s built-in functionality. 


(a) using a computer algebra system’s built-in functionality. (b) applying pattern recognition to a partial fraction 


(b) applying pattern recognition to an algebraic rearrangement decomposition to the given F(s). 
of js : — ian Ei. Bis) 2st + 15s +45 BIS. F(s) 5s? — 6s + 57 
m —2 . F(s) = ———————- . F(s) = ———————— 
B7. F(s) = 5 Bü Fel HAEC s*(s 4-3) (s — 2)(s? +9) 
S^ pA s +9 s — 25 7s* + 6s? + 54 
In Exercises B10—13, for the given function f (t): B19. F(s) — ead 9j 


(a) Obtain the Laplace transform F (s). 
(b) Obtain the second derivative f"(r). 


First Shifting Law 


Operational Laws 


The success of transform techniques in solving initial value problems hinges on their op- 
erational properties. Rules that govern how operations in the time domain translate to 
operations in the transform domain are called operational laws. We have already met 
one such law, namely, the rule for computing the transform of a derivative. The rule 
L[y'(0] = sL[y(t)] — y(0) is the first of four operational laws governing differentiat- 
ing and integrating transforms and multiplying and dividing transforms by t. Section 6.4 is 
devoted to a study of all four of these operational laws. 


EXAMPLE 6.5 


EXAMPLE 6.6 


EXAMPLE 6.7 


EXAMPLE 6.8 
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However, before studying them, we examine the first of three shifting laws. It may 
be argued that the shifting laws are also operational rules, but we will reserve the phrase 
operational laws for the four laws linking multiplication and differentiation, division and 
integration. 

In this section we examine the first of three shifting laws, the law that shows how to 
take the transform of a product in which one of the factors is an exponential. This First 
Shifting Law, 


Lje” f (£)] = F(s — a) (6.6) 


says that if you know F (s) is the transform of f (t), then you know the transform of e“ f (t). 
It’s just F(s — a). Thus, multiplication by an exponential in the time domain is a shift in 
the transform domain. 


The Laplace transform of f(t) = sin 3t is F(s) = so the transform of e~” sin 3t is 


EE 
F(s — (—2)) = F(st2)— aan $ 
The Laplace transform of f (t) = cosh 5t is F (s) = r =% cosh 5t 
is F(s +2) = ys 4$ 
Although we discovered the transform L[e^] — + by direct integration, it can also 
be obtained by applying ©. 6) to the function 1 x e^. With f(t) = 1 so F(s) = 
L[1 x e*'] = F(s — a) = —. We see, then, there are sometimes several ways to vina a 
given transform. b 


This final example illustrates the use of the First Shifting Law “in reverse,” that is, in 
service of inverting the transform F(s) = 5-5. We represent the inversion operation 
with notation L-![F(s)] = f(t) and call f(t) the inverse Laplace transform of F (s). 
Although there is an integration process that produces this inversion (see Section 36.2), it 
is generally difficult to evaluate the integrals involved. Instead, we use a process of pattern 
recognition. 

For example, no transform in Table 6.2 contains a complete quadratic in the denom- 
inator. The denominators in the transforms of the trigonometric and hyperbolic functions 
are of the form s? + œ? and are not the complete quadratic form s? + as +b. Now, how can 
this complete quadratic form arise? Certainly if s — s — a in a denominator of the form 
5? +o”, that is, if the First Shifting Law had been used to obtain the given transform. Thus, 
we are inspired to complete the square in the denominator of the given transform F(s), 
hoping to see evidence of the shift of from s to s — a. 

Thus, we write 


S (s+1)-1 84-1 1 
(8+1) +2 (s-1?-2 (s+1}+2 (s+1}?+2 
where, after completing the square, we made sure every appearance of an s was in the form 
of s + 1 because we wanted F (s) to have the form F(s + 1) for some new function Ê (S). 


Here, this was done by simply adding and subtracting 1 in a single location. We could also 
have achieved 


F(s) = 


F(S) = 
= 349 242 


by substituting s — S — 1 in F(s). 
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The function £ (5) is inverted as a function of 5, yielding f(t) = cos /2t— a sin /2t. 
This is the function that was multiplied by an exponential so that the First Shifting Law 
could be invoked in producing the original F(s). Hence, the inverse of F(s) is f(t) = 
e f(t) = e^ (cos 2t — +5 sin /2t). 

An alternative approach based on a partial fraction decomposition can also be effective. 
Here, the denominator factors over the complex field, a factorization favored in electrical 
and controls engineering. Thus, write 


14 iv2 1. iv2 
2t 2 


gi 4 
stl—-i/2 s+1+iv2 
and recognize the transform of an exponential in each fraction, obtaining 


1 i42 1 iv2 
—[2.l:YÀ5]),40142: Í ENE) pl-i? 
ro- (1 Z “(5 Pe 


F(s) = 


Se + i v2) (cos V2t + i sin V2t) + (2 — i V2) (cos V2t — i sin 21)] 


1 
= e^ | cos /2t — — sin V2t 4 
/2 


Justification 


The validity of the First Shifting Law follows upon examining 


Lie“ f(t)] = Í e f (t)e ^! dt — Í f (De $9?! dt — F(s—a) 
0 0 


where, in the second integral, the quantity s — a becomes the argument of the transform of 
f (t). Clearly, s > a is required for this transform to exist. 


EXERCISES 6.3—Part A 


A1. For each of the following functions f(t), use the First Shifting © F(s) = e(s — 2) (d) F(s) = 2e 
Law to obtain F(s), the Laplace transform. s —4s +1 s?--2s —3 
me 
(a) fü) Pe — (b) f(t) 2 e" cos 4t bi) dre mane 
" — 57244 ot 
i UP =e smi? In Exercises A5-7, obtain the inverse Laplace transform in each of two 
A2. For each of the following functions f(t), obtain the Laplace Ways. 


transform F (s) using the First Shifting Law. 
(a) f(t) =e cosh4t — (b) f (t) = e” sinh 5t 


A3. Obtain the Laplace transforms of the functions in Exercise A2 by 


(a) Perform a partial fraction decomposition, then invert the 
individual fractions. 


(b) Complete the square in the denominator, and use the First 


first expressing each function in exponential form and then using Shifting Law. 
- a for the transform of an exponential. Be sure both solutions U Shape nth mbok dine the semet: 

A4. Invert each of the following Laplace transforms using the First AS. F(s) = stt T4 A6. F(s) — —9 9 -3 
Shifting Law. (s rd 1) (s — 1)(s — 5) 
@ Fo = b Fw) = = An POT 66-5 


s? + 10s + 25 s? — 6s 4-11 
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EXERCISES 6.3—Part B 


B1. Using the First Principles of exponential guess, characteristic B7. F(s) = 7 B8. F(s) = — s+5 
equation, characteristic roots, fundamental set, homogeneous s+6 s? + 6s —2 
solution, Undetermined Coefficients, particular solution, and B9. F(s) = 4s —3 B10. F(s) = s 
general solution, for example, solve the IVP y" + 2y’+ s* + 85 —5 (s — 5)(s + 2) 
2y =te~*, y(0) = —1, y'(0) = 2. Check your answer B11. Work Exercise B10 by splitting F (s) into two fractions via a 
with a computer algebra system. Plot the solution. partial fraction decomposition. Invert each fraction. Show the 
B2. Solve the IVP in Exercise B1 using the Laplace transform. Use a answer is equivalent to the answer found using the First Shifting 
computer algebra system as needed. Law. 


B12. Given the graph of the piecewise-defined function f(t) shown in 
Figure 6.12, obtain its Laplace transform by writing a formula for 
f (t) and then applying the integral definition of the Laplace 

(a) applying the First Shifting Law. transform. The rightmost segment of f (t) extends to infinity. 


(b) using a computer algebra system's built-in functionality. 
B3. f(t) =e" sinh3t — B4. f (t) = e^? cosh2t 
Bs. f(t) =e cos(7t —3) B6. f (t) = te" 


In Exercises B3-6, obtain F (s), the Laplace transform of the given f(t) 
by 


In Exercises B7—10, find f (t), the inverse Laplace transform of the given 
F(s), by 


(a) applying the First Shifting Law. 


(b) using a computer algebra system's built-in functionality. FIGURE 6.12 


Exercise B12 


Operational Laws 


The Four Little (Operational) Laws 


We have already seen the first of four operational laws governing the behavior of the Laplace 
transform. This first law, the rule for the transform of the derivative, showed that, to within 
a detail, taking a derivative in the time domain was equivalent to multiplication of the 
transform by s in the transform domain. 

The First Shifting Law is another example of an operational law. We will discuss two 
other shifting laws, one in Section 6.5 and one in Section 6.6. Here, we concentrate on the 
paradigm of the derivative law: differentiation in the time domain becomes multiplication 
by s in the transform domain. 

The four operations of differentiation, integration, multiplication, and division pair up 
in a curiously symmetric way, making up four operational rules that are best learned, and 
remembered, by the symmetry in the rules. This approach to the operational rules was 
presented to the author by Professor Syl Pagano of the Math Department of the University 
of Missouri-Rolla in 1965. 

To within a detail in each case, differentiation and multiplication pair up in either direc- 
tion, as do integration and division. The precise statement of the resulting four operational 
laws is given in Table 6.3. The detail in each instance can be seen in the statement of the rule. 
The rule for the transform of the derivative is stated for y" (t), the second derivative, because 
the second derivative most often appears in the damped oscillator problems of science and 
engineering. The symbol Y (s) is synonymous with L[y(¢)]. 

The detail for “multiply by t — differentiate in s" is the minus sign needed in front 
of the derivative. The detail needed for “divide the transform by s" is “integrate y(t) from 
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EXAMPLE 6.9 


2 : 1 
L[y"] = s^Y(s) — sy (0) — y'(0) L n væar] uii. 
0 n 
L[ty()] = 2 vij L ka = [i Y (x) dx 
ds t s 


TABLE 6.3 Formal definitions of the Four Operational Laws 


0." The detail needed for “divide the function by ¢” is to integrate the transform from s to 
infinity. 
A terse distillation of these operational rules would be to remember the pairings 
(differentiate <> multiply) and (integrate < divide) 


which are elucidated by the four lines in Table 6.4. If differentiation is applied in the 
time domain, then multiplication is applied in the transform domain. If multiplication is 
performed in the time domain, then differentiation is applied in the transform domain. 
Similarly, if integration is performed in the time domain, then division is performed in the 
transform domain. If division is performed in the time domain, then integration is performed 
in the transform domain. 


Time Domain Transform Domain 
Transform a derivative Multiply transform by s 
Multiply function by t Differentiate transform 
Transform an integral Divide transform by s 
Divide function by t Integrate transform 


TABLE 6.4, Symmetries in the Four Operational Laws 


We have already inferred the rule L[t"] = n!/s"*! from the operational law for the transform 
of a derivative. We show here how this same result could be obtained by induction based on 
the operation law “multiplication by t becomes differentiation in s." A proof by induction 
begins with the validation of the claim for the first few cases, given in Table 6.5, and then 
shows the truth of the general case based on the truth of the preceding case. 


f d dl 1 

HA bts = DHI = = 

ds ds s $4 

LI] = Lit x t] d rin ONE 
- = x = = = 

ds ds s? s? 

d d 2 3! 

L[^] = Lit x °] 2——L[] =-—= = = 

Pl [xr] ds Ui dss? s^ 


2. n! . 
TABLE 6.5 Obtaining L[¢”] = —— by mathematical 
sf 
induction 


EXAMPLE 6.10 


EXAMPLE 6.11 


EXAMPLE 6.12 


EXAMPLE 6.13 


EXAMPLE 6.14 
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An induction step would fit in here. To show the general case, namely, L[t"] = n!/s"*!, 
assume the truth of the previous case and show the general case follows from that previous 
case and the operational law. Thus, assume L[t”~!] = (n — 1)!/s" to be true, and bootstrap 
one more time via 


n n— d n— d | (n — V! n! 
L|t^] = L[t x t de L{t a ay | m | s sn * 


The Laplace transform of the function f sin 3t is obtained by the operational law *multipli- 
cation by t becomes differentiation with respect to s." Thus, 
d 3 6s P 


d 
Lit sin 3t] = —— L[sin 3t] = = «e 
ds ds $2--9 — (s24-9»? 


The Laplace transform of the function t cos 3t is obtained by the operational law “multipli- 

cation by t becomes differentiation with respect to s." Thus, 

d s s2—9 à 
= e 

dss? +9 — (s2-4-9»? 


d 
L[t cos 31] = E L{cos 3t] = 2$ 
s 


2t 


The Laplace transform of the function te^ ^ is obtained by the operational law “multipli- 
cation by t becomes differentiation with respect to s." Thus, 


d d 1 d 1 1 
Lg | = —— Lg pe—————— =- — 
ds ds s — (—2) dsst+2 (s+2)? 
We can equally well obtain this result by the First Shifting Law by finding the transform of 
just f(t) = 1 and then shifting the argument in the resulting F (s). Thus, 
1 1 š 


2 s—s+2 B (s d 2)? 


L[te ^] = Li]l-.s42 = 


S 


The Laplace transform of the function == is obtained by the operational law “division by 


t becomes integration with respect to s." Thus, 


int 99 2 od 
L = sl Lisinrdx = f x = arctan x]? = 
t a s x41 : 


Notice how we anticipated the integration of the transform, an integration requiring the use 
of a “dummy” variable of integration. Hence, we wrote the transform as F(x) instead of 
the usual F(s). D 


— arctan s 


N/a 


Without performing the integration, obtain the Laplace transform of the function f(t) = 
[^ xe? dx using the operational law “integration of the function becomes division by s." 
Thus, 

1 1] 

s (s — 3)2 


L li xe? dx = Lepe ES ltr a] = 
0 AY S 


where we recognized that the required transform could be obtained by dividing (by s) the 
transform of the integrand te?'. The transform of te? is then available either using the rule 
“multiplication by t becomes differentiation with respect to s” or by the First Shifting Law. 
We chose to apply the First Shifting Law to the function t, whose transform is i, obtaining 


xu Additional experiments with this example appear in Exercises A3 and 4. E 
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EXAMPLE 6.15 


EXAMPLE 6.16 


EXAMPLE 6.17 


EXAMPLE 6.18 


The Laplace transform of the function f(t) = te” sin 3t can be obtained by an adroit use 
of the operational laws. Thus, 


5 d : 
Lite” sin3t] = Lit sin31]|,., 2 = E L [sin n] 
ds s>s—2 


_ d 3 _ 6s 
^L dsls?+9] J)... LG? 9-9»? 


in which both multiplication by t and the exponential e?' suggest operational rules to apply. 
In fact, we have a choice of two starting points since we can think of f (t) as either ¢ times 
e” sin 3t (suggesting the rule “multiplication by £ becomes differentiation with respect to 
s”) or e” times t sin 3t (suggesting use of the First Shifting Law.) 

We chose the second option because the "shifting" in the First Shifting Law is an easier 
transformation to make than differentiation in s. Thus, we reserve the simpler transformation 
for the very last step when the accumulation of intermediate results will be their most 
complicated. And this choice means we will differentiate a simpler transform than we 
would under the first option. 

The First Shifting Law directs us to find the transform of that which the exponential 
multiplies, namely, of fı (t) = t sin 3t whose transform, F; (s), is then shifted vias — s — 2. 
To obtain F|(s) we have to transform f; (t) = t sin3t, a function yielding to the rule “mul- 
tiplication by t becomes differentiation with respect to s." Hence, we obtain the transform 
of just sin(3r), negate its derivative, and shift. kd 


6(s — 2) 
~ ((s — 2)? + 9)? 


s—>s—2 


Given the Laplace transform Y(s) = 2s =2 the inverse Laplace transform, y(t), is most 


jeg 


easily found from a partial fraction decomposition. Thus, writing Y(s) — Z + L, the 
inversion is immediate, yielding y(t) = 2 + e'. The more complicated inversion based on 


completing the square in the denominator and the First Shifting Law is left to Exercise B1. 
D 


Given the Laplace transform Y (s) = the inverse Laplace transform, y(t), can be 


AY 
CHD? 
found if Y (s) is observed to have the form i du where u = s? + 1. This suggests the 
operational law “integration of the transform becomes division of the function by t.” The 


integral of Y (s) will be a new transform, this one of the function =. Thus, 


y(t) d = pr 1 1 
L | — ii Yoods = f 7 x === 
i y s Q^ -1» 2s5^--1 


which, by inspection, yields x E i sin t, and hence y(t) = i sin f. $ 


Given the Laplace transform Y (s) — In c and the task of inverting it to find y(t), we 


recall from calculus that differentiating a logarithm yields a rational function. There are no 
logarithms in Table 6.2, but there are rational functions. If this transform is to be inverted 
by pattern recognition, it seems like a good idea to do something to it that will convert it 
to a rational function. In fact, differentiation with respect to s becomes multiplication by t, 
or, more precisely, —£Y(s) = L[ty(t)]. Hence, we compute 


d | s? +1 2(s +1) 2 2s 
n = = 
(s — 1)? (s?+1)(s—1) s—1 s2+1 


and invert by inspection to obtain ty(t) = 2e! — 2cost, from which we finally get y(t) 


LE) ex 


je 


2 (e! — cost). * 


*, 
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Justifications 


The twin conditions of piecewise continuity and exponential order that guaranteed the exis- 
tence of the Laplace transform in Section 6.1 are also the basis for justifying the interchange 
of integration and differentiation in the following derivations. The technical details of uni- 
form and absolute convergence of integrals needed here are beyond the scope of this text, 
so we simply point to [83], [21], and [43] for the finer details. 


The Rule L[tf (t)] =- ŻF (s) 


Formal differentiation of ^ f (t)e *' dt, that is, passing the differential operator — $ inside 
the integral, gives 


-£f f(De^ dt = -f —tf (the dt = L[tf (0) 
ds 0 0 


The Rule L [£] sp” F(a’) do 


If F(s) = i, f (De dt is the Laplace transform of f (t), then, using o as the dummy vari- 
able of integration, the integral of the transform can be written as f° fj" f(1)e-?' dt do. In- 
terchanging the order of integration yields the new inner integral à UE * do = e™™ ft, pro- 
vided t > 0. Combining this result with the outer integral gives Iw £O e=st dt = L[£9], 
the Laplace transform of £o 


The Rule L | f, f(t) dx | = #2 


Define g(t) = [4 f (1) dx and recognize that we are trying to compute G(s) = L[g(t)], 
the Laplace transform of g(t). Consider, however, the Laplace transform of g'(t) = f(t). 
Then, using the rule for the transform of a derivative, we find 


L[g' (t)) = LIF] = F(s) = sG(s) — g(0) 


Noting that g(0) — I^ f (t) dt = 0, we solve for the unknown G(s) and obtain G(s) = Fo 
EXERCISES 6.4—Part A 
Al. Let F(s) = L[ f (t)]. Use the Four Operational Laws to obtain a A2. Use the appropriate Operational Laws to obtain the transforms of 
formal representation of the following Laplace transforms. each of the following. 
t É (f) = Tte?! f. rend 
(a) L l^ Í fod] (b) L p efaa] (a) f(t) =7te (b) f(t) = 3t sin J | 
0 0 (c) f(t) 2 (3 — 21e (d) f(t) = te" sin3t 


(c) L Ui feds] (d) L n d (e) f(r) 2 1cos3t.— (f) f(t) 2 te sint 
0 0 


A3. Verify the result in Example 6.14 by evaluating the integral and 


t t S " 
(9L le f rey] (D L p e f(a) da! then transforming. 
0 0 


A4. Using the Operational Law for multiplication by t, obtain the 


(9L | Í e f(z) «c (h) L [is 1 «fd transform of te* that appeared in Example 6.14. 
I z , adds 


(i) Ly] 


(j) Lle ^ y'(] 


(k) L[te ? y'(r)] ims 


2 


AS. Invert F(s) — In KCE 
c 
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EXERCISES 6.4—Part B 


B1. 


Work Example 6.16 by completing the square in the denominator 
and using the First Shifting Law. Show that the results agree with 
the simpler solution in Example 6.16. 


In Exercises B2—5, obtain the Laplace transform by 


(a) using a computer algebra’s built-in functionality. 


In Exercises B17—23, invert the given Laplace transform using 


(a) a computer algebra’s built-in functionality. 
(b) an appropriate combination of partial fractions, Operational 
Laws, and inspection that reproduces the solution in part (a). 
3 


B17. F(s) = B18. F(s) a I NETT 
(b) using the appropriate Operational Laws, obtaining an answer s(s +4) s(s* — 4) 
atc 1 P 2 1 =y 
that agrees with part (a). B19. F(s) = ; B20. F(s) = —- S 
j f e sin 5x ES) imi 
J = „ox «Dine r Ff = z S " 1 - f 
B2. f(t) Í xe cos 2x dx B3 f(t) Í = dx B21. F(s) = ae ae (Use partial fractions.) 
un s(s — 
4 — e " A uA. 9 5 
Bh f) =Í de Ba: ere Fu B22. F(s)=In = — B23. F(s) = arctan(2s — 3) 


B6. 
B7. 
B8. 
B9. 
B10. 
B11. 
B12. 
B13. 
B14. 
B15. 
B16. 


N 


0 


Use f (t) = cos2t to validate your answer in Exercise Al(a). 
Use f (t) = sin3t to validate your answer in Exercise A1(b). 
Use f(t) = t cost to validate your answer in Exercise Al(c). 
Use f (t) = e" sint to validate your answer in Exercise Al(d). 
Use f(t) = t cos2t to validate your answer in Exercise Al(e). 
Use f (t) = cos 5t to validate your answer in Exercise A1(f). 
Use f (t) = f? sint to validate your answer in Exercise Al(g). 
Use f(t) = t cos 4t to validate your answer in Exercise A1(h). 
Use f (t) = e sint to validate your answer in Exercise Al(i). 


Use f(t) = t° cost to validate your answer in Exercise A1(j). 


Use f(t) = sin2t to validate your answer in Exercise A1(k). 


B24. 


B25. 


B26. 


s—2 
Work Exercise B21 using the Operational Law Et fs y(x)dx] = 
TY (s), not partial fractions. 
Solve the IVP 3y” + 5y’ + 4y = 7 sin 2t, y(0) = —3, y'(0) = 1, 
using 
(a) a computer algebra system’s built-in functionality. 
(b) the Laplace transform. 
Repeat Exercise B25 parts (a) and (b) for the IVP y" + 
4y’ + 13y = 5cos2t, y(0) = —1, y'(0) = 2. In addition, as part 
(c), obtain a solution using First Principles (exponential guess, 
characteristic equation, characteristic roots, homogeneous 
solution, Undetermined Coefficients, particular solution, general 
solution, etc.). 


| Heaviside Functions and the Second Shifting Law 


The Heaviside Function 


The piecewise-defined function f(t) = | 


1 2 3 d 3 


FIGURE 6.13 Function representing a 


0 ift<a 


: is a switch that is off until time ¢ = a, 
1 ift>a 


then turns on, with value 1, at time t = a. For the specific value of a = 2, say, this function 
looks like the graph in Figure 6.13. 

This type of function is important enough in applied and engineering mathematics that 
the Heaviside function H(t) is defined as 


0 ift <0 


Hi) = i ift>0 


where we follow the convention of [51, p. 278], that at the point of discontinuity, the function 
is not defined. Figure 6.14 shows a plot of H(t). Figure 6.15 shows a graph of a translation of 
the Heaviside function, namely, H(t — 3). Thus, the Heaviside function and its translations 
behave as unit cut-off functions. 


switch turned on at t = 2 


Extinguishing 


Used in conjunction with other functions, the Heaviside function and its translates “ex- 
tinguish” functions prior to the switch-point. For example, consider the function f(t) = 


p H 
-1 0 1 


——P f 
e) 


FIGURE 6.14 The Heaviside function 
H(t) 


gro] >t 
( 1 2 3 


FIGURE 6.16 Fort < 3, the function 
f(t) = tis extinguished by tH(t — 3) 


EXAMPLE 6.19 


EXAMPLE 6.20 
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6.5 Heaviside Functions and the Second Shifting Law 


tH(t—1), graphed in Figure 6.16. Instead of getting a graph of y(t) = t, we get a graph where 
the portion corresponding to t < 1 is chopped, or cut off and extinguished. Multiplication 
by H(t — 1) is what both cut off and extinguished the graph in Figure 6.16. The Heaviside 
function is zero prior to being switched on, so the product of t with the translated Heaviside 
function shuts off, or extinguishes, y(t) = t prior tot = 1. 


-1 0 12 3 4 5 6 7 


FIGURE 6.15 H(t — 3), the Heaviside 
function H(t) translated three units to the 
right 


Shifting and Extinguishing 


At this point, it is imperative that the interactions between translation and chopping/extin- 
guishing with a Heaviside function become completely clear. To this end, Table 6.6 lists the 
four possible alternatives. Examples 6.19 and 6.20 illustrate these four possibilities. 


(a) f(t) Neither translated nor extinguished 
(b) f(t)H(t — a) Just extinguished for t < a 
(c) f(t—a) Just translated a units to right 


(d) f(t — a)H(t — a) Right-translate by a, extinguish for t < a 


TABLE 6.6 Alternatives for combining translation with extinguishing 


For the function f(t) = t*, Figure 6.17 shows, for a = 1, the four possibilities listed in 
Table 6.6. The function f(t) itself is graphed in (a); the product f (1?) H(t — 1) representing 
extinguishing is shown in (b); f (t — 1), the translation 1 unit to the right is shown in (c); 
and f (t — 1)H(t — 1), the function translated to the right by 1, and extinguished for t < 1, 
is shown in (d). * 


For the function f(t) = sint, Figure 6.18 shows, for a = 1, the four possibilities listed in 
Table 6.6. The function f (t) itself is graphed in (a); the product f (f) H(t — 1) representing 
extinguishing is shown in (b); f(t — 1), the translation 1 unit to the right is shown in (c); 
and f (t — 1)H(t — 1), the function translated to the right by 1, and extinguished for t < 1, 
is shown in (d). Ed 


Second Shifting Law 


Just as the four operational laws of Section 6.4 were best learned together and comparatively, 
we are now ready to discuss the Second Shifting Law in comparison to the First Shifting 
Law. Recall the First Shifting Law 


Lie” f (t)] = F(s — a) 
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(a) 


(d) 
FIGURE 6.18 The function sin f is (a) 
graphed; (b) extinguished for t < 1; (c) 
right-translated by 1; (d) right-translated 
by 1 and extinguished for t < 1 


EXAMPLE 6.21 


8 | 2 3 


FIGURE 6.19 Graph of (t — 2)H(t — 2) 


Hf —— H; 
E 0 l 0 1 2 
(a) (b) 
y y 
A A 
l ia. 
>t t 
0 1 2 0 1 2 
(c) (d) 


FIGURE 6.17 The function t? is (a) graphed; (b) extinguished for t « 1; (c) 
right-translated by 1; (d) right-translated by 1 and extinguished for t < 1 


which states that multiplication by an exponential in the time domain corresponds to shifting 
in the transform domain. It should not be surprising, then, that the Second Shifting Law 
states essentially that multiplication by an exponential in the transform domain corresponds 
to shifting in the time domain. The "detail" that accompanies this concept is the Heaviside 
function, which appears in the following statement of the Second Shifting Law 


L|f(t — a)H(t —a)] = e F (s) 


The translation, or shifting, that takes place in the time domain is in conjunction with 
chopping/extinguishing via a Heaviside function. The parallelism is remarkable, even beau- 
tiful. The delicacy of the translation in the time domain, however, can be problematic to the 
student who has not mastered the chopping/extinguishing action of the Heaviside function. 
For that reason, we rely on the following examples to clarify the use of the Second Shifting 
Law, both in a forward and in a reverse usage. 


Obtain the Laplace transform of the properly translated, chopped, and extinguished function 
g(t) = (t — 2)H(t — 2) whose graph is shown in Figure 6.19. The required transform could 
be obtained by the direct computation 


oo —2s 


G(s) = L[g(0] = i (t De" dt = — 


5 PA 


The Second Shifting Law requires that we first obtain the transform of just f(t) = t, 
the function that is translated and then hit by the chopping/extinguishing action of the 
Heaviside function. Next, obtain F(s) = +, the transform of f(t) = t. According to the 


EXAMPLE 6.22 


FIGURE 6.20 Graph of 
sin(t — 2)H(t — 2) 


EXAMPLE 6.23 


EXAMPLE 6.24 
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Second Shifting Law, to get the transform of the translated, chopped, and extinguished 
version of f(t) = t, multiply the transform of t by e^?5, again obtaining G(s) = e ?'/s?. 
4 


Obtain the Laplace transform of the function g(t) = sin(t —2)H(t —2), a properly translated, 
chopped, and extinguished function graphed in Figure 6.20. Again obtaining the required 
Laplace transform by directly integrating according to the definition, we compute 


Ps 


— = EL V! " 
G(s) = L[g(t)] =Í sin(t —2)e " dt = SI 
To apply the Second Shifting Law to obtain this same transform, first obtain the transform of 
just f(t) = sin t, the function that is translated and then hit by the chopping/extinguishing 
action of the Heaviside function. Next, get F(s) — zu the Laplace transform of f (t) = 
sin t. According to the Second Shifting Law, to get the transform of the translated, chopped, 
and extinguished version of sin t multiply the transform of sint by e7?5, again obtaining 
G(s) — e? Hs? +1). * 


The Second Shifting Law seems to give students most difficultly when it is used “in reverse,” 
to invert a transform containing exponential factors. For example, consider the transform 
G(s) = e^ /s? containing e^, the Second-Shift exponential “flag.” Recognize the given 
transform as G(s) = e^? F(s), where F(s) = i. Invert F(s) — + to f(t) = t; then 
recall there was an exponential factor that indicates the need to translate f(t) = t and to 
chop/extinguish this translation with an appropriate Heaviside function. Thus, the complete 
application of the Second Shifting Law yields 


g(t) = f(t — 3)H(t — 3) = (t — 3)H(t — 3) 


Again, the strategy is to recognize the exponential in the transform as a “flag,” indicating 
the Second Shifting Law took place going forward. Cover the exponential term, invert what 
is visible, then translate, and multiply by the corresponding Heaviside function. 


A second transform to invert via the Second Shifting Law is G(s) = e~**/(s — 3). Covering 
up e~*, the Second-Shift exponential flag, we are left with F (s) = a3 which inverts to 
f(t) = e”. Translate f(t) = e* to e*— and multiply by the corresponding Heaviside 


function to chop and extinguish, yielding 


g(t) = f(t -4)H(t — 4) = "PH — 4) $ 


Justification 


The validity of the Second Shifting Law is established as follows. Write the defining integral 
for the Laplace transform of f (t — a)H(t — a) and make the change of variables z = t — a, 
thereby obtaining 


(e e) 


[ f(t —a)H(t — ae" dt = fi)H(2e 9*9 dz 
0 =a 


—e ™™ [ f(e™ dz 
0 


— a ?* F(s ) 


The lower limit on the integral in the second line is zero because the Heaviside function 
is zero for z « 0. The Heaviside function disappears from that integral because its value 
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is 1 for z > 0. After making these alterations and recognizing that now z is but a variable 
of integration, the integral in question becomes the defining integral for F(s), the Laplace 


transform of f(t). 


EXERCISES 6.5-Part A 


A1. The function g(t) = tH(t — 1) is not in a form for which the 
Second Shifting Law applies. Every appearance of the variable t 
must occur, not as /, but as t — 1. For this function, the device 
80) = (t — 1 + DHG — 1) = (t - DH(t — 1) + H(t 1) allows 
the Second Shifting Law to work. For each of the following, use an 
appropriate algebraic device that allows the Second Shifting Law 
to apply and then use that law to obtain the Laplace transform of 
the given function. 


(a) g(t) 2 ?H(r —2)— (b) g(t) = sin(t)H(t — 1) 
(c) g(t) =e'H(t—2) (d) g(t) 2 e?H(r— 1) 
(e) g(t) = cos(t — 1)H(t — 2) 


A2. Use the Second Shifting Law to invert each of the following 


transforms. 
se? e~* 2e 
G(s) = —— b s) = ————— 
(a) G(s) $241 (b) G(s) E 


EXERCISES 6.5—Part B 


dic _ _4se™ 
(c) G(s) = A (d) G(s) — @44? 
. Qe-* 
eMe y 


A3. For each of the following, sketch f(t), f (r)H(t — 2), f(t —2), 
and f(t — 2)H(t — 2). 


(a) ft) 220-3 | (b) f) 21-cost (© f= 


(d) f(r) 22—3sint (e) f(t) 2:?—5t 44 

A4. Sketch each of the following, then express each as 
piecewise-defined functions. 
(a) fA 21--H(r—1) (b) f(t) = 2H(t — 1) 2 3H(t — 4) 
(c) f(t) = (t - DH(t — 1) + (t — 27 H(t — 2) 

AS. Use the Second Shifting Law to obtain the Laplace transform of 
f (t) = sin’ (r)H(t — 1). Hint: Use a half-angle formula, then 
consider Exercise A1. 


r+) 


B1. Use a computer algebra system to obtain by the defining integral, 
the Laplace transforms in Exercise A1. 
In Exercises B2 and 3: 
(a) Use a computer algebra system to obtain the Laplace 
transform. 
(b) Use the appropriate Operational Laws to reproduce the 
solution found in part (a). 
B2. f(r) =e" sinoat — B3. ft) he xe* y'(x) dx 
B4. Invert the Laplace transform F(s) — TUS using 
(a) a computer algebra system. 
(b) an appropriate combination of partial fractions, Operational 
Laws, and inspection, which reproduces the solution in 
part (a). 
(c) the Operational Law L| f, y(x) dx] = E but not partial 
fractions. 
In Exercises B5-10: 


(a) Plot the given function f(t). 


(b) Obtain the Laplace transform by the integral definition of the 
transform. 


(c) Write the function in terms of the Heaviside function. 


(d) Obtain the Laplace transform by using a computer algebra 
system. 


(e) Apply the Second Shifting Law. 


0 ift <3 0 ift <1 
B5. f(t) = B6. f(t) = 
f - ift 23 f Ear ift>1 
— 0 ift < + ji 0 ift «2 
. $j = " le = 
7e etl qppE FO et —2)? iff>2 
0 ift <1 0 ift < i 
B9. f(t) = ~ B10. f(t) = E 
fq is —1) ift>1 FO a ift > i 


In Exercises B11—13, invert each Laplace transform 


(a) by use of a computer algebra system. 
(b) by implementing the Second Shifting Law stepwise. 


(c) by converting f(t) (which is expressed in terms of the 
Heaviside function) to a piecewise-defined function. 


(d) by plotting the function f (t) obtained as the inverse. 


—3s e^ — 4e-5 
B11. F(s) = B12. F(s) = —————— 
(s) 5? — 16 (s) e 
1+ 30-5 
Bis Fit 


f 
1 
t 
-1 0 1 2 3 4 5 
FIGURE 6.21 Unit pulse of duration 


Tt = 2, switched on at time tọ = 1 


=] 0 1 2 3 4 5 


FIGURE 6.22 Product of sin? with unit 


pulse from Figure 6.21 


FIGURE 6.23 Product of sin t with unit 
pulse of duration t = 2, switched on at 
fo = 3 
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Pulses and the Third Shifting Law 


The Unit Pulse 


Pressing a key on a computer keyboard sends through the computer's circuits a pulse, a 
current of constant height and finite duration. Figure 6.21 shows a graph of the piecewise- 
continuous function that is 1 for 1 < t < 3, is undefined at t = 1 and 3, and is zero ev- 
erywhere else. This is an example of a unit pulse of duration t = 2, switched on at time 
to = 1. Clearly, the unit pulse is defined by giving either its starting time and duration or its 
on-off times. 

An analytic representation of the graph in Figure 6.21 is given by 


1 ] «£3 
H(t — 1) — H(t — 3) = f(t) = {undefined t= 1,3 (6.7) 
0 else 


Because we have chosen H(t) to be undefined at t = 0, the difference on the left in (6.7) is 
undefined at t = 1 and 3. Hence, the unit pulse can be specified either in the echelon form 
on the left in (6.7) or as the difference of Heaviside functions on the right. When writing 
the echelon form, it is often convenient to drop the explicit mention of the two points where 
the pulse is not defined. 


Pulsed Functions 


Multiplication of the function g(t) by a unit pulse will “filter out" that portion of g(t) where 
the pulse is nonzero. Figure 6.22 shows the graph of the product of the unit pulse (6.7) with 
the function g(t) = sin t. The unit pulse f(t) has the effect of filtering out just that portion 
of g(t) where the pulse has height 1. 

The upper graph in Figure 6.23 shows, superimposed on a graph of sin t, the graph of 


p(t) = H(t — 3) — H(t — 5) (6.8) 


a unit pulse of duration 2, starting at £ = 3. Multiplying sint by (6.8) filters out just that 
portion of sin t where ż is in the interval (3, 5). The lower graph in Figure 6.23 shows the 
filtering effect of this product. 


Transform of Pulsed Functions 

We next obtain the Laplace transform of the function h(t) = p(t) sin t, where p(t), given 
in (6.8), is a unit pulse of duration 2, starting at t = 3. 

DIRECT INTEGRATION The Laplace transform of h(t), obtained by direct integration, is 


& ?5(cos3 + s sin 3) 
s? +1 


e™5 (cos 5 + s sint) 
s +1 


5 
L[A(t)] -=f sin(t)e "' dt = 
3 


SECOND SHIFTING Law Brute force integration is not elegant, and without a computer 
algebra system, it is at best, tedious. It is often preferable to use the Second Shifting Law, 
to which end we write 


h(t) = sin((t — 3) + 33H(t — 3) — sin((t — 5) + 5)H(t — 5) 


Twice, the term sin t was arranged to appear shifted, with the amount of shift matching the 


152 Chapter 6 The Laplace Transform 


EXAMPLE 6.25 


© 


FIGURE 6.24 Driving term for shock 
absorber in Example 6.25 


shift in the corresponding Heaviside function, as required by the Second Shifting Law. We 
then apply the trigonometric expansion formula sin(A + B) = sin A cos B + cos A sin B 
to obtain 

h(t) = {sin(t — 3) cos 3 + cos(t — 3) sin 3}H (t — 3) 

— [sin(t — 5) cos 5 + cos(t — 5) sin 5}H (t — 5) 
a form in which the Second Shifting Law can be applied. We therefore get 
L[A(1)] = (e? cos3 — e 7 cos S) L[sin t] + (e~* sin3 — e^?" sin S) L[cos t] 
e? cos3 se? sin3 eS cos5 — se sin5 


T 5 
5241 5241 $241 s224-1 


THIRD SHIFTING Law Some texts (e.g., [11]) use the term Third Shifting Law for the 
following variant of the Second Shifting Law 


L[H(t — a)g(t)] =e ^L[g(t -- a)] 


The form on the left is precisely the type of problem faced in this ongoing example where 
we sought the transform of terms such as H(t — 3) sin t. Direct use of the Second Shifting 
Law required each appearance of g(t) = sin! to have been in the form of functions with 
arguments shifted to t — a. However, the Third Shifting Law is "ice in the winter time" 
because the transform of g(t + a) on the right embodies all the effort we exerted earlier 
with the trigonometric manipulations. It does not represent a radically new way to obtain 
the required transform. 

Computing the transform of sin(t + 3) requires trigonometric manipulations equivalent 
to those performed when “rigging” the expression to use the Second Shifting Law directly. 
In fact, sin(t + 3) = sint cos 3 + cost sin 3, so computing the transform of sin(t + 3) is 
equivalent to what we did when we used the Second Shifting Law. 


Suppose the action of a shock absorber is modeled by the IVP y" --3y'--2y = f(t), y(0) = 
1, y'(0) = 1, where f(t) is the function whose graph is shown in Figure 6.24. The initial 
conditions indicate initial displacement and velocity of 1. Until time ¢ = 1, the shock 
absorber is acting to damp out the induced vibrations. But between t = 1 and t = 3, a 
new force is introduced, a linearly decaying force that starts at magnitude 3 and decays to 
magnitude 1, at which point the force ceases to act. The driving force f (t) is an example 
of a pulsed function, and solving the IVP by the Laplace transform requires we obtain first 
its representation and then its transform. 

Taking the endpoints of the slanted line as (1, 3) and (3, 1), the equation of the slanted 
line segment would be y = —(t —3)4-1 = 4—t so that f(t) = (4—1)(H(r — 1)  H(t —3)). 
The Third Shifting Law suggests defining g(t) = 4 — t, so we can write 


L[f (0] — e? Ligt + 1] — e LI g(t +3)] 
—-e^L[4— (t + D] —e * L[4 — (t + 3)] 


7 E : ) n (, : ) 
=e > e^ = 
s s S s 


We can now take the Laplace transform of the given differential equation, obtaining 


2 3 J oy i. l 
s Y —s—1+3(sY —1)+2Y =e" (i-3)-e* (:-3) 


S $^ M $^ 


FIGURE 6.25 Solutions for driven (solid) 
and undriven (dotted) damped oscillator 


6.6 Pulses and the Third Shifting Law 153 


so that 


3 -— D. T 4 | 
— — — e — 
s+1 s+2 4s 2s? 4(s+2) stl 


a se 3 2 
^ \ 952 4s 4642) 5 +1 


whence 


9 9 feal T7 5 
y(t) 23e! —2e7 + E iE NS ^ im - een) H(t — 1) 


3 , 5 t—3 
Fa di —u a) IT ) H(t — 3) 


4 4 2 


The characteristic equation for the homogeneous differential equation is A? + 3A + 
2 = 0, with characteristic roots A = —1, —2, so the system is overdamped. Without the 
driving term f(t) the solution would be ys (t) = 3e7' — 2e~*', graphed as the dotted curve 
in Figure 6.25. Without the driving term f (f), the system would exhibit the effect of the 
initial displacement and velocity and then settle to rest asymptotically under the action of 
the damping. The pulsed driving term gives the system a "kick" of short duration. The 
system reacts to this kick and then resumes its determination to return to rest. The solid 
curve in Figure 6.25 is the driven solution, y(t). The interval 1 < t < 3 during which the 


driving term acts is marked as a thickened segment on the f-axis. e 
EXERCISES 6.6—Part A 
A]. Express in terms of Heaviside functions, the unit pulse that turns AS. If f (t) is the function in Exercise A4, use Laplace transforms to 
on at t = 0 and has duration 1. solve the IVP y" + 2y' + 5y = f(t), y(0) = y'(0) = 0. 
A2. Sketch the product of cos t with the pulse in Exercise Al. A6. For each of the following, express in terms of pulses and Heaviside 
A3. To the pulse in Exercise A1, add a unit pulse that turns on at £ = 4 functions and obtain the Laplace transforms using the Second 
and has duration 2. Represent the sum and sketch its graph. i Shifting Law. 
; 5 : ; , 
Ad. Express the ramp fünction f(f) = ‘ Teu 1 —' (a) Exercise B12, Section 6.1 (b) Exercise B13, Section 6.1 


Heaviside functions (as the sum of two pulsed functions) and 


obtain the Laplace transform. 


EXERCISES 6.6-Part B 


(c) Exercise B14, Section 6.1 (d) Exercise B15, Section 6.1 
(e) Exercise B16, Section 6.1 (f) Exercise B5, Section 6.5 


B1. Obtain the Laplace transform of '?H(t — 1) using B6. f(t) = te ‘H(t — 5) B7. f (t) = e~" costH(t —2) 
(a) the Second Shifting Law. (b) the Third Shifting Law. B8. f(t) = e cos 3tH(t — 1) 
` S — _28s=1 i 
In Exercises B2- 8, obtain the Laplace transform using B9. Invert the Laplace transform F(s) = 3745 using 


(a) a computer algebra system. 


(b) the appropriate Operational Laws, for example, to reproduce 


the solution found in part (a). 


B2. f(t) — t2e73t cos At B3. f(t) = (te)? 
B4. f(t) =tcostH(t—1) BS. f(y =r 


(a) a computer algebra system. 


(b) an appropriate combination of partial fractions, Operational 
Laws, and inspection, which reproduces the solution found 
in part (a). 

(c) the Operational Law L[ [^ y(x)dx] = in but not partial 


G(s); 
). 


sin 2tH(t — 1) fractions. (Integrate only once—write F(s) as =~ 
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In Exercises B10—12: 


(a) Plot f(t). 


(b) Use a computer algebra system to obtain the Laplace 
transform. 


(c) Convert to a piecewise-defined function written in echelon 
form. 


(d) Apply the Second Shifting Law, being sure the resulting 


(e) Apply the Third Shifting Law to obtain the Laplace transform 
of r(t). 

(f) Obtain R(s) by brute-force integration. 

(g) Solve for y(t) using Laplace transforms. 

(h) Express the solution y(t) as a piecewise-defined function. 


(i) Plot the solution y(t) and explain how its behavior reflects the 
properties of the system. 


transform agrees with part (b). B13. y" +4y’ + 13y = (t — 1)H(t — 2), yO) = 1, y'(0) = 0 
(e) Apply the Third Shifting Law to obtain the Laplace transform B14. y"+2y’+2y=14+ H(t — 2), y(0) = 1, y'(0) = —-1 


of f(t). 
(f) Obtain the Laplace transform by brute-force integration. 
B10. f(t) =(t —S)H(t—3) B11. f(t) = sin 2tH(t — 1) 
B12. f(t) = te" H(t — 2) 
For the IVPs in Exercises B13-21: 
(a) Graph the driving force r (t). 


(b) Use a computer algebra system to obtain R(s), the Laplace 
transform of r (t). 


(c) Express r(t) as a plecewise-defined function in echelon form. 


(d) Apply the Second Shifting Law to obtain the Laplace 
transform of r (t). 


. y” - 6y + 13y = Pe —tH(t — 1), yO) = —1, y'(00 = 1 

. 9y" + 6y +2y = t(1 — H(t — 2), y(0) 22, y'(0) 20 

. 2y" + 2y' + y = cos2t(1 — H(t —2z7)), y(0) = —3, y'(00 = 1 
. 9y" + 6y' + 5y = t(H(t — 1) 
. 16y" -24y" + 13y'+5y = 1 — H(t — 5), y(0) = 1, y'(0) = —1, 


H(t — 2)), (0) = —2, y'(0) = 0 


y"(0) —0 


. 25y" + 45y" + 33y! + 13y = te" (1 — H(t — 1), y(0) = —1, 


»y(0) = 0, y"(0) = 1 


. Ay" + 28y"+65y'+5ly = 1 — H(t — 2), y(0) = 0, y'(0) = —2, 


y"(0) 21 


Transforms of Periodic Functions 


Laplace Transform of a Periodic Function 


If f (t) is a function periodic with period p, then its Laplace transform can be found by the 


formula 


F(s) = 


p 
f (De dt 
0 


= (6.9) 


1—e 


Prototypical examples of periodic functions would be the functions sin and cos t, each 
of which has period p = 27x. In fact, we use these functions in the first two of the three 
examples that follow. 
EXAMPLE 6.26 The function f(t) = sint has period p = 2z and Laplace transform F(s) = zu. The 
integral in the formula for periodic functions looks like the defining integral for the Laplace 
transform, except that the range of integration is just one period for the function. Hence, an 


alternate route to F (s) must be 


l T ine dt 1 ] ens 1 P 
— sin(f)e ` = = = “ 
1 — e~ 275 Jo 1 — e727 \ 24] s2? +] 5241 


EXAMPLE 6.27 


The function f (t) = cos ot has period p = n and Laplace transform F(s) = a7 
alternate route to this transform must then be 


l 2z/o 1 e ?ns/o zs! S 
Í cos(ot)e “dt = s = P 
0 


tot 


] — e-?5s/o 1 — e-255/o 


EXAMPLE 6.28 


Oo = 
ce | 
w+ | 


FIGURE 6.26 Square wave with 
amplitude 1 and period 2 
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This next transform is more complicated than those of sin t or cos ot because the formula 
for the function cannot be written in terms of a single elementary function. This example 
will show why (6.9) is so important. There really is no other reasonable way to obtain 
the transform of a periodic function whose rule cannot be easily written in terms of the 
elementary functions. 


We will obtain the Laplace transform of f(t), a square wave, which is the repeated 

1 if0<t<1 
=] iflst<2 
three periods of the square wave; the leftmost two line segments would be the graph of g(t). 
Clearly, the period is p = 2. By (6.9), the Laplace transform of f (t) is 


c wears f Derdi) = T EET 5 


To corroborate this bn represent f (t) as the infinite sum of Heaviside functions 


replication of the function g(t) = | as a periodic function. Figure 6.26 shows 


Lif ()] = 


oo oo 
f) =H) +2) HE - 2k) —2 HG - Qk + 1)) (6.10) 
kel k=0 
obtained by generalizing from Figure 6.26. The six line segments in that figure are repre- 
sented, from left to right, in terms of Heaviside functions by 
[H(r) — H(t — 1)] — [H(t — 1) — H@ — 2)] + [HG — 2) — H(t — 3)] 
— [H(t — 3) - H(t — 4)] + [H(t — 4) - H(t — 5)] - [H(t — 5) - H(t — 6)] 

= H(t) — 2H(t — 1) + 2H(t — 2) - 2H(t — 3) + 2H(t — 4) — 2H(t — 5) + H(t — 6) 
Transform (6.10) term-by-term and then sum, recognizing two instances of the geometric 
series Y; 9 x^ = 7+. The independent corroboration we seek lies in 


—2ks _ 9) F sis 
k 
=25 =s —$42 - 
d T 2e a od (1— e`) - 1—e % 
s 1— e73 1—e-% s L(1 — ec3)(1 4 e75) s(14- e75) 


Derivation 


LIfe] = 


To derive the formula for the transform of periodic functions, write the defining integral for 
the Laplace transform as a sum of integrals » 77^  /,, where Ik = i faje  dxk- 
(UN EUM In each integral /;, k = 0, 1, ..., make the change of variables t = x — kp. Since 
each integral is over one period of the periodic function f (t) for which f(t + kp) = f(t), 
we obtain i, = f? f(t 4- kp)e ?€**P dt = e [^ f (t)e^s dt. 


uro f f (De dt 


3p 
foe dx +--+ 
p 


p p 
a| forare | Fine di en | fe dt + -- 
0 


=| Fyre WM f@Me" dt = = —oaf fe dt 


where we have summed the geometric series » zco xb 2 with x = e P5, 


=| fooe" dx + +f” f(ixje* dx + 


1 
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EXERCISES 6.7—Part A 


Al. Sketch f(t), the periodic extension of g(t) = sint, 0 < t < m. Use — A4. Sketch f(r), the periodic extension of g(t) = b =e 
(6.9) to obtain the Laplace transform of f (t), the full-wave 
rectification of the sine function. 


Use (6.9) to obtain the Laplace transform of f (t). 


oe 5 sint O<t<z 
A2. Sketch f(t), the periodic extension of g(t) = t?,0 < t < 1. Use A5. Sketch f(t), the periodic extension of g(t) = r -mzxtz2m] 
(6.9) to obtain the Laplace transform of f (t). Use (6.9) to obtain the Laplace transform of f (t), the half-wave 
A3. Sketch f (t), the periodic extension of g(t) = [i He i > T Use rectification of the sine function. 
(6.9) to obtain the Laplace transform of f (t). 


EXERCISES 6.7—Part B 


B1. Each line segment in the graph of f(t) in Figure 6.27 is a 
translation of y(t) = t. 
(a) State clearly, and graph, the function g(t) that is being repeated 
periodically. Hint: Its domain is [0, 2]. 


(b) Use (6.9) to obtain the Laplace transform of the periodic 
function f(t). FIGURE 6.28 Exercise B2 


the square wave given in Figure 6.26. Since f (t) is both periodic 
and piecewise-defined, its transform is computed by (6.9). Hence, 


f 
: Y (s) will be impossible to invert exactly, so expand Y (s) in powers 
0 i i - |t of e~* by replacing e * with z, obtain a Taylor expansion (ten 
i 1/2 3/4 5/6 1/8 9 terms) about z = 0, and then replace z with its exponential 


equivalent. Invert the approximate Y (s) and plot the solution. 


FIGURE 6.27 Exercise Bl B4. Repeat Exercise B3, this time taking f (t) as the periodic function 
in Exercise B1. Expand Y (s) in powers of e?*. 

B2. Repeat Exercise B1 for the function whose graph is shown in B5. Repeat Exercise B3, this time taking f(t) as the periodic function 
Figure 6.28. Hint: The domain of g(t) is [0, 4]. in Exercise B2. Expand Y (s) in powers of e”. 


B3. Using the Laplace transform, solve the IVP y" + 2y’+ 10y = f(t), 
y(0) = 0, y'(0) = 0, where f(t) is the function whose graph is 


Convolution and the Convolution Theorem 


Introduction 


The Laplace transform of a product is not the product of the transforms, since, for example, 


L[t] = i but LIP] = 4 x (4y . Therefore, the product of two Laplace transforms does 


not invert back to the product of the inverses of the factors, so in general, L^! [F(s)G(s)] # 
f()g(t). 

None of this should surprise the reader, since calculus has already provided at least 
two instances of results of this type. The derivative of a product is not the product of the 
derivatives. Instead, this is governed by the product rule, (uv)! = uv’ + vu’. The integral 


EXAMPLE 6.29 


EXAMPLE 6.30 


EXAMPLE 6.31 


FIGURE 6.29 Ordinary product (solid) 


and convolution product (dotted) of e^ 
and sin 3t 


2t 
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of a product is not the product of the integrals. Instead, this is governed by the formula for 
integration by parts, [f udv = uv — f vdu. . 

Likewise, the inverse of a product of two Laplace transforms is not the product of the 
inverses. Instead, it is the convolution product, the subject of this section. 


The Convolution Product 


The convolution product between two functions f (t) and g(t), denoted f * g, is a new 
function of t, defined, in the context of Laplace transforms, by either of the equivalent 
integrals in (6.11). The new function is f * g, and its value at t is (f * g)(t) 


reno - f fe-s = f f(x)g(t — x)]dx (6.11) 
0 


That the integrals in (6.11) are indeed equivalent is demonstrated after Examples 6.29— 
6.31. Then, the Convolution Theorem, which relates the product of two Laplace transforms 
to the convolution product is given. First, however, we provide examples of this new object 
f * g, the “convolution product" of the two functions f (t) and g(t). In these and subsequent 
calculations, it might be helpful to articulate the integrands in the convolution product with 
language like “one function has the dummy argument, the other, £ minus dummy,” which 
always seems to amuse a classroom full of students but is nevertheless effective. 


Find t x e', the convolution product of the two functions f (t) = t and g(t) = e'. According 
to (6.11), the convolution product f x g is given by either of the integrals h (t — x)e* dx 
Or f xe'^ dx, both of which have the value e' — t — 1, as calculation shows. Thus, t  e' 
is not the ordinary product te’, but rather, it is e — t — 1. $ 


Find 1 x 1, the convolution product of f (t) = 1 with g(t) = 1. Here, no matter which func- 
tion has its argument shifted, the result is the same, namely, still 1. Hence, the convolution 
+, 


product f x g = 1 « 1 is given by the integral du ldx =t. KA 


The convolution product of f(t) = e^?' and g(t) = sin 3t, namely, e^? 


by either of two integrals. Thus, we have 


* sin 3f, is given 


t t 
e? «sinat = Í e 2") sin3x dx = Í e^? sin(3(t — x) dx 
0 0 


= HBe” — 3 cos 3t + 2 sin 3t) 


leading to Figure 6.29, where we see as a solid curve the graph of the ordinary product 
e~*' sin 3t and as a dotted curve the graph of the convolution product e^?' sin 3t, again 
showing how very different these two products really are. e 


EQUIVALENCE OF CONVOLUTION Propucts To demonstrate in general that both convo- 
lution integrals are equivalent, make the change of variables t — x = z in one integral and 
show it becomes the other. In particular, write 


t 0 t 
pean f fog —x)dx — - [ fe -2sodz- | f(t — z)g(z) dz 
0 t 


recognize that z in the last integral can be replaced by x, and conclude that both forms of 
the convolution integral are equivalent. 
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EXAMPLE 6.32 


EXAMPLE 6.33 


THEOREM 6.2 CONVOLUTION THEOREM 


The Laplace transform of the convolution product f * g is the product of the Laplace 
transforms, that is, 


L|f x g] = F(s)G(s) 


Equivalently, the product of two Laplace transforms inverts back to the convolution 
product of the individual inverses so that 


'LF(s)G(s)] = f * 8 


By examples, we now illustrate the connection between f * g, the convolution product 
of f (t) and g(t), and F(s) and G(s), the Laplace transforms of f(t) and g(t), respectively. 


The convolution t x e' = e' — t — 1 has Birendy bas computed. The Laplace transform 


of this convolution prodnoti is L[t  e'] = = n 4 E =z iB D HUS the transforms 
of the factors f(t) = t and g(t) = e’ are FO) = = 3 and G(s) = —4, respectively. The 
ordinary product of these two transforms is F(s)G(s) = suc = L{t x e]. “fe 


Inversion of the Laplace transform L[y(t)] = c cup is a difficult project using only the 
four Operational Laws. The inversion is sketched here to show just how difficult it is using 
only the Operational Laws. To begin, observe that an integration with respect to s will lower 
the power of (s? + 1) in the denominator from 2 to 1, leading to a transform recognizable 
as belonging to a trigonometric function. This integration is greatly assisted by having an s 
in the numerator so that the form u^? du appears as the integrand. To insert the s into the 
numerator, consider the transform of y’, the derivative of y, related to the transform of y by 
multiplication by s according to the rule L[y'] = sL[y] = gap. Integrating the transform 
of y' yields a new transform, the transform of Y. Hence, 


y d x 1 
L E = / 9 bi dx = a 
t | 6 G+ 2(52 + 1) 


= lsint, from which we determine y by the integration 


SO 


: 1 
y(t) = f xsinx dx = 5 int — f cost) 
0 4 


That is indeed a tedious calculation, and we have yet to justify not including the term 
—y (0) in the very first step! But the point of the demonstration was to convince the reader 
of the difficulty in inverting this transform using only the four Operational Laws. 

The convolution theorem leads to a much simpler solution. Writing the given transform 


as the product 
1 1 
Hint 7 | " | | 3 | 
se +] s4+ 1 


we have the product of the transform of sin t with itself, explicitly stated as 
L[y] = L[sin t]L[sin t] 


The convolution theorem now tells us the function y(t) is the convolution product of sin(r) 
with itself, namely, 


i 5 
(t) = sin(t) * sin(t) = / sin x sin(t — x) dx = l (sint t cost) 
0 j 


~ 


(a) 


(b) 


FIGURE 6.30 Changing the order of 
integration in the transform of a 
convolution 


EXERCISES 6.8—Part A 


6.8 Convolution and the Convolution Theorem 159 


Proof of the Convolution Theorem 


The Laplace transform of the convolution product f * g = i f(t — x)g(x) dx, namely, 


oo t 
Lf xg] = Í m f f(t — x)g(x) dx dt (6.12) 
0 0 
can be interpreted as the iterated double integral 
oco t 
LIS #2|= / i e f(t —x) g(x) dx dt (6.13) 
o Jo 


because (6.12) converges absolutely, and hence uniformly, for piecewise-continuous func- 
tions of exponential order. As we mentioned in Section 6.4, the notions of absolute and 
uniform convergence of integrals are beyond the scope of this text, so we are simply sig- 
naling the reader that the reversal of the order of integration, from dx dt to dt dx which we 
are about to do with (6.13), is mathematically justified. 

Figure 6.30(a) shows a portion of the xt-plane in which shading marks the region of 
integration for (6.13). In addition, an element of area for the order dx dt is shown as the dark 
horizontal strip. Figure 6.30(b) shows an element of area for integration in the order dt dx. 

Corresponding to (6.13) we therefore have the companion iterated integral 


t co t oo 
Lif *g]— Í Í e" f(t — x)g(x) dt dx = Í g(xje * / e 3679 f(t — x) dt dx 
0 Jx 0 


x 
in which the inner integral is subjected to the change of variables f — x = y, resulting in 


L[f *g] — 1 gx) * Í e ? f(y) dy dx =f g(x)e “dx i e ? f(y) dy 
0 0 0 


0 

Notice how the change of variables on the inner integral changed the upper limit of integra- 
tion for the outer integral. Also notice how, with a change of integration variables from x 
to t, and y to £, and an interpretation of the iterated integral as the product of two integrals, 
we have arrived at the desired result, namely, L[ f * g] = L[f(t)]L[g()] = F(s)G(s). 


A]. Compute the convolution product 1 * ¢, and with it, verify the 


convolution theorem. 


A2. Compute the convolution product f * t?, and with it, verify the 


convolution theorem. 


A3. Show that t * sint = (sint) * f. 


EXERCISES 6.8—Part B 


A4. Obtain the convolution products t * (cos t * e') and (e! x t) * cos t. 
Comment on the outcome. 

A5. Compute e' x sin t by inverting the product of their Laplace 
transforms. 


B1. Sketch the region of integration for the iterated integral 
2 m " Cr . 
I 25 f (x, y) dy dx and reverse the order of integration. 


For the convolution products in Exercises B2-11: 


(a) Exhibit both convolution integrals. 


(b) Obtain the convolution product by evaluating both integrals in 
part (a), being sure results agree. 


(c) Plot on the same set of axes both the ordinary product and the 
convolution product, indicating clearly which is which. 


(d) Use a computer algebra system to obtain the transform of the 
convolution product in part (b). 


(e) Obtain the product of the transforms of the factors in the given 
function. The convolution theorem says the results in parts (d) 
and (e) must be the same. Verify this is so. 


(f) Use a computer algebra system to invert the product of the 
transforms of the factors. This should be the convolution 
product found in part (b). 
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B2. t? xcos5t B3. cos3ź *sin2t B4. cos? 3t x sin2t 


BS. £? xe” B6. sinh2t*cos3t B7. cosh 3t » sin 2t 
B8.:*sinh2t B9. 3xcosh5t B10. e`” xe” Bll. m «e 


B12. Obtain the convolution product f? * e? * sin 5t by convolving the 
first two factors, then convolving that result with the third factor. 
Then obtain this same convolution product by inverting the 
product of the transforms of the individual factors. 


B13. Repeat Exercise B12 for t? x sinh 2t * cos t. 


(b) Invert using the convolution theorem. Thus, write 
F(s) = G(s)K (s) as suggested, invert G and K to g(t) and 
k(t), respectively, and compute the convolution g * k. 
1 1 1 5 1 4 4 
'(8s—25  3s—2(8s—2Y 's21(s--3) s25 +3 
s _ 1 s 
'(s4-2)(5$2—9) s4252—9 
s+l s+] 1 2 1 2 


B14 


B16 


B17 = 


k = 18. = 
(s2—1?  s$2—152—1 s(s?+4) gs s?+4 


For the Laplace transforms F(s) given in Exercises B14—18: 


(a) Invert using a computer algebra system. 


Convolution Products by the Convolution Theorem 


Computing Convolutions by the Convolution Theorem 


Section 6.8 presented the definition of the convolution product and demonstrated how to 
obtain this product by performing one of two alternate versions of the convolution integral. In 
addition, Section 6.8 revealed the convolution theorem whereby the product of two Laplace 
transforms is the transform of the convolution. In symbols we wrote both the "forward" 
version L[f x g] = F(s)G(s) and the “backward” version L7'[F(s)G(s)] = f * g. 
Moreover, Section 6.8 showed that f * g, the convolution product of f(t) and g(t) 
could be obtained as the inverse Laplace transform of F (s)G (s), the product of the Laplace 
transforms of f(t) and g(t). This present section will again demonstrate how to use the 
convolution theorem to compute the convolution product of two functions f(t) and g(t). 
In particular, we will be interested in cases where at least one of the two functions is a 
piecewise-defined function, especially one in which Heaviside functions appear. 
When a factor in a convolution product is piecewise-defined, shifting the argument 
from t to  — x in the convolution integral can be subtle because such functions don't have a 
single formula for their definition. The inequalities in the piecewise-defined function and the 
inequality 0 < x < t, where x is the variable of integration, can be a challenge to coordinate. 
The method explored here is the use of the convolution theorem, which takes both 
functions to the frequency domain, uses ordinary multiplication instead of convolution, and 
then inverts back out of the frequency domain to the time domain. 
We illustrate with the following examples. 
EXAMPLE 6.34 Compute the convolution of £? and H(t — 1) using (a) the convolution theorem and (b) the 
defining integral for convolution. The point of the example is to demonstrate how much 
easier the convolution theorem is to apply than direct integration, especially when one of 
the factors in the convolution is a piecewise-defined function like the Heaviside function. 


e. 
—-* 


USING THE CONVOLUTION THEOREM The convolution theorem says the Laplace transform 
of the convolution is the product of the transforms L[r?] — i and L[H(t — 1)] = e^ /s. 
Thus, L[t? « H(t — 1)] = 2e^ /s^, so the desired convolution is 


2e? 


Pg) oL] a ]-3e- one -D (6.14) 


as determined by the Second Shifting Law and the transform L[t?] = f. 


—k 
0 1 2 3 


FIGURE 6.31 Region in the xt-plane 
where integrand for t? x H(t — 1) is nonzero 


EXAMPLE 6.35 


FIGURE 6.32 Region in the xt-plane 
where integrand for H(t — 1) x H(t — 2) is 
nonzero 


EXAMPLE 6.36 


| 


1 i= t >t 
0 1 2 3 4 5 6 
FIGURE 6.33 Unit pulses of duration 

t = 1, starting att = 1 and t = 3 
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USING THE DEFINITION OF CoNvoruTION Direct evaluation of the convolution integral 
t 
LP «Be - D] f 8e - De -xax 
0 


requires a delicacy that starts with an analysis of the integrand. First, it is far easier to shift 
t — t — x in the function 7? than it is in the Heaviside function. Second, because of the 
Heaviside function, the integrand is nonzero for x — 1 > 0. Third, the very definition of 
integration requires 0 < x < t throughout the interval of integration. The region in the 
xt-plane satisfying both these constraints is shaded in Figure 6.31. A representative arrow 
shows the path of integration for fixed t. 

Since the integration requires 0 < x < t,ift < 1,thenx < 1 andH(x—1) = 0. Hence, 
the integral yields the value 0 fort < 1. Fort > 1, the integral is f; (t x)? dx = $(t — 1», 
so the convolution is again (6.14). 

The hard part of this computation is sketching Figure 6.31, which shows the region 
of integration. The accompanying Maple worksheet demonstrates some built-in graphing 
tools that Maple makes available for sketching such regions. 


Obtain the convolution product H(t — 1) x H(t — 2) using (a) the convolution theorem and 
(b) the defining integral for convolution. ES 


By THE CONVOLUTION THEOREM To use the convolution theorem L[f x] = F(s)G(s), 
or actually, f x g = L~'[F(s)G(s)], obtain F(s) = L[H(t — 1)] = e^/s and G(s) = 
L[H(t — 2)] = e^? /s. The resulting convolution 


g2 


—3s 
He- «Be -2 2 L7 ]-«-526-» 
is computed by applying the Second Shifting Law in reverse to the transform L[t] = i. 


By THE CONVOLUTION INTEGRAL The integrand of the convolution integral J H(x — 1) 
H(t — x —2) dx is nonzero for that region in the xt-plane in which the inequalities x — 1 > 0 
and t — x — 2 > O are satisfied. This region is shaded in Figure 6.32. A representative arrow 
indicates a path of integration for a fixed value of t. The integrand is 0 if t < 3. Hence, the 
integral is 0 for t < 3. For t > 3 the integrand is 1 for 1 < x < t — 2 and the convolution 
integral is [^is dx = t — 3. Consequently, the convolution is again (t — 3)H(t — 3). 


Obtain the convolution product of two unit pulses of duration t = 1, one starting at t = 1 
and one starting at t = 3. These pulses, graphed in Figure 6.33, are represented in terms of 
Heaviside functions as f (f) = H(t — 1) — H(t — 2) and g(t) = H(t —3) — H(t —4). ** 


By THE CONVOLUTION THEOREM To compute the convolution by Laplace transforms and 

the convolution theorem, obtain L[ f (t)] = (e^? — e-?*)/s and L[g(t)] = (e~** — e~*’)/s 

and invert the product of transforms L[f (t)]L[g(t)] = (e745 — 2e75* + e755)/s?. The Sec- 

ond Shifting Law applied in reverse to the transform L[t] = E gives 

0 0<t<4 
4<f<5 
5<t<6 

0 t>6 


f*xg=(t-SH(t —4) —2(r — 5H( — 5) + (t —6)H(t — 6) = 


A graph of the convolution f * g is found in Figure 6.34. 
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1 2 3 4 6 7 
FIGURE 6.34 Convolution of unit 


pulses in Figure 6.33 


5 


By THE CONVOLUTION INTEGRAL Evaluating the convolution integral 


feg= f) [H(x — 1) - H(x — 2][Ht — x — 3) — H(t — x —4)] dx 
0 


requires knowing where, in the xt-plane, both f (x) and g (t —x) are simultaneously nonzero. 
Hence, the inequalities x > 1, x < 2,t—x > 3,t—x < 4mustall be satisfied. This region 
is shaded in Figure 6.35. Horizontal lines represent typical paths of integration along lines 
t — constant. Any such line for which t < 4 ort > 6 yields a zero integrand and a value 
of zero for the convolution. Any such line between t = 4 and t = 5 yields an integrand of 
l and a value for f x g that will be determined by the integral a^ dx — t — 4. Any such 
line between ¢ = 5 and t = 6 also yields an integrand of 1 and a value for f * g that will 
be determined by the integral pia 4 dx = 6 — t. These values are consistent with the results 
from the convolution theorem. 


FIGURE 6.35 Region in the xt-plane 
where integrand for convolution of unit 
pulses in Figure 6.33 is nonzero 


EXERCISES 6.9—Part A 


A5. Compute [H(t — 1) — H(t — 4)] x [H(t — 2) — H(t — 5)] by the 
convolution theorem. 


Al. Compute H(t — 2) * cos3t by the convolution theorem. 


A2. Compute the convolution of Exercise A1 by the defining integral 


after having sketched, in the x1-plane, the region where the 
integrand is nonzero. 

A3. Compute [H(t — 1) — H(t — 3)] « [H(t — 5) — H(t — 6)] by the 
convolution theorem. 

A4. Compute the convolution of Exercise A3 by the defining integral 
after having sketched, in the xt-plane, the region where the 
integrand is nonzero. 


EXERCISES 6.9—Part B 


A6. Compute the convolution of Exercise A5 by the defining integral 
after having sketched, in the xt-plane, the region where the 
integrand is nonzero. 


B1. Compute [e^ sin t] * [t cosh r] by the convolution theorem. 
B2. Verify the convolution in Exercise B1 using the defining integral. 


In Exercises B3-11, show graphically that the ordinary product and the 
convolution product are different after obtaining the indicated convolu- 
tion product 


(a) using the Laplace transform and the convolution theorem. 


(b) by the defining convolution integral. 
B3. H(t —3) «[tcost] B4. H(t — 1) x [te ?'] 
Bs. H (r — =) xcos?2t — B6. H(t — 2) * [e sin 51] 


B8. H(t — x) * sin? 3t 
B10. H(t — 4) x [t sinh 21] 


B7. H(t — 1) x [? cosh 3t] 
B9. H (t — 3) * cosh? f 


B11. H(t — 5) x Jt 
In Exercises B12-21, let P; p(t) represent a unit pulse between t = a 
and t = b. Obtain the indicated convolution product 


(a) using the Laplace transform and the convolution theorem. 


(b) by the defining convolution integral. 


B12. Pi 3(t)* Pa4(t) BI3. Py5(t) * P34(t) — B14. e x Pp. (t) 
B15. £? x P5(t) B16. [t sint] * Po4 (t) 
B17. [e cos3t] * P,5,(t) B18. H(t — 3) * Pya(t) 


B19. [H(t — 3) sin 2t] * H(t — 2) 
B21. [t? Py .2(t)] * Pz 4(t) 


B20. [H(t — 1) cost] * P»4(t) 
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The Dirac Delta Function 


A Question 


We now introduce a sophisticated object whose complete explanation is beyond the scope 
of this text. However, this object is so useful that it really needs to be available at every 
level. We meet this challenge of exposition by posing the following question: 


Which function f(t) has, as its Laplace transform, F (s) = 1? 


The Answer 


Surprisingly, no function f(t) has F(s) = 1 as its Laplace transform. However, the symbol 
ó(t) has been invented as an object with the property that L[d(t)] = 1. Textbooks call this 
object the “delta function.” Since the physicist Paul Dirac had a hand in promulgating its 
use, it is often called the “Dirac delta function.” 

Isn’t this a contradiction? First we state that no function transforms to | and then we 
say that L[6(t)] = 1 for the Dirac delta function 5(t). This is not a contradiction. The object 
ô(t) is not a function. It's an invented “object” concocted to have Laplace transform 1. 

The delta “function,” 5(t), is a distribution, a member of a class of mathematical objects 
whose complete description would take considerably more time than we can afford here. 
Distributions are not point-valued functions but rather functionals, functions whose domain 
is a set of functions and whose range is the real numbers. 

So, itis true that no point-valued function has 1 as its Laplace transform, but it is also true 
that defining an object whose Laplace transform is 1 is an extremely useful generalization. 


The Dirac Delta as Impulse 


For a first insight into the utility of the object 5(t), the Dirac delta function, consider the 
following two initial value problems 


IVP: y’+y=0 y(0) = 0, y'(0) =5 
IVP2: y’+y=5d(t)  y(0)20,y'(00) 20 


The first problem is a standard initial value problem for a harmonic oscillator that is initially 
at the equilibrium position but moving with an initial velocity of 5. The solution of IVP; is 
therefore y(t) = 5 sin t. The "solution" of IVP% is obtained by Laplace transforms. Hence, 


SY+Y=5 


from which we get Y(s) = zu and therefore y(t) = 5sin t. 

Each IVP delivered the same function, namely, 5 sint. This is a classical solution for 
the first IVP but a "generalized" solution for the second. In fact, to get the second IVP to 
yield 5 sin f, the initial condition y'(0) = 0 was used, but 5 sint satisfies y'(0) = 5 not 
y'/(0) = 0. The “solution” to the second IVP is actually a function with a discontinuity in 
its first derivative and is therefore not a classical solution. 

In spite of the difficulty of dealing with the nonclassical solution generated by the Dirac 
delta function, it is still convenient to argue that an initial velocity of five units in the first 
problem, representing a physical “kick” or impulse imparted to the system, is replicated by 
driving the system with the delta function. A pragmatic interpretation of the Dirac delta is 
that it must be equivalent to delivering to the system an initial impulse or kick. 
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| The Translated Dirac Delta: (t — a) 


If the kick is to be delivered at time £ = a, then the Dirac delta is translated as 6(t — a) and 
its Laplace transform is defined by L[6(t — a)] = e 5, consistent with the Second Shifting 
Law. The Second Shifting Law says that the shift t = a in the time domain is equivalent to 
multiplication by e~“ in the transform domain. But the transform of the unshifted Dirac delta 
is F(s) = 1. Except for an unwritten Heaviside function, L[Ó(t — a)] = e ^ is consistent 

| with the Second Shifting Law. We are untroubled by the missing Heaviside function because 
the Dirac delta “function” is not a point-valued object. Heuristically, people say its value 
is zero except at t = a, but that is a myth. It just isn't a point-valued object, so it does not 
need a Heaviside function in the statement of the Second Shifting Law. 


The Sifting Property of ô (t — a) 


To add insult to injury, not only is the Dirac delta "function" not a function in the ordinary 
sense of the word, but we also have the audacity to put it inside an integral sign. Worse still, 
we then declare that the integral sign does not stand for integration. How can we say such 
things? 

We stumbled upon the Dirac delta as an answer to the question, “Which function has 
Laplace transform F (s) = 1?" An alternate route to this same object is the question, “Which 
function 5(t) satisfies the equation 


oo 
| f 5(t) f (t) dt = f(0) 
ae 
for all input functions f(t) continuous at t = 0?" Again, the answer is, “there is no such 
function 5(t).” Thus, an object is invented so that the property holds, but the object cannot 
really be a function and the integral sign cannot really be an integral. However, the object, 
and its integral property, have proven so useful that both have been tolerated, and even 
encouraged, in the applied mathematics literature! 
This integral rule generalizes and is called the “Sifting Property" of the Dirac delta 
function. In particular, under translation, we have 


oo 
Í ó(t — a) f (t) dt = f(a) (6.15) 
—oo 
for every function f(t) continuous at t = a. Remember, we are not evaluating an actual 
integral. Neither we nor the underlying mathematics interprets these as real integrals. The 
| “integral” in (6.15) is not evaluated by antidifferentiation but is interpreted as the Sifting 
Property. 
Moreover, the Sifting Property will hold over any interval containing a. For example, 
with h taken as positive, the Sifting Property includes the following statements that should 
be interpreted as definitions: 


ath 
fi b(t — a) f (t) dt = f(a) 


—h 


ath 
J ó(t — a) f (t) dt = f(a) 


a 


| | .9-f0a -0 


a—h 


FIGURE 6.36 Continuous functions 
converging pointwise to a discontinuous 
function 


0 o5 1 152 


FIGURE 6.37 Members of the sequence 
-(H(x) — H(x — n)) 
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0(x) vy Concentrated Loads 

Because it is so difficult, at this level, to give a complete explanation of the logical structure 
in which the Dirac delta function properly resides, a considerably shorter but less rigorous 
argument typically prevails. This argument seeks to demonstrate the behavior of the Dirac 
delta function as the limiting behavior of a sequence of “real” functions. 

At this point, the reader is warned about making a significant logical error. If a sequence 
of functions f, (x) all have a certain property and this sequence converges to a limit function 
f (x), the limit function f (x) need not have the same property shared by the members of the 
sequence! The typical example is the property of continuity. The sequence of polynomials 
{x"}°° o are all continuous on the interval [0, 1]. The sequence converges to the discontinuous 
function 
0 O<x<l 
] xl 


a result illustrated graphically in Figure 6.36. 

Analytically, just remember that for x, any positive number less than 1, the value of 
lim;255 x" is 0. At x = 1 the value of 1" is 1 for every n, so the limit function must be 
discontinuous. Each individual function in the sequence of functions is continuous, but the 
limiting function is discontinuous. The limit function need not inherit all the properties of 
the "nearby" functions. 

It is imperative for the reader to keep this observation in mind during the following 
demonstration in which we set up a sequence of functions based on a unit pulse between 
x = 0 and x = h, with A > 0. Thus, define the unit pulse by p(x) = H(x) — H(x — A) and 
then adjust the height (or "strength") of this pulse so that the area beneath the pulse is 1. 
Thus, define 


p(x) 
h 
where H(x) is the Heaviside function. A plot of several members of the family of functions 
yi (x) is found in Figure 6.37. As h — 0, the height of y; (x) increases. If f (x) is integrable 

for x > 0 and continuous at x = 0, we have 


1 
yax) = =; (H(x) — H(x — h)) 


h 


— f GO dx = f(c) (6.16) 
0 h 


oo 

Í yn (x) f(x) dx = 

0 
for some c in (0, A). By continuity, f (c) — f (0) ash — 0, soit becomes tempting to claim 
that lim;.,o ya (x) = ó(x) and to say that, as the load becomes more and more concentrated, 
yi (x) approaches the delta function. It is thus appealing to explain the Dirac delta function 
in terms of the limit of a sequence of unit loads becoming more and more concentrated. 

Hence, the idea of the delta function as the "concentrated load" is born. 

Alternatively, compute the Laplace transform 


1 "- 
Y,(s) = L[y.(x)] = ——— 


(6.17) 
hs 


then “concentrate” the normalized pulse by letting ^ — 0 calculating lim;.,o Ya (s) = 1. 
Again, the limit of an integral of y; (x) behaves like the delta function, but that does not mean 
the limit of y; (x) itself is the delta function. As we said at the beginning of the discussion, 
the limit function may not inherit all the properties of the converging nearby neighbors. The 
actions of the sequence y; (x) in (6.16) and (6.17) approach the action of the delta function, 
but the limit of the sequence y; (x) is not itself the delta function. 
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| EXERCISES 6.10—Part A 


A1. Use the Laplace transform to obtain a formal solution to (a) y" +2y' - 5y = 5(t — 1), yO) 20, y'(00 20 
y" + y = d(t — 1), y(0) = y'(0) = 0. Sketch the solution and its (b) 3y” + 4y' + 2y = 8(t — D, y(0) = 0, y/(0) = 0 
derivative. Show that at t = 1 the solution has a jump of magnitude er? oe i ores 
1 in its derivative. Thus, the Laplace transform does not yield a () Ry TSF + y= 8G — 0,940) 79 3] =o 
From Exercise A2, deduce the effect of having 6(t — 1) on the 


classical solution, but rather, a generalized one. A3. i i i 

right-hand side of the differential equation. Write complete and 
grammatically correct English sentences to express your 
observations and conclusions. 


A2. Solve each of the following initial value problems by taking the 
Laplace transform of the equation, solving for Y (s), and inverting; 
then plot the solution. 


EXERCISES 6.10—Part B 


B1. Let f, (t) be the piecewise linear function connecting the origin, B3. Obtain, graph, and compare the solutions to 
the point (a, +), and the point (2a, 0). Its graph forms an isosceles n / E , = J E 
ins with base 2a, height 1, and area 1. Show that L[ f,(t)] > 1 WF pt peg DI eL RE eg 
as a — 0, making it clear that there is more than one sequence 
upon which to base the concentrated load" explanation of the 
Dirac delta function. 


(b) 3y” + 4y' + 2y = é(t), y(0) = 0, y/(00 20 


B2. Obtain, graph, and compare the solutions to 
(a) y" -2y' + 5y 20, yO) 20, (00 21 
(b) y" +2y’ + 5y = (0), y(0) = 0, y' (0) 20 


Transfer Function, Fundamental Solution, 
and the Green's Function 


Transfer Function and Fundamental Solution 


The spring-mass system governed by the differential equation y" +2y’+2y = f (t) can be 
viewed as a black box that takes an input f (ft) and delivers an output y(t). In some sense, 
the system is transferring the action of the input into an output. We follow up on this line 
of thought. 

Begin by finding out what the system does to a unit impulse ó(t). This corresponds to 
giving the resting system a kick, or ping (like a sonar ping in the submarine movies). We 
calculate the system's response to such a jolt. 

Hence, solve the initial value problem v" + 2v' + 2v = ó(t), v(0) = v'(0) = 0 for the 
Laplace transform V (s) and its inverse, v(t). We will call v(t) the fundamental solution 
and V (s) its Laplace transform, the transfer function. Hence, the Laplace transform of the 
differential equation is 


s?V(s) +2sV(s) +2V(s) 21 
from which we determine the transfer function to be 
1 
s? --2s +2 
and the fundamental solution, the inverse transform of the transfer function, to be 


V (s) = 


v(t) = e™ sint 


Transfer Function, Fundamental Solution, and the Green's Function 167 


Table 6.7 summarizes the two definitions illustrated in this example. 


Fundamental solution v(t) Inert system’s response to unit impulse 
Transfer function V(s) Laplace transform of fundamental solution 


TABLE 6.7 Fundamental solution and transfer function 


The Green's Function 
Suppose we drive the system with forcing term f (t) = cos2t. To do this we solve, by 
transform techniques, the initial value problem y" + 2y' + 2y = cos2t, y(0) = y'(0) = 0, 
obtaining 

S 
s?+25+4+2 | 


Y(s) = | — V(s)F(s) 


and the solution 
—t 


1 
y(t) = Tp (cost —3sint)+ 19€ sin 21 — cos 2t) 


Presently, however, we are more interested in the transform Y (5) that has been factored 
into the product of V (s), the transfer function, and F (s), the transform of the driving term 
f (t). This is the product of two Laplace transforms, so the inverse, y(t), is therefore the 
convolution of v(t) and f (t). This convolution is 


y(t) =vx f x v(t — x) f x) dx 
0 


and from Section 5.13, we are able to recognize v(t — x) as g(t, x) in the Green's function 
G (t, x). In fact, g(t, x) for this problem is 


v(t —x) = e "P? sin(t — x) = e ‘e* sint cos x — e 'e* cost sinx = g(t, x) 


Green's Function Revisited 


We have just observed that the solution of the initial value problem y" + 2y' + 2y = 
5(t), y(0) = y'(0) = O is the fundamental solution v(t). The g(t, x) from the Green's 
function G (t, x) is then supposedly v(t — x). In fact, we will now show that the function 
v(t — x) is actually the solution of the initial value problem u” + 2u' + 2u = ó(t — x), 
u(0) = u'(0) = 0. Again, taking Laplace transforms, we get 


s?U +2sU +2U = e™ 


and hence, 
ee 


is s?--2s +2 
and 
u(t) = H(t — x)e *-? sin(t — x) 


where H(x) is the Heaviside function. Except for the factor of H(t — x) we have obtained 
v(t — x). But in use, u would appear in an integral of the form 


t 
Í H(t — x)e f” sin(t — x) f (x) dx 
0 


and, since x < t in the integral, H(t — x) = 1 there, so u is indeed the same as v(t — x). 
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The diligent reader will not rest, however, until the process detailed in Section 5.13 is 
used to construct the very same Green's function as we have twice obtained in this section. 


0 Ix 
e(t,x) t>x 3570823] 


is a fundamental set of solutions for the homogeneous differential equation, and w(x) is their 
Wronskian. Since the characteristic equation is A? + 2A + 2 = 0, the characteristic roots 
are A = —1 +i, yielding y; = e™ cost, y; = e™ sint, and w(t) = e^?'. Consequently, 


YOy a) -y (Hy) 
w(x) 


Recall that recipe was G (t, x) = | , where g(t, x) = 


1—x) 


e ! sin(f)e * cos(x) — e™ cos(t)e * sin(x) 4 
=e 


2¢,x)= sin(t — x) 


e? 
in agreement with v(t — x). 


A Final Interpretation 


The response of y" + 2y' + 2y to the unit impulse 5(t) is the fundamental solution v(t). If 
the kick were delivered at time t = x, the driving term for the system would be ó(t — x) 
and the response would be v(t — x). If at each moment t = x the driving function f(t) is 
evaluated to f (x) and that amount of impulsive kick delivered to the system, the driving 
term would be 5(t — x) f (x). The response to such a kick would now be v(t — x) f (x). 

Finally, if the action of f(t) as a driving term for the system were decomposed into 
a collection of kicks (t — x) f (x) and the effects of all these individual kicks summed 
by integration over the corresponding responses v(t — x) f (x), the system's total response 
would be 


t 
y(t) =f v(t — x) f(x) dx 
0 


But this is just the convolution we computed earlier, and the Green's function appears 
naturally in the convolution integral. 


EXERCISES 6.11—Part A 


A1. The motion of a spring-mass system is governed by the IVP and then compare the result with the solution obtained in 
y" +2y'+5y 2 1—- H(t — D, yO) = y'(0) = 0. part (a). 
(a) Use the Laplace transform to obtain the solution. (f) Use the Laplace transform to obtain a formal solution to 
(b) Obtain the transfer function V (s). u” + 2u' + Su = b(t — x), (0) = u'(0) = 0, and compare the 


solution to v(t — x) obtained in part (d). 


(c) Obtain the fundamental solution v(t). . g 
A2. Repeat Exercise Al for the IVP y” + 3y' + 2y = t(1 — H(t — 2)). 


| (d) Obtain the Green’s function v(t — x). 


(e) The solution of the given IVP can be written as in integral with 
the Green’s function. Obtain and evaluate this representation, 


EXERCISES 6.11—Part B 


B1. Use the Laplace transform to solve the IVP y" + 2y' + 10y = For the IVPs in Exercises B2-5, where the initial conditions are taken as 
8(t) — ó(t — 1) --ó(t —2) — b(t — 3) +. (t — 4) — ó(t — 5), y(0) = y'(0) = 0: 
y(0) = y'(0) = 0, and then sketch the solution. Give a physical 
interpretation of the IVP and the resulting motion. 


(a) Solve, using appropriate technology, and plot the solution. 


(b) Obtain the transfer function V (s). 


6.11 


(c) Find the fundamental solution v(t). 

(d) Write the solution as y(t) = I v(t — x) f (x) dx, the 
convolution of u(t) and f (t), and show it is equivalent to that 
found in part (a). 


0 tex 


(e) Find the Green's function G (t, x) = P eit using the 
technique of Section 5.13. 
(f) Show that v(t — x) is g(t, x). 


(g) Find v(t — x) as the solution to the IVP formed when the 
right-hand side is replaced by ô(t — x). 


B2. y" +2y' + 5y — 5sin3t. B3. y" -- Ay' + 13y = 10cos 2t 
t 0zxt«l 
B4. y" + 6y' + 10y = f(t) = niis 
` s 3-t 2<t<3 
0 £3 


3 y" + 5y’+ 6y = gu — H(t = 2)) 


Chapter Review 


1. Give a verbal description of the Laplace transform. 
2. State the mathematical definition of the Laplace transform. 


3. Give an example of a function that does not have a Laplace 
transform. 


4. Delineate a class of functions for which all members have a 
Laplace transform. 


5. Give a verbal statement of each of the four operational rules for the 
Laplace transform. Highlight the symmetries in these rules. 


6. In mathematical terms, state the four operational rules for Laplace 
transforms. 


7. What are the Laplace transforms for t*, k = 0, 1,..., 4? 

8. What are the Laplace transforms for cos wt and sin wt? 

9. What is the Laplace transform for e“? 
10. What are the Laplace transforms for cosh wt and sinh wt? 
11. Illustrate each of the four operational rules with an example. 


12. Give a verbal statement of the First Shifting Law for the Laplace 
transform. 


13. In mathematical terms, state the First Shifting Law. Give an 
example. 


14. Define the Heaviside function. Draw its graph. 


15. Use the Heaviside function to express a pulse of duration 3, starting 
at t = 5, and having height 7. 


16. Use the Heaviside function to represent the function that is zero 
prior to t = 2, is sint for 2 < t <5, and zero after t = 5. 
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In Exercises B6—8, plot the solution after obtaining it using: 


B6. 


B7. 
B8. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 
26. 


27. 


28. 


29. 


(a) An appropriate technology. 

(b) The Laplace transform, via the following technique. Where the 
Laplace transform requires the initial values y(0) and y'(0), 
use the parameters a and b. Obtain Y (s) in terms of these two 
parameters, and invert to obtain y(t) containing a and b. 
Impose the given initial conditions on this solution, resulting in 
two equations in the two unknowns, a and b. Solve for a and b, 
and hence, obtain the solution to the given problem, which is 
called a boundary value problem and will be studied at length 
in Unit Three. 


2 
y" +2y' + 17y = cos2t, y (=) = —3, y (F) = 


6y” +5y'+y =t, yO) = 1, y(1) =e 
4y" +7y'+3y 20, y0) = —1, yA) =e 


Give a verbal statement of the Second Shifting Law for the Laplace 
transform. Highlight its symmetry with respect to the First Shifting 
Law. 


In mathematical terms, state the Second Shifting Law. 


Give an example of the use of the Second Shifting Law to obtain a 
Laplace transform. 

Use the Second Shifting Law to obtain the Laplace transform of 
tHeaviside(t — 1). Check by writing and evaluating an appropriate 
integral. 

Use the Second Shifting Law to invert the Laplace transform 
F(s) =e” /(s? +5). 

Show how the Laplace transform is used to solve [VPs containing 
nonhomogeneous second-order linear ODEs with constant 
coefficients. Give an example. 

Define the convolution product for two functions f(t) and g(t). 
Obtain the convolution of sint with cos f. 

State the convolution theorem for Laplace transforms. 
Demonstrate how to use the convolution theorem to obtain the 
convolution of sin t with cos f. 

Use the convolution theorem to obtain the convolution of 
Heaviside(t — 1) — Heaviside(t — 2) with Heaviside(t — 3) — 
Heaviside(t — 5). 

State the rule for finding the Laplace transform of a periodic 
function. Illustrate it with an example. 

Define fundamental solution and transfer function. Give an 
example of each. 


Unit Two 


Infinite Series 


Chapter 7 

Chapter 8 

Chapter 9 Power Series 
Chapter 10 Fourier Series 
Chapter 11 Asymptotic Series 


Thefive chapters of UnitTwo are really about representing functions, especially 
functions that are solutions of differential equations. For several important 
classes of differential equations that arise in science and engineering, Unit 
One showed how to find exact solutions in terms ofthe elementary functions, 
namely, polynomials, rational functions, trig functions and their inverses, ex- 
ponentials, and logarithms. 

However, many important differential equations appearing in practice 
cannot be solved in terms of these functions. Solutions can often only be 
expressed as infinite series, that is, infinite sums of simpler functions such 
as polynomials, or trig functions. 

We must therefore give meaning to an infinite sum of constants, using 
this to give meaning to an infinite sum of functions. When the functions being 
added are the simple powers (x—xo)^, the sum is called a Taylor (power) series 
and if xo = o a Maclaurin series. When the functions are trig terms such as 
sin kxor cos kx, the series might be a Fourier series, certain infinite sums of trig 
functions that can be made to represent arbitrary functions, even functions 
with discontinuities. This type of infinite series is also generalized to sums of 
other functions such as Legendre polynomials. Eventually, solutions of differ- 
ential equations will be given in terms of infinite sums of Bessel functions, 
themselves infinite series. 
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Sequences and Series of Functions 


When such infinite series are truncated, that is, terminated after a 
finite number of terms have been added, an approximate solution of the dif- 
ferential equation results. Although the availability of computing hardware 
and software has made numeric solutions of some of these equations viable, 
these additional symbolic techniques are sometimes imperative, and always 
useful, when the differential equation contains symbolic parameters. 

Butthese are notthe only ways of obtaining approximate analytic solu- 
tions of differential equations. Solutions of differential equations can also be 
given by asymptotic series, which can even be divergent. Surprisingly, such 
divergent asymptotic series can give useful approximations! 

Since all these types of series are eventually going to be used to rep- 
resent solutions of differential equations, it is imperative that we know when 
termwise operations such as differentiation and integration are valid. So, Unit 
Two contains some of the tools for approximating functions, whereas Unit 
Three will detail the techniques for obtaining series solutions and approx- 
imate solutions for differential equations. The notions of convergence and 
divergence developed in Unit Two are a useful, if not necessary, prelude to 
our continued work with differential equations. 


Chapter 7 


Sequences and Series of Numbers 


INTRODUCTION The key concept in Chapter 7 is convergence, both of se- 
quences and series of constants. The infinite series is an infinite sum whose precise meaning 
is given by the behavior of its sequence of partial sums. Hence, we first study the conver- 
gence of sequences, in terms of which we define the convergence of infinite series. A little 
bit of rigor here is an innoculate against susceptibility to proofs," based on a mishandling 
of infinite series, that 0 = 1. For example, abusing the series 1 — 1 + 1 — 1 +- -- leads to 
the contradictory outcome 


Dg nid Dr —It*(-I-D-4(C-14D-----1 


Understanding convergence for a series of numbers paves the way for understanding. in 
| Chapter 8, pointwise convergence for a series of functions. Ultimately, we wish to represent 
| solutions of differential equations as infinite series of functions, so Chapters 7 and 8 are 
stepping stones along that path. 

| Some material in Chapter 7 may have been seen in an elementary calculus course that 
provided an introduction to sequences and series of numbers and the convergence thereof. 
For students already familiar with these ideas, this chapter is optional. 


Sequences 


DEFINITION 7.1 


A sequence is a function whose domain is the set of integers and whose range is 
the set of real or complex numbers. Typically, the domain is the set of counting 
numbers, namely, 0, 1, 2, .... Sometimes the domain can include negative integers, 
and sometimes the domain can start with an integer o > 0. The values of the function, 
namely, f (Kk), are the elements of the sequence, and these are generally written as 
ay = f (Kk). 


In short, a sequence is an ordered list of numbers, as the following examples show. 


EXAMPLE 7.1 The ordered list of numbers 1, L, (dec which we label as ag, a), a2, . . . , and form 
k 


l 1 
2:428 
according to the rule f : k — 1/25, k =0,1,..., is an example of a sequence of numbers. 
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EXAMPLE 7.2 
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Figure 7.1, a graph of the points (k, ap), suggests that if k were to increase without bound, 
the corresponding term a, would approach zero. In fact, we know from elementary calculus 
that limy . 5, (1/2*) = 0; so when the sequence has an analytic rule, the limiting value of ax 
can often be found by treating the integer index as a continuous variable and applying the 


limit rules from elementary calculus. e 
a 
A fk) 
D A 
1+ 
e . = 
e. 
e 
e 
0 k 


e 
5 J— —1—2—8$—5—5—e—h—»- k j * ° 
2 4 6 8 1 UMT 


( 
l FIGURE 7.2 The sequence 
k 


FIGURE 7.1 The sequence a, = — ' 
a 2 a, = (- Dc 


2,2 3,2 é 1, _8 2 |. formed according to 


The ordered list of numbers 0, i, np 6° 7? 8? 9? 10? 

the rule f : k —^ (—-D'(k—D/k, k =1,2,..., is graphed as (k, f (k)) in Figure 7.2. This 
graph shows the oscillatory effect of the factor (—1)‘ = —1, 1, —1,... and suggests there 
may not be a single limiting value for the members of the sequence. Every other member 
of the sequence tends to a different value, either 1 or —1, so the sequence does not have a 


unique limit. Finally, we note that k = 0 is not in the domain because f (0) is undefined. % 


Convergence and Divergence of Sequences 


We give two definitions for the convergence of the sequence {az} to the limit L. The first is 
intuitive and consistent with the formalism of elementary calculus. The second is precise 
and historically interesting but significantly more difficult to apply. 


DEFINITION 7.2 


The sequence {az} converges to the limit L if ap = f (k) and limg.o. f(k) = L. 


DEFINITION 7.3 


The sequence {az} converges to the limit L if, for each positive number e£, there 
corresponds an index N beyond which every member of the sequence obeys the 
inequality |a; — L| < e. 


A sequence that does not converge is said to diverge. A sequence can diverge because 
its members oscillate between two or more different values (as in Example 7.2) or because 
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its members grow without bound and therefore L — oo, which is not a finite number. In 
this latter event, the sequence is said to diverge to infinity. 


EXAMPLE 73 The sequence whose general term is a, = 3*/ X? diverges because limo 3*/k?) = 00, a 
. >, 
result supported by Figure 7.3. v 
EXAMPLE 7.4 The sequence which has a, = (5/k)!/* for its general term converges to the limit L = 1 
. . . e. 
because lim; 4, (5/ k)/* = 1, a result evident in Figure 7.4. KS 
ak 
"i e ar 
5 e 
TI 
e 
204- 
e. e 
" * © o eo o © o o 
5 t k à e: 
12 345 6 7 S8 9 10 123 45 67 8 9 10 
3k 5\ Vk 
FIGURE 73 The sequence a, = B FIGURE 7.4 The sequence q = (2) 


EXERCISES 7.1—Part A 


A1. List the first five terms of the sequence a, = k?/2*,k = 0,1, ..., 
then analytically determine L, its limit. 
A2. List the first five terms of the sequence a, = 3*/k,k =1,..., then 


analytically show it diverges (to infinity). 


A3. For each of n = 1, 3, 5, find N, an integer for which k > N 


guarantees a, > 10", where a; is defined as in Exercise A2. 
A4. If a, b, c are constants, then aug, + bug, + cu, = Qisa 


constant-coefficient, linear, homogeneous, second-order difference 


EXERCISES 7.1—Part B 


equation with general solution u, = Aa* + BB*, where o and f 
are roots of the quadratic equation ar? + br + c = 0. The arbitrary 
constants A and B can be determined by prescribing, for example, 
the values of u; and u2. Show that the guess u; = r* leads to this 
solution. 


AS. Starting with xo = 0, obtain xz+1, k = 0,..., 4, if xy41 = g(xi) 
and g(x) = 14 zx. Find any fixed points of this iteration, that is, 


solutions of x — g(x). 


B1. Show that the iteration in Exercise A5 diverges if xo = 5. 
For the sequences given in Exercises B2-10: 
(a) List the first 10 members and plot the corresponding points 
(k, ay). 
(b) Find L, the limit of the sequence. 


(c) For each n = 1, 3, 5, find N, an integer for which k > N 
guarantees |a, — L| < 1/10". 


(d) Find, if possible, an N (s) for which k > N (€) guarantees 
lay — L| < £ for any small, positive €. 


(- Dk 
k+1 


k? +k 
= Kel. 


B2. ———,k- 
2k? —1 


B3. ye em dose 


Ink Indink 

Ri = pai ps, 22) 72 
k Vk 
k! 5k 4-2X* 

Bá T el B7 k=0, 
pe ($1) 


a 
| 
>= 
N 
4 
> 
q 
2 
Il 
e 
=z] 
© 
P ENS 
+ 
|— 
po. 
5 
= 
A 
Il 
= 


For each of the sequences in Exercises B11-17: 


B11. 


B13. 


B15. 


B17. 


(a) List the first 5 members and plot the corresponding (k, ax). 
(b) Show that the sequence diverges (to infinity). 


(c) For each n = 1,3, 5, find N, an integer for which k > N 
guarantees |a| > 10". 


-1)&e k+2\* 

ee thy. 212. (?** ) TT 
k2 4k +1 

-osh(In k 

Ow gi. BIA k- wae hkl 
Vk 

CLR PUN B16 (iei) k=0 

TEF ae A 7) k=O... 


ix” 


In Exercises B18—22, use the ideas of Exercise A4. For each: 


B18. 
B19. 
B20. 
B21. 
B22. 


(a) Find an expression for the solution uz- 
(b) Plot the solution. 
(c) Obtain limi. uj. 


(d) Show that u3, u4, and us determined by the analytic solution 
are given by ui. = —(buz+ı + cuz)/a, k = 1,2,3. 


Ups. + 3Up4, — uy = 0, u; = 1, u2 = —1 
Zugaz — Suey, — 3uy = 0, uy = —2, uo —3 


Bugy — Une, — Sug = 0, uy —3,u5 =5 


k42 + Tes, — 6uy = 0, uy = —5, u2 = —3 


—ujg42 + 3uj441 + 2uy, = 0,u4 = 0, u2 = —2 


The ideas of Exercise A4 do not apply to difference equations that are 
nonlinear or do not have constant coefficients. In Exercises B23-27: 


B23. 


B24. 


B25. 


B26. 
B27. 


(a) Determine if the equation is nonlinear or does not have 
constant coefficients (or both). 


(b) Fork = 1,...,5, obtain u;45 from ug, Ug+ı and the 
difference equation itself. 


(c) Plot the points (k, uy), k =1,..., 9. 


Uk42 + Kuga — ug = 0, uy = 2, u2 = —1 
z 1 
Uk+2 — Kuga + g“ —0,u;—1,u5—1 


Wk el 


=k 


Hu, = —l,u» LU 


Uk+2 
Uk 

" 
Uk42 = Ugy] — ug, U1 = l,u; 22 


Uk42Uk}1 — 2uj = k, uy = 2, u —3 


If the equation f(x) = 0 can be put into the form x = g(x), then the 
sequence defined by xz+ı = g (xx) converges to a root r when xo is suffi- 
ciently near r and |g'(r)| < 1. For the functions g(x) given in Exercises 
B28-34: 


(a) Use appropriate technology to determine r, a solution of 
x — g(x) = 0 for which |g'(7)| < 1. 
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(b) Obtam xe; k = 1,25; 


guarantee convergence. 


for an xo sufficiently near r to 


.g(x)mex*-— Bx +3 B29 g(x) = 2x3 413 x? x+5 
g(x) =cosx B31. g(x) = tan (x — 5522) 
- gx) = mmt byt EE 
(x) 6050x? + 1369 
. g(x) = —————— 
5 8000x + 6845 
. g(x) = — (4x? + 5x2 + 2x + $) 
. The continued fraction 
ji 
a; + i 
a» + 
1 
a3 + 
a4 ce 


1 1 L... is defined to mean 
a+ a3d a44- 


typically abbreviated to a; + 
the limit, if it exists, of the sequence of convergents 


1 1 
ay, a, + „äi + y, F 
a? 1 1 
d + — a» + 
a3 az + JL 
a4 
Given the continued fraction 
1 
y=2+ 1 
4+ 
4+ 
4+ 


(a) write out the first six terms of the sequence of convergents. 
(b) find 


4+ 


4+ 
4+. 


i assuming, of course, that x exists. 


SOX =F 


The infinite product [ [7-., (1 + ux) is defined as the limit of the sequence 
of partial products P, = [T; 4 (1 +u) = (o E ui om u2) (A + un), 
provided uz # —1, k = 1,2,.... For the infinite products in Exercises 


B36- 


B36. 


B39. 


40: 
(a) Write out the first six partial products. 
(b) Plot the points (n, Pa). 


(c) With a computer algebra system, try to determine the exact 
value of the infinite product. 


(d) Compare the partial products from part (a) with any analytic 
answers obtained in part (c). 


(+i) B37. T](1~ z) Bas. [](1+ 55) 
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FIGURE 7.5 Sequence of partial sums for 


=“ f 
2 3 


k=0 


Infinite Series 


Terminology 
INFINITE SERIES If {az}, k = 0,1,..., is a sequence of numbers, the ordered sum of 
all its terms, namely, | je dy = do ta, +a +434+--- , is called an infinite series. The 


terms of the sequence are added in the order in which they appear in the sequence. Thus, 
for example, the sequence defined by a : k — 1/2*, for which the first few terms are 
l, i, i, i, i: $, gives rise to the series » - 91/2, that is, to the sum 1 + 5 + 1 + i + 
E T ü T a +--+. We can give a meaning to this infinite chain of additions as soon as we 
make the following definition. 


PARTIAL Sums Given the infinite series ? 7. , a, the finite sum of terms up through 

an, namely, Y 7 9 dx, is called a partial sum. For the series Y 7-4 1/2*, the partial sums 

up through do, a), da2,... form a sequence of partial sums s,,n = 0, 1,.... In fact, 
0 i 1 2 À 3 i 

we would have so = } /;.9 1/2, s; = Dojo 1/2/, 82 = 5 75.91/2/, $3 = 375.9 1/27, .... 


a 


SUM OF THE INFINITE SERIES The sum of an infinite series is the limit of the sequence of 
its partial sums. Termwise addition is an infinite process and, if carried out literally, would 
be unending. Defining the sum of the series in terms of a limit is a prescription for obtaining, 
in finite time, the outcome of a task with an infinite number of steps. 

In Figure 7.5 the graph of the sequence of partial sums for $7 , 1/2* suggests this 
series sums to 2. In fact, Exercise Al shows that (5.9 1/2*)(1 — 4) = 1 —1/2%+4; and, 
since limy 1/2"*! = 0, we have 1 57,4 1/2" = 1, and hence, $ zco 1/25 = 2. 


DIVERGENT SERIES Series for which the sequence of partial sums diverges are called 
divergent series. Thus, an infinite series can diverge because its sum becomes infinite or 
because its partial sums oscillate. For example, the series 5; 91 diverges because its 
sequence of partial sums is 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, ..., a sequence clearly diverging 
to infinity. 

On the other hand, the series 1 — 1 + 1 — 1 +- -- , that is, the series yal, also 
diverges, but this time because the sequence of partial sums 1, 0, 1, 0, 1,0, 1,0, 1,0, 1, ... 
oscillates between 1 and 0. 


GEOMETRIC SERIES The series » ;- , ar^, known as the geometric series, arises often and 

converges to the sum $ = 4*-, provided |r| < 1. If 1 < |r|, the geometric series will 

diverge. This is established by letting Sy represent the partial sum up through k = N, 

forming the difference Sy — r Sy, and solving for Sy = a(r"*! — 1)/(r — 1). Provided 

|r| < 1, the term r^! will tend to zero as N becomes infinite. Hence, we obtain S = £ 
1 1 


l-r 
3 . . N k — " mE - . 

For example, in the series ? ^, , 1/2^, a = 1 andr = 5, so S = ipa = 2, as we saw 
earlier. 


Tue p-SERIES A series of the form 5 7^ , 1/k? is called a p-series. The geometric series 
Yo ar* has a fixed constant r raised to integer powers, whereas the p-series has the 
integers k raised to a fixed power p. There is a single formula for the sum of the geometric 
series, but not one for the p-series. At this point, we don't have the tools for determining the 


Lond 


0 1 2 3 4 


FIGURE 7.6 Divergence of the harmonic 
series 
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behavior of the p-series, but Exercise B1, Section 7.3 shows the p-series ? 7- , E converges, 
while Exercise A1, Section 10.4 shows it can be summed to T 


THEOREM 7.4 THE nth-TERM RULE 


[e.e] 
1. ) An < OO 


n=0 
=> lim a, = 0 


n— oo 


In words, this says that if the series eu an converges, the nth term must go to zero 
but not conversely. Thus, for a convergent series the condition lim,., 55 a, = Q is necessary 
for convergence but not sufficient. If the series converges, the successive terms have to be 
getting smaller or the sum will not be bounded. But surprisingly, the rate at which the terms 
become smaller actually matters. If the rate of decay of the terms isn't fast enough, the 
series won't converge. 

If the nth term goes to zero, the series need not converge, the classic counterexample 
being the harmonic series Y z i This series diverges because, even though the general 
term goes to zero, it doesn’t get small fast enough and the sum grows beyond all bounds. 
Below, the harmonic series is studied in detail. 


The Harmonic Series 


An intuitive feel for the truth of the nth term rule is important. Hence, we demonstrate the 
divergence of 3 7: , b the harmonic series, remarkable because the general term, namely H 
goes to zero. Figure 7.6 shows a graph of f(x) = 1, 1 € x <4, and a left-box rectangular 
approximation to the area under it. The interval is partitioned at the integers 1, 2,3, and 
over each of the three subintervals [k, k + 1],k = 1, 2,3, a rectangle of height f(k) is 
constructed. Since the heights of the three rectangles in Figure 7.6 are determined at the 
left endpoint of the subinterval over which each sits. 

The shaded area of the rectangles is clearly greater than the area under f (x). Moreover, 
given the integer partition points for the rectangles, the areas of these three rectangles are 
i, P and i respectively. But those are the first three terms of the harmonic series. In fact, 
the first n terms of the harmonic series would be the same numbers as the areas of the 
first n rectangles of a similar integer-based rectangular approximation, between x = 1 and 
x =n + 1, of the area under f(x) = L, Generalizing from the figure, we conclude that the 
nth partial sum obeys the inequality 


n+1 1 us 1 
f -dx 2ln(n41) «3 - 
1 A kel k 


from which the divergence of the harmonic series follows because lim,- In(n + 1) = oo. 

The sum of the first million terms is 14.39; and the values of the partial sums to 10!°, 
10!5, and 107° terms are, respectively, 23.60, 35.12, and 46.63. If one assumes the age of 
the universe to be 15 billion years, then there have been no more than 5.0 x 10!” seconds 
since time began. If one term of the harmonic series were added each second since time 
began, the sum would be less than 46. It takes a very large number of terms before the 
harmonic series becomes unboundedly large, but diverge, it does. 
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Termwise Arithmetic 


If two series converge, then termwise linear combinations are valid, that is, if X` zco a, = A 
and $7, be = B, then X} p o (œar + Bb) = aA + BB. 


EXAMPLE 7.5 


Consider the convergent series 37, 1/2" = 1 and 355, & = £. the first being a geo- 


metric series and the second a p-series. A termwise linear combination of the two series 
would be » 77^, (3/2 +7/k?), with sum 3 + 7%, the same linear combination of the sums 


of the original two series. 


EXERCISES 7.2—Part A 


SZ 
K 


Al. Expand (1 +r +r? +r°)(1 — r) to obtain 1 — r+. Generalize this 
to OS r*)(1 — r) = 1 — rF*!, and thereby obtain the 
summation formula Y7? , r* = (1 — r**!)/(1 — r). Test these 

| calculations for r — 5. 


A2. Compute the number of seconds in 15 billion years. 


A3. For the harmonic series: 


(d) Show 4 +---+ +, the sum of the next 16 terms exceeds 
E 32 


1 
32 2s 
(e) Generalize these observations and construct a proof that the 
harmonic series diverges. 
A4. Computationally, test the claim that  ;* ,(—1)**' } = In2. This 
series is called the alternating harmonic series. 


(a) Show 1 + 1 > : =l, AS. Computationally, test the claim that 
3 2 s ; 
(b) Show 2 +---+ 4, the sum of the next 4 terms, exceeds $ = 7. | Dike (- 0*1 = In| < gi 
(c) Show 3 +---+ +, the sum of the next 8 terms, exceeds 
& 1 
16 r 
EXERCISES 7.2-Part B 
B1. What sum would be attained by adding 10 million terms of the B10. a; = (= B 1 ) Bil. a, = 2 
harmonic series each second since the universe began 15 billion Vk k+1 [+k 
years ago? - sin is 
B2. On a fixed-precision computer, in a language such as BASIC, Misi k? 


FORTRAN, Pascal, or C, sum the harmonic series termwise until 
it appears to have converged. Explain both the phenomenon of 
“apparent convergence” and the specific value generated by your 
program. 


Exercises B3-12 give az, the general term of the series S en a,. For 
each: 
(a) Plot the points (k, a), k =1,..., 10. 
(b) Find S, = 37, ,aj n =1,..., 10, the first ten partial sums. 
(c) Plot the points (n, $,), n — l,..., 10. 
(d) Determine lim; s dy. 


(e) Hazard a guess as to whether the series converges or diverges. 


2 3 (-1)* Ink 
B3. a, = Hu B4. a, = B B5. a, — B B6. a, = — 
k! (—1)*k! k 
B7. Ok = NK B8. ok = De BS. a =In( =) 


Exercises B13-22 give ax, the general term of the series 9 7- ax. For 
each: 
(a) Find $, 2 35 ,a,n =1,..., 10, the first ten partial sums. 
(b) Plot the points (n, $a), n =1,..., 10. 
(c) Sum the series. 
(d) Verify the nth-term rule. 


3 4 2 3k 
B13. ay = S1 B14. ay = 3k-2 + Je B15. ap =e ` 
g ; 
Blé.a,— 55 B17. a = (—1)*3'* B18. a, = (V/7)* 
1 6 7 
B19. ag = 7k B20. ak = 53k+1 B21. ak = TH es FERE) 


B22. 


ak 
A 
6000 + e 
5000 + 
4( 100 + 
3000 4- 
2000 + © 
1000 ò 
T à 
o—p e p o è I >k 
2 4 6 8 10 


FIGURE 7.7 Divergence of the series in 
Example 7.7 


EXAMPLE 7.6 


EXAMPLE 7.7 


EXAMPLE 7.8 
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Series with Positive Terms 


The Ratio and nth Root Tests 


It is easier to determine whether or not a series converges than it is to determine the sum 
to which it might converge. There are few simple techniques for discovering the sum, but 
there are a number of “tests” for determining if convergence takes place. We remind the 
reader of two tests found in any calculus text. 


Tue Ratio Test For $7 ax, a series with positive terms, let o = limi s, (ay41/a;). If 
p < 1, the series converges; if 1 < p, the series diverges; if p = 1, the test is inconclusive 
since the series may diverge or converge. 

Intuitively, the test compares the "next" term to the “previous” term. For a convergent 
series, the “next” term should be sufficiently smaller than the preceding term, else the series 
will grow too fast to converge. If this "continuing decrease" in the size of successive terms 
is maintained indefinitely, it is reasonable to expect the series to converge. 


Tur nth Root Test For x8 Gn, a series with nonnegative terms, let r = lim, ,55(a,)!/". 
Ifr < 1, the series converges; ifr > 1, the series diverges; if r = 1, the test is inconclusive 
since the series may diverge or converge. 

It can be shown that if p = lim, ,4; dn+1/dy exists, then r = lim„— oo (an) !/” also exists 
and p = r. However, r may exist when p does not, so the nth root test is “more powerful.” 
(See [65, p. 394].) 

Typically, the ratio test is easier to apply, but there are series for which the nth root test 
can be convenient or even necessary. 


To determine if the series pau k/2* converges we use the ratio test. The ratio of two succes- 
sive terms is (k4-1)2* / k2**, the limit of whichis p = 5 < 1. By the ratio test, the series con- 
verges. Alternatively, the nth root test requires us to calculate r = lim, ,4,(n/2")/" = 1 


NI 


7 
«e 


so both tests let us conclude the series converges. 


To determine, via the ratio test, if the series 97 , 3* / k converges or diverges, form the 


ratio between two successive terms, obtaining k3**! /(k + 1)3*, whose limit is p = 3 > 1. 
Hence, conclude the series diverges. In fact, Figure 7.7 shows how rapidly the terms are 
growing. Indeed, since lim.,4,(3*/k) = oo, the general term does not approach zero, a 
much simpler proof that the series diverges. 

Alternatively, the nth root test requires us to compute r — lim,..4,(3"/n)!/^ = 3, and 
both tests lead us to conclude the series diverges. $ 


The series 3 7, mk diverges because each term is larger than the terms in the harmonic 


series 9 7, t, and we have already seen that the harmonic series diverges. As with the 
harmonic series, the general term tends to zero, yet the series diverges. However, the ratio 


test is indeterminate since p = lim,.,5; ne = |. Likewise, the nth root test is based on 
Inn 


, 1 i i . 
the number r = limpo% (97) /" whose value is, not surprisingly, 1. Thus, when the ratio 


n 


test fails to be conclusive, so also will the nth root test fail to be conclusive. $ 


EXAMPLE 79 The series $77 
g 
(k+1) 


n=l n 


EXERCISES 7.3—Part A 


Chapter 7 Sequences and Series of Numbers 


i. converges to 
-= = 1. The nth root test gives r = limy+o0 (4) /" — 1, so we again see both the ratic 


and nth root tests failing to be conclusive. 


x , but the ratio test again fails since p = limy.x 
n? 


i$. 
E: 


A1. Apply both the ratio and nth root tests to the series 
M 

A2. Apply both the ratio and nth root tests to the series 
NOR AK IBE 


A3. If {az} is the sequence defined by a; = 3, ay+; = a4 (2 — cosk)/k, 
determine if the series ^; , a; converges or diverges. 


EXERCISES 7.3—Part B 


A4. If 
k even 
ay = 


k odd 


wm |= 


use the nth root test to show the series Y -., a, converges. 


AS. Test the series ? 7, 1/(In k)* for convergence or divergence. 


B1. The integral test for the series 377. , f (k), where f(x) isa 
continuous, positive, decreasing function for x 7 1, concludes 
that the series and the integral pri , f(x)dx converge or diverge 
together. Use this test to verify the convergence of the p-series 


determined by f(k) = $. 


For the series in Exercises B2-15: 


(a) Form and plot the first ten partial sums. 


(b) Determine convergence or divergence by the ratio test, if 
possible. 


(c) Determine convergence or divergence by the nth root test, if 
possible. 


(d) If o from the ratio test and r from the nth root test both exist, 
are they the same number? They should be. 


(e) If neither test is conclusive, try to establish convergence or 
divergence by comparison to more tractable series or make a 
conjecture based on empirical evidence. 


e. Kl E F ~ d S Uk 
B2. $^ Gy B 2o py M 3 dus B x 
oo oo oo oo A 
B6. X` 5 m B7. > kek BB. D = B9. Y^ E 
Ea Decet QR) © k!link 
B10. BT X ee B11. aw: TEXTES 


2 Ink X k?+5k+6 
B2) 77 auff 


B16. An exercise in [65] declares that if a, > 0 and lim, ,,, ka; exists 
and is positive, then ) 7- , a, diverges. Which series, if any, in 
Exercises B2-15 can be declared to diverge on the basis of this 
proposition? 

B17. An exercise in [65] declares that if a, > 0 and there exists a 
number p > 1 for which lim;-,.. k"a; exists and is finite, then 
Tra a, converges. Which series, if any, in Exercises B2-15 can 
be declared to converge on the basis of this proposition? 


B18. The /imit comparison test for series of nonnegative terms states 
that (a) if a, > 0, b, > 0, and liM} a, /by = a, where o is 
neither 0 nor oo, then 37. , ay and Y»... , by either both converge 
or both diverge; (b) if œ = 0 and ae b, converges, then 
Yo, ax converges; (c) if o. = oo and Y 77 , b, diverges, then 
>, ap diverges. Which series, if any, in Exercises B2-15 can 
have their behavior decided on the basis of this test? 


B19. If a; = 1, and a1 = 1/(1 + aj), the series DE ap diverges. Tc 
see this, 
(a) obtain and plot az, k = 1,...,12. 
(b) show that a, — Sa is the Golden Ratio. (Hint: If a, — A, 


then A = ;+,.) Since the terms of the series do not tend to 
zero, the series cannot converge. 


B20. If j 
1 k even 

ag = > 

ke 
2 k odd 


show that the series c: , 4 converges. To this end, 


(a) obtain and plot az, k = 1,..., 10. 


n 


(b) obtain and plot the first ten partial sums S, = » /,. | de, 
mnes 1,...., 10. 


7.4 


(c) show that p in the ratio test does not exist. 


(d) show that r in the nth root test is 4. 


B21. Let $1, $5, $3, ... be the partial sums of a divergent series 


Vb ay. If the sequence op = i ys 4.54, the arithmetic means 
(or averages) of the first n terms of S1, $2, S3,... converges to S, 
the series 3 ;- ax is said to be summable to S by Cesaro’s ([3], 
[65], and [97]; Césaro in [84]) method of arithmetic means of 
order 1, or (C, 1) summable to 5S. It can be shown that if p ak 
itself converges, it converges to S, making Cesaro summability a 
regular method of summability. 


(a) Show that c; generates the sequence S, EIM. yx 


(b) Show that o, = $7; ,(1 — £2)a,. 


n 


TRES 


(c) Obtain the Cesàro sum for the convergent geometric series 
oo k 
> 1/25, 
k=0 


(d) Obtain the Cesàro sum for the divergent series 5 7 )(—1)*. 
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(e) Show that 2 is the (C, 1 sum of 1 +0—1+1+0—1+1+ 
O,1l+---. 


(f) Show that is the (C, 1) sum of 1+0+0-—-1+1+0+ 
0-—14+14+0+4+0-1+4---. 


(g) Show that 377 , (—1)*k is not (C, 1) summable. 


(h) Sum the series in part (d) with your favorite computer algebra 
system, and compare its answer with the Cesàro sum. 


B22. The comparison test of elementary calculus states that the series 


i-o a converges if it has no negative terms and ? 7. cx isa 
convergent series for which a, « c; for every k > K where K isa 
fixed integer. Use this comparison test to show the convergence of 
each of the following. 


oo 


sin? k A. 2-4- cosk 
82^ Nep 


k=1 k=1 
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Absolute and Conditional Convergence 


The sequence of partial sums for a series with positive terms either converges or diverges 
to infinity. Each successive partial sum will be at least as large as the preceding one, so the 
partial sums form an increasing sequence that either has a finite limit or becomes infinite. 
Ruling out the latter case means the series must converge. 

If there are positive terms and negative terms mixed in the series » ^7. o ax, convergence 
becomes a more delicate affair. Now, a partial sum can be either larger or smaller than its 
predecessor because the additional term added can be positive or negative. The sequence 
of partial sums can therefore have a finite limit or an infinite limit or can oscillate. Hence, 
there are now two ways for the series to diverge, so ruling out diverging to infinity does not 
imply convergence. Determining the convergence of a series with both positive and negative 
terms is more subtle than determining the convergence of a series of positive terms. 

To deal with the added complexity of series with positive and negative terms, we 
distinguish between absolute and conditional convergence. 


ABSOLUTE CONVERGENCE A series with both positive and negative terms is said to con- 
verge absolutely if the series converges when all its negative terms are made positive. Thus, 
when $7 , |ax| converges, the series ) 7 o ax is said to converge absolutely. The conver- 
gence studied for series with positive terms was, in fact, absolute convergence. 


The series 
x(4)- EN ROM C UN (7.1) 
E 2 2 4 8 16 32 
converges to ;— 5 = 3» whereas the series 5 77°. 1/2", converges to 2. Thus, (7.1) con- 


verges to i but converges absolutely to 2 and so is said to be absolutely convergent. 


Ratio and Root Tests Extended If in the ratio test and nth root test we compute 
p = limi lak;i/ax| and r = lim, 555 lär |". then the conclusions about convergence 
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and divergence are as stated previously. Hence, these two tests can be used to determine the 
absolute convergence of a series. 


CONDITIONAL CONVERGENCE If the series ? 7 ax contains both positive and negative 
terms and converges when ) 7. , |a;| diverges, we declare the convergence to be conditional. 
The convergence is contingent on the presence of the negative terms that serve to diminish 
the size of the partial PUE um classic example of this is the alternating harmonic series 
4 (-1*/k-21-1 t+ z-G i+: = ln 2, which diverges when all the terms are made 
positive. (The value of | the Redes is established i in [54].) 


THEOREM 7.2 


An absolutely convergent series is convergent. 


Intuitively, if a series of positive terms converges, the terms must be getting smaller. 
Making some of the terms negative would only make the partial sums smaller still, so a 
series that converges absolutely must converge in the sense of conditional convergence. 

Note that the term “convergent” is used in three different contexts. A series 9 7-9 ax 
is said to converge if the sequence of its partial sums has a limit. If the series 5 7;- o |ae| 
converges, the original series is said to converge absolutely. Finally, if the original series 
converges but does not converge absolutely, then the series is said to converge conditionally. 
A series containing both positive and negative terms can therefore be said to converge, or it 
can be said to converge absolutely, or it can be said to converge conditionally. It can converge 
and converge absolutely, or it can converge and converge conditionally. It cannot converge 
absolutely and conditionally at the same time. To a certain extent, using the unmodified 
"converge" leaves the reader in the dark about whether the series converges absolutely or not. 

Momentarily, we are going to see that absolute convergence is sufficient to guarantee 
that the terms of the series can be rearranged (reordered). Rearranging the terms of a 
conditionally convergent series leads to a new series that can diverge or can converge to an 
arbitrarily preassigned number (see [65]). 


REGROUPING Ifthe series Let a, converges (either conditionally or absolutely), then 
any series formed from it by regrouping terms, that 1s, by inserting parentheses while not 
changing the ordering of terms, converges to the same sum. For example, the alternating 
harmonic series converges (conditionally) to In 2, as do the regroupings 


1 i | I 1 1 4—3 6—5 
(l=-g)+(¢-2)+(6—- 4) + =o + get Get” 

I 1 1 
Do te t*G6"" 
oo 


» + me +2) 


and 


1 1 1 1 1 1 — -342 5+4 7+6 
leet tC +t) tC tg t+ -=ae TOO tent 
== 1 1 
zi 20a CT] (6)(7) 
1 


=] — 


= 2k(2k + 1) 


EXAMPLE 7.10 


EXAMPLE 7.11 
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REARRANGEMENTS A series is said to have its terms rearranged if the order of its terms 
is changed. Dirichlet's theorem on rearranged series states that if the terms of an absolutely 
convergent series are rearranged, the new series converges absolutely to the same sum as 
the original. (See, e.g., [65, p. 404].) However, the terms of any conditionally convergent 
series can be rearranged to give either a divergent series or a conditionally convergent series 
converging to any desired real number. 


Alternating Series 


It is difficult to say much about the general series whose terms are both positive and negative. 
However, if the signs of the terms strictly alternate between positive and negative, the 
resulting series, Yo C D'ar, a; > 0, is called an alternating series, for which we have 
the following convergence theorems. 


ALTERNATING SERIES THEOREMS The first alternating series theorem gives sufficient con- 
ditions that guarantee an alternating series does indeed converge. The second provides an 
estimate of the sum of an alternating series. 


THEOREM 7.3 LEIBNIZ THEOREM 


oo 
1. dK ~ia with each a; positive, is an alternating series. 
k=0 
2. Foreachk, a, > aj41, that is, the sequence {az} is monotonically decreasing. 


S hma = 0 
k—oo 


==> the series converges (at least conditionally). 


In a word, the alternating series converges (at least conditionally) if its terms a, mono- 
tonically decrease to zero. 


For 34-4 (—1*/k, the alternating harmonic series, the terms a, = + form a monotone 
decreasing sequence whose limit is zero. Thus, Theorem 7.3 guarantees the series converges 
but does not determine what that limit might be. á 


THEOREM 7.4 ESTIMATION THEOREM 


If $7 4 (— Da, is an alternating series satisfying the hypotheses of Theorem 7.3, 
then the partial sum Sy = yo 1)*a, approximates L, the sum of the series, with 
an error whose absolute value is less than ay ;, the numerical value of the first unused 
term. A symbolic statement of this result would be 


N 
cra — L| € ay, 
k=0 


Consider the alternating series Y 7^ , (—1)“*+)/k? that converges to the sum z (obtained in 
Exercise A3, Section 10.4). Since the general term a, = B forms a sequence of decreasing 
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positive terms whose limit is zero, we know by the theorem of Leibniz that the series 
converges. The series with all positive terms would be Xm ze a series whose sum is 
&- (obtained in Exercise A4, Section 10.4). Consequently, the original series converges 
absolutely. 

The partial sum after ten terms is $j9 = we = 0.8179621756, which approximates 
the true sum $ = 75 toa tolerance of $ — $19 = 0.0045048580. The approximation theorem 


claims this error is no worse than the absolute value of the first term neglected, namely, 


7 = 0.0083, and indeed, this is the case. e 


EXERCISES 7.4—Part A 


A1. Consider the alternating series Yu C DK 3 C). 
(a) List and plot the first 10 terms of the series. 
(b) Obtain and plot the first 10 partial sums of the series. 
(c) Show that the Leibniz convergence criterion does not apply. 


(d) Show that the series does not converge absolutely. Hint: An 
obvious rearrangement is nearly the harmonic series that 
diverges. 


(e) Show that a pairwise grouping of the terms, starting with the 


very first pair, leads to a series with partial sums s; = $5414 — 1, 
where S, are the partial sums of the alternating harmonic series. 


(f) Part (e) shows the given series converges to In(2) — 1. Obtain 
empirical evidence for this value of the series. 
(g) Show that the pairwise grouping described in part (e) leads to 
Hes YT 1 
the series Tr ~ FROKED * 
A2. Apply the integral test of Exercise B1, Section 7.3, to the general 
p-series 3 7, 1/k”, concluding that the p-series converges for 
p > land diverges otherwise. 


EXERCISES 7.4—Part B 


A3. Consider the alternating series 5 ;- ,(—1)**'k/(k + 1). 
(a) Show that the series is not absolutely convergent. 
(b) Show that the Leibniz convergence criterion does not apply. 


(c) Graph the first 10 partial sums, and from this, infer that the 
series is not conditionally convergent. 
A4. Consider the alternating series 
1 1 1 1 1 1 l 1 
373t3 9 ps 3 "Cs RT 


(a) Plot the first 10 terms of the series. 


(b) Obtain and plot the first 15 partial sums, and from this, suspect 
that the series converges conditionally. 


(c) Show that the Leibniz convergence criterion does not apply. 


(d) Show that the series converges absolutely. 


B1. The series 


E E 
Q^ 12'3'39 


k=l 


converges (absolutely) to 7- Hence any rearrangement must 
converge to the same sum. Show empirically that the 
rearrangement 


mts tata stst$gtgde 


(two “odd” terms followed by two "even" terms) also converges to 
the sum —. 


B2 


The alternating harmonic series $7 ,(—1)**! /k converges 
conditionally to In 2, so any rearrangement that converges need not 
necessarily converge to In 2. Show empirically that the 
rearrangement “two positive terms followed by one negative term,” 
thatissI--1—i-cici-icictui-ic-c.converges to 
3 In 2. 


For the alternating series given in Exercises B3-14: 


(a) Plot the first 10 points (k, Ja;|). 

(b) Apply the Leibniz convergence criterion to establish 
convergence. 

(c) Obtain and plot the first 10 members of the sequence of partial 
sums. 

(d) Use the estimation theorem to find an n for which the partial 
sum $, is within 10^? of the actual sum. (In B5-7, use 107, 
107}, 107, respectively.) 

(e) Evaluate the partial sum S, specified in part (d). 

(f) Use a computer algebra system to determine, where possible, 


the exact sum of the series, and compare the estimate to the 
exact value. 


(g) Test the series for absolute convergence. 


7.4 Series with Both Negative and Positive Terms 


$ ( De y (—1)* > (—1)*! 
B3. B4. B5. 
k=1 e k=l k=l Vk 


S (=1) = CD 2 „ink 
B6. B7.) ———— —— B8.» (-1) — 

2 Ink Lui 3 k 
10. = kl k? 
B10. =! —— 

2 ) (k 4- 1)! 


klnk 
k 
B9. J (—1) dk 


Chapter Review 


1. What does it mean for an infinite sequence of numbers to converge 
to a limit L? 


2. What does it mean for an infinite sequence of numbers to diverge? 


3. Give an example of an infinite sequence of numbers that converges 
to a limit. 


PN 


. Give an example of an infinite sequence of numbers that diverges. 
Explain why it diverges. 

. What is a partial sum of an infinite series? 

. What does it mean for an infinite series to converge? 


. Give an example of a convergent infinite series. What is its sum? 


Qo N A Un 


. What does it mean for an infinite series to diverge? Give an 
example of a divergent series and explain why it diverges. 


9. Answer true or false, and give a reason. 
(a) If a series converges, its nth term goes to zero. 


(b) If the nth term in an infinite series goes to zero, the series 
converges. 


(c) Two series can always be added or subtracted termwise. 
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oo k co k+1 
k+1 k+1 
B11.) (-1) ma B12. J (-1) EE 


B135 D 


10. 
11. 


12. 
13. 
14. 


15. 


16. 
17. 


18. 


k=1 k=l 


oo 12 
B14. Y 
k=0 


2 


2r 


Ax 


(2k)! 


k=1 


Discuss the behavior of the harmonic series. 


To what kinds of series does the ratio test apply? Give an example 
of its use. 


To what kinds of series does the nth root test apply? Give an 
example of its use. 


Describe the difference between conditional convergence and 
absolute convergence. 


Give an example of a series that converges conditionally but not 
absolutely. 


Answer true or false, and give an explanation. 
(a) A series that converges absolutely will converge conditionally. 
(b) A series that converges conditionally will converge absolutely. 


What is an alternating series? Give an example. Is the series 
1+2-—3-—4+4+5+6-—.--- an alternating series? 

State Leibniz’ theorem on the convergence of alternating series. 
Give an example. 


State the Estimation theorem for approximating the sum of an 
alternating series. Give an example. 
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Chapter & 


Sequences and Series of Functions 


INTRODUCTION As in Chapter 7, convergence of an infinite series of func- 
tions is defined in terms of the convergence of the infinite sequence of its partial sums. 
However, there are several notions of convergence for a sequence of functions. We have 
already hinted that pointwise convergence simply means that at each fixed xo, the series 
eso Fi (x0) is just an infinite series of numbers. 

In addition, there is the important idea of uniform convergence, a special case of point- 
wise convergence in which the rate of convergence is not dependent on xo, the point at 
which convergence is being examined. Many termwise manipulations with infinite series 
can be justified in the presence of uniform convergence. 

At the other extreme, we have convergence in the mean, a convergence that need not 
even be pointwise. A sequence of functions converges in the mean if certain integrals of 
these functions converge. But two functions which disagree at just one point are different, 
yet still have the same value for their definite integrals! As strange as this might seem, all 
of the theory of least-squares approximation, including the results on the convergence of 
Fourier series, is ultimately based on the notion of convergence in the mean. 


Sequences of Functions 


DEFINITION 8.1 


The ordered list of functions f; (x), k = 0, 1,2,..., is called a sequence of functions. 


Since a function is a rule (or formula) as well as a domain of admissible x's, it is 
typical for the common domain of the members of the sequence to be clearly stated. In 
some instances, we will find it convenient to call the first function fo as we did here; in 
other instances we will call the first function fi. 


Examples 


Table 8.1 contains a list of 12 examples of sequences of functions, each starting with f; (x). 
except for the first sequence, which starts with fo(x). In subsequent discussions, these se- 
quences will be referenced as SEQ-1-SEQ-12. Graphs of the first three members of each 
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sequence appear in Table 8.2, where solid, dashed, and dotted curves are used, respectively. 
Members of the sequence SEQ-1 are also graphed in Figure 6.36. 


SEQ fk) Domain SEQ fk Qo) Domain 
5 1 
4k“ x O<x<— 
2k 
1 k 0, 1] T 4k k ] n 0,1 
x [0, (1 x) DELE [0, 1] 
l 
0 —~<x<l 
k 
2 sin kx [0, 27] 8 kxe- ^ [0, 1] 
1 
kx — Jarak 
3 — ; 9 Vk ; 
1+k?x? ea) (0, o6) 
0 k<x<oo 
3/2 1 
4k?/? x 0 3x = 
2k 
4 = [—10, 10] 10 A /k(1— k ee [0, 1] 
k , x) 2k xis k , 1| 
0 l exe] 
bc 
x 
5 xe * 0,1 11 —lL1 
ies D. 1 1 + kx? [ l 
x* 1 kx? 
6 = 0,1 12 ———ÀÁ =l] 


TABLE 8.1 Examples of sequences of functions 


Although SEQ-7 and SEQ-10 look similar at first glance, the subtle changes in expo- 
nents on k in the rules defining their functions make for significant differences in behavior 
for the two sequences. This will be examined at length in the remaining sections of Chapter 
8. Suffice it to say here that the areas under the functions in SEQ-10 form the decreasing 
sequence GR. whereas the areas under the functions in SEQ-7 remain a constant 1. (See 


Exercise Al.) 


The functions in SEQ-5 and SEQ-8 differ only slightly, but in Section 8.3 their con- 
vergence properties will be seen to be significantly different. The functions in SEQ-12, 
the derivatives of the functions in SEQ-11, will also be useful in Section 8.3 where the 
convergence of differentiated sequences is discussed. 


F 
À 
: k=0 E 
k=1-7 
a E22 
at i 
FIGURE 8.1 SEQ-1 FIGURE 8.2 SEQ2 FIGURE 8.3 SEQ-3 
f 
À 


0 x 
FIGURE 8.4 SEQ-4 FIGURE 8.5 SEQ-5 FIGURE 8.6 SEQ-6 
F 
A 
6T 
-4— x 
4 
FIGURE 8.7 | SEQ-7 FIGURE 8.8 SEQ-8 
f 
d Jj 
TT ba A 
PRX 0.5 
2+ 5 r i ‘ | genu = 
if = >x 
Hg - 
0 1 ii - -5-L 
FIGURE 8.10 SEQ-10 FIGURE 8.11 SEQ-11 FIGURE 8.12 SEQ-12 


TABLE 8.2 Graphs of members of the sequences in Table 8.1. In each case, the first three members of the sequence are given by the solid, 
dashed, and dotted curves, respectively. 
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8.2 Pointwise Convergence 


A1. Show that i f(x) dx = 1 for the functions of SEQ-7 and i for 
the functions of SEQ-10. 


42. Sketch the first five members of the sequence { f;} if {fk} is SEQ-1. 
43. Sketch the first five members of the sequence { f) if {fk} is SEQ-2. 


A4. On the interval [0, 27], sketch the first five members of the 
sequence (f; fe(t) dt) if { f.) is SEQ-2. 


EXERCISES 8.1—Part B 


AS. On the interval [0, 1], sketch the first five members of the sequence 
{Jo felt) dt) if {fi} is SEQ-5. 

A6. On the interval [—1, 1], sketch the first five members of the 
sequence ( f^, fx(t) dt} if {fk} is SEQ-11. 


B1. In Section 6.10 the limiting function for SEQ-1 was said to be 
f(x)= {0 dos |: Compare i f (x) dx with 


lime>o fy f(x) dx. 


In Exercises B2—4, a sequence of functions f; (x), k = Le eee satay is given. 


For each: 
(a) Plot the first five members. 
(b) Obtain the first five members of the sequence f;,(1). 


(c) Plot the first five members of the sequence of derivatives, 


fe Go. 


2 
B2. fi(x) = —xarctan(kx), C1 <x <1 
T 


I 122 
B3. fi(x) = ru x" e xm 


BÀ A= c Li ep 

" x)= y X a 

Jk Dig > 

In Exercises B5—8, a sequence of functions fi (x), k = 1,2,..-, is given. 
For each: 


(a) Plot the first five members of the sequence. 

(b) Obtain the first five members of the sequence f;(1). 

(c) Plot the first five members of the sequence of derivatives, 
Si). 


(d) If a is the lower bound of the given domain, obtain the 


sequence F(x) = Lb fx(t) dt and plot the first five members. 


DEFINITION 8.2 


BS. f) = 7,0 SS 1 B6. f(x) = kxe™ 0 <x <2 
B7. fi(x) = B - xxxl 

i 1 + 6x? 
B8. fi(x) = = «x1 

i 1 T kx 


B9. For the sequence in Exercise B2: 


(a) Show that at any fixed x, limy oo f(x) = |x]. 


(c) Show that |x|, the limit function, does not have the 
differentiability property possessed by each member of the 
sequence. 


B10. For the function f (x) = e*, let f; (x) be the Taylor polynomial of 
degree k and g(x) = foi-1(x) be the sequence of odd-degree 
polynomials. Each such polynomial has at least one real zero. 


(a) Plot g; (x), Kk = 1,..., 5. on an interval that shows the real 
Zeros. 


(b) Compute the real zero of each function graphed in part (a), 
and note that each member of the sequence g, (x) has a 
property that e", the limit function, does not have, namely, the 
members of the sequence each have a real zero but the limit 
function does not. 


Pointwise Convergence 


Let ( f.(x)), k = 0, 1, ..., defined on the interval [a, b], be a sequence of functions. 
The function f (x) defining the pointwise limit ofthis sequence is the function obtained 
by computing the limit of the sequence of values determined by this sequence at each 
fixed point xo. Thus, f (xo) = limy+oo f. (xo) defines the value of f (x) at each point 
xo. We then say that the sequence converges pointwise to the function f (x). 
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More formally, we might also say the sequence { f;,(x)}, defined on [a, b], converges 
pointwise to the function f (x) whenever, given an £ > 0 and an x in [a, b], there always 
exists an integer index N for which n > N guarantees | f(x) — f (x)| < £. In general, for 
pointwise convergence, the index N depends on x. At some points in the interval [a, b] the 
value of N might have to be larger than at others. 

Fortunately, the student can build a strong intuition about convergence of sequences of 
functions by studying their graphs, especially as was done in the examples of Section 8.1. 
In a course in mathematical analysis, the formalism of the e-N definition is stressed. Here, 
we will take a more intuitive approach. 


EXAMPLE 8.1 Obtain the pointwise limit of SEQ-1, Table 8.1, defined by f(x) = x*, k = 1,2,..., 


on the interval [0, 1]. Figure 6.36 suggest the pointwise limit is the piecewise function 


7, JO OSx<1 
768 — 3 ^ zer 


limiting techniques learned in calculus, provided care is taken with domains. Clearly, at 
x = | each member of the sequence { f; (1)] is identically 1, so the sequence converges to 
1 at this point. For any x in [0, 1), we know that lim;_,, x* = 0, so the limit function is 0 
forO <x <1. 

Before quitting this example, we make the following observation. Each member of the 
sequence { f; (x)] is a polynomial and is continuous. The limit function f(x) is neither a 
polynomial nor a continuous function. Thus, in general, the pointwise limit of a sequence 
of functions can fail to have properties shared by each member of the sequence. This might 
be unintuitive to the novice but, nevertheless, signals important consequences for functions 
defined by limits of sequences. e 


. Analytically, the pointwise function can be found by using the 


EXAMPLE 8.2 Obtain the pointwise limit of SEQ-3, Table 8.1, defined by fi (x) = DK =1,2,...,0n 
the interval [0, oo). Figure 8.3 suggests the pointwise limit might be the function f(x) = 0. 
1 


For each fixed x, the sequence determined by f; (x) tends toward fs = g and there- 


fore has pointwise limit 0. More precisely, each function f(x) has a maximum of i at 
X E, This highest point “moves” toward the origin. Eventually, at every positive x, the 
maximum value of 1 passes to the left, and the sequence, at that x, is free to converge to 
zero. Hence, the convergence of SEQ-3 is more complicated than that of SEQ-1. 

An explicit representation of N, the index beyond which f; (x) is within € of f(x) = 0, 
is obtained by explicitly solving the equation f(x) = & fork = Lyla" the larger root, 
rounded up to an integer. Thus, N = N(x, €), and as x nears zero, the index beyond which 
all sequence members are within ¢ of f(x) = 0 increases. For each fixed value of e, the 


index k needed to guarantee | f(x) — 0| < e rises steeply as x nears the origin. “ 
EXERCISES 8.2—Part A 
Al. Find f(x) = limg soo fio) if f(x) = cos* x, 0 € x < 2. AS. In [54], the sequence of functions 
‘ EY: 
A2. Find f(x) = limy oo fi Go) if fex) = /cosx,0 < x < 5. 1-6" O<x<1 
A3. Find the pointwise limit of the sequence of functions defined by fx) = ids 
OLI ,0<x <1. i xd 
A4. In Example 8.2, what is the smallest value of N that guarantees is used in the proof that the alternating harmonic series converges 


|f (0.01)| < 0.001 for all k > N? to In 2. What is f(x), the pointwise limit of this sequence? 


EXERCISES 8.2-Part B 
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8.3 Uniform Convergence 


B1. For f(x) and f (x) in Exercise AS, obtain lim, ,.5 E fio) dx 
and h f(x) dx. 


In Exercises B2-10, for the indicated sequences taken from Table 8.1: 


(a) Determine f (x), the pointwise limit of the sequence. 


B11. f;(x)in Exercise BS B12. f, (x) in Exercise B6 
B13. f(x) in Exercise B7 B14. /f;(x) in Exercise B8 


For the sequences in Exercises B15-17: 


(a) Determine f (x), the pointwise limit of the sequence. 


(b) Determine N(x, €), an integer with the property that 
whenever the index k exceeds it, | f(x) — fe(x)| < £ for that 


x and that €. 


B2. SEQ-4 B3. SEQ-5 


B7. SEQ9 B8. SEQ-10 B9. SEQ-11 


For the sequences in Exercises B11—14: 


(a) Determine g(x), the pointwise limit of { f/(x)}, the sequence 


of derivatives. 


(b) Is f'(x) = g(x)? 


(c) Determine F (x), the pointwise limit of the sequence of 


B4. SEQ-6 B5. SEQ-7 


(b) Determine g(x), the pointwise limit of ( f/(x)}, the sequence 
of derivatives. 
(c) Is f'(x) = g(x)? 
B15. f(x) in Exercise B2 
B17. f(x) in Exercise B4 
B18. If f(x) = YS i ums 0 < x < 2x, use graphical and numeric 
techniques to determine f (x) = lim,.,4, f; (x). Be especially 
careful at the endpoints of the interval. 
B19. If f(x) = TS Le sinnx,0 < x x x, use graphical and 
numeric techniques to determine f(x) = limy.~ fi (x). Be 


especially careful at x = 5. 


B6. SEQ-8 
B10. SEQ-12 


B16. f,(x) in Exercise B3 


antiderivatives Fy (x) = I fx (t) dt, where a is the lower 


bound on the domain of the fy. 
(d) Is L^ f (D dt = F(x)? 


FIGURE 8.13 
SEQ-4, Table 8.1 


€-band for sequence 


EXAMPLE 8.3 


Uniform Convergence 


DEFINITION 8.3 


The convergence of the sequence { f;,(x)} to f(x) is uniform on the interval [a, b] 
whenever, given an £ > 0, there always exists an integer index N that is independent 
of x and for which n > N guarantees | fa (x) — f (x)| < e. 


Thus, a sequence that converges uniformly converges pointwise, but in such a way 
that each given error tolerance & can be attained with an index N that works all across the 
interval. Intuitively, if an £-band is drawn about the limit function f (x), then all sequence 
members with index k > N lie completely within the confines of the band. Such an e-band 
for the sequence described in Example 8.3 is seen in Figure 8.13. 


The functions f(x) = z.k = 1,2,..., from SEQ-4, Table 8.1, converge uniformly to 
f(x) = 0 on the interval [—10, 10]. Elementary calculus and Figure 8.4 convince us that 
the pointwise limit of this sequence is f(x) = 0. That the convergence is uniform follows 
from solving | f(x) — 0| = |z| < £ for k > BL, and taking N = N (€) = [23] + 1, one 
more than the greatest integer in 10. 

For example, remembering that |x| < 10, choose N to be the first integer greater than 
or equal to m, and every sequence member whose index is greater than N will lie in an 
é-band of the limit function f(x) = 0. Ife = L, N = 20, so a band j-unit above and below 
f (x) = 0 contains within it all sequence-members with indices greater than 20, as depicted 
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f EXAMPLE 8.4 
A 
0.2+ 
k=3 
0 AS x 


FIGURE 8.14 — &-band for sequence 
SEQ-5, Table 8.1 


EXAMPLE 8.5 


FIGURE 8.15 — ¢-band for sequence 
SEQ-6, Table 8.1 


EXAMPLE 8.6 


in Figure 8.13. Every sequence-member indexed with an integer greater than 20 lies totally 
within the band of width 2e. If ¢ is decreased to, say i then N = 30. But all f(x), k > 30, 


ie. 


will lie completely within this new e-band. kf 
The pes fi(x) = xe, k = 1,2,..., from SEQ-5, Table 8.1, converge uniformly 
to f(x) = 0 on the interval [0, 1]. Elementary calculus and Figure 8.5 lead to a limiting 


bd f(x) = 0. Uniform ws qu is established as follows. Each function f(x) 
has a maximum at the point (2, 1/e*). Consequently, | f; (x) — 0| < (fG) = 1/e < i: 
to get | f(x) — 0| < £, choose ‘k so that £ < £ ork > +. We therefore take N (e) as the first 
integer greater than HE this is independent of x, and the convergence is uniform. Choose N 
to be the first integer greater than L, and every sequence member whose index is greater 
than N will lie in an -band of the limit function f(x) = 0. 

For example, if e = i ,N = 3, a band 1-unit above and below f (x) = 0 will contain all 
sequence-members with tss greater ien 3, as shown in Figure 8.14. Every sequence- 
member indexed with an integer greater than 3 lies totally within the band of width 2e. If e 
is decreased to, say n? then N = 10. But all f; (x), k > 10, will lie completely within this 


new e-band. D 


The functions f(x) = x*/k, k = 1,2,..., from SEQ-6, Table 8.1, converge uniformly 
to f(x) = 0 on the interval [0, 1]. Elementary calculus and Figure 8.6 lead to a limiting 
function f (x) = 0. To establish uniform convergence, note that on the interval [0, 1], f(x) 
satisfies the AE d x*/k < i so that, as in Example 8.4, N (£) can be taken as the first 
integer greater than +. Choose N to be the first integer greater than +, and every sequence 
member whose index i is gueules than N will lie in an e-band of the limit function f (x) = 0. 

For example, if ¢ = L, N = 3,a band j-unit above and below f (x) = 0 will contain all 
sequence-members with indices greater than 3, as shown in Figure 8.15. Every sequence- 
member indexed with an integer greater than 3 lies totally within the band of width 2e. If e 
is decreased to, say i then N = 10. But all f; (x), k > 10, will lie completely within this 
new e-band. D 


Negation of Uniform Convergence 


To say that the sequence { f;,(x)} does not converge uniformly to f(x) is to say that for 
some € > 0, no matter what N is declared, there will always be at least one x for which 
| fix) — f (x)| > £. This negation is equivalent to the statement that there exists one € > 0 
and an x; for each f; for which | f(x) — f (x)| > €. 

Alternatively, uniform convergence is negated by claiming it is not true that given 
any € > OQ there exists an N that works for every x and for which k > N guarantees 
| f(x) — f(x)| < £. This negates the avowal that for every € > 0 something happens, 
because, for some one e at least, it is impossible to find an N for which k > N guarantees 
| f(x) — f(x)| < £ for every x. 


The functions f(x) from SEQ-7, Table 8.1, converge pointwise, on the closed interval 
[0, 1], to the limit function f(x) = 0. The convergence is pointwise but not uniform. 
Figure 8.7 shows that each function f; (x) is a “tent,” and a bit of algebra shows each has a 
maximum height of 2k at x — x. Since the maximum of each tent increases, it is impossible 
to obtain | f,(x)| < £ for all x's in [0, 1] and all k > N. In particular, it would have to be 
true that E163] < € for all k > N, but because f Go —2k-s£fork = N cannot be 
independent of x and the convergence cannot be uniform. 


8.3 Uniform Convergence 193 


Figure 8.16 shows the first five members of the sequence and an ¢-band corresponding 
tog = L, No matter what £-band is drawn and no matter how far out in the sequence 
we begin looking, we will always find members of the sequence beyond that place in the 
sequence where peaks are outside the e-band. $ 

EXAMPLE 8.7 Thefunctions f(x) = nis from SEQ-3, Table 8.1, were shown, in Section 8.2 to converge 
pointwise to f (x) = 0 throughout [0, oo). Because f;(7) = 4, the convergence cannot be 
uniform on any interval containing x = 0. In particular, consider the interval [0, 1], and, 
fore < 1 attempt to satisfy | f(x) — 0| < £ uniformly in [0, 1]. Since i < 1 for any 


k > 2and f,(;) = 5, there is at least one x in [0, 1] for which | f,(x) — 0| = 5 > e for 
any fg. The convergence is not uniform, and the functions f; (x) do not fit inside an e-band 


about f(x) = 0. Figure 8.17 shows the first 10 members of the sequence and an &-band 
1 * 


corresponding to £ = 3. d 


A classic theorem on uniform convergence is the proposition 


the uniform limit of continuous functions is a continuous function. 


0 x Stated more formally, we have 


FIGURE 8.16 — &-band for sequence 
SEQ-7, Table 8.1 THEOREM 8.1 


1. (ífi(x)) defined on the interval [a, b]. 
2. f(x) converge uniformly to f (x) on [a, b]. 


3. Each f(x) is continuous on [a, b]. 


==> f(x) is continuous on [a, b]. 


Our second classic theorem on uniform convergence and its consequences for sequences 
of functions is the proposition 


the uniform limit of continuous functions can be integrated termwise. 


A formal statement of this theorem is 


FIGURE 8.17 &-band for sequence 
SEQ-3, Table 8.1 


THEOREM 8.2 


1. (f&(x)) converges uniformly to f (x) on the interval [a, b]. 


2. Each f(x) is continuous on [a, b]. 


b b b 
= jim f fils) dx = | jim fils) dx = | f(x) dx 


a 
Thus, the limit of the integrals is the integral of the limit, a result justified by uniform 
convergence. A proof of Theorem 8.2 is given after the following two examples. 


EXAMPLE 8.8 The “moving tent" functions of SEQ-7, Table 8.1, converge pointwise, but not uniformly, 
to f(x) = 0 on the interval [0, 1]. The limit function is f(x) = 0, so the integral of the 
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EXAMPLE 8.9 


EXAMPLE 8.10 


limit is likewise zero. But not so for the limit of the individual integrals. From Exercise A1, 
Section 8.1, the integral of each f;,(x) is actually 1, so the limit of the integrals is 1, not 
zero. $ 


Uniform convergence is sufficient, but not necessary, for the integral of the limit to be the 
limit of the integrals. SEQ-10, Table 8.1, is a modification of the previous sequence. Taking 
the heights of the tents to be 24/k instead of 2k, we still have a sequence that converges to 
f (x) = 0 pointwise, but not uniformly. This time, however, the limit of the integrals will 
be the integral of the limit since f) fi(x) dx = A0 $ 


PROOF OF THEOREM 8.2. To establish lim; 5; D» f(x) dx = fi f(x)dx, the conclusion 
of Theorem 8.2, it suffices to show that given an & > 0, there is an N for which k > N 
guarantees LP f(x) dx — E f (x) dx| < e. The uniform convergence of f(x) to f (x) 
means there is an N for which | f; (x) — f (x)| < 75; for all values of x in [a, b], whenever 
k > N. Using this estimate we obtain 


b b b 
f(x) dx -f f(x)dx -| fx) — f(x) dx 


a 


b b g 
< | fx(x) — f(x)|dx < J —— dx =€ 
a a b—a 


Our third theorem on the consequences of uniform convergence concerns termwise 
differentiation of a sequence of functions. In a word, our theorem will state, roughly, that if 
the derived (differentiated) sequence converges uniformly, then the limit of the derivatives 
is the derivative of the limit. The formal statement of the theorem is 


THEOREM 8.3 


1. {f,(x)} is a sequence of functions differentiable on [a, b]. 
2. {fx(xo)} converges for some xo in [a, b]. 
3. {f,(x)} converges to g(x) uniformly on [a, b]. 


=> 


1. {f,(x)} converges uniformly to some f (x). 
2. f'(x) exists on [a, b]. 


3. f(x) = lim fj = 8) 


After considering the following two examples, we provide a proof of a slightly weaker 
form of Theorem 8.3. 


As we saw in Example 8.5, the functions f;(x) = x*/k from SEQ-6, Table 8.1, converge 


uniformly to f(x) = 0 on [0, 1]. The derivative of the limit function is f’(x) = 0. The de- 


5 x - 1 " à n 0 O<x<1 
rived sequence is (x*-! ), which we know is pointwise convergentto g(x) — | 1 = i hi x 


f'(x) = 0. The sequence of derivatives does not converge uniformly, so there is no guarantee 
that the limit of the derivatives is the derivative of the limit, even though the original sequence 


EXAMPLE 8.11 


Fk 
k=1 
0.3 k=3 
k=5 
- >x 
=] 0 1 


FIGURE 8.18 Members of the sequence 
F(x) in Example 8.11 
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converges uniformly! The derived sequence must converge uniformly for the theorem to 
hold. $ 


The sequence defined by F(x) = 75 converges uniformly to F(x) = 0 on [—1, 1]. 
Figure 8.18 showing the first few members of the sequence suggests that each F; (x) exhibits 


even symmetry across the y-axis, and has a maximum at the endpoints of the interval [— 1, 1]. 
In(1+k) 
2k 


In(1--kx?) 
2k 


The height of each maximum value is therefore Fmax = , and this maximum height 
goes to zero as k increases. In essence, we have demonstrated the uniform convergence of 
[Fi (x)) to F(x) = 0 because we have exhibited a uniform bound that itself goes to zero. 

The derived sequence, given by f(x) = [Ew T is SEQ-11, Table 8.1, and it also con- 
verges uniformly to f(x) = 0. Indeed, Figure 8.11 suggests there might also be a uniform 
bound for the maximums of | f; (x)|. In fact, we have |f CE) = x. Since the maximum 
of each f; clearly goes to zero as k increases, we have established uniform convergence 
to f(x) = 0. This is in agreement with the theorem on differentiation of sequences. Since 
the derived sequence converges uniformly, it converges to the derivative of the original 
sequence. 

If we take the sequence ( f; (x)) as the primary sequence and look at the sequence of 
its derivatives, we obtain the sequence g(x) = mE SEQ-12 in Table 8.1. Figure 8.12 
suggests the derived sequence g; (x) converges pointwise to the discontinuous limit function 
apes $2 
continuous. Since that is not the case, the convergence could not have been uniform. 

Even though the primary sequence ( f; (x)) converges uniformly to f(x) = 0 so that 
f'(x) = 0, the derived sequence does not converge uniformly. Hence, there was no guarantee 
that the limit of the derivatives was the derivative of the limit. And, indeed, it was not. ** 


If the convergence were uniform, the limit function would have to be 


PRoor OF THEOREM 8.3 We prove Theorem 8.4, the following slightly weaker form of 
Theorem 8.3. It is ^weaker" because we invoke the more restrictive hypotheses that f; have 
continuous derivatives and that ( f.) converges on the whole interval, not just at one point. 


THEOREM 8.4 


1. Foreachk, f(x) has a continuous derivative on the interval [a, b]. 
2. {fx(x)} converges to f (x) on [a, b]. 

3. (/fi(x)) converges uniformly to g(x) on [a, b]. 

— 

1. f'(x) exists on [a, b]. 

2. f'G)- lim f; = a) 


By hypothesis, each derivative f(x) is continuous. Since the f(x) converge to g(x) 
uniformly, g(x) is also continuous and hence integrable. Therefore, 


hs x d 
/ wat thn Í Z std = tim hid = A= ft) f00 
a k—oo 0 dt k—oo 


and f(x) = f> g(t) dt + f (a). The continuity of g(x) makes f (x) differentiable, and we 
have f'(x) = g(x) = limi oo fi (x). 
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EXERCISES 8.3 
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1. For SEQ-8, Table 8.1: 
(a) Find f (x), the pointwise limit. 


(b) Show that the convergence to f(x) is not uniform by finding the 
maximum value of each f; (x). 

(c) Find the pointwise limit of { f/(x)}, the derived sequence, and 
observe that “the limit of the derivatives is not the derivative of 
the limit". 

(d) Show that if f. (t) dt} converges uniformly on [0, 1]. Is this a 
consequence of Theorem 8.2 or is it just a fortuitous accident? 

2. Show that the sequence in Exercise B2, Section 8.1, converges 
uniformly. Hint: Use graphs to determine where the maximums of 

errors (| f (x) — f, (x)|) are occurring, and from this, exhibit a 

uniform bound on this sequence of errors. 

3. Show that the sequence in Exercise B3, Section 8.1, converges 
uniformly. Then show that f/(x) — f'(x), but the convergence is 
not uniform. 


4. Show that the convergence of the sequence in Exercise B4, Section 
8.1, is not uniform by 


(a) showing there is no uniform (and decreasing) bound on the 
errors (| f (x) — fx (x)l}- 
(b) using Theorem 8.1. 
5. For the sequence of Exercise B5, Section 8.1: 


(a) Show that the convergence is uniform by finding a uniform (and 
decreasing) bound on the errors (| f (x) — f;(x)]}. 


(b) Use Theorem 8.1 to show that the convergence of the sequence 
Uf c Q9] is not uniform. 


(c) Show that termwise integration is valid. 
6. For the sequence of Exercise B6, Section 8.1: 


(a) Show that the convergence is not uniform by showing there is no 
uniform (and decreasing) bound on the errors {| f(x) — fi Qx)1). 


DEFINITION 8.4 


(b) Show that ( f; (x)}, the derived sequence, converges pointwise 
for x 4 0, but the convergence on [0, 2] cannot be uniform in 
light of Theorem 8.1. 


(c) Show that iu fx (t) dt} converges pointwise on [0, 2] but not 
uniformly, again because of Theorem 8.1. 


kx zm 
Hx? 


7. For the sequence defined by f; (x) = 


] «xxm: 


(a) Show that the convergence is uniform by finding a uniform (and 
decreasing) bound on the errors (| f (x) — f(x) |}- 


(b) Show that { f/(x)}, the derived sequence, converges pointwise 
for x 4 0, but the convergence on [— 1, 1] cannot be uniform in 
light of Theorem 8.1. 


(c) By finding a uniform (and decreasing) bound on the errors 
{| f(x) — fi(x)|}, show that i. f(t) dt} converges uniformly. 
(d) Why do the integrals of the antiderivatives converge to the 
antiderivative of f(x) = lim, 5, f(x)? 
8. For the sequence of Exercise B8, Section 8.1: 


(a) Show that the convergence is pointwise, but, in light of Theorem 
8.1, not uniform. 


(b) Show that ( f; (x)], the derived sequence, converges pointwise 
for x Æ 0, but the convergence on [0, 1] cannot be uniform in 
light of Theorem 8.1. 


(c) By finding a uniform (and decreasing) bound on the errors 
{| f(x) — fe(x)|}, show that L5 f (t) dt} converges uniformly. 


(d) Show that lim} >æ f fi(x) dx = f f (x) dx, where f(x) = 
limi, s fi (x). Is this a consequence of Theorem 8.2? 


9. Show that SEQ-9, Table 8.1, converges uniformly to f (x) = 0. 
Hint: Find a uniform (and decreasing) bound on f(x) — f(x). 


_ Convergence in the Mean 


The sequence of functions { f,(x)} converges in the mean to f (x) on the interval 


[a, b] provided 


EXAMPLE 8.12 


On the interval [0, 27], the sequence of functions f(x) = m. bz 132. 


b 
Jim | AO FOP da 0 (8.1) 


.., converges 


s " " A Om ds E. 
to f(x) — 0 both pointwise and in the mean because f, i ess dx2£ $ 


gr 


Pointwise 
A 
Uniform 
B 
Infinite intervals 
B 
© cu uos 
Finite intervals 
D 
E 


Mean 


FIGURE 8.19 Relations between 
pointwise, uniform, and mean convergence 
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Discussion — Ateach fixed x, the integrand in (8.1) is the square of the difference between 
f(x) and f(x). The integral sums this measure for all x in the interval [a, b]. If the 
difference were not squared, the integral would give the area between the functions, and 
this could be zero even when the functions were far apart. (See Exercise A1.) 
For real-valued functions, the absolute value in (8.1) is superfluous when squaring the 
difference between f; and f. For complex-valued functions, the absolute value is essential. 
We also point out that some texts use the notation “l.i.m.” for “limit in the mean." 


Pointwise, Uniform, and Mean Convergence 


Sequences of functions can now converge in the three ways: pointwise, uniformly, and in the 
mean. These are not independent concepts because some sequences can converge in more 
than one sense. Certainly, a sequence that converges uniformly also converges pointwise. 
The following theorem gives a connection between uniform convergence and convergence 
in the mean. The proof is direct and informative. 


THEOREM 8.5 


On a finite interval, uniform convergence to f (x) implies convergence in the 
mean to f (x). 


PROOF or THEOREM 8.5 Assume the sequence f; (x) converges uniformly to f(x) on the 
finite interval [a, b]. To show convergence in the mean, we have to show (8.1). Thus, we 
have to show that given an £ > 0, we can provide an N for which I |æ fe)? dx < e 
for every k > N. The uniform convergence of f(x) to f(x) means we can make | f(x) — 
f(x)| < J for all k > N (e), independent of x. Consequently, I» LAG) — f(x)? dx < 
n pg dx = €, provided k > N (e), and we have established the desired limit. 

The connections between pointwise, uniform, and mean convergence are summarized 
in Table 8.3 and illustrated by the Venn diagram in Figure 8.19. 


Region Convergence 


Pointwise, but neither uniform nor mean 

Uniform (hence pointwise), but not mean; infinite interval 
Uniform (hence pointwise), and mean; infinite interval 
Uniform on finite interval; hence mean 

Pointwise (but not uniform) and mean 

Mean, but not pointwise 


moouur» 


TABLE 8.3 Connections between pointwise, uniform, and mean convergence 


Region E in Figure 8.19 requires the most explanation since it is possible for a se- 
quence to converge in the mean to different limit functions. Thus, the set of functions that 
behaves as the zero function under mean convergence has many members. This difficulty 
is resolved in functional analysis courses by defining classes of functions equivalent under 
mean convergence, but this will not be discussed further here. 
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EXAMPLE 8.13 


EXAMPLE 8.14 


EXAMPLE 8.15 


EXAMPLE 8.16 


EXAMPLE 8.17 


EXAMPLE 8.18 


The following examples show that the regions in Figure 8.19 are not empty. 


The “moving tent" functions from SEQ-7, Table 8.1, converge pointwise to f(x) = 0 on 
the interval [0, 1], but the convergence is not uniform (see Section 8.3). Moreover, this 
sequence does not converge to f(x) = 0 in the mean because [^ | fe(x) - 0 dx = ik for 
any of the f; (x). Clearly, the limit of the integrals is unbounded, so the sequence does not 


converge in the mean. This sequence is an example of a member of Region A in Figure 8.19. 
Se 


The functions from SEQ-9, Table 8.1, converge uniformly (see Exercise 9, Section 8.3) to 
f(x) = 0 on the semi-infinite interval [0, oo). The sequence does not converge in the mean 


because h —0)? dx = 1 foreach k, k = 1, 2, ..., andis therefore a member of Region 
B in Figure 8.19. $ 
The sequence Gs). ku 11:3. 5 defined on [1, oo), converges uniformly to f(x) = 0 


because, on that interval, 


z| < Ł. Thus, the bound on f;(x) is uniform. The sequence 
also converges in the mean to f(x) = 0 because hx SE —0)?dx = z and, therefore, is 
a member of Region B' in Figure 8.19. $ 


The functions f(x) = xe^** from SEQ-5, Table 8.1, converge uniformly to f (x) = 0 on 
the interval [0, 1], as we saw in Section 8.3. The sequence also converges in the mean to 
f(x) = 0 because 


f - 1 — e?*(14- 2k + 2k?) 
Ke dx = 
b 4k? 


which goes to zero as k goes to infinity. Hence, SEQ-5 is a member of Region C in Figure 
8.19. E 


The functions f(x) = kxe~* from SEQ-8, Table 8.1, converge pointwise to f (x) = 0 on 
the interval [0, 1]. In Section 8.3 we saw that this sequence does not converge uniformly, 
but since 


FEN 1 — e*(1 + 2k + 2k?) 
ke due 
0 4k 


it converges in the mean to f(x) = 0. Thus, this sequence is a member of Region D in 
Figure 8.19. $ 


Consider the sequence ( f; (x)) whose members are alternately g;(x) and g5(x), where 


9 xel 3 xz2 
21 (x) = and x)= 
gi (x) [o - 82(X) ls -— 
This sequence does not converge pointwise. However, since each function is zero except at 
a single point, their integrals, and integrals of their squares, are zero. The sequence therefore 


converges to zero in the mean but does not converge pointwise and so is a member of Region 
E in Figure 8.19. % 


EXERCISES 8.4—Part A 
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A1. Sketch f(x) = x and g(x) = 8x? — 12x? + 5x, and show that 
i (f — g) dx = 0. Find the maximum of the vertical separation 
between these two functions. 

A2. Verify limp. É xe dx = Q. 


A3. If f(x) = x*/(1 + x*), 0 < x < 1, show that ( f.) converges in 
the mean to f (x) = 0. Find the pointwise limit of this sequence. Is 
the convergence uniform? 


EXERCISES 8.4—Part B 


A4. If f(x) = ae im, 0 < x < 10, show that ( f.) converges in the 
mean to f(x) = 0. Find the pointwise limit of this sequence. Is the 
convergence uniform? 


AS. If f(x) = zi 0 € x < 1, show that ( f,} converges in the mean 


to f (x) = 0. Find the pointwise limit of this sequence. Is the 
convergence uniform? 


B1. The recursively defined sequence ([78, p. 169]) fo = 0, fry x) = 
fex) + (x? — f2(x))/2, k = 0, 1,..., is supposed to converge 
uniformly to |x| on [—1, 1]. Test this claim graphically. 


For the sequences in Exercises B2-10: 


(a) Find the pointwise limit. 
(b) Determine if the convergence is uniform or not. 
(c) Find the limit in the mean. 


(d) In which region of Figure 8.19 does the sequence fall? 
B2. SEQ-3, Table 8.1 B3. SEQ-6, Table 8.1 
B4. SEQ-10, Table 8.1 — B5. SEQ-11, Table 8.1 
B6. SEQ-12, Table 8.1 B7. Exercise B5, Section 8.1 
B8. Exercise B6, Section 8.1 B9. Exercise 7, Section 8.3 
B10. 
B11. 


Exercise B8, Section 8.1 
For the sequence of Exercise B2, Section 8.1: 
(a) Find the pointwise limit. 


(b) Use numeric integration to find evidence that the sequence 
converges in the mean to the pointwise limit. 


B12. For the sequence of Exercise B3, Section 8.1: 


(a) Find the pointwise limit. 


DEFINITION 8.5 


(b) Show the sequence converges in the mean to the pointwise 
limit. 

(c) In which region of Figure 8.19 does this sequence fall? 
The Stone-Weierstrass theorem [78] says that any function f (x), contin- 
uous on the interval [a, b], can be uniformly approximated by a sequence 
of polynomials that depend on f (x). For example, given f(x), 0 € x < 
1, the Bernstein polynomials B(x) = i m em EU -— xy" fG) 
converge uniformiy to f(x) on the interval [0, 1]. For the functions 
f(x),0 x x < 1, given in Exercises B13-16, obtain and plot the first 
five Bernstein polynomials. If your favorite computer algebra system has 
a built-in function for generating the Bernstein polynomials, compare 
your results to the polynomials it provides. 


B13. f(x) = x 
B15. f(x) = cos4zx 


B14. f(x) = sin2zx 
B16. f(x) 2e 
If f(z) is defined (and continuous) on the interval a < z < b, then 
g(x) = f((b—a)x--a),0 € x < 1, takes on the same values as 


f(z).a <z < b. Use this change of variables to obtain and plot the first 
five Bernstein polynomials for the functions in Exercises B17—20. 


B17. f(z) =V34+27,2<z<5 B18. f(z) 2zsinz 0xz x 4x 
1 


B19. f(z) = ,—2 <z <3 B20. f(z) =arctanz,-5<z<5 


1+ 2? 


B21. If K(x) = Kle? —1 <x < 1, show { fk} converges 
pointwise to 0, but not in the mean. 


~- Series of Functions 


We say the infinite series 3 7. , f(x) converges to f(x) pointwise if (9 zo fi Go]. 
the sequence of partial sums, converges as a sequence of numbers at each point x. 
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=i] 0 1 


FIGURE 8.20 Partial sums of 3 7, x* 
converging to z+ (dashed) 


EXAMPLE 8.19 


EXAMPLE 8.20 


t t 
-3 -2 -1 0 1 2 3 


FIGURE 8.21 Partial sum S, (dashed) 
and f(x) — x? (solid) in Example 8.20 


Two things have happened here. First, we have defined the convergence of the series of 
functions in terms of the behavior of the sequence of partial sums. Second, we have reduced 
pointwise convergence to the behavior, at each x, of a series of just numbers. 


DEFINITION 8.6 


If the convergence of the sequence of partial sums is uniform, then we say X zco fi (x) 
converges to f(x) uniformly. Again, we have reduced the issue of uniform conver- 
gence for the series to one of uniform convergence of a sequence, the sequence of 
partial sums of the series. 


DEFINITION 8.7 


If the sequence of partial sums converges in the mean to f (x), we say XO i-o fi (x) 
converges to f(x) in the mean. The issue of convergence for the series is again 
determined by the convergence of the sequence of partial sums. 


For |x| « 1, the function f(x) = E can be represented by the geometric series ) 7; 5 xÉ. 


The first five partial sums, Sy = cem x^, are graphed in Figure 8.20. The graph of f (x) is 
the dashed curve in the figure. The sequence of partial sums seems to converge pointwise to 
f (x) in the open interval (—1, 1). In fact, in the closed interval |x| < œ < 1, the convergence 
is uniform. However, at x = 1 the function f(x) is undefined, having a vertical asymptote 
there. Determining convergence at the endpoints of the interval [—1, 1] requires special care, 
and such matters will be discussed in Chapter 9, which specifically treats power series. % 
The function f(x) — x? is well represented on the interval [—z, x] by the series = 

AY E ((—1)*/k°) cos kx. (This is an example of a Fourier series, to be studied in detail in 
Chapter 10.) Figure 8.21 shows the partial sum $5 — x — 4cos x + cos 2x (dashed), and 
the function f (x) (solid) gives an indication of how quickly this series converges. $ 


An nth Term Rule 


In a convergent series of numbers, the nth term necessarily goes to zero (Theorem 7.1). 
However, this need not be true for a convergent series of functions, as the following series 
shows. 

Define the functions 


0 xk 
fRk(x)211 k<x<k+1 
0 xk-4l 


so that f; (x) is nothing more than a unit pulse of duration 1 starting at x = k. The sum of 
the series ys fx (x) is the function f(x) = 1. However, limy-.oo fx(x) 4 0. 
A condition ruling out this aberrant behavior is given by the following theorem. 
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THEOREM 8.6 


If the series Y 7-9 fi (x) converges uniformly on the pointset A, then fj (x) converges 
uniformly to zero on the set A. 


Proor or THEOREM 8.6 To prove f; (x) goes to zero uniformly in x, we need to show that 
given ane > 0, we can produce an N (£) that is independent of x and for which | f; (x) —0| < 
c whenever k > N. Let the series converge uniformly so that Yeo fee) = f(x), and 
represent the partial sums by Sn = )°;o f(x). Write 


fu (x) = Sn (x) = Sia (x) = Sn (x) E f(x) + f(x) EM S, (X) 
so as to obtain 
| fn(x)| < | Sn (x) =z Ff (x)| + | f(x) = Sn—1(x)| 
Lete > O be given, and use the uniform convergence of the sequence of partial sums (S, (x)) 
to f (x) to determine an N for which both |S, (x) — f(x)| « 5 and | f(x) — S,-1(x)] « § 
hold whenever n — 1 > N. Clearly, this is the N for which | fa (x)| < 5 + 5 = e likewise 
holds uniformly in x when n — 1 > N. 


Determining Uniform Convergence 


It is generally tedious to use the definition when verifying the uniform convergence of a 
series. The comparison test 


domination by a uniformly convergent series implies uniform convergence 


and its corollary, the Weierstrass M-test (domination by a constant series), provide two 
simpler criteria for determining whether or not a series converges uniformly. The precise 
meaning of domination is given by the following. 


DEFINITION 8.8 


The series Y 7 9 u(x) is said to dominate the series Yo vi (Qo) if [v| < u(x) 
for every k and for every x in a specified domain. 


A formal statement of the comparison test is given by the following theorem. 


THEOREM 8.7 COMPARISON TEST 


eo 
1. y us (x) = u(x) uniformly on a pointset A. 
k=0 
2. | fe(x)| < u(x) (on A) for every k. 
oo 


E b f. (x) converges uniformly on A to a function f (x). 
k=0 
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Theorem 8.7 simply says that if the series $^ y f;(x) is dominated by a uniformly 
convergent series, then it is also uniformly convergent. Before proving this theorem, we 
state and illustrate the corollary called the Weierstrass M-test. The M-test arises when the 
dominating series is a series of constants M; so that 3 ^;* o M; dominates 5 7- o fi (x). 


WEIERSTRASS M-Test If | fi (x)| < My for each k and every x in a set A and if bad Mi 
converges, then $`? o f; (x) converges uniformly. 


Use the Weierstrass M-test to establish the uniform convergence of the series 3; 9e ^ 
cos kx on the interval [a, oo), where a > 0. To this end, estimate f; (x) as 


" " E AE 
| fe(x)| = le^" coskx| < e < e™ = (=) =r* = M 


The first inequality holds because | cos t| < 1, while the second holds because e^" attains its 
maximum at the left endpoint of the interval [a, oo). We then have edit My = 1/(1—e7?) 
as the sum of the geometric series. Since the series of dominating constants converges, the 
original series converges uniformly. $ 


PROOF OF THEOREM 8.7 By the comparison test of Exercise B22, Section 7.3, the series 
Y eso |f (x)| converges pointwise, so bw" fx (x) converges pointwise to some function 
f (x) because, from Section 7.4, absolute convergence implies convergence. Noting that 
necessarily u(x) > 0, we then follow [65] in writing 


AG) — fe») D fe)| < DD wee) = | ue) -ua (8.2) 
k=0 


k=n+1 k-n4l k=0 
Since the term on the far right in (8.2) can be made uniformly small when n > N(e), so 
too will the term on the left be uniformly small, thus establishing the uniform convergence 


of re Sk (x). 


Further Consequences of Uniform Convergence 


We next present three theorems that guarantee the continuity, integrability, and differentia- 
bility of the limit of a uniformly convergent series. These theorems allow the operations of 
calculus to be performed termwise on a uniformly convergent series. 


As a straightforward consequence of the equivalent theorem for sequences, we have 
that 


a uniformly convergent series of continuous functions converges to a continuous 
function. 


Stated formally, we have the following theorem. 
THEOREM 8.8 CONTINUITY 
1. Foreachk, f(x) is a continuous function of x on the set A. 


oo 
2i 2 fk (x) converges uniformly to f (x) on A. 
k=0 


=> f(x) is continuous on A. 


EXAMPLE 8.22 
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We prove Theorem 8.8 by noting each partial sum S, (x) = $^; y f(x) is a finite sum 
of continuous functions and, hence, is continuous. Since f(x) is the limit of the sequence 
of partial sums and the partial sums themselves are a uniformly converging sequence of 
continuous functions, the limit function must be continuous. 

Again paralleling the equivalent theorem for sequences, we have that 


the uniform limit of continuous functions can be integrated termwise. 


Termwise integration of the geometric series ? 7^ 9 x =l+x+ H+ H ees on 
|x| <r « 1 is valid because of uniform convergence. Hence, 


O9 pr oo 2k+1 r : 
L r 1 ] +r 
) i x* dx 22 ) = J = dx — ln 
cian s 2k + 1 -+ 1l-x 1—r 
and we have obtained a series expansion for In ee by integration! Ed 


A formal statement of this theorem is as follows. 


THEOREM 8.9 TERMWISE INTEGRATION 


1. Foreachk, f(x) is continuous on the interval [a, b]. 
oo 

2. > fi. (x) converges uniformly to f (x) on [a, b]. 
k=0 


b b co oo b 
=> Foydx = ii T Sk (x) dx = i. fix) dx 
a a k=0 k=0 a 


PROOF OF THEOREM 8.9 We prove this theorem by again noting each partial sum S,(x) = 
>to fe(X) is a finite sum of continuous functions and, hence, is continuous. Since f (x) is 
the uniform limit of the sequence of (continuous) partial sums, f (x) is itself continuous and 
hence integrable, with value f? f(x)dx = [^ lim, o5 S,(x) dx = lim, ,o5 I^ S,(x) dx. 
The second equality follows from the integrability of a uniformly converging sequence of 
integrable functions. Now each $, (x) is a finite sum, so 


n 


b b 
Jim f S,(x)dx = lim. l 2, Site) dx 


(8.3) 


in b oo b 
lim > [i fi) dx = M f f Go) dx 
kz0 *? k=0 "4 


The term on the right in (8.3) is exactly the meaning of the limit on the left. Hence, the 
integral of the limit function f(x) is the sum of the integrated terms of the original series, 
that is, f fijdz= >a 17 fi G) dx. 

As with sequences, if a series converges at least for a single point and the series formed 
by termwise differentiation converges uniformly, then the derived series converges to the 
derivative of the original series. In a word, uniform convergence of the derived series justifies 
termwise differentiation. This is formalized in the following theorem. 
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THEOREM 8.10 TERMWISE DIFFERENTIATION 


1. Foreachk, f(x) is differentiable on [a, b]. 


oo 


2. > f (xo) converges for some xo in [a, b]. 
k=0 


oo 
3. 2 f, converges uniformly on [a, b]. 


k=0 

= 
oo 

1. se Jk (x) converges uniformly to f (x). 
k=0 


2. f'(x) exists. 


3 f= K 


k=0 


A slightly weaker form of the theorem assumes that each function f;,(x) has a contin- 


uous derivative. The conclusion is still that f'(x) = }°7°.) fi. The formal statement of this 
weaker theorem is 


1. Foreachk, f(x) has a continuous derivative. 


2. >D fk(x) converges to f (x). 


k=0 
oo 
3. > fi converges uniformly. 
k=0 
oo 
FO- 4 


k=0 


The proof of this weaker form of the theorem on termwise differentiation of a series 
follows from the equivalent theorem on the termwise differentiation of a sequence. In 
particular, set $,(x) = 7; & fi (x), the nth partial sum of bw Tia 


EXERCISES 8.5—Part A 


A1. For what values does the series (*) converge uniformly? A3. If f(x) = De, SE, verify that f'(x) = EZ; $99: for all x. 
S j dus A4. If f(x) is the function in Exercise A3, obtain a series for 
C) 2 k 1+ x2k I f (t) dt. 
7 Ja yr l1(ax y nia Filo) es 
A2. If {cx} is a sequence of constants for which ae c, converges AS. If fœ) d Pii k (x) » for what values of x is f'(x) = (12-23)? 
absolutely, show that both 5 77^ , c, sin kx and S72, cy cos kx Soo (355) ? 


converge uniformly for |x| < oo. 


EXERCISES 8.5-Part B 
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x0 


cu a0 Show that f (x) is continuous at 


Bl. Let f(x) = [5 


x = 0. Determine R for which ? 7: f (x)* converges uniformly 
on0<x<r<R. 


In Exercises B2- 8: 


(a) Show graphically that the sequence of partial sums seems to 
converge pointwise to the given function on the indicated 
domain. 

(b) Apply the Weierstrass M-test to determine uniform 
convergence. 

(c) Examine, at least empirically, the validity of f f dx = 
VS fi dx. 


(d) Examine, at least empirically, the validity of X` f; = f". 


8 
m 


B1e-) —0sxx2 
k=0 ` 
99 —1)k x% 
B3. cosx = ) £ ES SESH 
(2k)! 
k=0 
oo p * 
Lyn 
B4 snx- 3) 73 og eren 
pem (2k + 1)! 
oo 2k 
BS. coshx = 5 | -l<x<l 
k=0 
eo yel 
B6. sinh <1 
sinh x > EFD! <x< 
oo k+l 
B7. In(1 — x) = — 0x: 1 
n( x) ps <x< 
k=0 
= 2k)tx* 
B8. VI- x = k» eO Lexel 


4k (k1)2(2k — 1)’ 


k=0 


Exercises B9-16 each contain a Fourier series, of great important in sci- 
ence and engineering, and studied at length in Chapter 10. For each such 
series given, valid on the 0 € x < x: 


(a) Show graphically that the sequence of partial sums seems to 
converge pointwise to the given function. 

(b) Examine, at least empirically, the validity of f f dx = 
Y f fidx. 

(c) Examine, at least empirically, the validity of $^ f; = f’. 


oo 


š T 4 cos(2k — 1)x 
sinkx B10. x = eS $ Qk — 1» 


k=1 


» ~wf2 4 
B11. x? = 2 [co + =i = »| sin kx 


oo (-1)*) 


B13. ; 


B14. x 


B15. 


B16. si 


B17. 


B18. 


B19. 


B20. 


B21. 


OO 7_yyk+1 (p22 _ 
ja Se DW 9 a 


nkx 
k=l e 
3 co 
3 T 67 i, 12 k 
= 1 -1 J 
Paz M = Cl) a (DE = 1) | cos kx 
84 k 
cos(x) — -» 5 sin 2kx 
n= 4k? —1 
2 4 & cos 2kx 
maiis es s xl. 1-4k 


Use the series in Exercise B9 to establish 7 = 

Yo (— DE /(2k — 1). (Hint: Evaluate at x = 5.) 

1 a 
32 5! 
-++ . (Hint: Evaluate at x = 7.) 


Use the series in Exercise B10 to establish aa =l 
1 1 1 1 1 1 
+ 9 m — 732 + yz + 77 


Use the series in Exercise B15 to establish x2 = 

pe te T. (Hint: Evaluate at x = 7.) 

The Legendre polynomials P(x), —1 < x < 1, can be defined by 
the recursion P) = 1, P, = x, P, = Aly Pp — E py y. 
(Modern computer algebra systems have these polynomials 
built-in. The first five are listed in Section 10.7.) 


(a) Use the given recursion to generate P», ..., Pig, and compare 
the results to the built-in Legendre polynomials in your 
favorite computer algebra system. 


(b) Two functions f (x) and g(x) are said to be orthogonal on the 
interval [a, b] if f Ft (x)g(x) dx = 0. For0 <i, j < 5, show 
that the Legendre polynomials are orthogonal on the interval 
[-1, 1] by showing 


0 jzk 
Í PL) P;(x) dx = 2 
l j=k 
2k +1 


(c) Let f (x) = x, and compute a, = = f f (x) B. (x) dx, 
k =0,..., 10. Demonstrate that the series EN ay P(x) 
converges to f (x) by forming and graphing the sequence of 
partial sums $,(x) = 37, 9 a, Pk (x). 
(d) Repeat part (c) for f (x) = x?. 
(e) Repeat part (c) for f(x) = cos zx. 
(f) Repeat part (c) for f(x) = = Eee 
The Chebyshev polynomials 7, (x), —1 € x < 1, can be defined 
by the recursion To = 1, T, = x, T; = 2x Ty. | — Ty. 5. (Modern 
computer algebra systems have these polynomials built-in. The 
first eight are listed in Table 40.5 of Section 40.3.) 


(a) Use the given recursion to generate 75, ..., Tio, and compare 
the results to the built-in Chebyshev polynomials in your 
favorite computer algebra system. (The spelling of this 
Russian name varies greatly in the literature. Some texts 
render it as Tchebyshev.) 


(b) On the interval [a, b], two functions f (x) and g(x) are 
orthogonal with respect to the weight function w(x) if 
i w(x) f (x)g(x) dx = 0. Show that on the interval [—1, 1] 
the Chebyshev polynomials are orthogonal with respect to the 


weight function w — a by showing 
m k=j=0 
: x 
/ w(x)T,(x)T; (x) dx = = k=j>0 
-1 2 
0 k £j 
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(c) Let f (x) = e*, and compute (via numerical integration) 
ay = 2 f f G)w(x)Tu(x) dx, k = 0,...,10. Demonstrate 
that the series % + X a, T, (x) converges to f(x) by 
forming and graphing the sequence of partial sums 
S,(x) = 2 pny eT). 

(d) Repeat part (c) for f(x) = sin mx. 


(e) Repeat part (c) for f(x) = cos mx. 


(f) Repeat part (c) for f(x) = Li " 


Chapter Review 


1. Define the pointwise convergence of a sequence of functions. 


2. Give an example of a sequence of functions that converges 


3. 


11. 


12. 


13 


14 


15 


pointwise. What is the limiting function? 

Give an example of a sequence of continuous functions that 
converges pointwise to a discontinuous limit function. 

Give an example of a sequence of functions that does not converge 
pointwise, that is, for which there is no limiting function. Explain 
why the sequence does not converge. 


. Give a verbal description of the concept of uniform convergence of 


a sequence of functions. Give an example. 


. State the mathematical definition of uniform convergence of a 


sequence of functions. 


. Does pointwise convergence imply uniform convergence? Explain, 


and illustrate with an example. 
Does uniform convergence imply pointwise convergence? 


Explain what it means for a sequence to fail to converge uniformly. 
Give an example. 


. Give an example of a sequence of continuous functions that 


converges uniformly. What is the limiting function? Is it 
continuous? 


Give an example of a sequence of discontinuous functions that 
converges uniformly. What is the limiting function? Is it 
continuous? Can you find a sequence of discontinuous functions 
that converges uniformly to a discontinuous limit? Does this violate 
Theorem 8.1 on the uniform limit of continuous functions? 


Use an example to illustrate Theorem 8.2, which states that a 
sequence of continuous functions converging uniformly can be 
integrated termwise. 


Can a sequence of continuous functions that converges only 
pointwise and not uniformly be integrated termwise? Explain. 


State a theorem justifying termwise integration of a sequence of 
functions. Illustrate it with an example. Give an example that 
violates one of the hypotheses of your theorem and where termwise 
differentiation fails. Can you find an example of a sequence that 
fails one of the hypotheses of your theorem, but for which termwise 
differentiation succeeds? 


Give a verbal description of convergence in the mean for a 
sequence of functions. Give an example. 


16. Give the precise mathematical definition of convergence in the 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


26 


27 


28 


n 


£z 


29. 


30. 


mean for a sequence of functions. 


Give an example of a sequence of functions that converges in the 
mean but does not converge pointwise. 


Give an example of a sequence of functions that converges in the 
mean, converges pointwise, but does not converge uniformly. 
Give an example of a sequence of functions that converges in the 
mean, converges pointwise, and converges uniformly. 

Give an example of a sequence of functions that converges 
pointwise but does not converge in the mean. 


Give an example of a sequence of functions that converges 
uniformly but does not converge in the mean. 


Give a condition under which uniform convergence of a sequence 
of functions implies convergence in the mean. Give an example. 


Give a verbal description of what it means for an infinite series of 
functions to converge pointwise. Be sure to include the concept of 
the partial sum. Give an example of a series of continuous functions 
that converges pointwise to a discontinuous limit function. 

Give a verbal description of what it means for an infinite series of 
functions to converge uniformly. Give an example of a series of 
continuous functions that converges uniformly to a continuous 
function. 


Give a verbal description of what it means for an infinite series of 
functions to converge in the mean. Give an example of a series of 
functions that converges both pointwise and in the mean. Give an 
example for which the convergence is in the mean but not 
pointwise. 

Give an example of a convergent series of functions for which the 
nth term does not go to zero. Why is this surprising? 

Give a sufficient condition under which a convergent series of 
functions will have its nth term go to zero. 

State the Weierstrass M-test, and give an example of its 
applicability. 

Give an example that illustrates the validity of termwise integration 
of a uniformly convergent series of continuous functions. 


Give an example illustrating conditions under which a series of 
functions can be differentiated termwise. 


EXAMPLE 9.1 


Chapter 9 


Power Series 


INTRODUCTION Chapter 9 discusses the Taylor (or power) series, and 
manipulations thereon, in anticipation of representing solutions of differential equations 
as power series. The Taylor series should be seen as but a first example of representing a 
function by an infinite series of “simpler” functions. 

The calculus student should be familiar with Taylor polynomials and may even be fa- 
miliar with the infinite Taylor series. For students so prepared, this chapter can be considered 
optional. 


Taylor Polynomials 


Polynomial Approximation 


If a function f(x) is difficult to evaluate or manipulate, it is often replaced by an ap- 
proximating polynomial. Polynomials whose derivatives match those of f(x) at a single 
fixed point x = a are called Taylor polynomials, or Maclaurin polynomials if a = 0. Such 
approximations are typically studied in most calculus courses. 


To construct a cubic polynomial that approximates the function f(x) = z} in a neighbor- 
hood of x = 2, write the approximating cubic as Y = ax? + bx? + cx + d and determine 
the four constants a, b, c, d by the four conditions f (2) = Y 9 (2), k = 0, 1, 2, 3. Taking 


derivatives and evaluating at x = 2 gives the four equations 
į =8a+4b+2c+d  —$-212444btc $-12442b -F=6a 
from whose solution we find 
EA 285. Tl.» 129 1,9 
YQ) =a = ht gk — ye 


Figure 9.1 illustrates the accuracy of the approximation, showing f(x) as the solid curve 
and Y (x) as the dashed. 
In some neighborhood of x = 2 the approximation is good, but far enough away from 


x = 2 the approximation, an example of a Taylor polynomial, weakens. KS 


Taylor’s Theorem 


The conditions under which such approximating polynomials exist are captured in theorems 
such as the following, taken essentially from [91]. 
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FIGURE 9.1 Cubic approximation 


(dashed) for f(x) = z} (solid) 
constructed at x — 


THEOREM 9.1 


1. f(x), f/(x),..., f+ (x) are continuous in a closed interval containing x = a 
(either inside or at one end). 


2. xisany point in the interval. 


1 x 
3. Ryu = =| (x — ty fee) dt 


1 a (n) a 
=> f= f a+ a ^ —a)T---- f - lu —a)"+ Ry 
THEOREM 9.2 
l. f(x), f'GO, ..., f (x) are continuous in the closed interval [a, x], with x fixed. 
2. f+) (x) exists on the open interval (a, x). 
io 
3 R, L i (n4-1) 
+1(C) (n E DI (x —a) 
==> in the open interval (a, x), there exists a value c for which the equality 
(a) (a) : 
fa) =f@+ i ae ro ay" + Rua) 


holds. 


The nth-degree Taylor polynomial p, (x) is given by 


/ (n) 
D =a) ease f -0 

It is a polynomial approximation to f(x) constructed from values of the function f 
and its derivatives evaluated at x = a. Clearly, p,(a) = f(a), so at x = a the polynomial 
is exact; but as x moves away from a, the approximation becomes poorer. The general 
coefficient of (x — a)* is f® (a)/k!, the kth derivative evaluated at x = a and divided by 
k factorial. 

The remainder in Theorem 9.2 is ascribed to Lagrange and is more apt to be found 
in an elementary calculus text. Many other forms of the remainder exist, including forms 
attributed to Cauchy. The integral form of the remainder is an identity in x. It is exactly 
what remains if the Taylor polynomial is subtracted from the function. On the other hand. 
in the Lagrange form of the remainder, the constant c depends on x. For each value of x at 
which the function is to be approximated by a Taylor polynomial, the constant c is different. 
Hence, in the integral form of the remainder we have a difficult integral to evaluate, whereas 
in the Lagrange form we have the constant c, which cannot generally be found. 

Theorem 9.1 is easier to prove than Theorem 9.2, requiring just repeated integration 
by parts for its derivation. In particular, writing f(x) = f (a) + [as f" (t) dt and integrating 
by parts with u = f'(t), we obtain 


Pn(x) = f(a) + (x — a)” (9.1) 


FG) fto-- F'übis a f “fe — 0di 


a 
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Again integrating by parts, this time with u = f"(t), we find 


f) = f(a) + f'(a) x-a) + 


f^ (a) 
2! 


war +5 frowned 0D 


Repeated integration by parts, each time taking the derivative in the integrand as u, leads 
to the essence of an induction proof. Alternatively (see [65]), write the function as f(x) = 
f@t+ L f'(t) dt and make the change of variables x — t = z to obtain f(x) = f (a) + 
fo. f(x — z) dz. Integration by parts with u taken as the derivative again yields the desired 


result. 


EXERCISES 9.1—Part A 


A1. Using the interpolation technique of Example 9.1, obtain a 
quadratic polynomial that approximates f(x) = ina 
neighborhood of x = 0. 


M M 
1+2x 


A2. Use (9.1) to obtain the quadratic polynomial of Exercise A1. 


A3. For f(x) = e^', obtain p3(x), the third-degree Maclaurin 
polynomial, and then differentiate it termwise. 


EXERCISES 9.1—Part B 


A4. For f'(x), where f (x) is the function in Exercise A3, obtain the 
second-degree Maclaurin polynomial. Compare the results of 
Exercises A3 and 4. 


AS. For the polynomial p3(x) determined in Exercise A3, compute 
F p3(t) dt and compare the result to the Maclaurin expansion of 
F(x) = f, e" dt. 


B1. For f(x) = — anda = 0, apply the integration by parts that led 


1+x 
to (9.2) and evaluate the remaining integral. Show that the result 


is an identity in x. 


B2. For the function f(x) = sin (753): 


(a) Find R4(x) = Log — 2)*, the Lagrange form of the 
remainder. 

(b) If P4(x) is the cubic Taylor polynomial constructed at x = 2, 
find c in Ry by solving the equation f (3) — P3(3) = R4(3) 
for c. 

(c) Repeat part (b) if x — 4. 

(d) Using a graph, find M, the maximum value attained by 
| £9 (x)| on the interval [1, 4]. 

(e) Graphically compare | R4(x)|max = A — 2)^, an upper 
bound for the error in the Taylor approximation, with 
|f — P3|, the actual error in the Taylor approximation. 

(f) Find the largest interval centered at x = 2, over which P3(x) 
approximates f(x) with an error no worse than 1079; 

(g) Find P; (x), the first Taylor polynomial constructed at x = 2 
for which | f(x) — P(x)| < 10? on the interval |x — 2| < 1. 

(h) Find and plot the sequence of Taylor polynomials P; (x), 
k= 1,..., 4, if each polynomial is constructed at x = 2. 


For the functions f (x) in Exercises B3-7: 
(a) Using a computer algebra system, find and plot the sequence 


of Taylor polynomials P; (x), k = 1,...,4, if each 
polynomial is constructed at x — a. 


(b) Find the largest interval centered at x = a, over which P3(x) 
approximates f(x) with an error no worse than 107°. 


(c) Find P, (x), the first Taylor polynomial constructed at x = a 
for which | f (x) — Pg(x)| < 107? on the interval |x — a| < 1. 


(d) Construct 


by computing and evaluating the appropriate derivatives. 
(e) Construct P3(x) by determining the coefficients in the cubic 
polynomial Y = ax? + bx? + cx + d. 
(f) Find R4(x) = Log — a)*, the Lagrange form of the 
remainder. 
(g) Find c in R4 by solving the equation f (a 4- 1) — | 
P3(a + 1) = R4(a + 1) for c. 
(h) Repeat part (g) atx =a+2. 
(i) Using a graph, find M, the maximum value attained by 
|f® (x)| on the interval [a — 1, a + 2]. | 
(j) Graphically compare |R4(x)|max = M(x —a)*, an upper 
bound for the error in the Taylor approximation, with 
|f — P3|, the actual error in the Taylor approximation. 


B3. f(x) [339 —4X. 1 
. f (x) — cos 317 ja 


x+1 
ia= 
x? +2x +2 
BS. f(x) 2 x /x? +2x +3 — yx +4;a =3 


B4. f(x) = 


0 
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B6. f(x) 2e?;a-4 B7. f(x) = arctan x;a = 1 (c) Graph the Taylor polynomial used in part (b) and determine 
the maximum error it incurs as an approximation to the 


For the function f (x) and the value of a in each of Exercises B8-11: integrand on the interval [0, 1]. 


(a) Find R4(x), the integral form of the remainder, and using a l 1—x+xí 1 " 
computer algebra system, evaluate the integral. B12. Í pas dx B13. Í arctan” x dx 
(b) Show that P3(x) + Ra(x) = f (x), exactly. 1 1 
. . . B14. f vl+xřdx B15. sin y 1 + x? dx 
B8. f(x) from Exercise B4 B9. f(x) from Exercise BS 0 0 
1 


| B10. f(x) from Exercise B6 B11. f(x) from Exercise B7 B16. i eain 
0 


a prenin Hyeres IS LPS B17. For each of the following, show that termwise integration of the 


(a) Obtain an accurate numeric evaluation via your favorite second-degree Taylor polynomial constructed at x = 0 gives the 
technology. Taylor polynomial for an appropriate antiderivative of the 
(b) Replace the integrand with a Taylor polynomial constructed func. 
at x = 0 and integrate termwise. The Taylor polynomial (a) f(x) = - (b) f(x) = - 
should be one for which termwise integration yields an =a l+ 
answer accurate to 107°. ; l l 
© f(x) 2-— (d f(x) z 
V1 +x? 1 — x? 
Taylor Series 
Power Series 


We saw in Section 9.1 that sufficiently well-behaved functions can be approximated by 
polynomials of arbitrarily high degree. Is, then, the representation 


ed Gn . 
fe) 2 — (x — a)! 
k=0 ` 


meaningful? If it is, it will be called a Taylor series. 

A series of the form 7 o ce(x — a) is called a power series, that is, a series in powers 
of x — a. Since it can be shown that the coefficients in a Taylor series for f (x) are unique, 
cy = f? (a)/k! and a power series representation for a function f (x) must be its Taylor 
series. From now on, we will treat the terms Taylor series and power series as equivalent. 

From Chapter 8, an infinite series make sense if the associated sequence of partial sums 
converge. But the sequence of partial sums for this power series is just the sequence of Taylor 
polynomials. This sequence converges if the remainder term for the Taylor polynomials goes 
to zero. 


EXAMPLE 9.2 Let f(x) = e* so that, at a = O, the nth partial sum would be the polynomial p,(x) = 
1o X / Kk! and the Lagrange form of the remainder would be R = ex" *l/(n + 1)! 
where c lies in the open interval (0, x). In particular, c depends on x and n, so to show 
the remainder goes to zero for increasing n requires fixing x at M and noting that for the 
increasing functions e* and x"*! the maximum on (0, x) will occur at x = M. Thus, the 


remainder is bounded by R; = eV M"*/(n + 1)! for which the limit is 0. $ 


The appropriate arena for proving general results like this is the complex plane. Hence. 
we restrict ourselves here to a discussion of convergence for power series along the real 
line. 


EXAMPLE 9.3 


EXAMPLE 9.4 
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Obtaining Power Series 


Power series representations for the elementary functions are well known and tabulated. 
In fact, most are met in an elementary calculus course. For example, the Taylor series 
representation of sin x is 


oo (— 1 jk x2k+1 


2. (2k + 1)! 


k=0 


Alternatively, some series can be obtained by manipulating other known series. 


Obtain a power series representation of f(x) = =<, valid in a neighborhood of x = 2. 
Write f(x) so that each x appears as x — 2, and exploit the similarity of f(x) to B 
the sum of the geometric series. Thus, obtain 


a. # _ &@-2)42 . Z432 _ T em AZAR 
eer a TE ee qos LG) (9.3) 


where z = x — 2 and the geometric series has been used to expand iA. Then, writing 


u= = (9.3) leads to 


—(utuw +--+ 2 +u4+w+---))=—-(2 +34? +---)) 


5 


—-—(-1- 3-3 +u? x.) 


9$. 
** 


so f(x) 21— 3 5 xy , when u is replaced by =. 


3 


Interval of Convergence 


On the real line, power series of the form peu cy(x — ayY converge in (a — R, a + R), an 


interval of convergence about x — a, with R being a real number to be defined. The series 
may or may not converge at the endpoints of this interval. 


Radius of Convergence 


The real number R is the radius of convergence, the distance from a to the closest point of 
non-convergence in the complex plane. Hence, it is possible for the power series on the real 
line to converge at both ends of the interval of convergence or at neither. 

If R — 0, then the power series converges at just the single point x — a and we say 
there is no interval of convergence. On the other hand, if R = oo, then the power series 
converges everywhere and the interval of convergence is the whole real line. 

The radius of convergence for a power series can usually be found by an application 
of the ratio test. 


For the power series for e* — X cd x*/ k!, the condition p = lim; ss |ag41/ax| < 1 in the 
ratio-test becomes lim; , oo Sl < 1, from which we obtain |x| < limy..(k + 1) = co. 
Thus R, the radius of convergence, is infinite and we have the interval of convergence 
defined by |x| < oo. % 
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EXAMPLE 9.5 


For the power series z+ = ) pco x^, the ratio-test condition p = limi. os |ax41/ax| < 1 


becomes lim; |x ^! /x*| < 1, from which we obtain |x| < 1. Thus, the radius of con- 
vergence is R — 1, which is not surprising since this series is the familiar geometric series 


yeu P 


EXAMPLE 9.6 


known to converge for |r| « 1. 


e. 
hod 


Find R, the radius of convergence for 


(—1y x? 


oo 


an example deliberately picked because the powers in successive terms increase by two, not 
one. Now, the ratio test leads to R = lim, 55 /2(k + I) (2k + 3) = oo, where the radical 


appears because the ratio a;.,.; /a; simplifies to a multiple of x?, not just x. 


EXERCISES 9.2—Part A 


7 
“~~ 


A1. Using just the geometric series 4 + , Obtain the Taylor 


= pears x 


series for f(x) = = about x = —1. 


A2. Use the ratio test to determine the radius and interval of 
convergence for the series obtained in Exercise A1. 


A3. A Maclaurin series is a Taylor series about x — 0. For example, the 


Maclaurin series for f(x) = a5 = ga — is 
= 1 
? Dt ( - E 
kn 
k=0 2 T 


Verify that the first few terms are correctly given by this sum. 


EXERCISES 9.2—Part B 


A4. Obtain the Maclaurin series for the fractions —— and —;, and use 


x : 1 Es 2 
them to verify your work in Exercise A3. 


AS. Since f (x) in Exercise A3 factors to IC the product of the 
Maclaurin series obtained in Exercise A4 should again reproduce 
the Maclaurin series of Exercise A3. Show that this is so for the 
first few terms. 


B1. Obtain the Taylor series for f (x) = ins valid in a 
neighborhood of x — —1. Hint: Complete the square in the 
denominator, and use the technique of Example 9.3. 


In Exercises B2-6: 


(a) Establish the given Taylor series. 


(b) Use the ratio test to find R, the radius of convergence. 


oo 2k oo 
(=1)*x** (2k) !x* 
B2. cosx = 9 -—— —— B3. JI —- x= 
= 3 QI)! à 2 Gy QE) 
oo xt oo (- Dx 2k+1 
B4. In(1 — x) = Lar ? 5. arctanx = 3 7 —— — — bae 
(= k=0 
1 oo 
B6 - 1) 
EF 2 ) 


For the functions in Exercises B7—9: 


(a) Obtain the Maclaurin series, that is, the Taylor series at x = 0. 


(b) Use the ratio test to find R, the radius of convergence. 


(c) Decompose f (x) by partial fractions, and obtain the 
Maclaurin series for each fraction, noting that the 
denominators of each fraction are linear, and hence, the 
associated series are just geometric series. 


(d) Add the series stemming from the partial fraction 
decomposition, and show that the original series is obtained. 


(e) Obtain the series for f (x) by equating f(x) to the formal sum 


oo aex*, multiplying through by the denominator of f (x) 
and then matching coefficients of like powers of x on each 


side. 
5x — 17 37x — 12 
B7. f(x) = ———————— B8. f(x) = ———————— 
f(x) Ax? + 41x +45 fe 45x? — 61x 4- 20 
Ix —31 
B9. f(x) = ——————— 
origi eo 


For the functions f(x) and g(x) in Exercises B10—12: 
(a) Verify f (g(x)) = gCf (x)) = x, thereby showing that f (x) 
and g(x) are functional inverses. 
(b) Graph f (x), g(x), and y — x all on the same set of axes. 
(c) Obtain, at x = 0, the Taylor series for f (x) and g(x). 
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(d) Take g(x) as the formal sum pan a,x*, and substitute it into B13. Using just the geometric series D = am x*, obtain the Taylor 


f (g(x)) = x, matching coefficients of like powers of x on series of 
each side of the resulting equation. This should determine the in) fœ) = 1 — m b 
coefficients az, and these coefficients should be the same as A) foe 2-3: SER AU i» P= 24x "m: 
the coefficients in the Taylor series for g(x). x —2 
x x 
ce) f(x) « boutx =O (d) f(x) = bout 
B10. f(x) — sinx, Z < T. g(x) = arcsin x (e) feo) 2+x m (a) fo) 2+x ora 
= del | 
. T " 
B11. f(x) = tanx, —7 ; g(x) = arctan x (9 fa == ‘ alunt x 223. 
2 24x 
B12. f(x) = i — 4 > B14. For each function in Exercise B13, determine the interval of 


A 


convergence of the Taylor series. 


Termwise Operations on Taylor Series 


Introduction 


Inside the interval of convergence, a Taylor series can be manipulated as if it were a poly- 
nomial. Termwise integration and differentiation, as well as termwise arithmetic, are valid. 
In this section we state and illustrate a number of specific theorems that justify termwise 
manipulations with Taylor series. We will state results for series in powers of x, since the 
generalizations to series in powers of x — a are immediate. 


Theorems on Convergence 


Stated without proof, the following two theorems are the basis for most manipulations with 
power series. Inside the interval of convergence, a power series converges absolutely. In light 
of Theorem 8.7, the comparison theorem of Section 8.5, the convergence is also uniform. 
A formal statement of the theorems follows. 


THEOREM 9.3 ABSOLUTE CONVERGENCE 


The power series 3 7. 9 anx” converges absolutely in the open interval (—R, R). 


THEOREM 9.4 UNIFORM CONVERGENCE 


The power series ? 7. , a,x” converges uniformly in any closed interval completely 
contained inside the open interval (— R, R). Thus, uniform convergence takes place 
in [-r, r], where 0 < r < R. In terms of x, the set on which uniform convergence 
takes place is |x| € r < R, so x is bounded away from R. 


Related to convergence of a power series is the concept of analyticity for the limit 
function. 


ANALYTICITY A function f(x) defined on the real line is said to be analytic at x = a 
if f (x) has a Taylor series that converges in some interval about a. Typical real analytic 
functions are sin x, cos x, and e*. 


-4 -2 0 2 4 


FIGURE 9.2 A function which, at x = 0, 
is not analytic, but is infinitely 
differentiable 


Chapter 9 Power Series 


Clearly, if a real function is analytic at x — a, then all derivatives of f(x) exist at 
x — a. Oddly, the converse of this statement is not true. Real functions having all their 
derivatives at a point fail to be analytic at that point if there is no Taylor series converging 
to the function in an interval about the point. A classic example is the function 


0 x=0 


f@= e M 3 Z0 


whose graph, appearing in Figure 9.2, suggests examining the behavior at the origin. Since 
lim,.,55 e = 0, we accept lim,.,o f(x) = 0 as true. The derivative at x = 0 is the limit 
of the difference quotient e-!/^ /h, likewise zero. The second derivative at x = 0 is the 
limit of the difference quotient 2e~!/"" / h^, again zero. Continuing in this manner, we can 
verify that all derivatives f® (0) = 0. Hence, the Taylor series so generated for f (x) will 
be identically zero and, therefore, converges to f (x) just at the single point x = 0, not in an 
interval about x = 0. As predicted, this function has all its derivatives, but its Taylor series 
does not converge to the function in an interval. 

Real functions for which all derivatives exist are said to be of class C% (read “C 
infinity"). Real analytic functions are a subset of the class C®°, the infinitely differentiable 
functions. For a real function, having one derivative does not guarantee existence of any 
others, and having derivatives of all orders does not guarantee the existence of a Taylor 
series converging in an interval. 


Theorems on Continuity 


Since the uniform limit of continuous functions is a continuous function, inside the interval 
of convergence a power series represents a continuous function. This is formalized as 
follows. 


THEOREM 9.5 CONTINUITY 
The function defined by the series X anx”, provided R Æ 0, is continuous on the 


open interval (— R, R). 


Atthe endpoints of its interval of convergence, a power series may or may not converge. 
The question of continuity of the limit function at the endpoint of the interval of convergence 
is addressed by the following theorem of Abel. 


THEOREM 9.6 ABEL'S THEOREM 


If $ 7-5 ax" converges at x = R and R is nonzero and finite, then the convergence 
is uniform at R. Hence, the limit function is continuous on the closed interval [0, R]. 


EXAMPLE 9.7 The function f(x) = 4/1 + x has the Taylor expansion 


y (—D*Qk)!x* 


ECOL. — "2 
Lo 4KQk — DRN) 


converging for |x| « 1, so the series has a radius of convergence R — 1. We can see this 
from the ratio test since the absolute value of the ratio of two successive terms is 4 UP lz 
from which we realize R = 1. 


[^ 


TM 


0 2 4 6 
FIGURE 9.3 The sequence 
(2k)! 


T 4k — D 
monotonically to zero 


ak decreases 
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Now suppose we are interested in using the series to compute the value of f (1) = 
J/1+1 = V2. Can we expect the series to converge to V2 at x = 1? According to Abel's 
theorem, if the series converges to anything at x = 1, then it represents a continuous function 
on [0, 1] and must therefore give f(1) = V2 at x = 1. That the series converges at x = 1 
can be shown as follows. 

At x = | the series is alternating, and the absolute value of the general term is (2k)!/4* 
(2k — 1)(k!)?, which is monotone decreasing as a function of k, as seen in Figure 9.3. Theo- 
rem 7.3, Leibniz theorem for alternating series then assures convergence. Abel’s theorem in 
turn assures continuity of the limit function; and since f (1) = 4/2, the series must likewise 
converge to 4/2 at x — 1. e 


Uniqueness Theorems 


We have already mentioned that the power series f(x) = Y, 9 axx* is actually the Taylor 
series for f (x), that is, ay = f ®© (a) /k!. Therefore, it is not surprising to have the following 
uniqueness theorem. 


THEOREM 9.7 UNIQUENESS 


If two power series converge to the same values on a common interval |x| < r so that 
ouo arx" = X o byx* in this interval, then a, = b; for all k. Thus, the coefficients 
of the power series for f (x) are unique in a given interval. 


The Arithmetic of Power Series 


Power series behave like polynomials with respect to scalar multiplication and the four 
arithmetic operations of addition, subtraction, multiplication and division. The following 
theorem formalizes this claim. (See [65, p. 425] and [91, p. 676].) 


THEOREM 9.8 


L no nu ayx* in Rj, its interval of convergence. 
2. fax) = Jue b,x* in Ro, its interval of convergence. 


à «9. dh k-0oLhA 


— 


- 
. 


afi(x) = $ o wa,x* in Ri, where o is any constant. 


2. afi) + Bfa(x) = You o(aa + Bb,)x* for all points common to A; and Ro, 
and any constants o and f. 


3; fix) p= Nas cy. X for all points interior to the intersection of R; and R2. 


4. 5 Sr d,x* for sufficiently small x, provided bọ # 0. The coefficients 
dy can be found by long division or by solving the equations ae bndk-n = ak 
successively for do, did», .... The first few equations are body = do, bod, + 


bido = a4, bo, d2 + bid, + body = az and clearly arise by equating coefficients 
in the product | 577: o dex*|[ Yo bext] = Yo aix". 
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The Algebra of Power Series 


Our discussion of the algebra of power has two components. First, we discuss the relation 
between a Taylor series of the composition of two functions and the composition of the 
Taylor series of the individual functions. Then, we discuss the issue of reversion of series, 
that is, the process of generating from the power series of a function, the power series of 
the inverse of the function. 


Composition of Power Series 


Table 9.1 lists functions f(x), g(x), h(x), the compositions f(g(x)) and f(A(x)), and 
Taylor polynomials for each. We are interested in the composition of the Taylor polynomials 
corresponding to the two composite functions. For f(g(x)) we find 

3 


sift a jah OV 1, A _ 365107 
t3 ata) 8 a a) * Te ata) "356 52 5 


but for f (h(x)) we find 
3 


141 x ox Df p os es . ey T x x 
21 3*5) 8V 3 5 l6 92 3) ^ "3 8 di 


The coefficients in the expansion of f (g(x)) are not obtained by composing partial sums 
of the series for f(x) and g(x), but for f (h(x)), they are. Hence, we have the following 
theorem [35]. 


Function Taylor Polynomial Function Taylor Polynomial 


f)-VUEx — gPey-uo | fee) =viteosx (1-5) 


2 8 16 
6 neo i x? x4 - soa axi 
g(x) = cosx a ta f(h(x) = V1+sinx xi m ae 
: Qo AP x? 
h(x) = sm-x x — 3l + sl 


TABLE 9.1 Taylor series and the composition of functions 


THEOREM 9.9 COMPOSITION 


co 


Ll f= X aly — yo)*, convergent in |y — yo| < Ri. 
k=0 


oo 
25 px) X d(x — x0)", convergent in |x — xo| < Ro. 
k=0 
3. &(xo) = bo = yo 
— 
There is an interval about xo, namely |x — xo| « R3, in which |g(x) — yo| « Ri 
and in which the composition has a Taylor expansion given by 


[o9] 


oo oo k 
h(x) = fg) = a — xo) =) ar [x by(x — J 
k=0 


k=0 n=1 


l =b; 

0=b, 

0 = —1b, +b; 

0 = —ib, + b4 

0 ghi — 553 + bs 


TABLE 9.2 Coefficient equations which 
revert series for sin x 


EXAMPLE 9.8 
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In both examples above, the center for the expansions was yo = O, so the crucial 
condition became whether or not the lead coefficient bo in the series for g(x) was zero. In 
the first case, g(0) = bo = 1 Æ yo and composition of the individual Taylor series failed. 
In the second case, g(0) = bo = 0 and the composition of the individual series succeeded. 


REVERSION OF POWER SERIES Ifthe function y = f (x) hasaninverse, when can we obtain 
the Taylor series of the inverse function from the Taylor series of the given function? For 
example, given the function f(x) = sin x with Taylor series $7; 9(— 1) x^**! /(2k + 1)!, 
what connection, if any, exists between its coefficients and the coefficients in the Taylor 
series for the inverse function, that is, with the coefficients in 

o9 yy 2k+1 

: (2k)!x 
arcsin(x) = —— 

2, 4k (kY)? Qk + 1) 
From [35], we have the following theorem, where the term series reversion refers to the 
process of computing the coefficients of the power series for an inverse function from the 
coefficients of the power series of the function. 


THEOREM 9.10 REVERSION OF SERIES 


[5.9] 

1. f{f@= Ya — x9)* converges in |x — xo| « R. 
k=0 

2. KK Xo) =a) zs 0 


=- 


1. Ina neighborhood of f (xo) = yo = ao, defined by |y — ao| < r for some real r, 


an inverse function ó exists. 
us 


2. Inthis neighborhood, the function $ satisfies x = $(y) = xo + Pid by(y — ag)". 
k=1 
3. The coefficients b, satisfy x = xo + 3 by 2. as (x — xo)" 


k=1 n=l 


The first hypothesis gives y = f(x) = Ey a^ a(x — xo) = ag + ER ay(x — xoY*, 
so y—a = Yo a(x — xo)*. Since yo = f (xo) = ao, expanding x = $(y) about yo 
gives x = $(y) = xo + bet by(y — ag)*. Replacing y — ao with $a a(x — xo)* then 
gives the result in the third conclusion. 


The first few terms of the Maclaurin expansion of f(x) = sin x are given by 
S asd um. oss 
F=x- ix + ae" = ax! 


Theorem 9.10 suggests we form the identity 


5 
x = x0 t X bF" 
k=1 
and match coefficients of like powers of x on each side. This generates the equations in 
Table 9.2, which are then solved for the unknown coefficients bg, yielding x + 2x? + 3,3? 
for an expansion of the inverse function. 


>, 
“ 
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The Calculus of Power Series 


Inside the interval of convergence of a power series, the operations of termwise differ- 
entiation and integration are valid. The following theorem from [65] justifies termwise 
differentiation of power series. 


THEOREM 9.11 TERMWISE DIFFERENTIATION 
The power series f(x) = $?c axx* and the derived series Y 7. kayx" | have the 


same radius of convergence. Moreover, the derived series is the Taylor expansion of 
the derivative, f'(x). 


EXAMPLE 9.9 The function sin x with Maclaurin series 


Y (= Dx x? 
—— c4 ee eei 
2k ! ! 
rw (2k + 1)! 3! 
has derivative cos x with Maclaurin expansion 
oo 2 
(= 1 jig x? 
EF E =le JE e 
eo v e : 


9$. 
he d 


The second series is what is obtained if the first is differentiated termwise. 


Termwise integration of power series 1s justified by the following theorem from [65]. 


THEOREM 9.12 TERMWISE INTEGRATION 


oo 


L fo- Sax with radius of convergence R. 
k=0 
2. o and P are within the interval of convergence. 
F > i k SEE (k+1) (k+1) 
ee )dx = : ax: —— — 
[ (9 Laf nnn 


EXAMPLE 9.10 Consider the function f(x) = e* whose Maclaurin series, convergent on the whole real 
line, is $75, x*/k!. Termwise integration between x = o and x = f yields the series 
expansion for e? — e“, and integration of f (x) yields precisely e? — e. $ 
Examples 
The following examples illustrate valid and practical operations with series. 


EXAMPLE 9.11 The series for e* can be obtained from the series for f (x) = e* by substituting x? for x in 
the expansion for f (x). ^ 


EXAMPLE 9.12 The Maclaurin series for sinh(x) = (e* — e~*)/2, namely, 377-9 x7**!/(2k + 1)! can be 
obtained from the series e* = X% o x*/k! and e~* = Y 5: 9(—2x)*/ k! since the coefficient 


EXAMPLE 9.13 


EXAMPLE 9.14 


EXAMPLE 9.15 
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of x* in the termwise sum, namely, (1 — (—1)*) /2k!, is zero when k is even and 2 when k 
is odd. D 


The Taylor series for cos(x — a) about x — a is pe 1) (x — a)**/(2k)!, a result 

equivalent to $ ;* 9(— D*x?*/ Qk)!, the Maclaurin series for cos x, with each x shifted to 

x —a. e 

The Maclaurin expansion of the product sin x cos x requires us to multiply the two series 
oo (jj 9S (—D*x* 


Qk+D! £ 2K)! 


k=0 


The result should be pa a 25 /(2k + 1)!, the Maclaurin series of i sin2x — sinx 
cos x. Working with partial sums and truncating, we obtain 


x^ x» x^ xs Za 2g 1 (2x) (2x) 
(x zx) zti) 3" "1s" = 5 (2 ü 5 5 ) 


which is the partial sum of the series for E sin 2x. e 


The nth-order Bessel functions of the first kind, J, (x). are “special functions,” defined by 
power series and obtained as solutions of second-order linear differential equations with 
nonconstant coefficients. (Details appear in Section 16.2.) The graphs of 


oo l 9o (—1)*x 2441 


(7-1? ; 
Jo(x) — — — —— (solid) and J (x) = - (dashed 
ox) 3 paz Gold) it) 2 REDAEFD | i 
are shown in Figure 9.4. By termwise differentiation of the series representation for Jo(x), 
valid within the interval of convergence, it is possible to verify that Jj(x) = — Ji (x). e 
F 
y A 
1 
0 i A » x 
10 
" E m IL x t 
T aj 0 i 
FIGURE 9.4 The Bessel functions Jo(x) FIGURE 9.5 Graph of FIGURE 9.6 Graph of 
and Jı (x), respectively the solid and f(x) = B» F(t) 2 1— f, # dx 
dotted curves 
EXAMPLE 9.16 The function f (x) = n is undefined at x = 0, but lim,_.9 f(x) = —1, so at (0, —1) the 


graph of f (x) simply has a “hole” that can be “patched” be defining f (0) = —1. Thus, f (x) 
is said to have a removable singularity at x = 0. The function f (x) also has a vertical asymp- 
tote at x = 1 because lim,_,,;- f(x) = —oo. Both of these features are seen in Figure 9.5. 

The function F(t) = 1 — Je f(x)dx,0 < t < 1, graphed in Figure 9.6, has the series 
expansion 1 + 377 o 1**! /(k + 1). Dividing the series In(1 — x) = — 39x /(k +1) 
by x, and then integrating termwise give the series expansion for F (t). $ 
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EXERCISES 9.3-Part A 


A1. Insight into why a power series converges uniformly on 
|x| <r < R, where R is the radius of convergence, can be obtained 
by examining the convergence of the geometric series 5 po x^. 


Use the Weierstrass M-test and assume ) ^; r^ converges. 


A2. Obtain the first few terms of the Maclaurin series of tan x, sin x, 
and cos x. Long divide to test whether the division of the series for 
sin x and cos x gives the series for tan x. 


EXERCISES 9.3—Part B 


A3. Use the truncated Maclaurin series for e* sin x, e*, and sin x to test 
whether the series of a product is the product of the series. 


A4. Obtain g(x), the function inverse to f(x) = 75. Obtain the 
truncated Maclaurin series for both f (x) and g(x) and then apply 
the technique of series reversion to obtain the series for g(x). Of 
course, the two series for g(x) should agree. 


AS. For the Bessel functions given in Example 9.15, verify that 
Jg(x) = —JA1(x). 


B1. Evaluate F(a) = f? Va +x? dx and then obtain the Maclaurin 
series for F(a). Expand the integrand in a Taylor series about 
a = 0, integrate termwise, and compare (analytically and 
graphically) the two expansions for F(a). 


For the functions given in Exercises B2- 6: 


(a) Obtain the Maclaurin series. 
(b) Determine R, the radius of convergence. 
(c) Determine if the series converges at x = R and x = —R. 


(d) If the series converges at an endpoint of the interval of 
convergence, obtain the sum of the series at that point and then 
discuss the relationship of this outcome to Abel's theorem. 


(e) Show graphically, by plotting the first few members of the 
sequence of partial sums, that convergence in the vicinity of 
the endpoint in part (d) is uniform. 


B2. Ind +x)  B3.In(1--x? B4. V1 +x? 
B5. Inx? + 2x +1) B6. /1—x 
For the functions given in Exercises B7-16: 
(a) Obtain 37 o a,x* and Y 77 4 b,x", the Maclaurin series for 
f (x) and g(x), respectively. 
(b) Obtain 37. , ckx", the Maclaurin series for the product 
foga). 
(c) Apply c = xt. anbg-n, the product rule for coefficients, 
and show that these are indeed the coefficients found in 
part (b). 
B7. f(x) = sinx, g(x) =e B8. f(x) = cosx, g(x) = sinx 
B9. f(x) 2In(1—x), g(x) = v1 +x 


B10. f(x) = /1—x,g(x) = sinh x 

B11. f(x) = g(x) =e" 
f(x) i g(x) =e 

B12. f(x) = V1 4 x?, g(x) =In(1 + x) 


B13. f(x) = sinh x, g(x) = — 
us 


B14. 


f(x) = cosh x, g(x) = cos x 


B15. f(x) = e, g(x) — cosh x 


B16. f(x) = ——. g(x) = 


1+ 2+x 


For the functions in Exercises B17—26: 


(a) Obtain 377, azx* and Y, bx*, the Maclaurin series for 
f (x) and g(x), respectively. 


(b) Obtain Y77^ , d,x*, the Maclaurin series for the quotient 42.. 


g(x) 


(c) Compute the coefficients d; by solving the equations 
p bydx—n = ay, making sure that the results agree with 
those in part (b). 

(d) Obtain the Maclaurin series for the composition f (g(x)). 

(e) Compose partial sums of the Maclaurin series for f (x) and 
g(x), and determine if the results in parts (d) and (e) agree. 

(£) In either event, show that the expansion of the composition 
does or does not agree with the composition of partial sums of 
the expansions depending on the validity of g(xo) = yo, 
which for Maclaurin series, becomes g(0) — 0. 

B17. 


B18. 


f(x) = sinx, g(x) =e* —-1 


f(x) = sinx, g(x) = 1 — cosx 


B19. f(x) =In(2—x), g(x) = /14x 
B20. f(x) = sinh x, g(x) = /1—x 
B21. f(x) = gx) =e —1 

f(x) Tr io 4 
B22. f(x) =In(1 + x), g(x) = V1 + x? 
B23. f(x) = cosh x, g(x) = 1 — cos x 
B24. f(x) = e”, g(x) = cosh x 

x 1 

B25. f(x) = ——, g(x) = 

fe) 14x 8&9) 2+x 
B26. f(x) = arctan x, g(x) = — arccos x 


In Exercises B27—33: 


(a) Obtain the Maclaurin series for f (x) and for g(x), the 
functional inverse of f (x), defined by f(g(x)) = x. 


(b) In accordance with Theorem 9.10, revert the series for f (x) 
by solving for by, k = 1,..., via the equations generated by 
equating coefficients of like-powers of x in x = xo + 
Yu bua (x — xo)" l*. The b; should agree with the 
coefficients in the expansion for g(x) obtained in part (a), and 
the calculations are simplified since xo = 0. 


B28. f(x) =sinhx B29. f(x) =e* 
B31. f(x) =tanx B32. f(x) = — 


B27. f(x) = arccos x 
B30. f(x) = /1—x 
B33. f(x) = In(1 — x) 


]1—x 


in each of Exercises B34—43: 


(a) Obtain the Maclaurin series for both f (x) and f'(x). 


(b) Differentiate termwise the series for f(x) and show the 
resulting series agrees with the series for f’(x) found in 


part (a). 
sin x X 
B34. f(x)— B35. f(x) = 
f (x) om 35. [=a 


B36. f(x) = J2 + cos? x 
B38. f(x) = e^ cosx 


B37. f(x) = tanx 
x—1 
x4l 


B39. f(x) — 


Chapter Review 


1. Explain the difference between a Taylor polynomial and a Taylor 
series. 


N 


. Give a verbal description of just what it is that Taylor's theorem 
provides. 


3. For Taylor's theorem, illustrate the use of the Lagrange form of the 
remainder when estimating the error made by a quadratic Taylor 
polynomial. Use a function of your choice, expanded at a point of 
your choice. 

4. What is the radius and interval of convergence for a power series? 


Illustrate the use of the ratio test to find both the radius and interval 
of convergence for one representative example. 


Un 


. Detail the complication that arises when applying the ratio test to a 
power series leads to an inequality of the form p? = 
mnoo |d541/a5| « 1. 
6. Show that the power series ? ^7- n!x” converges just at x = 0. 
Hence, R — 0 defines the radius of convergence. 
7. What does analyticity mean for a real function? Give an example of 
a real analytic function. 
8. Give an example of a real function that has all its derivatives at a 


point but does not have a Taylor series converging in a 
neighborhood of that point. 


9.3 Termwise Operations on Taylor Series 


B40. f(x) = In(1 — x) 
B42. f(x) — arctanx 
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B41. f(x) = V14+x? 
B43. f(x) = arccos x 


B44. Evaluate each of the following definite integrals either 


analytically or numerically. Then, expand the integrand in an 
appropriate Taylor series and integrate termwise. Compare the 
resulting answers. 


2 2 5 
(a) l Vl+sinx?dx (b) f Inxdx — (c) f e* sine* dx 
0 1 0 


3 " 
(d) f " 
1 1 +x 


1 
dx to | e?""* cos x dx 
0 


In Exercises B45 and 46, neither of the given integrals is easily expressed 
in terms of simple functions. For each: 


(a) Evaluate F (a) numerically, exhibiting these values as a graph. 

(b) Expand the integrand in a Maclaurin series about a = 0 and 
integrate termwise. Compare graphically the two resulting 
representations of F (a). 


B45. F(a) — Jat+x3dx,0<a<2 
1 

B46. F(a) =| Vl+acosxdx,0<a< l 
0 


9. 


10. 


11. 


12 


13. 


14. 


With an example, verify the absolute convergence of a power series 
inside its interval of convergence. 

With an example, verify the uniform convergence of a power series 
inside its interval of convergence. 

Use the Taylor series for f(x) = cos x and g(x) = e^ to verify 
that termwise addition and multiplication of power series are valid. 
Show that termwise division is valid for the fraction & 


gx)" 

Use the Taylor series for xe~* to verify that inside the interval of 
convergence, a power series can be integrated or differentiated 
termwise. 


Give an example when the statement “the Taylor series of a 
composition is the composition of the Taylor series" is true. Give an 
example when it is false. What is a sufficient condition that 
guarantees the statement to be true? 


The term series reversion refers to the process of computing the 
coefficients of the power series for an inverse function from the 
coefficients of the power series of the function. If f(x) = cos x, 
obtain the Maclaurin series for its inverse, arccos x. Then, show 
how the process of series reversion can be used to construct the 
same series. 
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Chapter 10 


Fourier Series 


INTRODUCTION A Taylor series for f(x) is an infinite sum of powers 
of x, with coefficients determined by derivatives of f(x). A Fourier series for f(x) is 
an infinite series of sine and/or cosine terms, with coefficients determined by integrals of 
f (x). For general categories of functions, the convergence of a Fourier series is in the 
mean. For smooth enough functions, the convergence is pointwise and, sometimes, even 
uniform. In the absence of uniform convergence such series, sums of continuous functions, 
can represent discontinuous functions. Until adequate definitions of limit, continuity, and 
convergence were developed in the nineteenth century, Fourier's use of these series in 
solving heat transfer problems was not well received in the early 1800s. 

As with other series, we will examine the Fourier series with respect to integration and 
differentiation. 

Section 10.5 gives an example where the Fourier series is used to solve an IVP for a 
driven damped oscillator. The driving term is a periodic function that is represented by a 
Fourier series, and partial sums of this series are used as the forcing function for the motion. 
Surprisingly, the convergence of the approximate solutions so generated is quite rapid. 

The last two sections of the chapter are optional and theoretical but practical. They 
study the optimizing property of the Fourier series whereby its coefficients minimize the 
mean-square error between the function and the series. Central to this optimizing property is 
the orthogonality of sine and cosine functions. Other functions have similar orthogonality 
properties, and we show that Fourier-Legendre series can be constructed with Legendre 
polynomials. 


General Formalism 


Introduction 


In the Taylor series 


k=0 
the function f (x) is represented as a sum of powers, with coefficients determined by deriva- 


tives evaluated at a single point x = a. In a Fourier series, f (x) is represented as a sum of 
trigonometric terms, with coefficients determined by integrals of f (x) over a fixed interval. 


-2 -1 0 l 2 3 


FIGURE 10.1 Periodic extension of 
fx)2x?0zx-x«1 


»- 


=) 


FIGURE 10.2 The piecewise continuous 
function in Example 10.1 


EXAMPLE 10.1 


EXAMPLE 10.2 


EXAMPLE 10.3 
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Before stating what a Fourier series is, we need language to describe what the function 
to which it converges looks like. Hence, we define what we mean by a periodic extension 
of the function f(x) whose domain is the finite interval [a@, f]. 


PrERIODIC ExrENSION The periodic extension of f (x) whose domain is the finite interval 
[a, B] of length 2Z is a periodic function f (x) having period 2L and agreeing with f(x) 
on [a, p]. 

If the x-axis on either side of [o, 8] were divided into contiguous subintervals of length 
2L, then over each such subinterval, f (x) would look like f(x). For example, the periodic 
extension of f(x) = x?, 0 < x < 1, is shown in Figure 10.1. 


Discontinuities 


In order to define classes of functions for which a Fourier series will converge to the function 
it is supposed to represent, we review the terminology for the kinds of discontinuities a 
function f (x) can have. 


REMOVABLE Discontinuity If f(x) is continuous except at x = a where f(x) is not 
defined but b = lim,-., f(x) is a finite number, then x = a is said to be a removable 
discontinuity of f (x). 


The function f) = Pr : FS is then continuous at x — a and agrees with f(x) 
at all points where f(x) is defined. In this sense, f(x) is the same as f(x), except that the 


discontinuity of f(x) has been “removed.” (See Example 9.16, Section 9.3.) 


Jump Discontinuity If f(x) is continuous except at x = a where the one-sided limits 
lim,.,4- f(x) and lim,_,,+ f (x) both exist but are unequal, then x = a is said to be a jump 
discontinuity of f (x). 

At a jump discontinuity, the graph of the function literally jumps from one value to 
another, as, for example, in Figure 10.1. 


Piecewise Continuity 


A function is said to be piecewise continuous on the closed interval [a, b] provided it is 
continuous there, with at most a finite number of exceptions where, at worst, we would 
find a removable or jump discontinuity. At both a removable and a jump discontinuity, the 
one-sided limits f (t^) = lim,_,,+ f (x) (the limit from the left) and f (t7) = lim, .,- f(x) 
(the limit from the right) exist and are finite. 

This definition rules out, therefore, discontinuities where the function becomes un- 
bounded or has infinite oscillation. We illustrate in the following examples. 
The function f(x) = [1 : : graphed in Figure 10.2, is piecewise continuous on the 
interval [—1, 1]. It has a single jump discontinuity at x = 0. The limits from the left and 
right, at x = 0, are respectively, the finite values —1 and 1. $ 


j 1 x0. 5 : d , 
The function f(x) — | 1 i - o 1S not piecewise continuous on any closed interval that 


includes x — 0. For example, Figure 10.3 shows its graph on the interval [—1, 3]. The y-axis 
is a vertical asymptote, so the one-sided limit lim,.,9- f = co is not finite. ee 


The function f(x) = sin 1 is not piecewise continuous on any interval containing x = 0. 
The singularity is not removable since there is no limit at x = 0. Figure 10.4 suggests why. 
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The function f (x) actually takes on every value in the interval [—1, 1] an infinite number 


f 
5 of times. Therefore, near x = 0, the values of f (x) never “approach” a unique limit, so the 
| limit fails to exist. * 
| jl First Fourier Theorem 
| 
| The following theorem both defines a Fourier series, and gives conditions under which it 
1 a | > x converges to a reasonable facsimile of the function. 

-1 0 1 


2 3 


FIGURE 10.3 This function (Example THEOREM 10.1 
10.2) is not piecewise continuous 


1. f(x) and f'(x)are both piecewise continuous on the closed interval [o, P] whose 
f length is 2L. 


1 [£ 
^ 2. an =f f(x) cos 777 dx n=01,2.... 


1 B 
3. n= sf f(x) sin 7. dx 8-12 


1. Forx in the open interval (œ, 8) we have 


oo 
5 ao nux i NTX 
| Fx) = UI@H + FO = F Y (an cos 7 + b, sin =) 
T n-l 
FIGURE 10.4 This function (Example 2. lim a, = lim b, =0 
10.3) is not piecewise continuous noo noo 
f 
2 ^ The Fourier series for f (x) is the trigonometric sum in the conclusion of Theorem 10.1, 
provided the coefficients a, and b, are computed by the integrals stated in the second and 
| 1L third hypotheses. If the function obeys the first hypothesis, then Theorem 10.1 guarantees 
F the Fourier series for f (x) converges at each x to f (x), the average value of the limit from 
| . " . . . . i3 
| 0 H + >x the left and the limit from the right. At any point where f (x) is continuous, f (x) = f(x). At 
| 1 2 3 4 5 " s . NP. 5 s 
points where a jump discontinuity in f (x) occurs, the Fourier series converges to the average 
l of the left and right limits. No statement is made about convergence at the endpoints of the 


FIGURE 10.5 The piecewise continuous interval. However, outside the interval [œ, 8], the Fourier series converges to the periodic 
function of Example 10.4 extension of f(x), not f (x). 
The second conclusion of the theorem is generally called the Riemann—Lebesgue 
lemma, and it states that the Fourier coefficients a, and b, tend to zero as n increases. 


1 


EXAMPLE 10.4 We consider the function Js= l. -H - E N s : defined on the interval [1, 4] and graphed 


in Figure 10.5. 


THE FOURIER SERIES For the interval [1, 4] we have 2L = 4 — 1, so L = 3. The first 
coefficient, ay = : Ji f(x)dx = 5, is computed separately. Then, 


2n sin Sax + 3 cos Snr —3 sin inn 


2n?z? nz 


a 9 
3 sin nm — 2 cos nz cos gna — 2 
2 3 


2n?z? nz 


| 2 [' resem Pam 
s z X)cos -nmax dx = 
| 3 Ji 3 


2 ft 2 
b, = d f (x) sin qu dx = 
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f The n in the denominators of both a, and b, suggest they decrease in magnitude. The 
A Riemann-Lebesgue lemma, in fact, guarantees that valid Fourier coefficients must tend to 
zero as n gets large. However, the more slowly the coefficients tend to zero, the more terms 

"1 P it will take for a partial sum of the series to represent the function adequately. 
————Há— wA The Ath partial sum is given by Sk = 9+ Ye (an cos ^7 +b, sin “*); the partial sum 
P corresponding to k — 3 and the function f (x) are graphed in Figure 10.6, the approximation 
1 2 3 I ™ * as the dotted curve and the function as the solid. As noted, the slow convergence of the 
Fourier coefficients to zero suggests we will need many terms to approximate f(x) more 

closely. Thus, we draw Figure 10.7, showing f (x) along with S100. 

FIGURE 10.6 The partial sum $3 and the Each partial sum of the Fourier series is a sum of continuous functions and is hence 
function of Example 10.4 continuous. Thus, Figure 10.7 shows the partial sum, the dotted line, as a continuous func- 
tion. A nearly vertical dotted line is drawn at x — 3. However, in conformity with Theorem 
10.1, at x — 3 the Fourier series converges to the average value of the one-sided limits 


f across the jump, namely, to H2 = h, whereas the partial sum has value 0.5015122679. 


s 


T THE PERIODIC ExrENSION Itis instructive to plot the partial sum of the Fourier series 
outside the interval over which it was calculated. Figure 10.8 shows S100 plotted on the 
Lie interval [—2, 7]. The Fourier coefficients, and hence the Fourier series, reflect values of 
d the function f (x) on the interval for which the integrals were defined. If the Fourier series 

>» x is evaluated outside this interval, the periodicity of the sine and cosine functions in the 

Fourier series yields a periodic function. The Fourier series converges to Ô (x), the periodic 


w 
A 
at 


-1+ extension of f (x), the limit of the Fourier series on [1, 4]. 


FIGURE 10.7 The partial sum S10 and 
the function of Example 10.4 


THE Grsss PHENOMENON In the neighborhood of a discontinuity of f(x), the Fourier 
series cannot converge uniformly. Since each partial sum is a sum of continuous functions, 
if the convergence were uniform, then, by Theorem 8.8, Section 8.5, the limiting function 
would be continuous. But the limit function is not continuous at a jump discontinuity, so 
the convergence cannot be uniform in a neighborhood of such a discontinuity. 
The nonuniformity of the convergence near a discontinuity is manifested by the “spikes” 
seen in the graphs of the partial sums. These “overshoots” persist for all values of n, with 
* the location of the spike simply shifting closer to the point of discontinuity. In fact, the 
height of the overshoot tends to a value proportional to the jump at the discontinuity. The 
proportionality factor is dependent on the function. 
FIGURE 10.8 The partial sum S1oo for Figure 10.9 illustrates this behavior, called the Gibbs phenomenon, for the partial 
Example 104 sum $3 from Example 10.4. The local maximum in Figure 10.9 occurs at (2.557942578, 
1.083586807). Since the height of the jump is 1, the overshoot in $5 is approximately 
0.0835, or a bit less than 9%. 
$5 Repeating the experiment with the partial sum S100, we find the local maximum closest 
to x — 3in Figure 10.10 to be located at (2.985054260, 1.089318304). Here, the overshoot 
1T is approximately 0.089, or roughly 9% of the value of the jump in f(x) at x = 3. 
Figure 10.11 contains both 55 (dashed) and S100 (solid), thereby showing how the over- 
shoot retains a fairly constant height but moves closer to the point of discontinuity. e 


The Usual Formalism 


Typically, the defining interval for the Fourier series is taken as the symmetric interval, 


zl ; i > x [—L,L]. The formulas for the Fourier coefficients are then 


-— ]-f* nzux | f^ . NIX 
FIGURE 10.9 Example 10.4’s Gibbs Gn = — Í f (x) cos — dx p= — J f (x) sin dx 
phenomenon illustrated by 53 L J L LJ. L 
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EXAMPLE 10.5 


+ >x 
2 3 


FIGURE 10.12 Periodic extension of the 
function in Example 10.5 


Sio 
A 
2T 
1 
F— Hi 
0 l 


FIGURE 10.13 Example 10.5's Gibbs 
phenomenon illustrated by S10 
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S100 Ss 
A A 
it it 
es —— I» x 
ol “x9 292 294 296 298 3 0 ui 3 
FIGURE 10.10 Example 10.4's Gibbs FIGURE 10.11 S; (dashed) and S100 


phenomenon illustrated by S100 (solid) for Example 10.4 


with the Fourier series itself remaining 


"E . _ a nItx 
f(x) = sl ft) + fa- = z + > (a, cos —— 


On the interval [—1, 1], let us obtain the Fourier series of the function f(x) =x +1. 
For this interval, L = 1, so 


1 
ao =f (x + 1)dx 22 
-] 


1 
Qh = i (x + 1) cosnax dx = 0 


1 
b, = J (x + D sinnzx dx = —2(—1)"/nz 


By inspection, we can see that b, — 0 slowly, as L, so it will take a large number of terms 
to obtain a good approximation to f(x). 

Anticipating a second Fourier theorem that concludes this section, we observe that at 
the endpoints, the series converges to the midpoint of the jump discontinuity in Ô (x), the 
periodic extension of f (x), which is shown in Figure 10.12. The Fourier series converges 
to 1 at both endpoints where we find y — 1 to be the midpoint of the jump in the periodic 
extension. 

The Gibbs phenomenon, the overshoot in the partial sum at both endpoints where 
there are discontinuities in the periodic extension, can be seen in Figure 10.13, which 
displays the partial sum S10. The local maximum just to the left of x = 1 is at (0.9090909091, 
2.086692509). Since f (1) = 2, the overshoot is roughly 4.33%. $ 


Second Fourier Theorem 


One-S1pDED Derivatives’ The function f(x) = x??? is defined and differentiable for x 


in [0, co). At x = O the derivative is taken via a limiting process that approaches from 


į £O+h)— FO 


the right. Indeed, at x = 0 the difference quotien is vh and the limit as h 


approaches zero must be taken from the right, through the positive values of h, giving zero. 
The derivative obtained by evaluating a one-sided limit of the difference quotient is called a 
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one-sided derivative and is denoted by either fj or ff, depending on whether the derivative 


FIGURE 10.14 Amplitude spectrum for 
f(x) =x 


EXERCISES 10.1—Part A 


is from the right or left, respectively. 


THEOREM 10.2 


1. /f(x)is piecewise continuous on the closed interval [—L, L]. 
E 


= 


At any x in (—L, L) where f (x) has both a right and a left derivative, the Fourier 
series for f (x) converges to SL f Gc) + f(x-)]. 


2. If f; (—L) and f, (L) both exist, then at —L and L the Fourier series for f (x) 
converges to SL f(-L+) + f(L—)]. 


Thus, if the function f (x) is sufficiently well behaved, then its Fourier series converges 
at any jump in the periodic extension to the average value across that jump. 


Fourier Series: A Perspective 


The Fourier series is a remarkable object. A sum of continuous and periodic functions 
converges pointwise to a possibly discontinuous and nonperiodic function. This was a 
startling realization for mathematicians of the early nineteenth century. Even more startling 
is the realization that a smooth function can be expressed as a sum of the waveforms sin nx 
and cosnx. Just as a musical note is composed of a sum of a fundamental note and its 
harmonics, a function is the sum of the same waveforms as the musical note! 

This means a function, like a musical note, can be described by the strength, or am- 
plitude, of each “harmonic” its Fourier series contains. For example, consider the function 
f(x) =x, —m € x € z, whose Fourier series is —2 2 ((—1)"/n) sin nx. Once the fre- 
quencies w, = n are specified, the function is determined by the spectrum of amplitudes 
b, = —2(—1)"/n. 

Hence, the amplitude spectrum shown in Figure 10.14, a bar graph of amplitudes for 
f (x), is as much a representation of f(x) as its ordinary graph. Each bar is centered on 
a frequency w, = n and its height is proportional to the coefficient of the corresponding 
“waveform” sin nx in the Fourier series. 

In Section 30.3, the notion of the amplitude spectrum is generalized by the Fourier 
(integral) transform to the case of a continuous spectrum of frequencies. 


AI. Obtain the Fourier series for f(x) = 1 — x, —1 € x < 1, and 
show that a, and b, go to zero as n increases. 


A2. Sketch f(x), the function to which the Fourier series in Exercise 
A] converges on [—1, 1]. Sketch f (x), the periodic extension of 


f(x). 


43. Obtain the Fourier series for f(x) = (x — 1)?, 1 < x < 2, and 


A4. Sketch f(x), the function to which the Fourier series in Exercise 
A3 converges on [1, 2]. Sketch f(x), the periodic extension of 


f(x). 


" x " " & 0 — (c0 
A5. Obtain the Fourier series for f(x) = E URS 


1—-x Osx <0" 
investigate the Gibbs phenomenon at x = 0. 


and 


show that a, and b, go to zero as n increases. 
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EXERCISES 10.1—Part B 


B1. 


According to [97], the series $?c, anir converges for all x. 


According to [93], it is not a Fourier series since there i E no 
function whose Fourier coefficients are given by b, — n z- Plot a 
few partial sums of this series to verify the claim of convergence. 


In Exercises B2-17, a function and its domain is given. For each: 


B2. 


B3. 


B4. 


BS. 
B6. 
B7. 


B8. 


B9. 


B10. 


(a) Sketch f(x) on the indicated domain. 


(b) Obtain the Fourier series valid on the given interval [o, 8] of 
length 2L. 


(c) Verify the Riemann-Lebesgue lemma, which states that 
lim; .s5 ay = HM ges, by z 0. 

(d) Obtain and plot enough partial sums of the Fourier series that 
convergence to the given function is apparent. 


(e) Show that at points where the function has a jump 
discontinuity, its Fourier series converges to the average of the 
left and right limits at the jump. 


(f) By plotting a partial sum on the interval [—2L, 4L], show that 
the Fourier series converges to the periodic extension of the 
given function. 

(g) At points where a jump discontinuity generates a Gibbs 
phenomenon, determine the maximum height of the Gibbs 
overshoot and express it as a percentage of the amount of the 
jump. 


(h) Verify, analytically or numerically, the identity a + 


De (a? + bp = 1 f. f?(x) dx, known as Parseval’s 
identity. 


A [x O0Ozx«1 " , 
f@)= h ju with domain [0, 2] 
a ple Use. . 2 
fœ) = | er with domain [0, 2] 
~ f@-b? 0<x<1 . : 
fœ) = | 0 1p with domain [0, 2] 
(x—1? 0<x<1 ; ; 
f(x) = | ! arep with domain [0, 2] 
f(x) = |x — 1|, with domain [0, 2] 
" 1—x syel à 
P= ^ Gs) isse with domain [0, 3] 
x Garel 
f= l 1 € x < 2, with domain [0, 3] 
3—-x 2<x<3 
x Ugal 
f(x)=41 1zxx«2,with domain [0, 3] 
0 2Zex*x3 
0 Gral 
f= 1 1 € x < 2, with domain [0, 3] 


3-x 


2B 


1-x O<x<l 
B11. f(x) = 0 1 <x «2, with domain [0, 3] 
x-2 28xs€98 
0 0x] 
B12. f(x) = 1x—-DG3-x) 1<-x <3, with domain [O, 4] 
0 3<x<4 
x2 O0O<x <1 
B13. f(x) = 1 1 € x «2, with domain [0, 3] 
(x—3)? 2<x<3 
0 O<x<l 
B14. f(x) = 11 1<x <2, with domain (0, 3] 
0 2<x%<3 
D 024262 
B15. f(x) 2 41 2zx <3, with domain [0, 4] 
0 3<x<4 
x(2 — x) 0<x <1 
B16. f(x) = 1 1 € x «2, with domain [0, 3] 
4x-3-x? 2<x<3 
x2—x) Ox<x <1 
B17. f(x) = 1 1 <x <2, with domain [0, 3] 
(x—3? 2<x <3 


In Exercises B18—37, a function and a domain is given. For each: 


(a) Sketch f(x) on the indicated domain. 

(b) Obtain the Fourier series valid on the interval —L < x < L. 

(c) Verify the Riemann-Lebesgue lemma, which states that 
limo ay = limk o by = 0. 

(d) Obtain and plot enough partial sums of the Fourier series that 
convergence to the given function is apparent. 


(e) Show that at points where the function has a jump 
discontinuity, its Fourier series converges to the average of the 
left and right limits at the jump. 

(f) By plotting a partial sum on the interval [—3L, 3L], show that 
the Fourier series converges to the periodic extension of the 
given function. 

(g) At points where a jump discontinuity generates a Gibbs 
phenomenon, determine the maximum height of the Gibbs 
overshoot and express it as a percentage of the amount of the 
jump. 

(h) Verify, analytically or numerically, the identity X + 
De (a? +b?) = + f^, £2 (x) dx, known as Parseval’s 
identity. 

B18. f(x) = |x|, with domain —1 < x < 1 
B19. f(x) = x?, with domain —1 
B20. f(x) = 


z 


x°, with domain -1 < x < 1 


B21. 
B22. 


B23. 


B24. 


B26. 


B27. 


B28. 


B29. 


B30. 


B31. 


| 
| 
| 
| 
| 
| 
| 
i —2<x<-l 
| 
| 
| 
| 


f(x) 21-|x|, with domain —1 < x x 1 


" 1 -1x» Ü ox , 

fix)- E 0 = y cp With domain —1 =x <1 
—1 (c0 . i 

F= ia Qe. cp With domain —1 <x < 1 

fx)- 0 =e a0 iiion ex 


0O<x<1 


—m<x<0 


epa , with domain —r € x € x 
E 


0 -rn <x<0 


, with domain —7 < x € x 
O<x<az 


—rm<x <0 


, with domain —7 <x «€ x 
0<2 <7 


= <x . . 
lá pn <0 with domain —2<x<2 
1—|x — 1| 0zxz2 
0 -l<x<0O 


" , with domain —1 < x x 1 
e* O<x<1 


1 —2<x<-l 


x? -1<x <1 ,with domain -2 <x x 2 


1 l<x<2 


—2<x<-l 


x —]zx«1 ,withdomain —2 < x x2 


1 1<x<2 


l<x <2 


x<-l 
x«l ,with domain -2x x <2 


, with domain —2 < x <2 


, with domain —2 < x <2 


2<x<-l 
, with domain —2 < x <2 


x -l<x<l 
1x52 


Integration 


10.2 Termwise Integration and Differentiation 


B37. 


B38. 


B39. 
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—1 —2 <x < -l1 
fx)- ¥ -l<x<l 
2—x lsx 2 


, with domain —2 < x < 2 


Any trigonometric series that converges uniformly represents a 
function whose Fourier series is the given trigonometric series 
[35, p. 466]. The trigonometric series » ^, sin kx is not a Fourier 
series because the Riemann-Lebesgue lemma fails. Surprisingly, 
the trigonometric series )°?° , son is not a Fourier series of a 
Riemann-integrable function because $7; b; = Pai 
diverges. It can be shown (see [65, p. 533]) that for 

ie e mH = leo the series converges. By graphing some 
partial sums of this series, discover why convergence is to a 
function that is not Riemann integrable, that is, to a function 
whose Riemann integral does not exist. (The Riemann integral is 
the integral learned in elementary calculus.) 


One of the key steps in proving the convergence of the Fourier 
series is showing that ; TOYXLaOcoskx = Un — D(x), the 
Dirichlet kernel. This equality can be established as follows. 

(a) Since 2cos Asin B = sin(A + b) — sin(A — B), it follows 


„n~ — SinQk-4-1)e—sin(2k—1)o« 
thatcos2ka = e m, 


(b) i cos 2ka = 3a Doi (Sin(2k + 1)e — sink — 1)a) = 
snQktDa-s55C9) because the sum of sine terms telescopes. The 


desired result is now immediate if a = 2. 


(c 


— 


Graph the Dirichlet kernel for several values of n to see how it 
behaves. 


(d) It can be shown that the partial sums of the Fourier series for 
f (x) on [—7r, x] are given by S, (x) = 
xl, DWS +u) du = if. r Je + u) du. 
Unfortunately, even for the function f(x) = 1, this integral 
cannot be evaluated analytically. (Its value is precisely the 
sum of terms found in the corresponding partial sum!) 
However, for any function in Exercises B2-37, it would be 
possible to fix n and compute S, (x) numerically for enough 
values of x that a graph could be drawn. Compare the graphs 
of the partial sums obtained in Exercise B7 with the numeric 
evaluation of the corresponding integral defining S, (x). 


Termwise Integration and Differentiation 


Integration is a smoothing process, and under very mild hypotheses it is valid to integrate 
a Fourier series termwise. In fact, we have the following theorem. (See, e.g., [35]. 
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EXAMPLE 10.6 


IA x 
-1 0 1 


FIGURE 10.15 F(x) (solid) and partial 
sum (dashed) in Example 10.6 


Fourier Series 


THEOREM 10.3 INTEGRATION 


1. f(x) is piecewise continuous on [—L, L]. 


2. - + 2 (an cos — +b, sin T) is the Fourier series associated with f (x) 
on [—L, L] 

3. xisin[—L, L] 

= 


oo 


T di a To L 5 1 | SNAK P ( nax )] 
= —(x — — |a, sin —— — b, (cos —— — cosnz 
ni dn 2 P T n L L 


n-l 


The expression on the right in the conclusion is obtained by termwise integrating the 
Fourier series. Under the assumption that f (x) is merely piecewise continuous, this series 
need not converge to f (x), yet the termwise integral of the series converges to the integral 
of the function. 


Consider the function f (x) = x + 1 on the interval [—1, 1]. Its Fourier series, obtained in 
Section 10.1, is 


2 e —1)” 
f(x)21-— E» sin NIX 
A 


n 


(10.1) 


n=1 
The integral of f(x) is F(x) = fe f(t)dt = 5 +x+ ix^, for which the Fourier series is 


oo 


2. 2 — (I 2 (I . 
F(x)= [i e c 10.2 
(x) 3 + =) 3 z COS ATX » 2, : sin ATX ( ) 
Termwise integration of the Fourier series for f(x) yields 
E pe E 2 es (-1)" cosnax — 1 
1-—— sinnat|dt=x+1+ 10.3 
f. ( T > E IT xdi gr? 2 n? ia 


Figure 10.15 shows a partial sum of the series on the right in (10.3) (dashed) and F (x) 
(solid), graphically validating the termwise integration. To make the right side in (10.3) 
look like the Fourier series for F(x) in (10.2), replace x + 1 with its Fourier series (10.1) 
and split the sum into two terms, obtaining 


>= - Ty! $ aw 19" 1 
= sinnzx-—- 7— COSATX — — = 
22. "tui og 2». 


n 
n-l n=1 n=1 


(10.4) 


The rightmost term (10.4) evaluates to -i, so (10.2) and (10.4) are actually the same. e 


Differentiation 


Termwise integration of a Fourier series is valid under mild restrictions, as we have just seen. 
Termwise differentiation requires as much more in the way of hypotheses as termwise inte- 
gration required less. Indeed, a theorem validating termwise differentiation is the following. 
(See, e.g., [35].) 


THEOREM 10.4 


10.2 Termwise Integration and Differentiation 


DIFFERENTIATION 


1. f(x) is continuous, and f'(x) is piecewise continuous on [—L, L]. 


2. f(L) = f(-L) 


3. f(x) exists at x in (—L, L). 


oo 
T . nnunx nax 
=> Joy = T ) ^( an Sin i H b, cos 1 ) 


n=1 


The series on the right is precisely the series obtained by termwise differentiation of 
the Fourier series for f (x). 


EXAMPLE 10.7 


The function f(x) = x?, =x < x < x, satisfying the hypotheses of Theorem 10.4, has 


2 oo n 
fera T " Ax — ibi md (10.5) 
as its Fourier series. The Fourier series for 2x, the derivative of f(x), is 
e CD. 
2x — um : sin nx 
which is exactly the termwise derivative of (10.5). $ 


EXERCISES 10.2 


1. Show formally that if f (x) has a convergent Fourier series on 
[77, x], then + f7, f? dx = 2 + V (a2 + b2). (This result is 
known as Parseval's identity.) 
Exercises 2-17 use the functions of Exercises B2-17 in Section 10.1. For 
each: 
(a) Obtain the function F(x) = fj f(t)dt,0 € x € 2L. 
(b) Obtain the Fourier series for F (x). 
(c) Termwise integrate the Fourier series for f (x). 


(d) Use graphs of the partial sums of the series obtained in part (c) 
to determine if termwise integration of the Fourier series was 
valid. 


(e) What can be said about convergence at points of discontinuity 
of f (x)? 
(f) If the evidence in part (d) is positive, show analytically that the 


Fourier series for the antiderivative is the termwise 
antiderivative of the Fourier series for f (x). 


(g) Comment on the applicability of the theorem governing 
termwise integration of a Fourier series. 


(h) Obtain the function f'(x). 


(i) Obtain the Fourier series for f'(x). 


(j) Termwise differentiate the Fourier series for f (x). 

(k) Use graphs of the partial sums of the series obtained in part (j) 
to determine if termwise differentiation of the Fourier series was 
valid. 

(1) If the evidence in part (k) is positive, show analytically that the 
Fourier series for the derivative is the termwise derivative of the 
Fourier series for f (x). 

(m) Comment on the applicability of the theorem governing 
termwise differentiation of a Fourier series. 
Exercises 18—37 use the functions of Exercises B18—37 in Section 10.1. 
For each: 

(a) Obtain the function F(x) — f f(t)dt, -L <x xL. 

(b) Obtain the Fourier series for F (x). 

(c) Termwise integrate the Fourier series for f (x). 

(d) Use graphs of the partial sums of the series obtained in part (c) 


to determine if termwise integration of the Fourier series was 
valid. 


(e) What can be said about convergence at points of discontinuity 


of f(x)? 
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(f) If the evidence in part (d) is positive, show analytically that the (k) Use graphs of the partial sums of the series obtained in part (j) 
Fourier series for the antiderivative is the termwise to determine if termwise differentiation of the Fourier series was 
antiderivative of the Fourier series for f (x). valid. 
(g) Comment on the applicability of the theorem governing (I) If the evidence in part (k) is positive, show analytically that the 
termwise integration of a Fourier series. Fourier series for the derivative is the termwise derivative of the 


(h) Obtain the function f'(x). 


(i) Obtain the Fourier series for f'(x). 


Fourier series for f (x). 


(m) Comment on the applicability of the theorem governing 
termwise differentiation of a Fourier series. 


(j) Termwise differentiate the Fourier series for f (x). 


r— 
1 


0 
(b) 


FIGURE 10.16  Prototypical even 


functions: cos x and x? 


EXAMPLE 10.8 


) Odd and Even Functions and Their Fourier Series 


Even and Odd Symmetry 


Functions with certain symmetry properties are called either even or odd functions. The 
Fourier series for such functions assume particularly simple forms. 


Even Functions A function f (x) is said to be even if it exhibits the symmetry expressed 
in the relationship f (—x) = f (x). The prototypical even functions cos x and x? are shown 
in Figure 10.16. 


Opp Functions A function f (x) is said to be odd if it exhibits the symmetry expressed 
in the relationship f(—x) = — f (x). The prototypical odd functions sin(x) and x? are 
shown in Figure 10.17. 


(b) 
FIGURE 10.17 Prototypical odd functions: (a) sin x and (b) x? 


Fourier Series of an Even Function 


Special things happen when you compute the Fourier series of an even function over 
[—L, L]. The integrals with cos T can be taken over half the interval and doubled. The 
nzx 


integrals with sin ^7 are all zero. 


On the interval [—2, 2], let f (x) be the even function f(x) = x?. From Figure 10.18, which 
shows graphs of f(x) times a cosine and times a sine, we suspect that an even function 


times an even function yields an even function but an even function times an odd function 
yields an odd function. A general proof is left to the Exercises. 


(b) 
FIGURE 10.18 Graphs of (a) x? cos 3x, 


and (b) x? sin 3x 
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Moreover, we recall from calculus that when integrating functions with appropriate 
symmetry, we can use the symmetry to “balance areas” when setting up the integrals. When 
. . . r zd 
integrating the even function, we can use the rule f^. evendx = 2 f, evendx and when 
integrating the odd function we find f”, odd dx = 0. 

Applying both these observations to the computation of the Fourier coefficients of the 
even function f(x) = x? we find 


1 2 2 " 8 
= i eax= f x“ dx == 
2 J2 0 3 


D$" 1 dsl (—1)" 
an => x^ cos -nzx dx = x^ cos 2nzx dx = 16——— 
2 0 2 n?n? 


9$. 
ksd 


| 
p = J x? sin Paid dx =0 


Summary For an even function, only the even terms survive in the Fourier series. The 
coefficients of the odd terms are all zero. Even functions have a cosine series. Symmetry 
allows the a,,’s to be computed by integrating over [0, L]. The Fourier series for the even 
function is 


oo L 
Pi » 
F@)= 2 4 a cos 77 where a -i] f(x) cos = dx, n — 0,1,2,... 


n=1 


Fourier Series of an Odd Function 


Special things happen when you compute the Fourier series of an odd function over [—L, L]. 


The integrals with sin “}* can be done over half the interval and doubled. The integrals with 
cos “F* are all zero. 


On the interval [—2, 2], let f (x) be the odd function f(x) = x. From Figure 10.19, which 
shows graphs of f (x) times a cosine and times a sine, we suspect that an odd function times 
an even function yields an odd function but an odd function times an odd function yields an 
even function. Again, verification is left to the exercises. 


(a) 


FIGURE 10.19 Graphs of (a) x cos 3x, and (b) x sin 2x 
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Further, recalling the “rules” s even dx = 2 hi even dx and a odd dx = 0, we find 
the Fourier coefficients of the odd function f(x) = x to be 


7 


1 l 
ajo = zS xdx —0 
1 1 
an = = x cos -nzx dx =0 


1 1 a 1 —1)" 
b; = J x sin 2nzx dx = / x sin —nzx dx = i ) 
= 2 0 2 


2 p 4 nim 


e. 
KSA 


Summary For an odd function, only the odd terms survive in the Fourier series. The 
coefficients of the even terms are all zero. Odd functions have a sine series. Symmetry 
allows each b, to be computed by integrating over [0, L]. The Fourier series for the odd 
function is 


oo . i 
TI 2 TX 
fx)- ) b, sin T where b, = L [ f (x) sin E d = baye 


n=l 


EXERCISES 10.3—Part A 


A1. Justify analytically each of the following statements. A4. Determine if each of the following statements is true or false, and 
(a) The product of two odd functions is an even function. give justification for your conclusion. 
(b) The product of two even functions is an even function. (a) The sum of two odd functions is an odd function. 
(c) The product of an odd and an even function is an odd function. (b) The difference of two odd functions is an even function. 
A2. Verify analytically that (c) The sum of two even functions is an even function. 
(a) sin Es, for any k = 1,2,..., tenn odd function: (d) The mind of She n functions 1s un Wim T 
(b) cos ke. for any k = 0, 1,2, ..., wan evenfinction. (e) a of an odd function and an even function is an odd 
A3. Determine whether each of the following functions is odd, even, or e" "E MNA 
neither. Give evidence for your declaration (f) The sum of an odd function and an even function is an even 
function. 


(a) f(x) 2 e'sinx (b) f(x) = e^! cosx ph o. — 
(g) The difference of an odd function and an even function is an 


(c) f(x) = rpm (d) f(x) = DA (e f(x) = = - odd function. 
— x? =x x? 
(f) f(x) =sin(cosx) (g) f(x) = cos(sin x) (h) The sum of two odd functions is an even function. 
h f(x) 2e-* i) fo) eil F(x) = sin? x (i) The difference of two odd functions is an odd function. 
k) f(x) =x+sinx M) f(x) 2 x —cosx (j) The sum of two even functions is an odd function. 
Gm) fücxma? W fh x? + wan (k) The difference of two even functions is an even function. 
(0) f(x) = sin(x + e*) 
EXERCISES 10.3—Part B 
B1. Using numeric integration implemented with appropriate The functions in Exercises B2—9 are either odd or even on the indicated 
technology, obtain the Fourier series for f(x) =e, domains. For each: 


—1 € x < I. Graph f (x) and a partial sum to verify the 

correctness of your calculations. Graph this same partial sum on 
[—3, 3] to see f(x), the periodic extension of f(x), the limit of 
the Fourier series on [—1, 1]. 


(a) Obtain the Fourier series without using the relevant symmetry 
property. 


(b) Identify the symmetry as odd or even, and obtain the Fourier 
series via the formulas for functions with such symmetry. Be 
sure the results in parts (a) and (b) agree. 

(c) Sketch, on [—3L, 3L], the function to which the Fourier 
series converges. 


B2. f(x) = 1 — x?, with domain —1 < x < 1 
x7-1 -1l=x <0 
B3. mal? ~ - , Wi in-l<x< 
3. f(x) -— (india se] with domain —1 < x < 1 
B4. f(x) 2|sin(x),—17 €x € x 
2+x —2<x<-l 
Bs. f(x) = 1 —l<x<1_ ,withdomain —2 < x x 2 
2—x Leya 
(x +13 +x) -3<x<-l 
B6. f(x) = 0 —]zx-«1 ,with domain 
(x — 1) — x) 12g a3 
—3 <x <3 
B7. f(x) 2e", -1«x x1 
2—x 2<x<-l 
1 -l<x <0 " . 
B8. f(x) = =*<"" with domain 22 < x <2 
1 0O<x< 
2—x Dx 2 
3—x 3<x<-l 
B9. f(x) = x=} -IsxaD with domain —3 < x <3 
RW P O<a=<1 ’ = 
3—-x ]sx-3 


Determine if each function given in Exercises B10—29 is an odd 
function, an even function, or neither an odd nor an even function. 


Motivation 


For each odd function, show that a; = 0, k = 0,1 


10.4 Sine Series and Cosine Series 
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and b, = 


2 i f(x)sin "7 dx. For each even function, show that b, = O, 
=D: E anda, — 2 i f(x) cos "7 dx. 
B10. f(x) from Exercise B18, Section 10.1 


. f (x) from Exercise B33 


. f (x) from Exercise B37 


. f (x) from Exercise B19, 
. f (x) from Exercise B20, 
. f (x) from Exercise B21, 
. f (x) from Exercise B22, 
. f (x) from Exercise B23, 


. f (x) from Exercise B24 


. f(x) from Exercise B31, 


. f (x) from Exercise B32, 


Sine Series and Cosine Series 


Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 


, Section 10.1 
. f (x) from Exercise B25, 
. f (x) from Exercise B26, 
. f (x) from Exercise B27, 
. f (x) from Exercise B28, 
. f (x) from Exercise B29, 


. f (x) from Exercise B30, 


Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 
Section 10.1 


, Section 10.1 
. f (x) from Exercise B34, 
. f (x) from Exercise B35, 
. f (x) from Exercise B36, 


Section 10.1 
Section 10.1 
Section 10.1 


, Section 10.1 


If f(x) is an even function on [—L, L], its Fourier series will contain just cosine terms; 
whereas if f (x) is an odd function on [—L, L], its Fourier series will contain just sine terms. 

Alternatively, suppose you have the function f (x) defined on [0, L] and you want a 
Fourier series for it containing just cosine terms. Extend f(x) to a function g(x) that is 
even on [—L, L], and get the Fourier series of g(x). It will contain only cosine terms and 


represent f (x) on [0, L]. 


Likewise, suppose you have the function f (x) defined on [0, L] and you want a Fourier 
series for it containing just sine terms. Extend f (x) to a function g(x) that is odd on [—L, L], 
and get the Fourier series of g(x). It will contain only sine terms and represent f(x) on 


[0, L]. 


In each case the function g(x) is called an extension of f (x). 


General Extension 


The function g(x) is an extension of f (x) if g(x) = f (x) on the domain of f (x), but g(x) 


has a bigger domain. 
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& + 
‘ , 
N , 
^ ^ 
b ar 
+ E— "ai —] 
-2 -1 0 l 2 


FIGURE 10.20 f(x)-1xx-xl, 
(dashed) extended to g(x) (solid plus 
dashed) 


EXAMPLE 10.10 


2 


FIGURE 10.21 g(x) (solid), the odd 
extension of f (x) (dotted) in Example 
10.10 


EXAMPLE 10.11 


For example, on the interval [—1, 1] let f (x) be the function f(x) = x? and define 


1 x«-1 
g(x) = x? —-1xx«1 
: Isg 


embedding f(x) = x? as part of its definition. Figure 10.20 shows a graph of g(x), where 
the portion common with f (x) is dashed. The function g(x) agrees with f(x) wherever 
f (x) is defined, but the domain of g(x) is larger than the domain of f(x). Thus, g(x) is an 
extension of f (x). The functions agree where they have a common domain but g(x) has a 
bigger domain. 


An odd extension Let f(x) = x? with domain [0, 1]. The goal is to extend f(x) to a 
new function G(x) that then has domain [—1, 1] and is an odd function on [—1, 1]. The 
general recipe for extending f(x), defined on [0, L], to G(x), an odd function on [—L, L], 
is given on the left in (10.6). Applied to f(x), it yields the rightmost member of (10.6), the 
extension g(x) that is graphed in Figure 10.21 

—f(-x) -L<x<0 =% -lz 


G(x) = => gal" 3x30 — a06 
H=] feo  OzxzL PE dura i 


FOURIER SINE SERIES The Fourier series of the odd function G(x) is given by 


Ga Pg . nux h b 2 f* me uem L2 
icy ha I where =f f (x) sin T x ae E 

It is not a mistake to put f(x) into the integral for the coefficients b,. Since G(x) is f (x) 
in the interval [0, L], we can write f(x) in place of G(x) for that interval. Moreover, on 
the interval [0, L], if the Fourier series represents G(x), then it also represents f (x) on that 
interval. 

A Fourier sine series for the function f(x) = x7, valid on the interval [0, 1], is obtained 
by a computation of the coefficients that does not require us to use a representation of the 
extension g(x). In fact, we find 
Pat iF 


n?m? 


1 
J xw 
b, = Í x^sinnzx dx = 4 
0 


nT 


CowcLUsION Given f(x) defined on [0, L], you can obtain its Fourier sine series by 
extending f (x) to the interval [—L, L] as the odd function G(x) and obtaining the Fourier 
series of g(x). This Fourier series represents both f (x) and G(x) on the interval [0, L]. In 
practice, the extension to G (x) need not be made because the sine series can be computed 
by integrating f(x) over the interval [0, L]. 4 


An even extension Obtain the Fourier cosine series for the function 


O0<x<l 
x lex =2 


fide, 


defined on the interval [0, 2] and graphed in Figure 10.22. To end up with a cosine series, 
form the Fourier series of an even function. Hence, extend f(x) to [—2, 2] as the even 
function g(x). The general recipe for extending f(x), defined on [0, L], to G(x), an even 
function on [—L, L], is given on the left in (10.7). Applied to f(x), it gives the rightmost 
member of (10.7), the extension g(x), graphed in Figure 10.23 
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10.4 Sine Series and Cosine Series 


f 2+x —2<x<-l 
1 f(-x) -L<x< —x -l<x< 
G = 4 a(x) = ER . 
(x) | f(x) O<x<L = gd x x<(0<1 aa 
2—x I «x32 


Again, we repeat that it is not necessary to have an explicit formula for G(x) in order 
to obtain the required Fourier cosine series for f(x). The Fourier cosine series for f(x) 
coincides with the series for G(x), which can be obtained via the recipe 


+ > X 


0 1 2 


FIGURE 10.22 The function f(x) of 


Example 10.11 2 


co L 
ao nax . nux 
G(x) = E + dt cos E where a, = al f (x) cos E & n=1,2,... 
g ne 
On the interval [0, L], the interval over which the integration is performed, g(x) agrees 
with f (x), soto get the Fourier series for G(x) you can use the values provided to the integral 
by f(x). We never needed an expression for G(x) at all. Thus, the Fourier coefficients are 


— ! >x 2 2 nux 4 nz 
a9, =] 0 1 9 ao =i f(x)dx =1 An af f (x) cos zm dx == (2 cos — (-1)" — 1) 
Zz nm Zz 
FIGURE 10.23 g(x), the even extension 9 3 
of f (x) in Example 10.11 $ 


EXERCISES 10.4—Part A 


Al. Given f(x) =x,0<x <1: 
(a) Sketch g(x), the even extension of f (x). 
(b) Sketch the even periodic extension of f (x). 
(c) Sketch the odd extension of f (x). 
(d) Sketch the odd periodic extension of f (x). 
(e) Obtain a Fourier cosine series for f (x). 


(f) On [—3, 3], sketch the function to which the series in (e) 
converges. 


EXERCISES 10.4—Part B 


(g) Obtain a Fourier sine series for f (x). 
(h) On [—3, 3], sketch the function to which the series in (g) 
converges. 


A2. Repeat Exercise A1 for the function f(x) — 1 ES 2 


A3. Obtain a Fourier cosine series for f (x) = x°, valid on [0, 7]. By 
evaluating the series at x = 0, show that 5 ^ ,(—1)**! //? = 7. 


A4. By evaluating the series in Exercise A3 at x = zr, show that 


2 
k=1 k ~~ 6° 


B1. If f(x) is the function given in Exercise Al and h(x) extends 
f (x) to be zero on —1 < x < 0, show that the Fourier series for 
h(x) is the average of the two series from parts (e) and (g) of 
Exercise A1. 


In Exercises B2-17, the given functions have a domain of the form [0, A]. 


For each: 
(a) Find goga, the odd extension of f (x). 


(b) Using the formalism appropriate for the interval [—A, A], 
obtain the Fourier series of Zoda- 


(c) Obtain the Fourier sine series of f(x), valid on [0, A]. 


(d) By graphing a partial sum of the sine series on [—A, A], show 
that the series represents f(x) on [0, A]. 


(e) Find Zeven, the even extension of f(x). 


(f) By using the formalism appropriate for the interval [—A, A], 
obtain the Fourier series of Zeven- 

(g) Obtain the Fourier cosine series of f (x), valid on [0, A]. 

(h) By graphing a partial sum of the cosine series on [—A, A], 
show that series represents f (x) on [0, A]. 

(i) Show that the average of the Fourier sine and cosine series 


—-A<x <0 


5 5 0 
represents the-function fü) O<s<a° 


(j) Extend f (x) to a function g;(x) = P : z : pe and 


obtain its Fourier series on [—A, A]. 


(k) Graph a partial sum of the Fourier series of g; (x) on the 
interval [—34, 3A]. 
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B2. f(x) in Exercise B2, Section 10.1 B10. f(x) in Exercise B10, Section 10.1 
B3. f(x) in Exercise B3, Section 10.1 B11. f(x) in Exercise B11, Section 10.1 
B4. f(x) in Exercise B4, Section 10.1 B12. f (x) in Exercise B12, Section 10.1 
B5. f(x) in Exercise B5, Section 10.1 B13. f(x) in Exercise B13, Section 10.1 
B6. f(x) in Exercise B6, Section 10.1 B14. f(x) in Exercise B14, Section 10.1 
B7. f(x) in Exercise B7, Section 10.1 B15. f(x) in Exercise B15, Section 10.1 
B8. f(x) in Exercise B8, Section 10.1 B16. f(x) in Exercise B16, Section 10.1 
B9. f(x) in Exercise B9, Section 10.1 B17. f(x) in Exercise B17, Section 10.1 


Periodically Driven Damped Oscillator 


Damped Oscillator Driven Periodically 


Consider the driven damped spring-mass system governed by the differential equation 


y” +2y'+10y = f(t), where f (t) is the periodic extension of g(t) = ME ii a 


Three cycles of the periodic forcing function f (t) are shown in Figure 10.24. 


Exact Solution by Laplace Transform 
2 
A graph of the exact motion of this oscillator, started with the inert initial conditions y(0) — 


0 6 12 18 0, y'(0) = 0, can be found via the Laplace transform. To this end, we obtain F(s), the 
transform of f (t), with the formula for periodic functions from Section 6.7. Thus, with 
p = 21, the period of f (t), we obtain 

—e 


1 p 
F = ———— x = ———————— 
(s) 1 — e-rs [ fee s?(1 4- e775) 


Transforming the differential equation and solving for Y , the Laplace transform of y(t), we 


FIGURE 10.24 Forcing function for 


damped oscillator 
nS 


get 
1 ]—-e"75 
~ '52(s2 + 2s + 10) 1 4e 
| y Itis impossible to invert this transform with just a finite number of elementary functions, 
| ! so we expand (1 — e~*°)/(1 + e~**) in powers of e^", obtaining —1 + 2 YX 4(—1)*e^ 75. 


The inverse Laplace transform of the factor eta 1S the function 


ig . 3t 2 nor jd 
MD = s 5 COS zi 50 


so the solution to the differential equation is 


y(t) = —h() +2 Dh — kt) Ht — kr) 


k=0 
The graph of ŷ = —h(t) +2 »- 1)*h(t — kx)H(t — kr) is given in Figure 10.25, 
FIGURE 10.25 Exact solution for the where, on the interval [0, 20], the solution is exact because H(t — kr), k > 7, is zero, since 


| driven damped oscillator 8x > 20. 


Approximate Solution by Fourier Series 


We next obtain a sequence of approximate solutions that rapidly converge to the exact 
| solution. In the differential equation, the driving function f(t) is replaced by f(t), a 
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partial sum of the Fourier series of f(t), and the corresponding solution y, (f) computed. 

The sequence of approximate solutions y;(t) converges rapidly to the exact solution. 
Using the general formalism of Section 10.1, we first obtain a Fourier series represen- 

tation of f (t). Hence, with the interval [0, 2L] taken as [0, 277] so L = 7t, we obtain 


2x 
d) = — f(t)dt —-n 
T Jo 
l 2x yt f 
= =f f(t) cosnt dt = Ma -l 
x Jo nin 


1 2x 
n= f(t) sinnt dt = 0 
T Jo 


The first three distinct partial sums of the resulting Fourier series are then 


E 


4 
fi= = — — cost 
7 


E JN. 1 3 : 5 
fae cosit- c COS dui Lu 


Letting y; (t), k = 1, 2, 3, be the solutions of the original IVP when f (t) is replaced by 
f (t), we obtain Figure 10.26 wherein the approximations y; are plotted against ĵ. The third 
partial sum approximates f(t) well enough for the graph of the resulting approximation 
to y(t) to be indistinguishable from the graph of the exact solution. In Chapter 14 we will 
study additional techniques for obtaining approximation analytic solutions of differential 


equations. 
y y y 
A A A 
0.3 + o3+ A 0.3+ 
0.2 4- 0.2+ 024. 
0.1 + 014- 0.14 
E i "à V ia = f, f Wu [t } ii d j£ | EH } ai 4 
0 5 10 15 20 0 5 10 15 20 0 5 10 15 


(a) (b) (c) 


FIGURE 10.26 Approximate solutions y;, y». and ys, dotted in (a), (b), and (c), superimposed on the exact solution (solid). 


EXERCISES 10.5-Part A 


A1. The supposition in Section 10.5 is that solutions of initial value (b) Obtain y, (1), the solution of the initial value problem when 
problems with “close” driving functions should themselves be a x 0. 
“close.” Use the initial value problem y" + 2y' + 10y = e 0*9, 


(c) Show that limao y; = yo, making y, (f) continuous in a at 
y(0) = y'(0) = 0 to quantize this notion. zii). 
(a) Obtain yo(t), the solution of the initial value problem when 


a — 0. 
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(d) One measure of distance between fo(t) = e ' and f,(t) = 


e +4)" is the mean-square norm, JK (fo — fa)? dt. Show 
that by this measure, fo and f, are close if a is small and that 
the distance goes to zero as a goes to zero. 


(e) Show that by the same measure, yo and y, are close and the 
distance between these two solutions go to zero as a goes to 
zero. 


In Exercises A2—6, a function g(t) is defined on an interval of the form 
[0, A]. For each: 


(a) Over the interval [0, 3A], graph the function f(t), whose 
period is 4 and which is the periodic extension of g (t). 


(b) Obtain F(s), the Laplace transform of f (t). 


EXERCISES 10.5—Part B 


P o Q-fel1 
A2. g(t) =t,0<t<1 as «0 =f 1<1<2 
Ad gerta] AE Qazel 
oc 1522 80) = =2 1<f£<2 


converges to zero both pointwise and in the mean (but not 
uniformly) for t > 0. Obtain y(t), the solutions of the initial 
value problems y" + 2y' + 10y = f(t), y(0) = y'(0) = 0, and 
show that they converge pointwise to zero, the solution of the 
completely homogeneous initial value problem. 


In Exercises B2—6, g(t) is prescribed and extended periodically to 
f (t), which then drives the damped oscillator described by the IVP 
y" +2y’+5y = f(t), y(0) = y'(0) = 0. In each case: 
(a) Obtain Y (s), the Laplace transform of y(t), the solution of 
the given IVP. 
(b) Approximate Y (s) with a Taylor polynomial in powers of an 
appropriate exponential e~°°. 
(c) Invert the approximation in part (b) and graph it over a 
domain for which it is the exact solution. 


(d) Obtain f(t), k = l,..., 5, partial sums of a Fourier series 
for f(t). 
(e) Obtain y, (t), k = 1, ..., 5, solutions of the initial value 


problem where f(t) has been replaced by f, (t). 
(f) Plot each solution y; (1) against the exact solution found in 

part (c). 
B2. g(t) from Exercise A2 
B4. g(t) from Exercise A4 
B6. g(t) from Exercise A6 


B3. g(t) from Exercise A3 
B5. g(t) from Exercise A5 


In Exercises B7-11, g(t) is prescribed and extended periodically to 
f (t), which then drives the damped oscillator described by the IVP 
y" + 4y' + 13y = f(t), y(0) = y'(0) = 0. In each case: 


(a) Obtain Y (s), the Laplace transform of y(t), the solution of 
the given IVP. 


(b) Approximate Y (s) with a Taylor polynomial in powers of an 
appropriate exponential e 


—as 


(c) Invert the approximation in part (b) and graph it over a 
domain for which it is the exact solution. 


(d) Obtain f, (t), k = 1,...,5, partial sums of a Fourier series 
for f (t). 


(e) Obtain y, (t), k 2 1,..., 5. solutions of the initial value 
problem where f (t) has been replaced by f; (t). 


(f) Plot each solution y; (t) against the exact solution found in 

part (c). 
B7. g(t) from Exercise A2 
B9. g(t) from Exercise A4 
B11. 


B8. g(t) from Exercise A3 

B10. g(t) from Exercise A5 

g(t) from Exercise A6 

In Exercises B12-16, g(t) is prescribed and extended periodically to 


f (t). which then drives the damped oscillator described by the IVP 
y" + 6y' + 13y = f(t), y(0) = y'(0) = 0. In each case: 
(a) Obtain Y (s), the Laplace transform of y(t), the solution of 
the given IVP. 


(b) Approximate Y (s) with a Taylor polynomial in powers of an 
appropriate exponential e ?*. 

(c) Invert the approximation in part (b) and graph it over a 
domain for which it is the exact solution. 


(d) Obtain f(t), k =1,..., 5, partial sums of a Fourier series 
for f (t). 
(e) Obtain y(t), k = 1,...,5, solutions of the initial value 


problem where f (t) has been replaced by f; (t). 
(f) Plot each solution y(t) against the exact solution found in 

part (c). 
B12. g(t) from Exercise A2 
B14. g(t) from Exercise A4 
B16. g(t) from Exercise A6 


B13. g(t) from Exercise A3 
B15. g(t) from Exercise A5 


B17. The solution of the boundary value problem y" 4- 2y' +2y = 1, 


y(0) = y(1) = 0, can be obtained from y = 1 + 

e ' (Acost + B sint), the general solution, by imposing the 
endpoint conditions to get the algebraic equations 0 = + + A and 
0- 1 + e`! (Acos 1 + B sin 1) and solving for the constants A 
and B. (Use of a computer algebra system is highly recommended. 
For example, Maple's dsolve command solves this boundary 
value problem immediately, yielding y = į — }e™ cost + 


di — £ —É e 
5 (cos l — z)e''sinr.) 


(a) Obtain f, (t), k = 1, 2, 3, the first three distinct partial sums 
of the Fourier sine series for f(t) — 1,0 « t <1. 

(b) Plot the three partial sums on the same set of axes. 

(c) Solve the three boundary value problems y" + 2y' 4-2y = fx, 
y(0) = y(1) = 0, for y, (t), k = 1,2,3. 


(d) Plot y(t), the exact solution, and the three approximate 
solutions all on the same axes. Although the Fourier series 
converges slowly, the approximate solutions to the boundary 
value problem converge much more rapidly. 


10.6 


B18. 
B19. 
B20. 
B21. 
B22. 
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(g) Plot the approximate solutions and the exact solution on the 
same set of axes. 


ft) =t, y0) =1, y) 22 

f(t) 2e',y(0) 21, y(1) = -I1 
f(t) 216, yO) 2 51, (2) 20 
f(t) = cost, y(0) 22, y(1) = 1 
f(t) —tsint, y(0 =0, yd) 21 


In Exercises B23—27, a driving function f (x), and boundary conditions 
are given. These, along with the differential equation y" + 6y' + 18y = 


f(t), 


form a BVP. In each exercise: 


(a) Solve the boundary value problem exactly by finding the 
general solution and applying the boundary conditions to 
determine the arbitrary constants. 


(b) Solve the boundary problem directly with your favorite 
computer algebra system. 
(c) Plot the exact solution. 


(d) Approximate the driving function with a sequence of partial 


In Exercises B18—22, a driving function f(x) and boundary conditions 
are given. These, along with the differential equation y" + 4y’ + Sy = 
f (t), form a BVP. In each exercise: 


sums of a Fourier sine series. 


(a) Solve the boundary value problem exactly by finding the 
general solution and applying the boundary conditions to 
determine the arbitrary constants. 


(e) Plot these partial sums on the same set of axes. 


(f) Obtain the approximate solutions that correspond to replacing 
f (t) with one of its partial sums. 


(g) Plot the approximate solutions, and the exact solution, on the 


(b) Solve the boundary problem directly with your favorite same set of axes. 


computer algebra system. B23 
B24. 
B25. 
B26. 


B27. 


f(t) =t, yO) = 1, y0) 22 
f(t) =e", yO) = 1, y(1) = —1 
f(t) =te', yO) =—1, y0) 20 
f(t) = cost, y(0) 22, y1) 21 
f(t) =tsint, y(0) 20, y(1) 21 


(c) Plot the exact solution. 


(d) Approximate the driving function with a sequence of partial 
sums of a Fourier sine series. 


(e) Plot these partial sums on the same set of axes. 


(f) Obtain the approximate solutions which correspond to 
replacing f(t) with one of its partial sums. 


; Optimizing Property of Fourier Series 


Approximating f (x) via Trigonometric Polynomials 


A partial sum of a Fourier series is a trigonometric polynomial approximating the function 
to which the series converges. For the function f(x) = x defined on the interval [0, x], a 
two-term trigonometric polynomial that might approximate itis g(x) = s; sin x + s2 sin 2x. 

Judging the quality of the approximation of f(x) by g(x) requires a measure of the 
goodness of the fit of g(x) to f (x). In Section 8.4 we used the notion of convergence in the 
mean to measure convergence of a sequence of functions. The measure of performance for 
our trigonometric approximation will be 

b 


If) -W= | FE) -ga ax (10.8) 
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EXAMPLE 10.12 


FIGURE 10.27 Approximating f(x) = x 
(dashed) with g(x) = sin x + sin 2x (solid) 


51 3-2 $2 


FIGURE 10.28 ff (f — g} dx asa 
function of sı and sy 


FIGURE 10.29 The best mean-square fit 
of f (x) = x with g(x) = 
sı Sin x + s2 sin 2x 


the square of the measure used for convergence in the mean. The subscript 2 indicates that 
the difference between f(x) and g(x) in the integral has been squared. We illustrate this 
measure in the following example. 


Assigning sı and s» the values 1 in g(x) yields the approximating function g;(x) = sin x + 
sin 2x appearing in Figure 10.27 as the solid curve. The dashed curve is, of course, f (x). 
A computation shows 


F(x) — 516015 = Í (f (x) — 8 G9)? dx = 10.3 e 
0 


OPTIMIZING THE Fir HEURISTICALLY For our example, applying (10.8) to f (x) and g(x) 
would give 


T 
. ù T pl ? 
Q(s}, 52) = Í (x — sı sin x — s2 sin2x)^ dx = Ip — ams, + Is qs, lsn 
" k 2 2 


a function of the two parameters s; and s2, graphed in Figure 10.28. The surface determined 
by Q(si, s2) has a minimum point near (s1, s2) = (2, —1). We next find the exact critical 
point by the techniques of calculus. 


OPTIMIZING THE FIT ANALYTICALLY  Equating to zero the partial derivatives of Q(s;, 52) 
taken with respect to s; and sz yields the equations 


z(s; —2)=0 and z(s.+1)=0 


whose solution is (s1, 5?) = (2, —1). Hence, the best fit to f(x) = x that we can obtain 
under this measure, using the fitting function g(x) = s; sin x + s2 sin 2x, is the function 
G(x) = 2sin x — sin 2x, graphed in Figure 10.29 and for which Q(2, —1) = 2.418. 


Best Fit, Generalized 


We next seek, for a general function f(x) on the interval [0, 7] the best approximating 
trigonometric polynomial of the form g(x) = Y 77: , sx sin kx. To minimize the measure of 
performance Q — EG (x) — Ke 5, sin kx)? dx, solve the normal equations 


18Q 4 = 
— (rm ~Yonsinks)sinjrds =o j=l... 
j 9 k=l 

for s;,k =1,2,.... Because the integrals of the “cross terms” vanish, that is, because 
ie sin nx sin mx dx = 0 for n Æ m, these equations take the form 


 fG)sinkxdx = % f sin? kx dx — = sy (10.9) 
0 


0 
from which we determine s; = Z fo f (x) sin kx dx. These values for the s; are precisely 
the coefficients of the Fourier sine series for f (x) on the interval [0, x]. The Fourier series 
is the best trigonometric approximation to f (x), provided the measure used to determine 
"best" is convergence in the mean. 


Orthogonality of Functions 


A key step in obtaining the Fourier coefficients by minimizing the mean-square norm Q is 
the vanishing of the “cross-terms,” the integrals fo sin nx sin mx dx, n + m. This leads to 
a general definition of the orthogonality of functions. 


DEFINITION 10.1 
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Two functions f(x) and g(x) are said to be orthogonal on the interval [a, b] if 


S? F8) dx — 0. 


There are functions other than just sines and cosines with the same orthogonal, **mini- 
mizing" property, the basis for generalizations of the Fourier series. In Section 10.7 we will 
use orthogonality to obtain the Fourier-Legendre series, and in Section 16.2 we will again 
use orthogonality to obtain the Fourier-Bessel series. Similar techniques could be used to 
obtain series of Chebyshev polynomials, Laguerre polynomials, Hermite polynomials, and 
many other of the special functions of applied mathematics. 


EXERCISES 10.6—Part A 


Al. Verify that cos x and sin x are orthogonal on [0, x] by showing the 
integral ie sin x cos x dx evaluates to zero. 


42. Determine s; and sz so that g(x) = s; cos x + s? sin x gives the 
best mean-square fit to f (x) = x on [0, x]. 

43. Show that x and cos x are not orthogonal on [0, 7 ]. 

44. Determine s; and s; so that g(x) = s; cos x + sox gives the best 
mean-square fit to f(x) = sin x on [0, zr]. 

45. Verify that the functions {coskx},k =0,1,..., are mutually 
orthogonal on the interval [0, x] by showing that the integrals 


^T 


Jy cosnx cos mx dx = 0 whenever n z m. 


EXERCISES 10.6—Part B 


oo 


A6. Execute a best mean-square fit of so + X rc; s, cosnx to f (x) on 
[0, z]. Show that s, are the coefficients of the Fourier cosine series 
for f (x). What is the role of orthogonality in this calculation? 


AT. Show that sin x and sin 3x are orthogonal on [0, zr]. Graph these 
functions on the same set of axes and observe that, in spite of the 
terminology “orthogonal,” there is nothing *geometricaly 
perpendicular" about these two curves. In fact, compute slopes at 
the points of intersection and show they are not negative 
reciprocals of each other. 


B1. Show that the functions (1, x, x?, x?) are not mutually orthogonal 
on [0, 1]. 

B2. Determine s;, k = 0, 1, 2, so that g(x) = pm s,x* gives the 
best mean-square fit to f(x) = sin zx on [0, 1]. 


For the functions f (x) given in Exercises B3-12: 


(a) Obtain bj, k = l,..., 5, the first five coefficients of the 
Fourier sine series on the interval [0, z ]. 

(b) Let  — Y^, by sin kx, obtain the normal equations in the 
process of minimizing fj (f — 9)? dx, and show that the 
solution of these equations is the same set of coefficients as 
determined in part (a). 

(c) Write the equation f (x) = b; sin x + b2 sin2x +--+ , and 
multiply, in turn, by sin x, sin 2x, . . . , sin 5x, each time 
integrating with respect to x on the interval [0, z ]. Show that 
the same five normal equations result. 


(d) Let ps(x) be the value of the minimizing ®. Plot f(x) and 
Ps(x) on the same set of axes. 


(e) Compute the value of hu — psy dx. 


(f) Show that f° p2(x) dx = £ Y b? < f; f^ (x) dx. (The 
left half suggests Parseval's identity, first met in the exercises 
of Section 10.1; while the right half suggests Bessel's 
inequality, the relevant form of which is 5 7^ b? < 
fo f(x) dx.) 

(g) Determine the five coefficients 5; by collocation. Pick five 
points in the interval (0, x) and at each point x, require 
f Gy) = 9 (x) to hold. Solve the resulting five equations for 
b, = B,, and call the ensuing approximation Ps5(x). 

(h) Plot f(x), ps(x), and Ps(x) all on the same set of axes. 

(i) Compute the value of ff (f — Ps)? dx, and show that it is 
larger than the value computed in part (e). 


B3. f(x) 2x B4. f(x) = x B5. f(x) 21 —x 
B6. f(x) 2zx?—x? B7. f(x)=1 B8. f(x) =cosx 
B9. f(x) =cos> B10. f(x) = x? 


Bll. f(x) =e” B12. f(x) 2x— 


wa 
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For the functions given in Exercises B13—22: require f(x) = ® (xx) to hold. Solve the resulting seven 


equations for (A, ux, vg} and call the ensuing approximation 


(a) Obtain az, k =0,1,..., 5, the first six coefficients of the 


P3(x). 
Fourier cosine series on the interval [0, zr]. uS 

i . 5 . . . (h) Plot f (x), p3(x), and P(x) all on the same set of axes. 

(b) Let ¢ = x + Ma ck coskx, obtain the normal equations in . — Pd didis hat it is 
the process of minimizing hif — ®)* dx, and show that (i) Compute the value of If pi 3)" dx and show that it is 
these equations determine c; = az, where the a; are larger than the value computed in part (e). 
determined in part (a). B23. f(x) 2x +x B24. f(x)=e* B25. f(x) 2 x( — x) 

(c) Write the equation f(x) = ® and multiply, in turn, by B26. f(x) =x? —7x — 6 
1, cos x, cos2x, .. : 408 5x, each time integrating with . B27. Show that the basis functions 1, x, x”, ..., x? are not orthogonal 
respect to x on the interval [0, x ]. Show that the same six 


í on the interval [0, 1]. (See Exercises A1—6 for the notion of 
normal equations result. 


orthogonality.) 
(d) Let ps(x) be the value of the minimizing ®. Plot f(x) and 


Ds(x) on the same set of axes. For the functions in Exercises B28—37: 


(e) Compute the value of [F (f — ps)? dx. (a) On the interval [0, 1], obtain ps = Y. , by sin kzrx, the fifth 


(f) Show that B p2(x) dx = Sql EN ae a? < j f2(x) dx. partial sum of the Fourier sine series, which the preceding 
' P ^ "i E exercises show to be the minimizer of the mean-square norm 
(g) Determine the six coefficients a; by collocation. Pick six of the ditierenes Bebweon és] and pels) q 
points in the interval (0, x) and at each point x; require i piii 
f (xy) = ® (x) to hold. Solve the resulting six equations for (b) Graph f(x) and ps e) on the same set of axes. 
Cx, and call the ensuing approximation Ps(x). (c) Obtain the value of J5 (f — ps)? dx. 


(h) Plot f(x), ps(x), and Ps(x) all on the same set of axes. 


(i) Compute the value of du 4f — Ps)? dx and show that it is 
larger than the value computed in part (e). 


(d) Let h(x) = xs a A,x*, and then determine the coefficients in 


t; (x) by minimizing [^ (f — t3? dx (obtain and solve the 
normal equations). 


B13. f(x) from Exercise B3 B14. f(x) from Exercise B4 (e) Let h(x) = dm Prx*, and then determine the coefficients in 
^ i . os 1 2 
B15. f(x) from Exercise BS B16. f(x) from Exercise B6 t(x) by minimizing f (f — t3)° dx. 
B17. f(x) = lz — 7| Bis $60 dns (f) Let t4(x) = (V B.x*, and then determine the coefficients in 
fe)y-i-7| . f (x) = sin; 


t4(x) by minimizing f (f — ty)? dx. 
B19. f(x) — sin 5 B20. f(x) from Exercise B10 (g) Let s(x) = Y, , ix^, and then determine the coefficients in 
ts(x) by minimizing LO — t3)? dx. 


ee eee ; h) Obs that th al tions in pz -(g) : 

For the-foneticus in Bescisas 89-97. (h) Observe att e normal equations in parts (d)-(g) are coupled 
and that adding a term to the approximating polynomial 
causes the preceding coefficients to change. 


B21. f(x) from Exercise B11 B22. f(x) from Exercise B12 


(a) Obtain the Fourier series coefficients aj, k = 0, 1, 2,3, and 
by, k = 1, 2, 3 for the interval [—z, 7]. (i) Compare the graphs of the polynomials f(x) with the graph 
(b) Let 6 = A+ E uy COS(kx) + v, sin(kx), minimize of f(x). 
| (f — ©)? dx to obtain the normal equations, and show 


(j) Obtain the values of f) (f — t)? dx, k =2,...,5. 
that the solution of these equations is the same set of 


coefficients as determined in part (a). B28. f(x) — xsinzx B29. f(x) = x cos x 
(c) Write the equation f (x) = ® and multiply, in turn, by B30. f(x) —e'sinzx — B31. f(x) = e™ cos mx 
1, cos x, cos 2x, cos 3x, sin x, sin 2x, sin 3x, each time B32. f(x) = xe™ 
integrating with respect to x on the interval [—z, 2]. Show 0<x<1} . x Ozx«l 
that the normal equations of part (b) result. B33. f(x) — 1 " B34. f(x) = 1 1 A 
-] 5<x<1 7 gers l 
(d) Let p3(x) by the value of the minimizing ®. Plot f(x) and i io 
5 m ' m" X 0zxcz 
p3(x) on the same set of axes. B35. f(x) = | e 2 B36. f(x) 2 x(1— x) 
(e) Compute the value of [7 (f — ps)? dx. =E Sas] 
(f) Show that /*. pix) dx = Za? +r Y (a? +b?) < 3x 0xx«i 
f. F (x) dx. B37. f(x) = l layat 
Jr 3 3 
(g) Determine the seven coefficients (A, uz, vg} by collocation. 3(1— x) i xxx«l 


Pick seven points in the interval (—z, 7) and at each point x; 
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B38. Use the following implementation of the Gram-Schmidt forming and solving the normal equations. Show that the normal equa- 
orthogonalization process to orthogonalize 1, x, x?, .. .,; E tions are now uncoupled and that the resulting polynomial is still t5(x) 
thereby forming the set of polynomials 1, v, (x), k = l...., 3 as found in the earlier exercise with that function. Hence, orthogonality 
which, on the interval [0, 1], are orthogonal in the sense that makes computing the best approximation about as easy as computing 
I" v (x)v; (x) dx = 0 when k Æ j. Take vp = 1 and v; = 1 — partial sums of Fourier series. 


Aix. Determine A4; by forcing v; to be orthogonal to its 
predecessor, vp = 1. Having determined v;, write v; = 1 — 
ÀoiX — Aogx? and determine A5; and Az. by forcing v2 to be 


B39. f(x) from Exercise B28 B40. f (x) from Exercise B29 
B41. f(x) from Exercise B30 B42. f(x) from Exercise B31 


orthogonal to its predecessors, vo; = 1 and vı. Having determined B43. f(x) from Exercise B32 B44. f(x) from Exercise B33 


n » 
V2, Write v3 = 1 — Aa1x — Aaox^ 


determined. 


AasxX* and determine B45. f(x) from Exercise B34 B46. f(x) from Exercise B35 
Ak, k = 1, 2, 3, by forcing v3 to be orthogonal to its predecessors 


Vo, Vj, and v». Continue in this way until v4 and vs have been 


B47. f(x) from Exercise B36 B48. f(x) from Exercise B37 


For the functions in Exercises B39—48, find the best approximation in 
terms of the minimum mean-square norm, using the orthogonal ba- 
sis polynomials 1, vj (x), k = 1,..., 5, found in Exercise B38. Do this by 


py) 


= 


FIGURE 10.30 The first five Legendre 
polynomials 


Fourier—Legendre Series 


Orthogonality and Minimization 


We wish to show that, in general, orthogonal functions lead to series with the minimization 
property of Fourier series. To do this, we carry out the following experiment in an arena 
less familiar than that of the trig functions [58]. 

On the interval [—1, 1], consider the set of functions p; (x), k = 0, 1,..., with the two 
properties: 


l 
T Pn(X)Pm(x) dx =0,n zm and i 
= 


? 2 
(PANES k 1 ( ) 


The property on the left in (10.10) is orthogonality of the functions on the interval 
[—1, 1], and the one on the right is the analog of i sin? kx dx = 5, already used in 
(10.9) when developing the Fourier series. Are these two properties enough to reproduce 
the minimization property of the Fourier series? 

The measure of performance, Q — He! (f(x) — Y7 o Sk Px Q2)? dx, is the same as we 
used for the Fourier series. Again forming the normal equations 


la | ~ 
0= A = (rŒ = Smt) pj(x) dx 
j -1 


k=0 


we find from (10.10) that 


i l 

. 2 
f, F(x) pj) dx = 5; Í, i 

2j+1 


Hence, sj = ^5 f, F@)pj@) dx. 


LEGENDRE PoLyNoMIALS Do such functions exist? Are there actually functions that sat- 
isfy (10.10)? Yes, the Legendre polynomials p,(x), the first five of which, graphed in 
Figure 10.30, are 1, x, 3x? = P 3x3 — dx, and 2x4 = By? + Š. As seen from the graph, 
Pn(1) = 1 for each Legendre polynomial p, (x). This is not the only normalization found 


in the literature, and the reader is advised to read any new text carefully. 


Chapter 10 Fourier Series 


coefficients 


FIGURE 10.31 
approximation (solid) for sin zx (dashed) 


Fourier-Legendre 


Sk = 


Next, consider the function f(x) = sin xx on the interval [—1, 1], and compute the 


k41 f 
* Í sin(zxx)py(x)dx k=0,...,4 
=i 


obtaining so = s2 = s4 = 0, sı = 2, and s; = 775", so that 


m 


(x) id ur ? — 15) F ) 
x)= —x n^ x x 
da ES 2^ 753 


plotted as the solid curve in Figure 10.31, is a Fourier-Legendre approximation to f(x), 
plotted as the dashed curve. The approximation g(x) is a partial sum of the full Fourier- 
Legendre series f(x) — Ee sk py (x), where s; = 
f (x) can be represented as infinite series in other orthogonal families such as the Hermite, 


UB f f (x) pi (x) dx. Likewise, 


Laguerre, or Chebyshev polynomials, developed in the exercises. 


EXERCISES 10.7—Part A 


Al. Obtain sz, k = 0, 1, 2, the first three coefficients in the 
Fourier-Legendre series for f(x) 2e *,—1 <x < 1. 
A2. Obtain sz, k = 0, 1, 2, the first three coefficients in the 


Fourier-Legendre series for f(x) — jo] <x <1. 


x42? 


EXERCISES 10.7—Part B 


A3. Show that the functions (1, x, x?) are not mutually orthogonal on 
[0, 1]. Determine a, b, c so that, in the mean-square sense, 
g(x) =a + bx + cx? best approximates f(x) = =e How do the 
calculations differ from approximating with orthogonal functions? 


B1. Obtain s;, k = 0, 1,...,10, the first eleven coefficients in the 
Fourier-Legendre series for f(x) = xcoszx, —1 < x < 1. Show 
bg 252 /k + 1) < f^, f* dx. 
B2. Account for the inequality in Exercise B1 by considering 


G one Sk px GO? dx. 
For the functions f(x), —1 < x < 1, given in Exercises B3-14: 


(a) Obtain sz, k = 0,...,5, the first six coefficients of the 
Fourier-Legendre series. 

(b) Let ®(x) = ae 0; Di (X), obtain the normal equations by 
minimizing /", (f — 9)? dx, and show that the solution of 
these equations is the same set of coefficients as determined in 
part (a). 

(c) Write the equation f(x) = ®(x) and multiply, in turn, by 
Dàs.Dis «»««5 each time integrating with respect to x on the 
interval [—1, 1]. Show that the same six normal equations 
result. 

(d) Let fs(x) be the minimizing o (x), and plot f(x) and f5(x) 
on the same set of axes. 

(e) Compute the value of f (f — fs? dx. 

(f) Determine the six coefficients s; by collocation. Pick six 

points in the interval [—1, 1] and at each point x, require 

FS (xz) = ® (xz) to hold. Solve the resulting six equations for 

Sk = Sp, and call the ensuing approximation F5(x). 


(g) Plot f(x), fs(x), and F5(x) all on the same set of axes. 


(h) Compute the value of f". (f — Fs)? dx and show that it is 
larger than the value computed in part (e). 


B3. f(x) = sin xx B4. f(x) = cos zx B5. f(x) = e 
B6. f(x) = xe~* B7. f(x) 2 xsinzx B8. f(x) = xcoszx 
x] 1 lex 4. jl -1xzx«0 
B9. f(x) = m" j2nei B10. f(x) = à eae] 
B11. f(x) = |x| B12. f(x) =1—|x| 
B13. f(x) = |sinzx| B14. f(x) =| cos xx] 


B15. The Gram-Schmidt orthogonalization process was described in 
Exercise B38, Section 10.6. On the interval [—1, 1], apply this 
process to x*, k =0,1,..., 5. Normalize the resulting 
polynomials so that they pass through (1, 1), thereby making 


them the Legendre polynomials defined in Section 10.7. 


B16. In Exercise B21, Section 8.5, the Chebyshev polynomials were 
defined by Tọ = 1, Tj; = x, T; = 2x Ty) — Ti», a definition 
under which 7;(1) = 1. In addition, on the interval [—1, 1], the 
Chebyshev polynomials were shown to be orthogonal with 
respect to the weight function w = —L—. Take 1 and x as the 


1-42 ' 


first two orthogonal polynomials, and show that using the inner 
product (f, g)r = f DM dx and the Gram-Schmidt process 
1—x* 


applied to x*,k = 2, 3,. .., the Chebyshev polynomials result if 
the polynomials are normalized to pass through the point (1, 1). 


For the functions f(x), —1 < x < 1, given in Exercises B17-26: 


(a) Obtain f = f+ Ta a, Ty (x), ay = 2 (f, T;)r, the 
third-degree partial sum of the Fourier-Chebyshev series. 
Don't be surprised if the integrations have to be carried out 
numerically. (Your favorite computer algebra system should 
have the Chebyshev polynomials built-in. Maple has them as 
T (k, x) in its orthopoly package.) 

(b) Obtain [x w(x)(f (x) — f3(x))? dx, the square of the 
minimum weighted distance between f(x) and f3(x), where 
the least-squares norm is predicated on the inner product 
(f far. 

(c) Write ® = ys Sk T, (x) and determine the four coefficients 
sx by collocation. Pick four points in the interval [—1, 1] and 
at each point x; require f (x4) = ®(x;) to hold. Solve the 
resulting four equations for s; = Sp, and call the ensuing 
approximation F3(x). 

(d) Compute fie w(x)Cf (x) — F3(x))? dx, which should be 
larger than the value computed in part (b). 


(e) Plot f (x), fs, and F; all on the same set of axes. 
B17. f(x) 2xsinzx B18. f(x) = xcoszx 


e* 


] +x? 
B21. f(x) 2|sinzx| B22. f(x) 21— |x| 


B23. f(x) =e"!  B24. f(x) = |x(1 — x) 
2x 41 

ibe iy B26. f(x) 2 J/2+x 

B27. The Laguerre polynomials Lo = 1,L; = 1 — x, L = 
— Lia iA Ly-2, k = 2,3,..., are orthogonal on [0, oo) 
under the inner product (f, g), = | e^? f (x)g(x) dx. Using 
this inner product, apply the Gram-Schmidt process to 
x*, k =0,1,..., to obtain the Laguerre polynomials. (Your 
favorite computer algebra system should have these polynomials 
built-in. Maple has them in the orthopoly package under the name 
L(k, x).) 


B19. f(x) =arctanx B20. f(x) = 


B25. f(x) = 


1. What is a piecewise continuous function? Give an example of a 
piecewise continuous function and an example of a function that is 
not piecewise continuous. 

2. Sketch the periodic extension of f(x) = (x — 1)(3— x), 1 € x <2. 
To what does the Fourier series of f(x) converge? Does it converge 
to the periodic extension at every point? 


3. State the formulas by which a Fourier series representing f(x) on 
[o, P] can be constructed. To what does the Fourier series converge 
on the interval [o, 8]? To what does the Fourier series converge 
outside [a, 8]? 
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B28. Show that the Laguerre polynomials satisfy 
e *Ly(x)L;(x) dx = 
0 t à jzk 


For the functions f(x), 0 € x < oo, in Exercises B29—38: 


(a) Obtain fs = X3 _o ag Le (x), ay = (f. L;)1, the fifth-degree 
partial sum of the Fourier-Laguerre series. 

(b) Obtain fj" e Cf (x) — fs(x))? dx, the square of the 
minimum weighted distance between f(x) and fs(x), where 
the least-squares norm is predicated on the inner product 


(f. fs)r. 

(c) If it exists, obtain Fs, the fifth-degree Taylor polynomial at 
x — 0, and compute b e^ (f(x) — Fs(x)Y dx. It should be 
larger than the value found in part (b). 

(d) Plot f (x), fs(x), and F5(x) on the same set of axes. 


(e) Explain why approximating with polynomials over an infinite 
interval must yield those results such as those seen in the 
graphs of part (d). 

B29. f(x) = /x41 B30. f(x) = sinx B31. f(x) 2e* 

B32. f(x) = xe" B33. f(x) = xsinx 

B34. f(x) = 1 —H(x — 1) B35. f(x) = (1 — H(x — 1)) sin x 

B36. f(x) = (1 — H(x — 1)je*  B37. f(x) = (1- H(x — 1))x? 

B38. f(x) = (1 — H(x — 1))(1 — x”) 

B39. The Hermite polynomials H; (x) are orthogonal on (—oo, oo) 
under the inner product ( f, g)g = I2 e f(x)g(x) dx, and 
satisfy the normalization condition f^^. e^ H2(x) dx = J/22*k!. 
If Ho(x) = 1, obtain H;(x) and H»(x). Hint: To get H from Ho 


and Hi, set p(x) = a + bx + cx? and solve the equations 
(Ho. p)u = (Hi, p)u = 0, (P, p)u = 02721. 


4. Obtain the Fourier series for f(x) = x — 1, 1 € x < 2. Sketch the 
function to which the Fourier series converges for 0 < x < 3. To 
what values does the Fourier series converge at x — 1 and at x — 2? 


5. State the formulas by which a Fourier series representing f(x) on 
[—L, L] can be constructed. To what does the Fourier series 
converge on the interval [—3L, 3L]? 

6. Obtain the Fourier series for f(x) = (x +1)(22—x),-I <x < 1. 
Sketch the function to which the Fourier series converges in 
[—3, 3]. Sketch the periodic extension of f (x). Is this the same as 
the limit of the Fourier series? 
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7. Sketch the odd periodic extension of f(x) = x, 0 < x < 2. Obtain 


a Fourier sine series for f (x), and on [—6, 6] sketch the function to 
which it converges. Is this the odd periodic extension? 


. Sketch the even periodic extension of f(x) = x, 0 < x < 2. Obtain 
a Fourier cosine series for f (x), and on [—6, 6] sketch the function 
to which it converges. Is this the even periodic extension? 


. Use an example to verify that for a continuous function f (x), 
—2 < x < 2, the termwise integral of its Fourier series is the 
Fourier series of F(x) — l5 f (t) dt. 


10. 


11. 


12. 


13. 


Use an example to verify that for a smooth function f (x), 

—2 < x < 2, the termwise derivative of its Fourier series is the 
Fourier series of f'(x). 

Describe the optimizing property of the Fourier series. What do the 
Fourier coefficients optimize? 

What is the role of orthogonality in the optimization property of the 
Fourier series? 

Obtain the Fourier-Legendre series for f(x) = x +2, 


-Il<x<l. 


Chapter ] ] 


Asymptotic Series 


INTRODUCTION Series that do not converge are said to diverge. Some 
divergent series, called asymptotic series, can actually be used to approximate solutions of 
differential equations. Instead of adding terms until the error of the approximation decreases, 
the number of terms is fixed and a region for which the approximation is useful is determined. 
Clearly, this is an unusual representation for a function, and the examples in Section 11.1 
are designed to take the mystery out of this concept. Section 11.2 makes precise the notion 
of the asymptotic series, and the optional Section 11.3 provides conditions under which 
termwise manipulations of asymptotic series are valid. 


|! Computing with Divergent Series 


Creating a Divergent Series 
The point x = 0 is a singular point of the differential equation 
x?y" + (3x - 1)y' - y 20 (11.1) 


because y"(0) cannot be determined from (11.1) itself. However, for x > 0, (11.1) has 


F(x) = b Eum dt as a solution. (See Exercise Al.) The integral defining F (x) cannot be 
evaluated in closed form in terms of elementary functions but can be evaluated numerically 
so that, for example, F(0.2) = 0.852. A graph of F(x) is given in Figure 11.1. 

Expanding the factor zz in a power series about t = 0 and integrating termwise, we 
have the formal power series F(x) — do et 3 CU: dt — in k!(—x)*, which, 
unfortunately, diverges everywhere, except at x = 0. Indeed, using the ratio test, form the 
ratio of two successive terms, obtaining |(n + 1)x| < 1 and |x| < =a? from which the 
radius of convergence is seen to be R = 0. 

Shortly, we will show that information about F (x) can be obtained from this divergent 
series! 


INTEGRATION By Parts Sometimes, integration by parts can be used to create the divergent 
series. Thus, interpret F(x) as f u dv, choose u as the factor multiplying e *, and integrate 
by parts to obtain F; in Table 11.1. Again choosing u as the factor multiplying e~’ and 
integrating by parts, obtain F5. One last repetition yields F3. Not only does this process 
provide the terms of the divergent series, it also yields a useful remainder term. Thus, 
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F 
| i 
t ! t t 


oo xe 
n2i-f — ——— dt 
0 (1 + xt)? 


| 


| Fy=l—x+] dt 
FIGURE 11.1 Graph of D i (1+ xt) 
F(x) = fy a dt " "m 
F; =1—x+2x -f fae 


TABLE 11.1 Repeated integration by parts 
applied to F(x) = fj" < dt 


generalizing from these few cases, we write 
n oo (=x) tlet 


F(x) = » k\(—x)* 1)! —— —5 dt 
(x) = Yo o Ji E 


| 
k=0 


Computing with a Divergent Series 


Surprisingly, it is possible to use such divergent series computationally. In essence, for each 
value of x, there is an optimal number of terms of this series for which the corresponding 
partial sum gives a best approximation to the function value F(x). To see this, express 
F(x) as + Ei(1, +)e'/*, where the exponential integral Ei(1, z) = f^ e~'/t dt, while not 
elementary, is tabulated and available in computer programs such as Maple. Then, define 
the nth partial sum as S, (x) = Y; k!(—x)* so that the error at any x and any number of 
terms n is defined by the difference Error = |F (x) — Y, k!(—x)*|. A graph of the error 
as a function of both x and n is obtained as the surface plot shown in Figure 11.2. 


Error 


1 

Li 

I 

1 : 

E 2 FIGURE 11.2 
i oj Graph of Error = | F(x) — 3.9 k\(—x)*| 
I 
I 


From this error surface it is possible to infer that for fixed n the error goes to zero as x 
goes to zero. Specifically, consider the curves in Figure 11.3. The solid line is the plot of the 
partial sum S12 (x), the dotted line is the plot of the partial sum S9(x), and the dashed line 
is the plot of the partial sum S4(x). In each case, the error goes to zero as x goes to zero. 


»-x 


: + t 
0 0.1 0.2 0.3 


FIGURE 11.3 Partial sums 5j5(x) (solid), 
So(x) (dotted), and S4(x) (dashed) 
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11.1 Computing with Divergent Series 


In addition, the surface plot of the error shows that for fixed x there is an optimal 
number of terms at which the error is a minimum. For example, at x = 0.1, we have the 
error as a function of the number of terms as shown in Figure 11.4. Taking three other 
plane sections corresponding to x = 0.25, 0.2, and 0.15, we have the three curves shown in 
Figure 11.5. In each case, we see a minimum error for some number of terms, n. In regions 
where a small number of terms yields accurate approximations, such divergent series are 
extremely useful representations of functions in applied mathematics. 


Error Error 
A Á 
0.07 4- 
0.05 + 
0.03 + 
0.01 4- NS ER. 
7 n (ee 
5 10 15 20 ( 2 4 6 8 10 12 


FIGURE 11.4 Atx = 0.1, Error asa 
function of n 


FIGURE 11.5 Error as a function of n for 
x — 0.25, 0.2, 0.15, solid, dotted, dashed, 
respectively 


Standard references such as [1] give divergent series representations for many of the 
special functions of applied mathematics. These expressions are useful for determining 
the behavior of these functions in certain regions and are even used in computer library 
programs that evaluate these functions numerically. 


EXERCISES 11.1-Part A 


A1. By differentiating under the integral sign, show formally that 
F(x) = fy" &— dt satisfies (11.1). 


l+x 


A3. Integrate 
(—x)Fe-* 


oo 
ef — dt 
o (1 xr) 


by parts once to generate the next term for the series given in 
Exercise A2. 


A2. Show formally that the series 5 ^; y k!(—x)* satisfies (11.1). 


EXERCISES 11.1-Part B 


B1. The error function of applied mathematics is given by erf(x) = 
a Is e^ dt. 
(a) Show that lim, ,4, erf(x) = 1. 
(b) Expand e^" in a Maclaurin series and integrate termwise, 
obtaining a Maclaurin series for erf (x). 
(c) Graph erf (x). 
B2. The Laplace transform of f (t) = Zu is F(s) — 
fo e A12 t. 
(a) Obtain F(s) — e E — erf (s)), even if only by using a 
computer algebra system. (An alternative is to consult an 
extensive table of Laplace transforms such as found in [1].) 


(b) Expand f(t) in a Maclaurin series and integrate termwise, 


obtaining 
2 (—1) (2k)! 
k=0 
(c) Use the ratio test to show that the series in part (b) diverges for 
s £0. 


(d) Use repeated integration by parts to obtain this same divergent 
series but in the form 
N-1 


(—1)*(2k)! 
> Ak kg kd 


k=0 


et T ET s 
AN Nis 0 (1 + 0N2 
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B3. 


B4. 


(e) By simply creating a table of values, find the optimum number 
terms in the divergent series in part (d) that yields the smallest 
error at s — 1. What is that smallest error? 


(f) Repeat part (e) for s = 2,...,5. 


L is F(s)— 


af 1412 


The Laplace transform of f(t) = 
ho e /V1 + (dt. 


(a) Expand f(t) in a Maclaurin series and integrate termwise, 
obtaining 
oo 


Y (—1)*[(2k)!7 


k 2 ,2k4-1 
c Ak KI se 


(b) Use the ratio test to show that the series in part (b) diverges for 
0; 

(c) Use repeated integration by parts to obtain the first few terms 
of this divergent series. The remainder term becomes 
complicated after just a few terms. 


(d) By simply creating a table of values, find the optimum number 
terms in the divergent series in part (c) that yields the smallest 
error at s = 1. What is that smallest error? 


(e) Repeat part (e) for s = 5, 10, and 15. 

The integral F(x) = fo" e" /A/x +t dt is not a Laplace 

transform. 

(a) Verify that F(x) — e" JEA — erf (x)). (You might find the 
result in a table of integrals, you might use a computer algebra 
system, or you might evaluate F (x) numerically at a few points 
and compare to the result of numeric integration.) 

(b) Expand —— in a Maclaurin series and integrate termwise, 
obtaining 


» (—1)*(2k)! 
KN 2k43/2 
ta PRI 
(c) Use the ratio test to show the series in part (b) diverges for 


x: S5 Oy 


(d) Use repeated integration by parts to obtain the series in part (b) 


in the form 
ia Vlr C ANH (N 4 DIxNH Jo (x 4 AH 


(e) At x = 1,3 and 5, find the optimum number of terms in the 
divergent series so as to best approximate F (x). 


(f) What is the error made in each case in part (e)? 


Definitions 


EXAMPLE 11.1 
the divergent series 


Y uc 
k=0 


BS. If F(x) = fo" e> dt: 


(a) Evaluate F(1), F(5), F(10) by numerical integration. 


(b) Make the change of variables s = sin t to obtain the integral 
G(x) = fo^ e 1T — 8? ds. 


(c) In the integrand for G(x), expand — 


Jf 1-52 
and integrate termwise over 0 < s « oo, obtaining 
oo 


y (2k)! 

2p 2 y2k+1 
e prx 

(While the integrand for G(x) is not real for s > 1, Watson's 
lemma (Section 11.3) justifies the expansion and termwise 
integration!) 


in a Maclaurin series 


(d) Use the ratio test to show that the series in part (c) diverges for 
x £0. 

(e) Find the optimum number of terms that minimize the error 
when F (5) is approximated by the divergent series. What is the 
error in the approximation? 


. If F(x) = fee * (2/1 + t dt, [17] suggests expanding (24/1 + t 


in a Maclaurin series and integrating termwise on the interval 
0 €f 69. 


(a) By integrating numerically, obtain accurate values for F(x) at 
x= LS, 2:5, 3:5. 


(b) The integral h e" t? /1 +t dt is a Laplace transform with 


value 
"m M" 3 15 | 15 
27" E- etfi x) (1 x i 4x? 2x2 i 4x3 


Obtain this transform, either using a computer algebra system 
or by looking in a table of transforms. 
(c) Follow the suggestion of [17] to obtain 


oo 


y (— D (2k) (kK + 1)(k + 2) 
kM*(2k — 1)xk+3 


k=0 
(d) Use the ratio test to show the series in part (c) diverges. 


(e) At each of x = 1.5, 2.5, and 3.5 find the optimum number of 
terms for the series in part (c) to best approximate F (x). 


(f) What is the actual error made for each of these approximations? 


Recall, from Section 11.1, the function F(x) — is e ! /(1-- xt) dt for which we computed 


n œ ¢_y+)nt+l,-+ 
=J kx) 04 » f M noi 
0 


n+2 
c4 (4 xt 


We now make three observations to motivate key generalizations. 


FIGURE 11.6 In Example 11.1, 2|x| 
(dashed) dominates |x?| (solid), 
on |x| « 2 


bo 
t 


0 


FIGURE 11.7 In Example 11.2, x? 
(dashed) dominates x (solid), for x large 


EXAMPLE 11.2 


EXAMPLE 11.3 


11.2 Definitions 


OBSERVATION1 The magnitude of the remainder term can be estimated as 

(n 1)! L mc i M 
0 (1 +i xt)” +2 

since decreasing the denominator from 1 +. to 1 increases the value of the fraction in the in- 


tegrand and then he — dt = 1. Consequently, F (x) can be expressed as ) 7; o k(x)" + 
R,, where |R,| < (n + 1)!x"*!. In fact, the remainder satisfies 


oo 
< (n 4 Dix" Í e™ dt =(n+1)!x""! 
0 


n 
xnl 


Rn 
<(n+1)! and lim — =0 (11.2) 


x" 


The inequality on the left in (11.2) says that in a sufficiently small neighborhood of x = 0 
the ratio of R, to x”*+! is bounded by a constant, and the limit on the right in (11.2) says the 
remainder R, goes to zero more quickly than x" 


OBSERVATION2 The series is a sum of increasing powers of x. For small values of x, each 
successive power of x is an order of magnitude smaller than its predecessor. Specifically, 
for each k we have lim,..o x^*! /x* = 0. 


OBSERVATION3 The coefficients a, in the series bir a,x* can be computed by the recipe 


1 
F— 5 agx* 
d; = hm = 


x0 x" 


Computing the first few coefficients this way, we get do = lim,..o F(x) =La = 


lim,_+0 Fos —], and a» = lim, LIEU L2. $ 


Bachman-Landau Order Symbols 


Tue “Bic Og" SyuBor A function f(x) is said to be “big oh" of g(x) in a region R, and 
we write f (x) = O(g(x)), provided | f (x)| is bounded by a constant multiple of |g(x)| in 
R, that is, the inequality | f (x)| < A|g(x)| holds in R, with A being a constant independent 
of x. 

If g(x) # 0 in R, then we can more simply say that the ratio of | f (x)| to |g(x)| is 
bounded by some constant. 

This definition makes precise our first observation about the remainder term for the 
function F(x). For each n, R, = O(x"*!) because |R,| < (n + 1)!x"*!. 


The function f(x) — x? is O(x) on |x| « 2 since |x2| < 2|x| on that interval. Simply 
consider Figure 11.6, in which 2|x| (the dashed line) dominates [x?| (the solid line). E 


The function f(x) = x is OG) for x large. enough. Indeed, Figure 11.7 shows, for x > 
1, |x| < |x?], that is, |x| (solid) lies below Ix?| (dashed). $ 


Tur “LITTLE On” SYMBOL A function na is said to be o(g(x)), that is, “little oh” of 
g(x) at x = xo, provided liMx— xo 9] = = 

This definition supposes that even if -" = 0, g(x) # 0 elsewhere in R, thereby 
simplifying the definition. Intuitively, if f(x) = o(g(x)), then, at x = xo, f(x) goes to 
zero “more rapidly” than g(x). 

In terms of this definition, we see that near x = 0, x^*! = o(x*). Each power of x is 
smaller than its predecessor by a prescribed amount, namely, by an “order of magnitude.” 
By Observation 2, namely, lim, ,o x**!/x* = 0, we can say the remainder in the series 


EXAMPLE 11.4 


EXAMPLE 11.5 


EXAMPLE 11.6 


EXAMPLE 11.7 


| EXAMPLE 11.8 
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for F(x) satisfies R, = o(x"). In fact, this remainder satisfies both R, = O(x"*!) and 
R, = o(x"). 

Often, the context of the statement f = o(g(x)) provides ample indication of the point 
xo at which f (x) is being compared to g(x), or barring that, the statement is interpreted as 
being true at some specific xo. 


The function f (t) = f? is o(e') as t — oo, since lim, ,4, |t|?/e' = 0. b 


The function f(x) — n!/x"*! is O(1/x"*!) and o(1/x") as x — oo. The first claim is 


verified by writing g(x) — 1/x"*! and examining the ratio D — n!. Choosing A to be 
any constant greater than n! means | f (x)| < A|g(x)|. The second claim is valid since 

j (x) . nx" 

lim f = lim —— = P 


x>œ ]/x" x00 Nt] 


Asymptotic Sequences 


We have already noted that for small values of x and for each k we have x*+! = o(x^), an 
observation generalized by the following definition. 


DEFINITION 11.1 


A sequence of functions {¢; (x)} whose magnitudes decrease systematically according 
to the prescription $y..1(x) = o($x(x)) is said to be an asymptotic sequence. 


We have just seen that the sequence {x*} is an asymptotic sequence near x = 0. Additionally, 
{1/x*} is an asymptotic sequence for x large. Indeed, we have 


. Pe f xk 
lim — = lim —— =0 $ 


The functions g(x) = (2 + cos x*)/x* form an asymptotic sequence for large x because 


$a 2 + cos x**! 3 
de | |2-cosx*|x| 7 |x| 
The inequality follows upon maximizing the numerator and minimizing the denominator. 


2 
bd 


The functions $; (x) = (sin kx) /x* do not form an asymptotic sequence for x large because 
each fraction 


peti} — |sin(k + Dx 
de | | xsinkx 
becomes unbounded infinitely often, at every zero of sin kx. e 


Asymptotic Expansions 


Once again consider the function F (x) and its divergent series expansion » ^. 9 k!(—1)*x* + 
R,, where we describe the remainder with the notation R, = o(x"). Thus, we have 


F(x) = y eco +o(x") n=0,1,... (11.3) 
k=0 


EXAMPLE 11.9 


EXAMPLE 11.10 
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as the meaning of the divergent series. In fact, we now define such an expansion as an 
asymptotic (power) series and write F(x) ^ Y 7-9 k!(—1)*x* to mean the collection of 
equalities in (11.3). Hence, we have the following definitions. 


ASYMPTOTIC SERIES If 


f(x) = Do axt + oG") or f(x) 2 3 axt + 0G") (11.4) 
k=0 k=0 
holds for each n = 0, 1,..., then 5 a,x* is called an asymptotic series, or asymptotic 


power series, for f (x) and we write f (x) ~ dest a,x* to denote it. 
The sets of equalities in (11.4) are equivalent. 


GENERAL ASYMPTOTIC EXPANSION If {#,(x)} is an asymptotic sequence for x — xo and 
fF) = X go aku (x) + 0(bn) holds for every n = 0, 1,..., we call 37-9 aed (x) an 
asymptotic expansion and write f (x) ~ ye arb; (x) to denote it. 

By virtue of Observation 3, we also have 


an = lim fœ) - þa akQk (x) 
à $.) 


f(x) 
pox)" 


with ag = lim, >x 


Asymptotic Expansions to N Terms 


Not every asymptotic expansion results in an infinite series. Some expansions terminate 
after a finite number of terms, in which case we make the following definition. 

If f(x) = Y apel) + oloni) but f(x) A Y gard (x) + olon), then f (x) ~ 
p ay Gy (x) is an asymptotic expansion to N terms. 

When the expansion at xo is to one term, namely, to g(x), it is common to say “ f (x) 
is asymptotic to g(x),” denoted by f(x) ^ g(x), and meaning f(x) = g(x) + o(g(x)) as 
X — xo, so that liMy— xo ft = 0: 


The asymptotic power series for the function 
0 x <0 
ge xc 


fx)= 


is zero as x — 0. Thus, we would write f(x) ~ 0 as x — 0. Indeed, we have lim, 9 f = 


lim,-+0 i = lim,.,9 L = - -- = 0. Hence, with respect to the asymptotic sequence {x*}, the 
asymptotic expansion of f (x) is zero. Thus, two functions, F (x) and G(x) = F(x)+ f (x), 
may have the same asymptotic expansion. $ 


To expand the function f(x) = v1 — sinx in an asymptotic series with respect to the 
asymptotic sequence (sin* x), x — 0, first establish sin**! x = o(sin*x) via 

sin**! x 
=0 


lim —— 
x>0 sin'x 
Then, compute the coefficients of the asymptotic expansion by the recipe 


Fœ — Yo acd GO 


à, — lim 
dici dn (x) 
"ES R " "E, 3 " 
thereby obtaining the expansion f(x) ~ 1 — }sinx — s sin” x — jg sin? x +--+ as 


$. 
x — 0. d 
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EXAMPLE 11.11 Obtain the asymptotic expansion of f(x) = 41 — sinx with respect to the asymptotic 
sequence ($y(x)) = {x**/./1 + sinx}, x > 0. First, show x41 = o($) by verifying 
lim,.,0 $x.1/óy = lim,+o x2k+2 72k = 0. Then, compute the coefficients via the recipe 


an = lim ie) — 2 Ay (x) 
i Gn (x) 


thereby obtaining the expansion f(x) ~ » 5; 9 (— D x^^ /Qk)!/1-F sinx as x — 0. Of 
course, this expansion converges, and follows from the trigonometric identity f(x) — 
y1 -sinx = ETA The point being made here is that the asymptotic expansion of a 
given function is determined by the asymptotic sequence used. $ 


EXAMPLE 11.12 This final example demonstrates that a finite asymptotic expansion actually can terminate. 
If we expand F(x) = fj e™/( + xt) dt with respect to the asymptotic sequence (x?*], 

x — 0, we find ap = lim,_.9 F(x) = 1 buta; = lim,-,9 LI is undefined. Consequently, 

with respect to this asymptotic sequence, the most we can say about F(x) is that F(x) ~ 1 

+ 


to one term. g 


EXERCISES 11.2—Part A 


A1. For each of the following, verify the indicated order relationship. A6. If h = o(f) and g = o(h), show that g = o( f). Thus, 
(a) x? =O(x), |x| <2 (b) sinx = O(1), |x| < oo o(oCf)) = off). 

A7. If F = O(f) and G = O(g), show that FG = O( fg). Thus, 
OCf)O(g) = OCf 2). 

A8. If F = O(f) and G = o(g), show that FG = o( fg). Thus, 


(c sinx = O(x), |x| «oo (d) x? = O(sinx), x > 0 
(e) e* =O(1),x > oo (Ê) x = O(x”), x => oo 


(a) cons =1+0(x), & 0 o l O(f)o(g) = o( fg). 

A2. Indicate whether each of the following is true or false, and give AS. If F —o(f) and G = o(g), show that FG — o( fg). Thus, 
evidence for the determination. es 

P o( f)o(g) = o( fg). 

(a) e™ =o(1),x >œ (b) e™ = O(%), x > oo A10. If F, = O(f) and F, = O(f), show that F; + Fy = O( f). Thus, 
(c) sinhx =O(x),x > 0 (d) sinhx = o(x), x —0 O(f) + O(f) = O(f). 
(e) sinhx = O(e*),x > œo  (f)sinhx = o(x), x —^ oo A11. If F; = O(f) and F» = o( f), show that F; + F; = O( f). Thus, 
(g) Inx =o(x),x > œ (h)lnx-0O(1)x- oo O(f) + oCf) = OCf). 

A3. If h = O(f) and g = O(h), show that g = O(f). Thus, A12. If Fi = o(f) and F; = o( f), show that F; + F; = o( f). Thus, 
O(O(f)) = O( f). o(f) + oCf) = o(f). 

A4. If h = o(f) and g = O(h), show that g = o( f). Thus, A13. Show that f ~ g — 8 ~ f. 


O(o(f)) = oCf). 
AS. If h = O( f) and g = o(À), show that g = o( f). Thus, 
o(O(f)) = o(f). 


EXERCISES 11.2-Part B 


B1. A function can have two different asymptotic expansions if two (e) Show that m — | -2sinx +2sin? x + 1 sin? x +, 
different asymptotic sequences are used. |x| « 1. 
(a) Show that = 9 142x 2x? +---, |x] <1. B2. Verify each of the following both analytically and graphically. 
(b) Show that sin‘ x, k =0,1,..., is an asymptotic sequence for (a) sinx —x =O?) asx —^0 (b) e™* = O(1) asx > 0 


x — 0. (c) e™* — 1 = O(x) asx > 0 


B3. 


B4. 


B5. 


B6. 
B7. 


Let f(x) = In(1 + vx) ~ Yo ax’: 

(a) Show that (x'?), k = 1,2, ..., is an asymptotic sequence as 
x — 0. 

(b) Obtain the coefficients 

feo-XT ax" 


xn/2 


an = lim 


x0 
(c) Show that the series actually converges and that the radius of 
convergence is R = 1. 
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B8. 


B9. 
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If f(x) = sin(x + x): 

(a) Show that, with respect to the basis of Exercise B4, f(x) has 
a terminating asymptotic expansion. 

(b) Obtain, if possible, an asymptotic expansion of f (x) in the 
basis of Exercise B5. 

For each of the following, obtain the asymptotic power series as 


x — 0. Test the validity and utility of the expansion by graphical 
and numerical techniques. 


Show that (1, In(1 + x), In(1 + x°), In(1 + x°), ..., } is an (a) ^ an? di (b) e™* — (e) e» 

asymptotic sequence as x — 0. E . . . . 
n . i B10. For f(x) = —————., obtain the asymptotic expansion with 

Show that (tan x)'?, k = 1,2,..., is an asymptotic sequence as v xXx 

x — 0 from the right. respect to the asymptotic sequence {x*/?},k = 0, 1, .... On 


Obtain an asymptotic expansion of e* in the basis of Exercise B4. [graphically compute We expansin aud FG; 


Obtain the asymptotic expansion of f(x) = e* — 1 with respect to 
the basis of Exercise B5. 


Operations with Asymptotic Series 


Overview 


Theorems validating arithmetic with asymptotic power series parallel theorems validating 
arithmetic with convergent power series. Moreover, composition of asymptotic power series 
can be justified. Integration of asymptotic power series is likewise typically valid, but 
differentiation may not be. If the derivative is known to have an asymptotic expansion, then 
termwise differentiation yields the asymptotic expansion of the derivative. 

In the following sections, we give conditions under which various operations can be 
performed on asymptotic power series of the form Y ^ a,x* and Y^ agx ^. 

Loosely speaking, the asymptotic expansion of a linear combination of two functions 
is the termwise linear combination of the terms of the asymptotic expansions of the two 
functions. Thus, we have the following theorem. 


THEOREM 11.1 
1. ($&(x)) is an asymptotic sequence as x — xo. 


2. f(x) ~$ apax) and g(x) ~ D> biroa) 
k=0 


k=0 
=> af (x) + Bg(x) ~ Y (aar + Box) d(x) 
k=0 
EXAMPLE 11.13 Consider the functions 
fije esi et 
idm l-x2 x? xt xó x8 (11.5) 
ias x 1 2 4 " 
a m x? x5 x8 
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The asymptotic expansion of h(x) = 2f (x) + 3g(x) is E — A 4 4 E H As ams, 
which is just 2(5—-4+3—-4+-:-)+3(-4-43-4+4--). * 


As for multiplication of power series, multiplication of asymptotic power series is also 
valid. Thus, we have the following theorem. 


THEOREM 11.2 


1. Let the asymptotic sequence (wy, (x)] be either (x^) or (x^^). 


2, fü) X awa) and g(x) ~ bw) 
k=0 k=0 
k 
3. Ck = Wo, 
n=0 

oo 
=> f(x)g(x) ~ J ewe (x) 

k=0 


EXAMPLE 11.14 If f(x) and g(x) are given in (11.5), the asymptotic expansion of h(x) — f (x)g(x) is 


1 1 2 1 2 3 2 


x4 xo x! x8 x? x 10 xl! 


which matches, through terms of order 11, the product 
l 1 m 1 1 Pi 1 2 Bs & 
A P g x x5 x8 


THEOREM 11.3 


1. {wy} is either (x^] or (x ^^]. 
oo 
2. f(x) low. with co 40 
k=0 
co 


~ y d, wy for appropriate constants dy. 
k=0 


Sm f(x) 


In each case, the restriction on co prevents the quotient series from containing terms 
not in the asymptotic sequence for f (x). 


EXAMPLE 11.15 The reciprocal of neither series in (11.5) is an asymptotic power series for x — oo since 
"5 = ]-4 x? and 2 = —x? + I introduce positive powers of x, terms not in the 
asymptotic basis for the original expansions. 


On the other hand, at x — 0, we have 


f(x) =1—2x7 +x +06) and g(x) = ix + ixt + Oa) 


EXAMPLE 11.16 
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Therefore, the reciprocal of f (x) remains an asymptotic expansion with respect to the same 


asymptotic sequence, whereas the reciprocal of g(x) does not. kd 


Composition of asymptotic power series is not as well-behaved as it is for convergent 
power series. As for convergent power series, composition of asymptotic power series is 
valid at x = 0 under certain restrictions but is generally not valid for x — oo. A theorem 
governing the case at x = 0 reflects the condition imposed on convergent power series in 
Section 9.3. 


THEOREM 11.4 


oo oo 

LS ar and g(x)~ > bet 
k=0 k=l 

k 


oo k 
=> f(K(g(x)) e Y« z 22 


k=0 n-l 


This result is in complete accord with its analog for convergent power series wherein 
(xo) = bo = yo = 0. 

Composition of series developed for x — oo is not as well-behaved. Consider the 
following example. 


For the composition f (g(x)) of the functions in (11.5), we have 


FeO) (x3 — 2) pb 5:1, 
x)) = 4 iu ds mu c cT esos 
á 4 4- x? — Ax? + x6 x^ x! x8 
On the other hand, composing the individual asymptotic series yields 
l 1 


2 4 
( z 2 $) ( E m 5 x) 


which does not even have a power series development! A moment’s reflection reveals the 
difficulty. The series for g(x) is a development for large values of x. In fact, lim, ,o5g(x) = 
0. The asymptotic power series for f(x) is also a development for large x. But in the 
composite f (g(x)), when x is large, g(x) is small, so f(x) is not getting the large values 
of its argument that its series calls for. “ 


Termwise integration of asymptotic series is generally valid. In fact, for sufficiently 
well-behaved functions f(x) and g(x), we have the following theorem. 


THEOREM 11.5(a) THEOREM 11.5(b) 
eo oo 
Ero) A ax L g(x) ~ » bx 
k=0 k=2 
=> ih f(t)dt ~ j» ZR eH — T g(t)dt ~ z br e~ 
9 perl * po 
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Each conclusion simply says the asymptotic expansion of the integral is obtained by 
the termwise integration of the expansion of the integrand. 


EXAMPLE 11.17 Consider the function f(x) = xsinx and )°~2,(—1)*x***?/(2k + 1)!, its asymptotic 


EXAMPLE 11.18 Consider the function g(x) = st; ~ 


0.1 


—0.1 
—0.2 


FIGURE 14.8 Graph of f(x) = 
e ^ sin e!/* from Example 11.19 


power series at x — 0. The asymptotic expansion of [s f (t) dt = sinx — x cos x is 


oo 


(—1)k x+ 


= (2k + 3)(2k + 1)! 


* 


which is just the termwise integral of the expansion for f(x). s 


1 
1 x? 


4 +4 +- and its integral 


Enel datae l — INTE 
x)= [ g(t) dt — a arctan x = Uu E 


Termwise integration of the expansion for g(x) yields precisely the expansion for G(x). 


$ 
d 


Differentiation of Asymptotic Power Series 


Differentiation of asymptotic expansions, like composition, requires some care, since it 
is not always true that an asymptotic expansion can be differentiated. For example, the 


function f (x) = e~'/* sin e'/*, graphed in Figure 11.8, is asymptotic to 0 since 
. e! sine!” 
lim - =0 
x—0* xk 
for each k = 0,1,2,.... But the derivative f'(x) = i(e Us sin e!/* — cos el/*) has no 


asymptotic expansion at all since not even the limit of this derivative exists at the ori- 
gin. However, if both f(x) and f'(x) have asymptotic power series expansions, then the 
expansion for f'(x) is the termwise derivative of the expansion for f (x). 


THEOREM 11.6(a) THEOREM 11.6(b) 


1 O Yar L aD 
k=0 k=0 


oo oo 
2. Jf») » o 2. g(x)~ » dc 
k=0 =2 


=> cy = (k + Dana => dy = —(k — lib.i 


EXAMPLE 11.19 For large x, consider 


x 
~ 


1 
+x X 


fuo 


f'@)= 


(l4+x)? x? x3 x* x5 


Termwise differentiation of the series for f(x) yields the asymptotic power series of the 
derivative. e 


EXAMPLE 11.20 
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WATSON'S LEMMA 


oo 
L fa)- 5 a with convergence in |t| < R. 
k=0 
2. f(t) = O(e"), a > 0, as t — oo, so that f(t) is of exponential order. 


ak 
gkt1 


a f (De dt ~ 
0 


k=0 


In essence, Watson’s lemma says that the termwise Laplace transform of a series ex- 
pansion of f(t) is the asymptotic expansion of its Laplace transform. 
1 


Consider the function f(t) — das whose nontrivial Laplace transform F(s) = e? Ei(l, s) 


is given in terms of the tabulated exponential integral Ei(1, s) = | e *' /t dt. We then 
have 


01 oD ab WE dw e. CD 
fio Tg 2 4-0^ and Fo) = | ips ur 


The asymptotic series for F (s) is the termwise transform of the Maclaurin series for f (t). 


EXERCISES 11.3 


9$. 
«v 


1. In Exercise B2, Section 11.1, F(s) = fj e ///1-- t dt is 
evaluated as a Laplace transform, from which an asymptotic series 
is developed for s — oo. 


(a) Termwise differentiate the series obtained for F(s). 


(b) Evaluate F'(s) by differentiating under the integral sign and 
recognizing another Laplace transform. 

(c) Obtain an asymptotic power series in the basis {s~*} for the 
function found in part (b). 

(d) Show that the series in part (a) is the same as the series in part 
(c). Hence, termwise differentiation of the asymptotic 
expansion of F (s) is valid. 


2. In Exercise B4, Section 11.1, F(x) — ihe. e" [A/x +t dt is 
evaluated in closed form, and an asymptotic series is developed for 
x — oco. 


(a) Evaluate F(10), expand F(x) in an asymptotic series, evaluate 
the series at x — 10, and compare. 

(b) Obtain F’(10) by differentiating under the integral sign, and 
integrating numerically. Then termwise differentiate the series 
for F (x), evaluate the differentiated series at x — 10, and 
compare. 


3. In Exercise B5, Section 11.1, an asymptotic series for 
F(x) = p e~*sint dt is developed for large x. 


(a) Termwise differentiate the asymptotic series for F(x). 


(b) Obtain an asymptotic expansion for F’(x) by differentiating 
under the integral sign and expanding the integrand in the same 
way as was done for F(x). 


(c) Show that the series in part (a) is the same as the series in part 
(b). Hence, termwise differentiation of the asymptotic 
expansion of F (x) is valid. 


4. In Exercise B6, Section 11.1, an asymptotic expansion for 
F(x) = i e "t? 4/1 +t dt is developed for large x. 


(a) Obtain F(10) by numeric integration. Approximate F(x) with 
G(x) = fo e A/1- t dt as a Laplace transform, and obtain 
G (10). Expand G(x) in an asymptotic series and evaluate it at 
x = 10. Compare the three values. 


(b) Obtain F'(10) by differentiating under the integral sign and 
integrating numerically. Obtain G'(10). Termwise differentiate 
the expansion for F (x) and evaluate the differentiated series at 
x — 10. Compare the three values. 


For the pairs of functions f (x) and g(x) given in Exercises 5-9: 


(a) Obtain F(x) and G(x), the asymptotic expansions, for large x, 
of f (x) and g(x), respectively. 

(b) Obtain the asymptotic expansion of the product f (x)g(x). and 
compare to F (x)G (x), the product of the asymptotic 
expansions of f (x) and g(x). 
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| (c) If the expansion of the product f (x)g(x) matches the termwise 
product FG ~ $` cx^*, show that the coefficients c; are given 
by Y a, by .,, Where f(x) ^ Y ayx~* and g(x) ~ Y byx^*. 
(d) Obtain the asymptotic expansion of the composite function 
f (g(x)), and compare to F(G(x)), the composition of the 
asymptotic expansions of expansions of f (x) and g(x). 


(e) Obtain the asymptotic expansion of the composite function 
g(f(x)), and compare to G(F(x)), the composition of the 
asymptotic expansions of expansions of f (x) and g(x). 


(f) Obtain the asymptotic expansion of the function +}; and 
compare it to the expansion of +4; in particular, note whether 


or not the expansions are asymptotic series even if they match. 
(g) Obtain the asymptotic expansion of the function —— and 


compare it to the expansion of —; in particular, note whether 
G(x) 


or not the expansions are asymptotic series even if they match. 


(h) Obtain the asymptotic expansion of the function ie and 
compare it to the expansion of "m ; in particular, note whether 
x) 


or not the expansions are asymptotic series even if they match. 


(i) If it exists, obtain fi(x) = | f (t) dt and expand it in an 
asymptotic series. Compare this result with the termwise 
integral of F (x). 

(j) If it exists, obtain g(x) = LT g(t) dt and expand it in an 
asymptotic series. Compare this result with the termwise 
integral of G(x). 


5. fiw) = SF, ee) = 
6. f(x) = E ,g(x)-— e 
9 fa) = Eae SL 


For the pairs of functions f(x) and g(x) given in Exercises 10-14: 


(a) Obtain F(x) and G(x), the asymptotic expansions, for small x, 
of f(x) and g(x), respectively. 


Chapter Review 


1. Explain the statement “near x = 0, f(x) = O(g(x)).” Give an 
example. 

2. Explain the statement “for large x, f(x) = O(g(x)).” Give an 
example. 


3. Explain the statement “at x = 0, f(x) = o(g(x))." Give an 
example. 


10. 
11. 
12. 
13. 
14. 


(b) Obtain the asymptotic expansion of the product f(x)g(x), and 
compare to F(x)G(x), the product of the asymptotic 
expansions of f(x) and g(x). 

(c) If the expansion of the product f(x)g(x) matches the termwise 
product F(x)G(x) ^ Y; cyX* , show that the coefficients c; are 
given by r^ a, by .,, Where f(x) ~ >> a,x* and 
g(x) ~ Yi byx*. 

(d) Obtain the asymptotic expansion of the composite function 
f (g(x)), and compare to F(G(x)), the composition of the 
asymptotic expansions of expansions of f (x) and g(x). 


(e) Obtain the asymptotic expansion of the composite function 
gCf (x)), and compare to G(F (x)), the composition of the 
asymptotic expansions of expansions of f(x) and g(x). 

(f) If £ (0) Æ 0, obtain the asymptotic expansion of the function 
Fay and compare it to the expansion of Fa in particular, note 
whether or not the expansions are asymptotic series even if they 
match. 

(g) If g(0) Æ 0, obtain the asymptotic expansion of the function 

1 » B H d 1 PE . z 
p and compare it to the expansion of gc; in particular, note 
whether or not the expansions are asymptotic series even if they 
match. 


(h 


— 


If g(0) Æ 0, obtain the asymptotic expansion of the function 
: a and compare it to the expansion of ae ; in particular, note 
whether or not the expansions are asymptotic series even if they 


match. 


(i) Obtain fi(x) = fy f (t) dt and expand it in an asymptotic 
series. 


(j) Obtain the termwise integral of the expansion of F (x) and 
compare it to the series developed in part (1). 


(k) Obtain g; (x) = h g(t) dt and expand it in an asymptotic 
series. 


f (x) and g(x) as given in Exercise 5 
f (x) and g(x) as given in Exercise 6 
f (x) and g(x) as given in Exercise 7 
f (x) and g(x) as given in Exercise 8 


f (x) and g(x) as given in Exercise 9 


. Explain the statement “as x — oo, f(x) = o(g(x))." Give an 
example. 

. Explain the statement “x*, k = 0, 1,..., is an asymptotic sequence 
near x — 0." 

. Explain the statement *x^*, k = 0, 1, ..., is an asymptotic 


sequence for large x.” 


7. Let $; = x*, k = 0, 1, ..., and let f(x) = Vx + 1. Use the 
formulas 
do = lim fe) and a, — lim LO) = 2o UPR — 2o Gr 
x0 p(x) x0 Pn 


to generate the asymptotic expansion E a, y. Show that the 
expansion is just the Taylor series for f(x). 


8. Use the results of Question 7 to explain the statement “f ~ 1 as 
x > 0.” 


12. 


. Use the results of Question 7 to explain the statement “f ~ 1 — 
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Nis 


asx > 0.” 


. Explain the statement “ f (x) ~ g(x) for x large.” Give an example. 
11. 


Explain the statement “O(g (x)) + O(g(x)) = O(g(x)).” Give an 
example. 

Verify Watson's lemma for the function f(t) = sin t. Thus, show 
that the asymptotic expansion of F(s) = -4 is the termwise 
Laplace transform of the Maclaurin series for f (t). 


| UNIT THREE 


Ordinary Differential 
Equations—Part Two 


Chapter 12 
Chapter 13 
Chapter 14 
Chapter 15 
Chapter 16 


Series Solutions 


Physical systems described by differential equations are often complex 
enough to require more than one differential equation in their models. Typi- 
cally, these equations will be coupled, forming a system of differential equa- 
tions. The simplest such system is the first-order constant-coefficient system, 
which we introduce and study in terms of interconnected mixing tanks. 

These systems have a natural vector structure that prompts a study of 
enough matrix algebra to support a discussion of the eigenvalue problem for 
matrices. In addition to the applicability to such physical models as mixing 
tanks, the first-order linear system also captures the second-order linear ODE. 
The second-order linear ODE of Unit One can be expressed as a first-order lin- 
ear system, and the characteristic roots of Unit One become the eigenvalues 
of Unit Three. 

The behavior of a system for which an exact solution is available is 
readily determined. In particular, a system's stability, the propensity to return 
to an equilibrium, is important to the designers of control systems. The stabil- 
ity of nonlinear systems can often be determined by examining the stability 
ofthe associated linear system obtained from linearizing the original system. 

The second-order, constant-coefficient, linear ODE can be solved ex- 
actly. Some second-order, linear ODEs with nonconstant coefficients also can 
be solved exactly. But the majority of such equations defy analytic solution, 
and numeric methods must be used. The Runge-Kutta-Nystrom method can 
be applied directly to the second-order equation. Alternatively, the second- 
order equation can be converted to a first-order system, and a vectorized 
version of one ofthe numeric methods of Chapter 4 can be applied. One such 
method, the vector version of rk4, is studied. 

At regular points, second-order ODEs have solutions expressible 
as power series, which we learn to find directly from the DE itself. At regular 


Systems of First-Order ODEs 
Numerical Techniques for Second-Order ODEs 


Boundary Value Problems 
The Eigenvalue Problem 


singular points, the linear ODE has generalized series solutions that we also 
learn to obtain. Equations whose coefficients are not analytic may have solu- 
tions given in terms of asymptotic series that we learn to obtain as well. 

Having accumulated a suite of tools for solving the second-order ini- 
tial value problem, we turn our attention to the second-order boundary value 
problem. In the BVP, conditions are placed on the solution at the endpoints 
of an interval. Given a general solution containing two constants, the BVP 
is solved by writing and solving an appropriate pair of algebraic equations. 
Otherwise, we resort to numerical methods such as the shooting method and 
finite differences, and analytic approximation techniques such as the finite 
element method, or the methods of least squares, Rayleigh-Ritz, Galerkin, 
and collocation. 

The ability to solve a BVP means we can now solve the eigenvalue 
problem for differential equations. This problem generally arises when solv- 
ing partial differential equations. The Sturm-Liouville self-adjoint eigenvalue 
problem generates an infinite sequence of eigenvalues and a complete or- 
thonormal set of eigenfunctions that behave in the infinite dimensional case, 
like the finite basis vectors (i, j. k} in three dimensions. 

Two important cases that arise in the applications are Bessel's equa- 
tion for problems in cylindrical coordinates and Legendre's equation for prob- 
lems in spherical coordinates. In each case, an infinite set of mutually orthog- 
onal eigenfunctions are generated, and these functions can be used to form 
Fourier-type series, just as we did with trig functions in Chapter 10. 

The unit concludes with a finite-difference scheme for obtaining nu- 
meric solutions of eigenvalue problems. 
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Chapter ] 2 


Systems of First-Order ODEs 


INTRODUCTION Just as coupled systems of algebraic equations arise in 
the applications, so too do coupled systems of differential equations. Complex systems 
with many components will naturally be described by more than one interacting differential 
equation. The simplest systems are the first-order linear systems with constant coefficients. 
We use the example of interconnected mixing tanks to illustrate such systems. 

Matrix and vector notation is the natural language for describing and solving first- 
order linear systems. After posing representative problems and solving them by Laplace 
transform techniques, we elucidate the vector nature of the solutions of these linear systems 
and proceed with a study of the requisite linear algebra In particular, the eigenvalue problem 
for matrices is examined. Since the second-order constant-coefficient linear equation of Unit 
One can be represented as a first-order system, the characteristic roots of Unit One become 
the eigenvalues of Chapter 12. 

The matrix formalism introduced allows us to discuss the question of stability. Points 
at which the first derivatives in the first-order system simultaneously vanish are equilibrium 
points, and the system point in the phase plane will remain at rest at an equilibrium point if 
it once arrives there. However, physical systems are subject to disturbances, and the system 
point can be displaced from equilibrium. Stability of a system refers to its propensity to 
return to equilibrium after such a perturbation. 

Not all physical systems are described by linear systems of differential equations. Most 
real-world systems are nonlinear. Nonlinear systems are rarely solvable in closed form and 
generally require numerical techniques for solution. However, establishing the stability 
of a nonlinear system is often as important as obtaining its solution. By the process of 
linearization, the stability of a nonlinear system can generally be determined by examining 
a related linear system. 

The chapter concludes with a study of the nonlinear pendulum. 


Mixing Tanks—Closed Systems 
A Two-Tank Problem Without Flow-Through 


We introduce the notion of a coupled set of first-order linear differential equations by setting 
up and solving the following mixing-tank problem associated with Figure 12.1. The tanks 
form a closed system because no matter enters or leaves the two tanks but only recirculates 
between them. 


5 gal/min 


5 gal/min 


100 


A B 


FIGURE 12.1 Schematic for mixing-tank 
problem 
A 
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FIGURE 12.2 


Asymptotes (dotted) 
approached by x(t) (solid) and y(x) 
(dashed) 
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Tank A initially contains 50 gal of pure water, whereas tank B initially contains 100 
gal of brine G lb of salt per gallon). Instantaneous mixing occurs when liquid is pumped 
back and forth between the tanks at 5 gal/min. To find the instantaneous amounts of salt in 
each tank proceed as follows. 

Let the variables x(t) and y(t) represent the amount of salt in tanks A and B, respec- 
tively. Then, the initial amounts of salt in the tanks are given by x(0) = 0 and y(0) = 
3(100) = 75. 

Before doing any further mathematics, we reason to the limiting outcome as follows. 
Eventually, the fluid in both tanks will be uniformly mixed. Thus, there will be 75 Ib of salt 
mixed in 150 gal of water. There will be one-third of that in tank A and two-thirds of that 
in tank B. Hence, tank A will eventually contain 25 Ib of salt, and tank B will eventually 
contain 50 Ib of salt. 

Differential equations governing x(t) and y(t) are written using the rate-balance prin- 
ciple 


rate at which salt-content changes — rate at which salt enters — rate at which salt leaves 


learned in Section 2.3. Thus, each minute, tank A loses 5/50 of its volume, so it loses 5/50 
of its salt. Each minute, tank A gains salt from tank B, namely, 5/100 of the salt in tank B, 
so we have the equation - = — x(t) + By. 

Each minute, tank B gains salt from tank A, namely, 5/50 of the salt in tank A, and 
tank B loses salt to tank A, namely, 5/100 of its own salt. Thus, we have the equation 


4 — 3 x(t) — qo» (t), and the IVP 


UT 
— ERI — y 
dt 50 100° 
with x(0) = 0, y(0) 2 75 
dy cati c est 
dt 50° 100? 


These two differential equations are linear, first order, and coupled. Each variable 
appears in both equations, so the equations must be solved simultaneously. Fortunately, the 
equations have constant coefficients and are, therefore, amenable to solution by the Laplace 
transform. 


Solution by Laplace Transform 


Our solution starts by computing the Laplace transform of each differential equation. There 
are then two unknowns, X = X (s) and Y = Y (s), the transforms of x(t) and y(t), respec- 
tively. We thereby obtain 


sX—x(0)=-{X+HY and sY — y(0) = HX — HY 


supply the initial data to obtain 


1 l A 
$X — —igX + ggY and sY —75 = 7X - 


1 

a5) 

and solve for X = X(s) and Y = Y(s) to obtain 
T5 25 


sQ0s-3) s s+ 


051 50, 25 
s(20s 4-3) s st 


X(s) = and Y(s) = 150 
Inverting each transform, we find x(t) = 25 — 25e77/2" and y(t) = 50 + 25e ?/??', 

The behavior of these solutions can be seen in Figure 12.2, where x(t) is the solid 
curve, y(t), the dashed, and the dotted horizontal lines are asymptotes. As predicted, each 
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y curve is asymptotic to the limiting values 25 and 50, respectively. Figure 12.3 shows an 
alternate representation of the relation between y(t) and x(t), generated by interpreting 


| 75 ; s s 
x(t) and y(t) as the parametric representation of a curve y(x). As f increases from zero, 
the “system point” (x, y) travels along the curve y (x), from (0, 75) on the y-axis, toward 
the terminal point (25, 50). 
50+ 


That the system point (x(t), y(t)) actually traverses a line can be verified by eliminating 
the parameter f from the equations for x(t) and y(t). Adding the two equations x = 25 — 
25e 3/9 and y = 50 + 25e 7! gives x + y = 75, the explicit equation of the line, which 
2T is algebraically consistent with the realization that salt is conserved, neither entering nor 
leaving the system. This line is found in the phase plane, an xy-plane whose points represent 
system configurations (x, y). 
| ü  — xu x As the state of the system varies in time, x(t) and y(t) change. A parametric plot of 
| ^ the points (x(t), y(t)) is a curve in this the phase plane, each point of which represents a 
FIGURE 12.3 Phase-plane representation potential state of the system's variables. The actual history of system states is the collection 
SE Suna of phase-plane points constituting the parametric curve. 

Alternatively, the equation of this line can be obtained by eliminating the parameter t 

from the differential equations themselves. This is done by recalling that the slope of the 

parametrically defined curve y (x) is given by dy = alee = —1, from which y(x) = 75 —x 

follows when the initial condition (x (0), y(0)) = (0, 75) is imposed. 


EXERCISES 12.1-Part A 


| A1. For the example described by Figure 12.1, show that the limiting (b) x'(t) = —38x + 21y, y'(t) = —70x + 39y, x(0) = —1, 
| values x4; and ys; can be found from the governing IVP by setting y(00) 21 
| x’ = y! = 0, then using the initial data and conservation of salt to (c) x'(f) = —27x + 12y, y (t) = —T2x -- 33y, x (0) — 4, 
get x (0) + y(0) = xa; + Yoo. WO) e -2 m l 
A2. For the initial value problem x'(t) = 5x + 6y, y'(t) = —7x — 8y, (d) x'(t) = 31x +45y, y(t) = —18x —26y, x(0) = —5, y(0) = 3 


x(0) = —2, y(0) = 2: P » A 
(e) x'(t) = —30x — 32y, y'(t) = 37x +39y, x(0) = 1, y(0) = —2 
(a) Obtain the solution by use of the Laplace transform. MN UN . 
Assume that in Figure 12.1, tank A initially contains œ gallons of pure 


(b) Graph the curves x(t) and y(t). water whereas tank B initially contains f gallons of brine (b pounds of 


| (c) Graph the parametric curve y(x) determined by x = x(t), salt per gallon). Instantaneous mixing occurs when liquid is pumped back 
| y-—yt(t). and forth between the tanks at r gallons per minute. For the parameters 
A3. Assume that in Figure 12.1, tank A initially contains 200 gal of given in each of Exercises A5-9: 


| pure water, and tank B, 150 gal of brine in which 50 Ib of salt has 
been dissolved. Instantaneous mixing occurs when liquid is 
pumped back and forth between the tanks at a rate of 6 gal/min. 


(a) Let the variables x(t) and y(t) represent the amount of salt in 
tanks A and B, respectively, and formulate an appropriate 
initial value problem for the instantaneous amounts of salt in 

(a) Formulate an IVP whose solution gives, as a function of time, each tank. 
the amount of salt in each tank. (b) Reason to the limiting values of x(t) and y(f). 


| (b) Reason to a limiting value of the amount of salt in each tank. AS. œ — 75, B = 200, b 


i 

A6. a = 250,8 —150, b 2 2,r —4 
Syr 
lr 


(c) Use the method of Exercise A1 to calculate the limiting values 
for the salt in each tank. 


AT. œ = 500, B = 300, b 
A8. a = 400, B = 125, b 
A9. œ = 30, B = 80, b = Lr 


A4. Use the Laplace transform to solve each of the following initial 
| value problems. 


(a) x'(t) = 3x + 6y, y'(t) = —5x + 14y, x(0) = 3, y(0) = —1 


EXERCISES 12.1-Part B 


12.1 Mixing Tanks—Closed Systems 


B1. Use the Laplace transform to solve the IVP x’(t) = 27x — 72y, 
y'(t) = 16x — 41y, x(0) = a, y(0) = b. Show that 
lim; x (f) = lim, y(t) = 0 for any values of a and b. What 
does this say about the parametric curve y(x) in the phase plane? 


Assume that in Figure 12.1, tank A initially contains œ gallons of pure 

ater whereas tank B initially contains P gallons of brine (b pounds of 
salt per gallon). Instantaneous mixing occurs when liquid is pumped back 
and forth between the tanks at r gallons per minute. For the parameters 
given in each of Exercises B2-6: 

(a) Let the variables x(t) and y(t) represent the amount of salt in 
tanks A and B, respectively, and formulate an appropriate 
initial value problem for the instantaneous amounts of salt in 
each tank. 


(b) As in the text, reason to the limiting values of x(t) and y(t). 


(c) Use the method of Exercise A1 to calculate the limiting values 
of x(t) and y(t). 


(d) Use the Laplace transform to solve the IVP formulated in 
part (a). 

(e) Graph x(t) and y(t) on the same set of axes. 

(f) Verify the limiting values obtained in parts (b) and (c). 

(g) Plot y (x), the trajectory in the phase plane. 


(h) Eliminate the parameter t from the solutions obtained in 
part (d). 


(i) Eliminate the parameter t by forming a differential equation 
for the function y (x). 

(j) Use a computer algebra system's differential equation solver 
to obtain the solution of the IVP, and compare to the Laplace 
transform solution found in part (d). 


B2. o = 1000, 8 = 750, b = 3, r = 15 
225, B = 650, b = S. r —8 
B4. œ = 450, 8 = 350, b = 3, r— 12 
B5. æ = 100, 6 = 75,b = į, r =5 
B6. æ = 600, 8 = 800, b = 5,r = 20 


B3. a 


Assume that in Figure 12.1, tank A initially contains o gallons of brine 
a pounds of salt per gallon) whereas tank B initially contains f gallons 
? brine (b pounds of salt per gallon). Instantaneous mixing occurs when 
quid is pumped back and forth between the tanks atr gallons per minute. 

For the parameters given in Exercises B7—16: 

(a) Let the variables x(t) and y(t) represent the amount of salt in 
tanks A and B, respectively, and formulate an appropriate 
initial value problem for the instantaneous amounts of salt in 
each tank. 


(b) Reason to the limiting values of x(t) and y(t). 


(c) Use the method of Exercise A1 to calculate the limiting 
values of x (t) and y(t). 


(d) Use the Laplace transform to solve the IVP formulated in 
part (a). 


(e) Graph x(t) and y(t) on the same set of axes. 

(f) Verify the limiting values obtained in parts (b) and (c). 

(g) Plot y(x), the trajectory in the phase plane. 

(h) Eliminate the parameter ¢ from the solutions obtained in 
part (d). 

(i) Eliminate the parameter t by forming a differential equation 
for the function y (x). 

(j) Use a computer algebra system's differential equation solver 
to obtain the solution of the IVP, and compare with the 
solution obtained in part (d). 


B7 85, 8 =220,a = ł,b = purus 
B8. a = 350, 8 = 250, a =3,b =4,r =3 
B9 50,8 —30,.a— 2, b — 1.7 =6 


= 240, B = 325,a 22,b 23, r =4 


~~) 

- 
D mÓ > ow & > 
R RQR 9 8 9 R Q 


B11 70,8 200,2 7,854," =1 
B12. œ —100,8 = 75,a=2,b=i,r = 3 
B13. a = 850, 8 = 550,a = 2,b = 3, r = 16 
B14. œ = 275, B = 575,a=32,b=2,r=14 
B15. œ = 300, 8 = 175,a=3,b=},r =6 
B16. œ = 450, 8 = 675,a =3,b=2,r =8 


B17. Assume that in Figure 12.1, tank A contains 100 gal of 10% brine, 
and tank B, 200 gal of 15% brine. (Amounts of salt are therefore 
measured in gallons, not pounds.) Find r, the recirculation rate for 
which, at time f = 10, the amount of salt in tank B is within 5% 
of its limiting value. 

B18. Assume that in Figure 12.1, tank A contains 300 gal of 162 % 

brine, and tank B, 100 gal of 10% brine. (Amounts of salt are 

therefore measured in gallons, not pounds.) Find r, the 
recirculation rate for which, at time ¢ = 20, the amount of salt in 
tank A is within 5% of its limiting value. 

B19. Assume that in Figure 12.1, tank A contains 250 gal of 2% brine, 

and tank B, 400 gal of 20% brine. (Amounts of salt are therefore 

measured in gallons, not pounds.) Find r, the recirculation rate for 
which, at time t = 15, the amount of salt in tank A is at 50% of 
its limiting value. 


In Exercises B20—29: 
(a) Use the Laplace transform to obtain x (t). y(t), the solution of 
the given IVP. 
(b) Plot x(t) and y(t) on the same set of axes. 
(c) Plot y (x), the trajectory in the phase plane. 


(d) Use a computer algebra system's differential equation solver 
to obtain the solution of the IVP, and compare with the 
solution found in part (a). 
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B20. x'(t) = 8x (t) + 4y(t), y (t) = —5x(t) — Sy(t), x(0) = —2, 


y(0) 23 


B21. x'(t) = —x(t) — y(t), y'(t) = —4x(t) + 2y(t), x(0) = 5, 


B22. x'(t) = —4x(t) + y(t), y (t) = —9x(t) + 2y(t), x(0) = 4, 


(c) Plot the space curve determined parametrically by 
(x (t), y (t). z(t)). 

(d) Use a computer algebra system's differential equation solver 
to obtain the solution of the IVP, and compare to the solution 
obtained in part (a). 


y(0) — —5 B30. x’ = —12x — 12y — 30z, y' = —44x — 19y — 60z, 
B23. x'(r) = —4x(t) + Ty(t), y'(t) = 3x1) — 8y(0), x(0) = —3, SS a Polit i 

y(0) =5 Hint: Work in floating-point form. 

: "P , a 5. A " 
B24. x'(r) = —8x(r) - 260 (4), y(t) = -H y (r) — 2 y(n), B31. x’ = 82x + 108y + 72z, y = —=>x — 153y — 100z, 


x(0) = —5, y(0) = —1 


B25. x'(t) = —8x(1) + 2 y(t), y'(r) = s 
y(0)=1 


B26. x'(t) = -2x(n + 2y(t), W(t) = x(t) — y(t), x(0) = 2, 


B27. x'(t) = Zx(t) + $£y(t)y'(t = zx() + 7 y(t), x(0) =-7, 


Im 


y(0) 28 


B28. x'(r) = —ix(t) + Syl), y'() = Ex) + Ly), xO) = 6, 


5 


y(0) = —4 


B29. x'(r) = Balt) + Py, y'a) = xq) + Vy, xO) =9, 


49 - 


y(0) = —7 


For the initial value problems in Exercises B30—39: 


(a) Use the Laplace transform to obtain the solution x(t), 


y(t), z(t). 


(b) Plot x(t), y(t), and z(t) on the same set of axes. 


1 gal/min 


2 gal/min 


" 3 gal/min 
2 gal/min a 


E 


FIGURE 12.4 Schematic for mixing-tank 
problem 


x(t) — Z y(t), x(0) = —1, 


z’ = 76x + 96y + 61z, x(0) = 3, y(0) = 0, 2(0) = —2 

B32. x’ = 91x — 22y + 24z, y’ = 656x — 161y + 168z, 
z’ = 280x — 70y + 69z, x(0) = —5, y(00 = 1, z(0) = 4 

B33. x’ = 16x + 2y — 4z, y' = 120x + 14y — 32z, z' = 120x + 
Py — 31z, x(0) = 7, y(0) = —3, z(0) = -1 

B34. x’ = 19x + 29y — 15z, y' = —93x — 139y + 75z, 
z = —147x — 219y + 119z, x(0) = y(0) = z(0) = 1 

B35. x’ = 63x + 232y + 80z, y' = —22x — 82y — 28z, 
z! = 10x + 40y + 13z, x(0) = 1, y(0) = —2, z(0) = 3 

B36. x’ = 45x + 18y + 6z, y' = 24x + 3y + 6z, z' = —424x — 
151y — 64z, x(0) = 4, yO) = —7, z(0) 22 

B37. x’ = 29x — y — 3lz, y! = —72x -- Ty + 92z, z' = 24x — y — 262, 
x(0) = —9, y(0) = 5,z(00 = 1 

B38. x’ = 155x + 30y — 39z, y' = 120x + 26y — 30z, z' = 732x + 
144y — 184z, x(0) = 8, y(0) = —6,z(0) = —1 


B39. x’ = 189x + 376y — 80z, y' = —166x — 331y + 70z, 
z’ = —350x — 700y + 147z, x(0) = 2, y(0) = 3, 2000 = 5 


Mixing Tanks—Open Systems 
Two-Tank Example with Flow-Through 


We consider a second example of a two-tank mixing system and add “flow-through” to its 
structure. This makes the system “open” since matter can now enter and leave it. The goal is 
again to model the system as a coupled set of first-order linear differential equations, which 
we solve with the Laplace transform. The solution, plotted in the phase plane, reveals the 
typical complexity of the computations and casts further light on the notion of a path in this 
plane. 

Consider, then, the two-tank system shown in Figure 12.4. Tank A contains 100 gal of 
brine (1 Ib of salt per gallon), while tank B contains 100 gal of water. Fresh water flows 
into tank A at 2 gal/min and there is instantaneous mixing. Liquid flows from A to B at 
3 gal/min, liquid flows from B to A at 1 gal/min, and liquid overflows from B at 2 gal/min. 
Find the amounts of salt present in tanks A and B at any time t > 0. 

Fluid enters and leaves each tank at the net rate of 3 gal/min. The long-term outcome 
will be that both tanks contain pure water, since pure water flows into tank A and is then 
transferred to tank B by the recirculation pipes. 

If we define x(t) as the amount of salt in tank A and y(t) as the amount of salt in tank B, 
the initial amounts of salt in the tanks will then be x (0) = 100, y(0) = 0. The rate of change 
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FIGURE 12.5 Solutions x(t) (solid) and 
y(t) (dotted) 
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FIGURE 12.6 — Phase-plane path, y(x) 
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of the amount of salt in pus A is given by the differential equation 2* = -i x (r) cus T y(t) 

because tank A loses m of its salt each minute (it goes to tank B) but gains ET of the salt 

in tank B each minute. Likewise, the rate of change of the amount of salt in tank B is given 
; , os dy 3 2 ly 

by the differential equation % = ig () i y(t) — yy or 2 = x(t) jog 

because tank B gains, each minute, = of the salt in tank A but loses, each minute 


E , n 
its salt to tank A, and us of its salt to the drain. 


of 


Solution by Laplace Transform 


To solve the system of differential equations just derived, Laplace-transform each differen- 
tial equation, obtaining 


sX —x(0) = -X + GY and sY — y(0) = 5X — WY 


100 10 
where X = X (s) and Y = Y (s). Pos the initial data, finding 


sX — 100 = -5X + wY and sY =75X-GY 
the solution of which is 
des 5000-55557 SUO qg7 ™ t E 2 
(s+) - (4) 
and 
15000 3 


~ 5000s? + 300s +3 ~ 3 2 
(s 3) - (8) 
Inversion of these transforms yields 


x(t) = 100e-?/199t cosh 3B, and y(t) = 1004/3e3/19* sinh Xi 


the graphs of which appear in Figure 12.5, where the solid curve is x(t) and the dotted, 
y (t). Both curves seem to have a limiting value of zero, but y(t) has a maximum value. 
Thus, tank B attains a maximum amount of salt before its contents asymptotically become 
pure water. 


Phase Plane Path 


In Figure 12.6, we plot the path y(x) by treating x(t) and y(t) as the parametric represen- 
tation of a curve in the phase plane. The system point (x(t), y(t)) starts at (100, 0) and 
traverses the path from right to left, heading toward the point (0, 0). Obtaining the equation 
for the path is challenging. 


ELIMINATING f FROM THE DIFFERENTIAL EQUATIONS First, we eliminate the parameter 
t from the differential equations, obtaining < m -—31— m and y(100) = 0 as an initial 
value problem for y(x), the solution of which can bo brought to the form 3x? — y? = 
30,000e-? 3 arctanh(y/x/3) 


ELIMINATING f FROM THE PARAMETRIC REPRESENTATION Careful inspection of the solu- 
tions for x(t) and y(t) suggests that forming the ratio ? will allow us to solve for t, that is, 


J3 sinh 33, 3 100 
y = er es Bad. gives f — f(x, y) = —~ arctanh —— 
X 


cosh Ar 100 V3 i 
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Since x(t) is a hyperbolic cosine and y(t) is a hyperbolic sine, we can use cosh? z — 
sinh? z = 1 so that we have 3x? — y? = 30,000e 73/5% = 30,000e? Sarctanh(y/x/3). 


EXERCISES 12.2-Part A 


A1. For the example described by Figure 12.4, show that the limiting (a) Formulate an IVP for x(t) and y(t), the instantaneous amounts 
values x% = Yoo = 0 can be determined from the differential of salt in tanks A and B, respectively. 
equations that govern the system. (b) Without solving the IVP in part (a), reason to xo; and yoo, the 
A2. Use the Laplace transform to solve the IVP x'(r) = 3 — 13x — limiting (steady-state) values of x(t) and y(t). 
16y, y'(t) = 14x + 17y, x(0) = yO) = 0. (c) Obtain xæ and y; from the differential equations written in 
A3. Use the Laplace transform to solve the IVP x’(t) = 1+ 3x + part (a) by noting that at steady state, x’ = y’ = 0. 
3y, y(t) = 2 — 24x — 14y, x(0) = y(0) = 0. AS. In Exercise A4, let pure water instead of brine enter tank A. Then, 
A4. Modify the two-tank system shown in Figure 12.4 as follows. Tank the parameter t can be eliminated from the resulting equations for 
A contains 400 gal of 35% brine, while tank B contains 125 gal of x(t), y(t) by writing e = z2 and making the change of variables 
40% brine. At a rate of 2 gal/min, 30% brine flows into tank A and v(x) = 2€ as detailed in Section 3.2. Obtain an implicit 
there is instantaneous mixing. Liquid flows from tank A to tank B representation of the phase plane trajectory y — y(x) by this 
at 3 gal/min, liquid flows from tank B to tank A at 1 gal/min, and technique. 
liquid overflows from tank B at 2 gal/min. 
EXERCISES 12.2-Part B 
B1. Modify the two-tank system shown in Figure 12.4 as follows. (c) Plot the space curve defined parametrically by (x(t), 
Tank A contains 450 gal of 1796 brine, while tank B contains 200 y(t), z(t)). 
gal of 14% brine, At a rate of 1 gal/min, 50% brine flows into tank (d) Use the differential equation solver of a computer algebra 
A and there is instantaneous mixing. Liquid flows from tank A to system to obtain the solution, and compare with the results in 
tank B at 4 gal/min, liquid flows from tank B to tank A at 3 part (a). 
gal/min, and liquid overflows from tank B at 1 gal/min. 
! . B2. x’ = —343x + 300y + 432z, y! = 456x — 397y — 572z, 
| (a) Formulate an IVP for x(t) and y(t), the instantaneous Z = —588x + 513y + 739z, x(0) = —7, (0) = 8, z(0) = 0 
amounts of salt in tanks A and B, respectively. 7 i pes i UN 
| . . f B3. x' = —384x — 840y + 240z, y' = 260x + 574y — 166z, 
| (b) Without solving the IVP in part (a), reason to x4 and yoo, the z^ 28x 4 Ay — 1912200) = —3, »(0) — 2, z(0 — 5 
| limiting (steady-state) values of x(t) and y(t). T f CU A "hd 
f Ka f . : ] B4. x’ = 703x — 324y — 606z, y' = 50x — 27y — 45z, z' = 790x — 
(c) Obtain x. and yæ from the differential equations written in 362» — 680z, x(0) = 5, 00 = 9, z(0) = —7 
SVL = rer Ju 34 = 
part (a) by noting that at steady state, x’ = y' = 0. i n 
D Usesthe Lari: F ; " BS. x’ = 58x + 166y + ^T z, y' = —240x — 666y — 400z, 
(d) Use the Laplace transform to solve the IVP. z' = 360x + 996y + 602z, x(0) = 10, y(0) = —7, z(0) = 4 
| (e) Plot x(t) and y(t) on the same set of axes. B6. x = —138x — 234y — 279z, y' = 405x + 699y + 837z 
(f) From the solutions, compute lim, .,; x(t) and lim; y(t) z’ = —270x — 468y — 561z, x(0) = 0, y(0) = 1, z(0) 22 
| and compare to the answers in parts (b) and (c). B7. x’ = 489x + 490y — 24562, y' = 72x + 71y — 364z 
| (g) Plot y(x), the trajectory in the phase plane. z —112x + 112y — 563z, x(0) = 8, y(0) = 6, z(0) = 1 
(h) Eliminate the parameter t in the differential equation by B8. x’ = —109x — 45y +5, y' = 252x + 104y — 5, 
| obtaining a = 70 , y(x(0)) = y(0) and solving z! = —63x — 27y — 4z, x(0) = 12, y(0) = 7, z(0) = —8 
| numerically, using a graph as the outcome of the computation. B9. x! = —45x + 10y + 4z, y! = —204x + 45y + Wz 
| (i) Solve the IVP with the differential equation solver of some z' = 48x — 10y L Oz, x(0) = 1, y(0) = 1, z(0) = 3 
| compuferalgebrasysfem: B10. x’ = —135x + 32y + 492z — 2, y! = —43x + 12y + 156z, 
| For the nonhomogeneous IVPs in Exercises B2-11: z’ = —34x + By + 124z, x(0) = 0, y(0) = —3, 2(0) = 5 
| B11. x' = 20x — 108y — 8z + 9, y' 2 —24x + 139y + 8z — 1, 


(a) Obtain the solution using the Laplace transform. 


(b) Plot x(t), y(t), and z(t) on the same set of axes. 


z! = 465x — 2670y — 159z, x(0) = 1, y(0) = —1, z(0) = 0 


In Figure 12.4, let r, in gallons per minute, represent the rate of influx 
of a c% brine solution, flowing into tank A holding o gallons of an a% 
brine solution. Let r; and r2, in gallons per minute, be the recirculation 
rates from tank B to tank A and from tank A to tank B, respectively. Tank 
B initially contains £ gallons of a b% brine solution, and the outflow from 
tank B to the drain is again at the rate r. For the parameters in Exercises 
B12-18, let x(t) and y(t) represent the amount of salt in tanks A and B, 
respectively, and 


(a) formulate the appropriate initial value problem. 

(b) reason to the limiting values of x(t) and y(t). 

(c) calculate the limiting values by setting x’ = y' = 0 in the 
differential equations for the system, and then solving for 
x(oo), y(oo). 

(d) use the Laplace transform to solve the IVP. 

(e) plot x(t) and y(t) on the same set of axes. 


(f) from the solutions, compute lim, .4; x(t) and lim,.. y(t) 
and compare to the answers in parts (b) and (c). 


(g) plot y (x), the trajectory in the phase plane. 


(h) eliminate the parameter ¢ in the differential equation by 


obtaining z = fo, y(x(0)) = y(0) and solving 


numerically, using a graph as the outcome of the computation. 
(i) for x(t) or y(t), determine any maximum that is not at an 
endpoint. 


(j) solve the IVP with the differential equation solver of some 
computer algebra system, and compare with the results in 


part (d). 
B12. r =5,c = 80, a = 625, a = 32,7) = 1,7 = 6, B = 725, 
b= 14 
B13. r = 3,c =0,a =775,a = 36, r = 5, r5 = 8, B = 450, b = 13 
B14. r =4,c = 25,a = 800,a = 6,r; = 1, r2 = 5, B = 800, b = 10 
B15. r = 4,c = 30,a = 550, a = 18,7; = 2, r3 = 6, B = 675, 
b= 34 


B16. r = 2, c = 0, a = 725,a = 37,7, = 4,17. = 6, B = 975,b = 2 
B17. r = 2, c= 55, a = 325, a = 36,r; = 7,12 = 9, B = 450, 


B18. r 


In Exercises B13, 16, and 18, c = 0, so the resulting differential equa- 
tions were homogeneous. For the systems in Exercises B19-21, write 
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dy _ y(t) 


a = wp anduse the change of variables v(x) = (see Section 3.2) to 


obtain an implicit representation of the phase plane trajectory y = y(x). 
B19. IVP of Exercise B13 B20. IVP of Exercise B16 
B21. IVP of Exercise B18 


B22. Modify the two-tank system shown in Figure 12.4 as follows. 
Tank A contains 200 gal of 15% brine while tank B contains 175 
gal of 7% brine. At a rate of 4 gal/min, 10% brine flows into tank 
A and there is instantaneous mixing. Liquid flows from tank A to 
tank B at 9 gal/min, and liquid flows from tank B to tank A at 5 
gal/min. In addition, at a rate of 3 gal/min, 20% brine flows 
directly into tank B and liquid overflows from tank B at 7 gal/min. 


y(x) 
x 


(a) Formulate an IVP for x(t) and y(t), the instantaneous 
amounts of salt in tanks A and B, respectively. 

(b) Without solving the IVP in part (a), reason to xə and ys, the 
limiting (steady-state) values of x(t) and y(t). 

(c) Obtain x. and yæ from the differential equations written in 
part (a) by noting that at steady state, x’ = y' = 0. 

(d) Use the Laplace transform to solve the IVP. 

(e) Plot x(t) and y(t) on the same set of axes. 


(f) From the solutions, compute lim, .4; x(t) and lim,_,. y(t) 
and compare to the answers in parts (b) and (c). 


(g) Plot y(x), the trajectory in the phase plane. 


(h) Eliminate the parameter f in the differential equation by 


obtaining 2 — 20, y(x(0)) = y(0) and solving 


© dx 


numerically, using a graph as the outcome of the computation. 


(i) Solve the IVP with the differential equation solver of some 
computer algebra system, and compare to the results in 
part (d). 


In Exercises B23-27, solve the given IVP 


(a) with the Laplace transform. 
(b) with the differential equation solver of some computer 
algebra system, and compare to the solution in part (a). 
B23. x/(t) = 1—2x 4-3y, y'(t) = 2—14x -11y, x(0) = 9, y(0) = —5 
B24. x'(t) = 2—3x+4y, y'(t) = 5—12x+11y, x(0) = —5, y(0) 23 
B25. x'(t) = 5—9x +30y, y'(t) = 7+6x + 18y, x(0) = 3, (00 = —2 
B26. x'(t) = 44-5x —24y, y'(t) = 2+3x — 12y, x(0) = —7, y(00 = 1 
B27. x'(t) = 6+8x+28y, y'(t) = 1—6x + 18y, x(0) = 8, y(0) = —3 


Vector Structure of Solutions 


Mixing Tanks Revisited 


Recall that for the closed-system mixing tanks in Section 12.1 we had the equations 


ee) = — x(t) + 35 (t) and y(t) = ixO — 35) (t) 


(12.1) 


and the solution x(t) = 25 — 25e73/2, y(t) = 50 + 25e79/°", which we now write as a 


274 Chapter 12 Systems of First-Order ODEs 


EXAMPLE 12.1 


sum of two vectors 


x(t) " | (3/202) —] 
= =25 256. w^ 
X(t) o] hl + 25¢ 1 


where X(t) is the vector whose components are x(t) and y(t). Similarly, we write the 
solution of the open-system mixing tanks in Section 12.2 as the sum 


x(t) i ANT l 7 ] 
= = 50e(-3+-¥3)1/100 50 (-3—4/3)t/100 
X(t) h | € B + 50e -A3 


Vector Solutions, Directly 


These examples suggest that the right way to look at a system of linear first-order ODEs is 
in vector-matrix form. For example, defining A to be the array 
1 1 
10 20 


ask 
10 20 


A= 


allows us to write the equations in (12.1) in the form 
; | l 
; x —~ 10 20 | | x(t 
X(t) = $ | Ee © b 1 = AX() (12.2) 


where X'(r) is the vector whose components are the derivatives x’(t) and y’(t). Now implied 
in (12.2), which can be written compactly as X'(t) = AX(t), is a multiplication between 
the matrix A and the vector X(f). 

Indeed, momentarily in Example 12.1, we will study matrix-vector arithmetic in detail. 
However, before getting lost in the details of such formalism, we point out the reason for 
the digression. Having written (12.1) in the form (12.2), we will look for vector solutions 
of the form X(t) = Be^', where B is a constant vector and A is a constant to be determined. 
This is not a wild guess since y’ = ay, the scalar case of the first-order linear homogeneous 
equation, has the exponential solution y = be^. 


The algebraic equations 
3x+4y=7 and 2x —5y — I 


are reduced to the matrix-vector form AX — B by writing 


ed 9 


where in (12.3) A is the matrix, X is the vector of unknowns, and B is the vector of constants. 
Multiplication of a vector by a matrix is accomplished by computing the dot product 


[a b]. N — ax + by 
y 


of each row of the matrix with the vector. The first entry in the vector forming the product 
is the dot product of the first row of the matrix with the vector X. The second entry in the 
product is the dot product of the second row of the matrix with X, etc. $ 


EXAMPLE 12.2 
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Caution 


Nonlinear equations cannot be put into matrix form. Matrix form can only be obtained for 
linear first-order equations. For example, x'(t) = xy, y'(ft) = xy — y cannot be put into 
matrix form since each equation is nonlinear. 


Matrix Notation 


Elements in the matrix are doubly subscripted, arc, with r, the first subscript, being the row 
index, and c, the second subscript, being the column index. In fact, for a 2 x 2 matrix the 
elements would be designated as i= m 


1 422 


Matrix Arithmetic 


Matrices are added, subtracted, and multiplied by scalars elementwise. Thus, we illustrate 
the three computations of matrix addition, matrix subtraction, and multiplication of a matrix 
by a scalar. Note how addition and subtraction are accomplished by adding or subtracting 
corresponding entries of the matrices. Scalar multiplication requires that each entry of the 
matrix be multiplied by the scalar. For example, if 


then we have 


1+6 2+1 7 3 

isje T PI 
7+3 9+4 10 13 
iapa l-6 S-Tp T» 1 
| (17-3 9-4| [45 
x1 3x2 3 6 

23A = = 
be ed E i 


Matrix Multiplication 


To multiply matrix A against matrix B, dot row i of A with column j of B. This gives the 
ij-entry in the product matrix. Thus, using the matrices in (12.3), we obtain the product 


A B as 
1 2][6 1] [1x64-2x3 1x1+4+2x4] [12 9 
7 9113 4| |7x6-9x3 7x1+9x4] |69 43 


Dimension Rule for Multiplication 


A row in the first matrix has to have as many elements as a column in the second matrix. 
Hence, the rule for multiplying matrices requires [n x m][m x k] = [n x k]. The number of 
columns in the first must equal the number of rows in the second, in which case the product 
matrix has as many rows as the first and as many columns as the second. 


We distinguish between the product of two matrices and the product of a matrix and a vector, 
for which the dimension rules are 
[2. x 2][2: x2] = [2 x 2] 


and [2 x2][2 x 1] 2 [2 x 1] 
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In the first case, we are multiplying two 2 x 2 matrices and thereby obtain another 2 x 2 
matrix. The second case is illustrated by 


lL 2/7 3 1x342x11] [| 25 

7 9|lnj |7x3-9x11| [120 
where the 2 x 2 matrix A multiplies a 2 x 1 column vector, giving a 2 x 1 column vector. 
D 


Multiplicative Identity 


The matrix that behaves like the number “1” for multiplication is called the multiplicative 
identity. In the 2 x 2 case, the multiplicative identity is the matrix J = [s zh For the matrix 


A from (12.3), we verify that ZA = AI = A by the calculations 
1 0][1 2]. 1x1+0x7 1x2+0x9] |1 2 
o 1},7 9| [0x1+1x7 0x2+1x9] |7 9 
1 2][1 0] _ [1x1+2x0 1x0-2x1| [1 2 
7 9|[0 1] [7x1+9x0 7x0+9x1] |7 9 
Matrix Multiplication is NOT Commutative 


Matrix multiplication is not commutative. In general, AB + BA; that is, the order of the 
factors in a matrix product cannot usually be reversed. Indeed, for the matrices A and B in 


(12.3), we have 
AB = 12 9 — 13 21 
—|69 43] ^. ~131 42 


No Zero-Principle 


If the product of two real numbers is zero, then at least one of the factors must itself be zero. 
This is the zero-principle. However, there is no zero-principle for matrices. Thus, you can 
have two matrices, neither of which is zero, whose product is itself zero. In the following 
example, two matrices, neither of which has only zero entries, are multiplied. The product 


is the zero matrix. 
1 0770 o] [o o 
0 0/0 1] |0 0 


Consequently, if a Æ 0 in the scalar equation ax — oy = 0 we can conclude that x = y 
because one of the factors on the left in a(x — y) = 0 must be zero. It isn't œ, so it has to 
be x — y — O and that means x — y. The equivalent algebra does not hold for matrices. In 
fact, if A Æ 0 for the matrix A (that is, there is at least one nonzero entry in A), then the 
equation AX — AY = 0 does not guarantee X = Y because neither factor in A(X — Y) 
need itself be the zero matrix. 


EXERCISES 12.3-Part A 


A1. Write each solution in Exercise A4, Section 12.1, in the form A2. Write the linear algebraic equations 8x — 9y = 12,3x —5y = 11 
X = e^'B, + e?'B;, where B, and B, are constant vectors and X in matrix-vector form. 
is as defined in (12.2). 


A3. Write the linear algebraic equations 3x — 7y — 13z — 21, 
Tx —2y — z = 14, x — 6y — 7z = 3 in matrix-vector form. 

A4. Write the IVP in Exercise A3, Section 12.1, in matrix-vector form. 

AS. Find two 2 x 2 matrices, neither of which contains any zeros but 
whose product is the zero matrix. 

A6. Find two 3 x 3 matrices, neither of which is the zero matrix but 
whose product is the zero matrix. 

A7.IfA-[ janaX-e"[ 7], compute X’ and AX. 


AS. Given the matrices A = E p B = [ a j^ C= É E 


2 dh -l 4 5 2. 


1 y Ex k «| and the vectors X — E Ye rz 
4 


3 


EXERCISES 12.3—Part B 


277 


12.3 Vector Structure of Solutions 


Z= He compute 


(a) AX 
(b) det A, the determinant of A, defined as a11a22 — a)2a2). 
(0A—2B  (d)AB,BA 


(e) (A+B), A? -2AB + B, A? + AB + BA + B? 
(f) A(tB),t(AB)  (g) (A—2DX, AX — 2X 
(h) det(A — AJ), the determinant of the 2 x 2 matrix A — AI. 


B1. Using the definitions in Exercise A8, obtain the indicated 
quantities. 
(a) AY (b)B+3C (ce) AC,CA 
(d) (B—C)*, B? — 2BC + C?, B? — BC — CB + C? 
(e) 2A—7B+4C (f) A(2B),2(AB) 
(g) (B+5DY, BY + 5Y 

B2. Using the definitions in Exercise A8, obtain the indicated 


quantities. 
(a) AZ (b AX- BY (oOX-2Y 
(d AD, DA (e) BC, CB 


(f) (A -- 3C?, A? +6AC 4+ 9C?, A? + 3(AC + CA) + 9C? 

(g) A(tC),t(AC) (h) ACX- BY 

(i) (-A? — 4B +7C°)Z —2DY +5B°X (j) det(C — AI) 
B3. Using the definitions in Exercise A8, obtain the indicated 

quantities. 


(a) Y + 3Z, 5X — 7Z 
(d) (34? — 6B3)X 
( AB—C? — 6D 
(h) det(B — AI) 


(b) BD, DB 
(e) 5X — 7Y + 8Z 
(144-4 pP 24 
à) (C -7DZ. CZ - 7Z 


(c) CD, DB 


In Exercises B4—9, rewrite the solution of the indicated IVP in the form 
X = eB, + e?'B,, where B, and B» are constant vectors. 


B4. Exercise B20, Section 12.1 B5. Exercise B21, Section 12.1 
B6. Exercise B23, Section 12.1 B7. Exercise B24, Section 12.1 
B8. Exercise B25, Section 12.1 B9. Exercise B26, Section 12.1 


In Exercises B10—15, rewrite the solution of the indicated IVP in the 
form X = e^! B, + e?! B; + e^ B5, where B;, k = 1, 2, 3, are constant 


x(t) 
vectors and X = | »(0 |. 
z(t) 


B10. Exercise B2, Section 12.2 B11. Exercise B3, Section 12.2 


B12. Exercise B4, Section 12. 


2.2 B13. Exercise B5, Section 12.2 
B14. Exercise B7, Section 12.2 


B15. Exercise B9, Section 12.2 


In Exercises B16—25, write the given system of linear algebraic equations 
in the matrix-vector form Ax — b, where x — E]. 


B16. 2x — 3y 27, 4x — 5y 29 B17. 6x —5y =2,x+2y=7 
B18. —3x +y - 5 = 0, 7x +8y-1=0 

B19. 7x = 5y +4, 2y =9x —5 

B20. —13x = 12 — 9y, 12y =x +7 

B21. 3x — 5 = —8y, 2y — 7 = —9x 

B22. 14y — 8 = 3x, 21x — 23 = 13y 


B23. 56 — 31y = 11x, 41y + 6 = 13x 
B24. 161x — 79 = 123y, 37y +5x —4=0 
B25. 11.7x — 19.8y = 6.7, 4.5x = 12.3y — 7.7 


In Exercises B26-35, write the given system of linear algebraic equations 


x 

in the matrix form Ax = b, where x = | y |. 
B26. 2x — 3y + 5z = 7, —x + 4y — 8z = 9, 12x +7y — 13z = 17 
B27. 21x — 51y -- 77z 26, —x — y c Az = 7, 23x + 37y — 122 22 
B28. 11.3x — 72.1y = 55.4z, 15.9x = 27.7z + 33.7z, 71.8y = 

81.1x 4- 64.9z 
B29. 67x — 113y + 107z = 91, 123x + 231z = 13, 321x + 55y — 

76z = —98 
B30. 16y = 21x + 5z — 7, 23z — 7y = 14 — 32x, 17 — 3x = 4y + 2z 


B31. 
B32. 
B33. 


171y—75z—6x—4 = 0, 5—4z—3y+13x = 0, 8x—11 = 7y4-12z 
34x — 23z = 9 — 29y, 15 — 2x = 9z — 8y, 43y + 7 — 6x = 65z 
1.2x — 4.3y — 5.77 = 9.8, 62x —7.3y — 5.42 = 2.2, 7.7x — 
8.3y + 9.5z = 6.8 

B34. 2x = 7y — 5z, 8x — 5y = 12z, 13x — 23y = 17z 
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B35. 57y — 11 = 13x — 12z, 8z— 19y = 24x, 119x —84z = 101y —62 
In Exercises B36—40, write the indicated IVP in the matrix form X'(1) = 


AX(t), X(0) — 
B36. Exercise A5, Section 12.1 
B38. Exercise A7, Section 12.1 


| 
| ] 2 3 1 2 
| 
4 5 6 4 5 
7 8 9 7 8 


FIGURE 12.7 Computing the value of a 
3 x 3 determinant 


EXAMPLE 12.3 


EXAMPLE 12.4 


B37. Exercise A6, Section 12.1 
B39. Exercise A8, Section 12.1 
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B40. Exercise A9, Section 12.1 
B41. 1f A=[3 | 


8 3 


B42. fA-[ 5 3] 
B43. If A = [$ 3]andX— e” 
[; 3l: 


= 
8 
3 compute X' and AX. 
B44. If A= = 


j^ compute X' and AX. 


Determinants and Cramer's Rule 


Computing Determinants 


The determinant of an n x n matrix A is the scalar det(A) whose computation we presecribe 
as follows. The determinant of the 2 x 2 array A on the left in (12.4) is the scalar ad — bc. 
The determinant of the 3 x 3 array B in the center in (12.4) can be computed in several 
ways. 

-1 —2 5 1 


12 
-| i| Bals sal e=l* {= 4 (12.4) 
789 


e d —6 -3 3 —4 
5 -2 Y 3 


For example, Figure 12.7 shows the array B with its first two columns written to its 
right. Each of the six slanted lines in the figure passes through three numbers. Each such 
slanted line represents the product of the three numbers through which it passes. Products 
associated with lines slanted upward (/) are taken as negative, while products associated 
with lines slanted downward (V) are taken as positive. The determinant is then the sum of 
the six products. 

Here, the three positive products are (1)(5)(9) = 45, (2)(6) (7) = 84, (3)(4)(8) = 96. 
The three products that will be taken as negative are (3)(5)(7) — 105, (1)(6)(8) — 48, 
(2)(4)(9) = 72. The determinant is then 45 + 84 + 96 — 105 — 48 — 72 = 0. Note well, 
however, that this method does not generalize to higher order determinants. 


Laplace (Row or Column) Expansion of the Determinant 


Higher order determinants can be evaluated via the Laplace expansion along any row or 
column. Given the matrix A with elements a;;, define M;;, the minor of element aj;, as the 
determinant of the submatrix formed by deleting row i and column j from A. Then, define 
cij, the cofactor of element a;;, as the signed minor of element a;; so that cj; = (—1)'*/ Mij. 
The determinant of A is then the sum, along any row or column, of the products of each 
entry and its cofactor. For example, computing the determinant along row i is accomplished 
via the sum det A — es ipti 


The determinant of the matrix C on the right in (12.4) computed by a row-one expansion 
is —1(—12) — (—2)(—275) + 5(127) — 93 = 4. “ 


From multivariable calculus, a x b, the cross-product of the vectors a = aji + a5j + ask 
and b = bii + b5j + 53k, is the vector produced when the determinant on the left is formally 


12.4 Determinants and Cramer's Rule 279 


evaluated by expanding the first row 


i j k azb3 = d3b» 

det] a; a a3 | = (ab; — a3b2)i — (ayb3 — a3b1)j + (abr — a3bi)k = | aab, — abs 

bj b bi aib — a5bi 
(12.5) 


We take this opportunity to remind the reader of the following useful properties of the 
cross-product a x b, where 0 in [0, x] is the angle between a and b. In Section 31.3 we 
show that the following first and third properties uniquely determine the cross-product. 


1. a,b, anda x b form a right-handed system of mutually perpendicular vectors. 
2. axb—-bxa 

3. |a x bl] = |la||||b|| sin 8 

4. 


ax(bxc)z(axb)xce 


The first property says that a x b is perpendicular to both a and b and is thus perpen- 
dicular to the plane containing a and b. There are two possible directions for such a vector, 
and the right-hand rule selects a unique direction as follows. If the fingers of the right hand 
are wrapped around a x b in such a way as to point in the direction of rotation of a into 
b (through the angle 0), then the extended thumb of the right hand points in the direction 
of a x b. This is equivalent to the statement that if a is rotated through the angle 0, into 
coincidence with b, then a screw with a right-handed thread, turned in the same direction, 
would advance in the direction of a x b. 

The second property, an immediate consequence of the first, says that the cross-product 
is not commutative. In fact, it says the cross-product is anticommutative, reversing direction 
if the order of the vectors in the cross-product is reversed. 

In the statement of the third property, the notation ||a|| indicates the length of the vector 


a, so that 
lal = ya? + a2 +43 


Therefore, the third property says that the length of the cross-product is equal to the product 
of the lengths of the factors, times the sine of the angle between the factors. 

The fourth property says that the cross-product is not associative. Table 31.3 in Section 
31.3 lists several other algebraic properties of the cross-product. In particular, it gives more 
detail on the nonassociativity described by the fourth property. $ 


PLANE AREA VIA DETERMINANT Again from multivariable calculus, |a x b|| is the area 
of the parallelogram whose edges are the vectors a and b. If a = aii + aj + Ok and 
b = bii + b2j + Ok are plane vectors, then the area of the parallelogram they span is 


i j k 
a a 
det | @1 a» O0]||z- |det = jaib — azb; | 
bi b 
bi b, 0 


The absolute value of the 2 x 2 determinant det(A) can be interpreted as the area of the 
parallelogram whose edges are the row vectors of the matrix A. 


TRIPLE SCALAR (Box) Propucr In multivariable calculus the absolute value of 
A * (B x C), the Triple Scalar (or Box) Product, is found to be the volume of the 
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parallelepiped formed by the three vectors A, B, and C. Indeed, given the vectors A — 
ait a5j + a3k, B = bii + boj + b3k, and C = cji + coj + c3k, this volume is the absolute 
value of 
a, a2 a 
A-(BxC)-—det| bij b» bi 


Cy C2 C3 


Determinant of a Product 


The determinant of a product is the product of the determinants, as illustrated with the fol- 
lowing example. Thus, for the matrices A, B, and the product A B in (12.6), the determinants 
are —134, —56, and 7504 = (—134)(—56), respectively. 


-1 -3à 5 -à $ -4 8 —4 -15 
A=| 1 -6 1 B=| 52 7 AB = | —30 14 -47 
—§ 1 e8 3 -I =i T7 -3 #1 
(12.6) 


Cramer’s Rule 


Cramer's rule represents the solution of a system of linear equations as ratios of determinants. 
For example, the Cramer's rule solution of the linear system Ax — y 


aq an d3||XI yı 
421 an 423. | | X2 | =|» (12.7) 
431 032 433 X3 y 
A3 
is given by 
yı a 13 ay yı a13 ai a yı 
y2 an 23 a2) y a23 a2) a22 y2 
. J3 0832 33 43 3 433 231 anz  J35 
X] = X2 — X3 = 
ai an 413 ai a 413 41 an 433 
ai an az 4» an az ai an 3 
a31 032. 433 a31 A32 033 31 a32 033 


where |A| = det A. Note that the array in the numerator of the fraction giving x, k = 1, 2, 3, 
is the system matrix A with the kth column replaced by the vector y. 

Finally, we point out that Cramer’s rule is not practical ifn > 2. For example, ifn = 3, 
it takes 12 multiplications and 5 additions to compute a single determinant. There are four 
different determinants to compute, and then three divisions. Hence, Cramer’s rule requires 
48 multiplications, 20 additions, and 3 divisions, for a total of 71 arithmetic operations. As 
we will learn in Unit Eight, a3 x 3 linear system can be solved with 27 arithmetic operations 
using Gaussian elimination, a technique to be studied in Section 12.5. 


EXERCISES 12.4—Part A 


A1. Find the area of the parallelogram determined by the vectors A4. Use Cramer's rule to find the solution of the system in Exercise 
A = 2i+ 3j, B = 5i — 7j. A3, Section 12.3. 


A2. Find the volume of the parallelepiped determined by the vectors AS. Verify that det(A) det(B) = det(A B) for the matrices in (12.6). 


A = 3i — 7j + 4k, B = 6i — 9j — 11k, C = 7i — 12j + 2k. 
A3. Use Cramer's rule to find the solution of the system in Exercise 
A2, Section 12.3. 


EXERCISES 12.4—Part B 
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B1. Find the cofactors for the matrix A in (12.6). 


In Exercises B2—5, find the area of the parallelogram determined by the 
ziven pairs of vectors. 
B2. A = —3i + 5j, B = 8i — 13j 
B4. A = 7i + 13j, B = —4i — 17j 


B3. A = 9i — Sj, B = 6i + 11j 
BS. A=i+j,B = -i+3j 


In Exercises B6—9, find the volume of the parallelepiped determined by 
each of the given triples of vectors. 


B6. A = —8i + 5j + 7k, B = 2i — 3j 


5k, € = 21i+ 2j + 17k 


B7. A = 13i - 9j — 17k, B = —3i+ 5j+ 23k, C = —18i+ 13j+ 14k 
B8. A = —5i — 12j — 13k, B = —i+ 7j — 15k, C = 10i — 11j + 13k 
B9. A = 2i + 4j + k, B = 19i — 11j + 17k, C = 25i + 16j — 17k 


For the linear algebraic equations given in Exercises B10—19: 


(a) Obtain a solution by Cramer's rule. 


(b) Obtain a solution using the solver in some modern 
technological device and then compare answers. 


B10. Exercise B16, Section 12.3 B11. Exercise B17, Section 12.3 
B12. Exercise B18, Section 12.3 B13. Exercise B19, Section 12.3 
B14. Exercise B20, Section 12.3 B15. Exercise B21, Section 12.3 
B16. Exercise B22, Section 12.3 B17. Exercise B23, Section 12.3 
B18. Exercise B24, Section 12.3 B19. Exercise B25, Section 12.3 


For the linear algebraic equations given in Exercises B20—29: 


(a) Obtain a solution by Cramer's rule. 


(b) Obtain a solution using the solver in some modern 
technological device and then compare answers. 


B20. Exercise B26, Section 12.3 B21. Exercise B27, Section 12.3 
B22. Exercise B28, Section 12.3 B23. Exercise B29, Section 12.3 
B24. Exercise B30, Section 12.3 B25. Exercise B31, Section 12.3 
B26. Exercise B32, Section 12.3 B27. Exercise B33, Section 12.3 
B28. Exercise B34, Section 12.3 B29. Exercise B35, Section 12.3 
B30. If the matrices A, B, C, I are as defined in Exercise A8, Section 


12.3, compute and comment on each of 


Introduction 


B31. 


B33. 


(a) det(A B), det(A) det( B), det(B A) 

(b) det(ABC), det(A) det(B) det(C), det( BC A), det(AC B) 
(c) det(A — A7) (d) det(A + B), det(A) + det(B) 

(e) det(B — 21), det(B) — 2 


If the matrices A, B, C, D, I are as defined in Exercise A8, 
Section 12.3 compute and comment on each of 


(a) det(AC), det(A) det(C), det(C A) 

(b) det(AB D), det(A) det(B) det(D), det(D B A), det(A D B) 
(c) det(B — AI) B32. det(A — C), det(A) — det(C) 

(d) det(C + 37), det(C) +3 


: -Í 1 2 2 —2 1 5 0-2 
IfA-|-3 2 3|,B=|3 0 -1],C=|3 1 -1], 
104 i I 3 4 4 1 


(a) det(A B), det(A) det(B), det(B A) 

(b) det(A BC), det(A) det(B) det(C), det(BC A), det(AC B) 

(c) det(A DC), det(A) det(D) det(C), det( DC A), det(AC D) 

(d) det(A — A7) (e) det(A + B), det(A) + det(B) 

(f) det(A — C), det(A) — det(C) (g) det(B — 21), det(B) — 2 
(h) det(C 4-37), det(C) +3 (i) det(A — J), det(A) — 1 


For the matrices in Exercises B33—36: 


(a) Compute the determinant by some form of modern 
technology. 


(b) Obtain the Laplace expansion by any one row and any one 
column. 


(c) Obtain all sixteen cofactors. 


2 € 1 3 =3 ] -1 2 
ex 2 0 ES! i 4 

l 5 —2 2 Bas. 3 0 l 1 

4 3 -3 1 5 —2 -2 

2 3 ] =] 6 5 — 2 
-1 1 -2 1 2 —2 l 

5 4 -4 -2 B37. 4 —3 L =i 
-3 0 1 3 7 6 0 -7 


Solving Linear Algebraic Equations 


A set of simultaneous linear algebraic equations such as 


at+b+c=2 


9a—3b+c=4 25a+5b+c=-—5 


can be solved in a variety of ways. We examine some of those ways. 
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Successive Elimination 


Although somewhat tedious, successively eliminating variables in a set of linear equations 
will lead to a solution. The first equation is solved for the "first" unknown, and this value is 
substituted into all remaining equations, thereby eliminating the first unknown from the set 
of equations. The process is repeated with the two remaining equations, yielding a numeric 
value for the third unknown. By working back through the equations, values for the second 
and first unknowns can be found. 

Solve the first equation for a, obtaining a — —b — c 4- 2, which is substituted into the 
second and third equations to yield 


| —35 — 85 e —14 (12.8a) 
—20b — 24c = —55 (12.8b) 


The set of three equations in three unknowns has been reduced to a set of two equations 
in two unknowns. The variable a has been eliminated from the system. Solve (12.8a) for 


b= —ic + z and substitute this into (12.8b), producing 
| 32, __ 95 
3O= 7-9 


an equation in which just the variable c appears. There are now the three equations 


at+b+c=2 (12.9) 

—]2b — 8c = —14 (12.10) 

Bea 8 (12.11) 

We then determine c from (12.11) via simple arithmetic, obtaining c = 2. Substitute 

this value for c into (12.10), thereby obtaining b = — B, Make substitutions for both b and 
c in (12.9), and find a = —3. Clearly, this successive elimination process that results in 


the “triangular” system (12.9)-(12.11) will be exceedingly simplified if the variables are 
not dragged along at each step. 


Gauss Elimination 
By working with just the array of numbers and suppressing the names of the unknowns, we 
can represent the set of equations via the augmented matrix 

| 1 l 2 


25 5 ] =5 


The process of eliminating the unknown a from the second and third equations amounts 
to adding and subtracting multiples of row 1 in such a way as to create zeros in the second 
and third positions in column 1. This row elimination arithmetic is accomplished by adding 
to row 2, row 1 multiplied by —9, yielding the matrix 


l 1 1 2 
B,=| 0 -12 -8 -—14 
23 5 I =5 


and then adding to row 3, row 1 multiplied by —25, yielding the matrix 


l l l 2 
By = |0 12 8 14 


0 —20 —24 -55 


Of course, the rows of matrix B» represent equations (12.82) and (12.8b). 
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The equivalent of solving (12.82) for b, and using it to eliminate b from (12.8b) is using 
the second row in matrix B» to create a zero at the 3-2 position. This is done by adding to 


row 3, row 2 multiplied by — H, yielding the matrix 


l l l 2 
B;=|0 -12 -8 -14 


32 95 
0 0-2 -3 


The process of solving (12.11) for c, then using that value to eliminate c from (12.10), 
then using the values of b and c to eliminate b and c from (12.9) is called back substitution. 
Since we have already done that arithmetic, we'll not repeat it. 

The process of row-reducing the augmented matrix B to the upper triangular form seen 
in B3 is called Gaussian elimination. Thus, the matrix system Ax = b can be solved by 
forming the augmented matrix [A, b], row-reducing to an upper triangular form by Gaussian 
elimination, and finishing with back substitution. 


Gauss-Jordan Reduction 


The process of row reducing the augmented matrix until only 1s remain on the main diagonal 
is called Gauss-Jordan reduction. Requiring more computations, it is more "expensive" than 
Gaussian elimination followed by back substitution. Section 39.1 considers the number of 
arithmetic operations needed to complete each process and seeks ways to reduce this number 
to a minimum. 

Gauss-Jordan reduction of the augmented matrix B yields 


1 0 0 -% 
6 IL 0 =Ë (12.12) 
0 0 1 8 


from which the solution for the vector x is immediate. It's the rightmost column of (12.12). 


Row-Echelon and Reduced Row-Echelon Forms 


If Gaussian elimination steps lead to a matrix wherein the leftmost nonzero entry of each 
row is a 1, rows with all zeros are below all rows with nonzero entries, and the lead 1 in 
row k + 1 occurs in a column to the right of the column in which the lead 1 occurs in row 
k, then that form of the matrix is called a row-echelon form. 

Reducing B to B3 does not achieve an echelon form because the leftmost nonzero 
entries in rows 2 and 3 are not 1’s. If we multiply row 2 by ah and row 3 by -$. we 


achieve the echelon form 


111 2 
2 i 
01$ £4 
0015 


The leftmost nonzero entry in each row is a 1, there are no zero rows, and each leading 
1 occurs to the right of the leading 1 in the previous row. The row-echelon form of a matrix 
is not unique. A matrix has many row-echelon equivalents, depending on exactly how the 
Gaussian elimination steps were performed. 

When each leading 1 in the nonzero rows is used to create as many zeros in the column 
above it as possible, the matrix is said to be in reduced row-echelon form. 'The reduced 
row-echelon form (12.12) of the matrix augmented B, denoted by rref (B), is unique. 
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The number of nonzero rows in the reduced row-echelon form of A is a unique number 


called the rank of A. 


EXERCISES 12.5-Part A 


A1. To solve the linear system Ax = b, use Gaussian elimination to 
row-reduce the augmented matrix [A, b] to an upper triangular 
matrix. Is this necessarily a row-echelon matrix? Explain. 

A2. Answer true or false: To use back substitution, the upper triangular 
matrix must be in row-echelon form. Explain your answer. 

A3. Solve the linear system in Exercise B26, Section 12.3, by the 
method of successive elimination. 


EXERCISES 12.5—Part B 


A4. Solve the system considered in Exercise A3 by writing the 
augmented matrix, row reducing to an upper triangular form, and 
using back substitution. Compare the solution process to that used 
in Exercise A3. 


AS. Obtain the reduced row-echelon form for the augmented matrix in 
Exercise A4. 


B1. If A is given in Exercise B32, Section 12.4 and Y = ki ; 
solve AX — Y by É 
(a) an appropriate technological tool. 
(b) the method of successive elimination. 
(c) Gaussian elimination and back substitution. 
(d) Gauss-Jordan reduction to reduced row-echelon form. 


B2. Repeat Exercise B1 for BX = Y, where B is given in Exercise 
B32, Section 12.4 and Y is given in Exercise B1. 


B3. Repeat Exercise B1 for CX = Y, where C is given in Exercise 
B32, Section 12.4 and Y is given in Exercise B1. 


B4. Repeat Exercise B1 for DX = Y, where D is given in Exercise 
B32, Section 12.4 and Y is given in Exercise Bl. 


For the linear systems designated in Exercises B5-13, solve by 


(a) the method of successive elimination. 
(b) Gaussian elimination and back substitution. 


(c) Gauss-Jordan reduction (which yields the reduced 
row-echelon form of the augmented system matrix). 


B5. Exercise B27, Section 12.3 
B7. Exercise B29, Section 12.3 


B9. Exercise B31, Section 12.3 


B6. Exercise B28, Section 12.3 
B8. Exercise B30, Section 12.3 
B10. Exercise B32, Section 12.3 


B11. Exercise B33, Section 12.3 B12. Exercise B34, Section 12.3 
B13. Exercise B35, Section 12.3 
3 
If Y = = and M is the matrix specified in Exercises B14—17, solve 
-8 


each system MX — Y by 
(a) an appropriate technological tool. 


(b) the method of successive elimination. 


(c) Gaussian elimination and back substitution. 

(d) Gauss-Jordan reduction to reduced row-echelon form. 
B14. Exercise B33, Section 12.4 
B16. Exercise B35, Section 12.4 


B15. Exercise B34, Section 12.4 
B17. Exercise B36, Section 12.4 


For the augmented matrices in Exercises B18—27: 


(a) Write the set of equations represented by the matrix. 
(b) Obtain a row-echelon form. 


(c) Write the set of equations corresponding to the row-echelon 
form found in part (b). 


(d) If a solution to the system of equations exists, obtain it from 
y q 
part (b) and back substitution. 


(e) Obtain the reduced row-echelon form. 


(f) If a solution to the set of equations exists, use an appropriate 
technological tool to find it. 


0 —2 11 —12 —4 10 12 -7 
-10 9 -4 -8 B19. 9 6 8 —4 
1 


—6 -3 6 10 


6 6 6 -8 5 —12 11 —2 
7 —7 0 -8 B21. 5 -10 11 9 
-6 3 9 7 —11 4 —12 —9 


B27. 
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Homogeneous Equations and the Null Space 


Homogeneous Equations 


Homogeneous linear algebraic equations are of the form $7; ,a;x, = 0, where the ag 
are coefficients and the x; are variables. A pair of such homogeneous equations in two 
unknowns represents a pair of lines each passing through the origin. Three such equations 
in three unknowns represent three planes passing through the origin. 

Ann x n system of homogeneous linear equations of the form Ax = 0 either has x = 0 
as its only solution or infinitely many solutions. In the first case, det A Æ 0, and in the 
second, det A = 0. For clarity, we formalize these remarks as a theorem. 


THEOREM 12.1 


If det A Z 0, then Ax = 0 has x = 0 as its only solution. 
If det A = 0, then Ax = 0 has infinitely many solutions. 


Table 12.1 lists five examples that illustrate Theorem 12.1. 


Example Equations detA Solution 
2x + 3y =0 2 8| 0 
12.5 : --—2 
5x —7Ty =0 5 =y] 4 H 
2x +3y=0 2 3 —3 
12.6 . [20 pl ? 
7x -23y 20 7 2| l 
2x+3y+4z=0 2 3 4 0 
12:7 5x —y—7z=0 5 -1l -7|2-187 0 
x —2y 4-62 20 ] —2 6 0 
26 
2x +3y+4z=0 2 3 4 -=F 
12.8 2x +3y+4z=0 3 2 6-0 rj 3 
x—2y+6z=0 |] o3 
2x +3y+4z=0 2 3 4 -3 A 
12.9 3x + Sy +62 =0 3 $ 6-0 at il+] 0 
5x + By 10; 20 5 15 10 0 l 
TABLE 12.1 Examples of homogeneous equations 


The equations of Example 1, Table 12.1, implicitly define the lines graphed in Figure 12.8. 
The two lines are distinct and pass through the origin. The only solution to this set of equa- 
tions is (x, y) = (0, 0). In fact, the array of system coefficients has the nonzero determinant 
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EXAMPLE 12.6 


EXAMPLE 12.7 


EXAMPLE 12.8 


—29, so we can use Cramer's rule to solve this (homogeneous) system, obtaining 


0 3 2 0 

‘ l E 0 0 EN. j " 0 E" 
IE. —29 D. —29 
5 -1 5 b 


Thus, for homogeneous equations, if the system determinant is nonzero, then the only 
solution for the system is zero. For each variable, the determinant in the numerator is of a 
matrix with a column of zeros. Such determinants are always zero. Ed 


The equations of Example 12.6, Table 12.1, are not distinct, as Figure 12.9 shows. In fact, 
multiplying the second equation by Z converts it to the first. Moreover, the determinant 
of the system array is now zero, so Cramer’s rule does not apply. However, there are now 


an infinite number of solutions, obtained by solving the first equation for x = -i y. For 
each value of y, there is a corresponding value of x, namely, x — -$y. Alternatively, this 
solution can be written in terms of a parameter t as x = —3t, y = t. For every possible 


real number f, there is a corresponding pair (x, y) = (—3t, t). We can also express these 
solutions in vector form, as listed in Table 12.1. Thus, for homogeneous equations, a zero 
determinant means many solutions; whereas a nonzero determinant means just one solution, 
the zero solution. s 


N 


N 


0 
£i y 
=2 
FIGURE 12.9 Homogeneous equations FIGURE 12.10 Homogeneous 
in Example 12.6 equations in Example 12.7 


Each equation in Example 12.7, Table 12.1, represents a plane passing through the origin. 
Figure 12.10 suggests the three planes are distinct, so the only solution of these three 
equations is the zero solution, namely, (x, y, z) = (0, 0, 0). Indeed, the system matrix has 
the nonzero determinant —187, so Cramer’s rule applies and the only solution is the zero 
solution. “ 


The equations of Example 12.8, Table 12.1, are graphed in Figure 12.11, which suggests two 
of the planes are coincident, so there might be only two distinct equations. The determinant 
of the system matrix is zero, so Cramer’s rule does not apply. From the reduced row- 
echelon form of the system matrix in (12.13), we obtain the multiple solutions (x, y, z) = 
(—*r, 3t, t), which Table 12.1 and (12.13) give in vector form. From the reduced row- 
echelon form of the system matrix in (12.13), we see that it has two nonzero rows and, 
hence, has rank 2. The rank is consistent with the number of distinct equations we found 


EXAMPLE 12.9 
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FIGURE 12.11 
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Homogeneous equations 


FIGURE 12.12 Homogeneous equations 
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the system to contain 


à 4 4 | s 2 TO -2 
3 3 6|—]|0 1-i|[2|»5i sx=r] $| 215 
1 —2 6 0 0 0 — 1 


Figure 12.12, a graph of the equations in Example 12.9, Table 12.1, suggests there may be 
only one distinct plane and, hence, one distinct equation. The determinant of the system 
matrix is zero, so Cramer's rule cannot be used. From the reduced row-echelon form of the 
system matrix in (12.14), we obtain the solution (x, y, z) — (—3t, — 2h, tj, t2), which now 
depends on the two arbitrary constants, ¢; and t2. From the reduced row-echelon form of 
the system matrix in (12.14), we see it has only one nonzero row, so the rank is 1. The rank 
is consistent with the number of distinct nonzero equations we found the system to contain 


2 3 4 1 2 2 x — —$y-2z -3 -2 
3 z 6| — |o 0 0|> yy >x=1, 1| +h 0 
5 = 10 000 z=z 0 l 
(12.14) 
Table 12.1 and (12.14) express the general solution in terms of the two “basis” vectors 
-3 _2 
Vs = 1 and V6 = 0 
0 1 


Any member of the general solution can be realized as a sum of the form avs + bve, where 
a and b are constants. Such a sum is known as a linear combination. Any such member 
of the general solution lies in the plane described by the one distinct equation to which the 
system reduces and that plane can be described by the single equation x 4- i y+z=0.% 


The Null Space 


The collection of all solutions to a homogeneous linear system is called the null space. 
Vectors whose linear combinations give all members of the solution set are said to span, or 
generate, the null space. If a set which spans the null space is “minimal” because no vector 
in it is a linear combination of the others, it is called a basis. Table 12.2 lists bases for the 
null spaces of the examples in Table 12.1. In Examples 12.5 and 12.7, the only solution is 
x = 0 so the bases for these null spaces are empty. 

In Example 12.6, the null space consists of all multiples of a single vector and any 
multiple of that single vector can be considered a basis vector for the null space. This is 
again the case in Example 12.8. AII solutions are a multiple of a single vector, so a basis for 
the null space consists of a single vector. That vector can be any multiple of the vector used 
to express the solution set, and often, it is convenient to use a multiple whose components 
have no fractions. 

In Example 12.9, the general solution contains all vectors lying in the single distinct 
plane represented by the given equations. It takes two noncolinear vectors in a plane to 
express all other vectors in that plane. The reduced row-echelon form of the system matrix 
led to the vectors vs and vg in (12.14), and Table 12.2 lists these two vectors as a basis 
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EXAMPLE 12.10 


Solution Basis for Null Space 


—3 =f -$] r-2 -37 [= 
12.9 xfi BENZ 0 Ls 0 or 2 ll g 0 
0 l 0 l 0 l 


TABLE 12.2 Null spaces for examples in Table 12.1 


for the null space. Additionally, Table 12.2 lists fraction-free multiples of vs and vg in an 
alternative basis for the null space. In fact, any two linear combinations of v5 and v6 which 
result in noncolinear vectors can be taken as a basis for the null space. For example, the 
vectors U = 2v5 + vg and V = 4v5 — vs, given in (12.15), can be taken as a basis for the 
null space in Example 12.9 


-i = i =; E =A 
Uz2 1|/ + 0| = 2 and V—4 1|- 0| = 4 (12.15) 
0 1 l 0 | -— 


Linear Dependence and Independence 


Section 5.4 describes linear dependence and independence of functions. The functions f (x) 
and g(x) are linearly dependent if the equation af (x) + bg(x) = 0 has nonzero solutions 
for the constants a and b. If the only solution to this equation is a = b = 0, then the 
functions are linearly independent. 

The concepts of linear dependence and independence also apply to vectors. A collection 
of vectors {vz}, k = 1,..., n, is said to be linearly independent if the only solution of 
the vector equation P ad SjVj = 0 is the zero solution s; = 0,k = 1,..., n. If there 
are nonzero solutions for the constants s;, then the vectors {v+} are said to be linearly 
dependent.s, X 0, then we can express v; in terms of the other vectors in the collection by 
writing vj = — 35, (sy/si)Vi- 

In practice, the condition $7; , s.v; = 0 can be applied by writing the augmented 
matrix A = [vi,..., v,] and determining if the vector s, whose components are sp, k = 
ls n, is 0 or not. If the null space of A contains more than just 0, then a solution s zz 0 
exists and the columns of A are linearly dependent. If the basis for the null space of A 
contains only 0, then s = 0 and the columns of A are linearly independent. 


è 3 . . 
Let v, k = 1,2,3, in PR S, Vy = 0 be the column vectors given in (12.16), and let A = 
[Vi, V2, V3] be the matrix whose columns are the vectors v. Since det A = 0, the system 
of homogeneous equations in (12.16) has multiple solutions, so there are nonzero solutions 


12.6 Homogeneous Equations and the Null Space 
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for the constants sy. Hence, the given vectors are linearly dependent. (See Exercise A1.) | 


] —]1 —2 1 -l -2 Sy 0 
sp} 2) + 5 O} + 53 2 | = | 2 0 2 s| = |0 (12.16) 
3 l 4 3 ] 6| | 83 0 
4 
EXERCISES 12.6—Part A 
A1. Obtain at least one nonzero solution for the s; in (12.16), thereby A3. Determine bases for the null spaces of the matrices in Exercise A2. 
confirming the linear dependence of the vectors v, in Example A4. The dimension of the null space of the matrix A is the number of 
12.10. (necessarily linearly independent) vectors in a basis for the null 
A2. Determine the rank of each of the following matrices. (See the end space. For each matrix A in Exercise A2, show that the dimension 
of Section 12.5.) of the null space is 3 — rank A. 
—24 —36 —20 b 6 -0 -l -26 —25 -31 AS. For each matrix A in Exercise A2, write the general solution of the 
PES =z ERO) = -— exl 9 z 5 
(a) e. * in (b) : »- xi (c) Es H- a homogeneous system Ax = 0 in vector form. 
EXERCISES 12.6—Part B 
B1. For each of the following matrices, determine the rank and a basis (b) if det A 4 0, show that Cramer's rule gives the unique 
for the null space. solution X = 0. 
70 —64 6 —68  —50 6 —56 (c) if det A = 0, obtain the general solution, making free use of 
mils -6 3 g| — =B =A symbolic technology where appropriate. 
z : —2 9 63 —54 , : ; 5. ds 
0 18 —24 —12 -2 -78 56 (d) from the general solution, determine a basis for the null space 
of A. 
2% 62 -4 Tl , : 
( -06  —36 40 —57 (e) determine the dimension of the null space of A; that is, 
€) 57 81 —136 57 determine the number of independent vectors in a basis for 
70 26 l6 59 the null space of A. 
In Exercises B2-8, determine if the columns of the given matrices are (f) obtain the reduced row-echelon form of A and, from it, 
linearly independent or dependent. Support your conclusions with ap- construct the general solution to the homogeneous system of 
propriate evidence. equations. 
r_10 26 —24 -9 12 -12 (g) obtain a basis for the null space of A by using a computer 
B2. | —12 13 57 B3. 6 4 7 algebra system's built-in functionality. 
L-45 96  —9 3 > —9 (h) determine the rank of A; show that in each case it is equal to 
= S Jë d 6 the number of independent rows in A. 
27 =27 =6 2 12 9 10 T e z í s 
B4. | —63 63 14 B5. 4l 1 p i0 (i) verify that the rank of A plus the dimension of the null space 
L-81 81 18 -12 9 3 3 of A adds up to n. 
s —54 —36 —54 
3 —103 3 4 2 5 2 E 
T N gB.| 7 9| pols 7| mi|:o s rm 
B6 10 —2 —26 B7 12 16 8 —5 1 172 :82 54 36 54 
"| 29 —28 0 “127 36 18 E : B 
wit - 50 R -— 3 —52 
E ue ix =~ po e 3 ai 14 15-31 
[-35 23 40 B12. | -72 22 74 B13. | ; 9 %2 -4 
B8 8 —19 —62 81 —36 —99 4 10 38 13 
j 59  —15 24 E £ 
| 531 =22 —14 68 51 —6 49 
" i gi -7 51. 12. 38 
In Exercises B9—14, n x n matrices A of different rank are given. If each "| 96 -35 -ið -25 
matrix represents a homogeneous system AX = 0, —31 33 12 22 


(a) compute the determinant of A. 
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If 7 is the identity matrix of the appropriate dimension, for each matrix (c) Using a computer algebra system, obtain X, the general 


A given in Exercises B15-19: 


(a) Obtain all values of A that satisfy the equation 


det(A — AI) = 0. 


(b) For each value of A = A; found in part (a), form the matrix 


solution of the system AX — Y. 


(d) Show that X = X, + X4, the sum of X,, a particular solution 
of the nonhomogeneous equation, and X}, an arbitrary 
member of the null space of A, which is therefore the general 
solution of the homogeneous equation AX = 0. 


C, — A— XA. 
E ee ‘ ; ; [-51 -29 -58 305 
(c) Find a basis for the null space of each C, found in part (b). B20. -4s -4s —57|. | 330 
(d) Show that any vector v; in the null space of C; satisfies the L 9 —9 6 -3 


equation Av, = AxVx. 


! -3 -5 —65 
B15. | ° E B16. E =a 


2 3 22 


77 


[ -7 -3 -16 ei 
B17. | -32 1 —100 B18. 
0 1 96 


In each of Exercises B20—25, a matrix A and a vector Y is given. For B25. 


each: 
(a) Show that det A = 0. 


| 


[ 14 35 3 —164 66 54 18 —60 
B21. | -32 -47 23],] 246 B22. |38 35 Sla 4 
.68 -—63 72 369 78 56 32 —148 


116 —524 112 -12 -10 14 6 10 
7 35 5 B23. | 36 12 -42 -30|'|-72 
-51 230  —50 L-6 -3 7 -9| |-37 
-63 286 —62 [-32 10 -75 -13] [ 503 
8 -5 16 26| |-145 

B24. |40 -3 4 -5I -12 

| & 52 -34 10] | -38 

-39 -35 18 —65] [129 

-39 -35 18 -65] | 129 

-32 -32 8 -64]"| 152 

| 23 19 -14 33] |-53 


(b) Obtain a basis for the null space of A. 


Inverses 


The Matrix Inverse 


If A and B are square matrices (n x n) and AB = J, then x n identity, then B is called 


the multiplicative inverse of A, much like i is the multiplicative inverse of 3. Not every 


matrix A has an inverse, but if A does have an inverse it is often denoted by the symbol 
A~!. Matrices that have an inverse are called nonsingular, or invertible. 


The Inverse by Brute Force 


l 2 


Given the matrix A — G i we seek its multiplicative inverse using brute force. Hence, 
seek the matrix B = [^ ^] for which the product AB = I, where / is the 2 x 2 identity 


1 


0 i i! If we equate the product A B with J, we form the four equations 


matrix J = [ 


a+2c=1 b+2d=0 
1 
"U- T mtel GARD 


in the four unknowns a, b,c, and d. Solving these equations leads to the matrix B = 


3I N 


i] for which AB = BA = 1. Thus, we have computed B, the multiplicative inverse 


of the matrix A. 
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Inverse by Gaussian Elimination 


As an alternative to the brute force method, we can find the inverse of A by augmenting 
A with 7 and then row reducing this augmented matrix so that the portion where A was 
becomes 7. The portion where J was will be A^, Complete (Gauss-Jordan) row reduction 
of the augmented matrix [A,7] = [5 4 9 j]leadsto[I, A] = [j 9 5 _i].A 
glance at (12.17) shows that the product A B takes place by columns. Writing B as [b,, b2], 
where b; and b are the columns of B, shows that AB = [Ab), Ab;]. Hence, solving for 
B amounts to solving the two systems Ab; = e; and Ab; = e», where e, and e; are the 
columns of /. Instead of forming two different augmented matrices, we have combined 


[A, ei] and [A, e2] to form the one augmented matrix [A, e1, e2] = [A, Z]. 


A Matrix with No Inverse 


A square (n x n) matrix A having no inverse is said to be singular, or noninvertible. 

Why would a matrix not have an inverse? What symptoms would indicate that a matrix 
would not be invertible? We will show that A is invertible if det A # 0 and singular if 
det A = 0. 

For example, augmenting to [A, 7] the matrix A on the left in (12.18) and row-reducing 
lead to the three inconsistent equations 0 = 1, 0 = —2, and 0 = 1, shown in the bottom 
row of the reduced matrix on the right in (12.18) 


123 123100 D 9-1 Q-$ i 
A=/4 5 6|25[A,]]2|4 5601 0|>jo 1 2 0 1 -1 
7 89 78 9 00 1 0 0 0 1 2 1 


(12.18) 


If C = [c;, €?, c3] is a candidate for the inverse of A and the columns of J are ez, k = 
1, 2, 3, then the equation AC = J decomposes into the three sets of equations Ac, = 
ez, k = 1,2, 3. Solving any one of these sets of equations by Cramer's rule would require 
the determinant of A to be nonzero. However, we find that the determinant of A is 0, so 
Cramer's rule does not apply. The row reductions that lead to three zeros as the third row of 
the reduced A do not likewise lead to a zero as the third component in any of the vectors ez. 
The rank of A is notn = 3, the rank of 7. When A row-reduces to an echelon matrix of rank 
less than n, the determinant will be zero and the equations in the reduced form of [A, 7] 
will be inconsistent. Thus, if det A = 0, the inverse of A will not exist. Correspondingly, 
if det A Z 0, then Cramer’s rule will lead to solutions for the vectors c; and, hence, to 
C — A7. 


AL fA =|; 7E AAXAE E 
(a) Show A is nonsingular. (a) Show det A = 0. 
(b) Obtain A^! by solving AB = I for B = A™', element by (b) Show that the reduced row-echelon form of A is not J. 
element. 


(c) Show the reduced row-echelon form of [A, 7] contains an 


(c) Obtain A^! by row-reducing [A, J] to [J, A^]. inconsistent equation, so that A^! does not exist. 
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AS. Tf A = [G5 an] is ann x n (square) matrix whose kth column 
is az, and AB = I,, show that BA = I. Hint: Argue that 
det(B) Æ 0 so that, by Cramer’s rule, each Ba; = ex, 
ome oues n, has a solution, where e; is the kth column of 7,. 


A4. Suppose AB = I, making B = A^! the inverse of A. Suppose 
further that C is proposed as a different candidate for the inverse of 
A. Show that C = A^, making the inverse unique. Hint: If C is an 
inverse of A, then AC = I. 

AS. If A= ls A and ad — bc # 0, the inverse can be found by 
solving Ab; = e; and Ab; = e for B = [b;, b2], where e; and e; 


EXERCISES 12.7—Part B 


are the columns of the 2 x 2 identity matrix. Show this leads to 
B=A?=-—} [s p^ as a simple rule for finding the inverse 


ad —bc c a 


of a 2 x 2 matrix. 


A6. The transpose of the n x m matrix A, denoted AT, is the m x n 
matrix formed by interchanging the rows and columns of A. Thus, 
the rows of AT are the columns of A, and the columns of AT are 
the rows of A. Let A; and A» be the matrices A in Exercises A1 
and 2, respectively. Show that 


(a) (A142)! = ATAT (b) det(A;) = det(AT) 


-3 -l 7 2 
Bl. If A — E 5 | and Y = Ell obtain X, the solution 
2 -H = 5 


of AX = Y as X = A^!Y. Verify this solution by row-reducing 
[A, Y] to [7, X]. 


For the matrices A given in Exercises B2-7: 


(a) Obtain det A, since A^! exists only if det(A) 4 0. 
(b) Obtain A^! using a modern technological device. 
(c) Verify that AA! = A^ A — I. 


(d) Obtain A^! by “brute force,” writing and solving the n? 
equations arising from AA"! = J. 


(e) Obtain A^! = [Xi, X», ..., X,,] column by column by 
solving the n linear systems AX, = ej, k = 1,...,7, where 
e, is the kth column of /. 


(f) Obtain A^! using Gaussian elimination to bring the 
augmented matrix [A, 7] to the form [7, A1]. 
adjA 


(g) Obtain A^! by the formula A^! = >, where adj A is the 
transpose of the matrix of cofactors. Thus, each element a;; in 
A is replaced by (—1)'*/ M;;, its signed minor, and the 
resulting matrix is transposed (see Exercise A6) to form 
adj A, the matrix called the adjoint (or conjoint, adjunct, 
adjugate, and a host of other names). The naming problem 
arises because adjoint, the most common name for this 
matrix, is already used in a different context in linear algebra 
and mathematics in general. 


Hu -2 7 -1 -1 -3 
B2./-11 12 10| B3.| 4 -6 8 
1 3 7 11 12 6 
-12 -2 9 -8 
7 -i -12 
— 2 
B4. |-6 8 -2| BS T 8 S 
o A ad - 6 7-2 
0 2 2 9 
-9 -2 17 4 -1 4 5 7 
-10 -7 -7 5 6 4 10 4 
Beja o r u| "Ales D To 
2 0-2 -2 -6 5 7 -9 


By the formula A~! = 354, the inverse of the 2 x 2 matrix A = ls °] is 


det A 
1 - " . n " . 
l -[ - | because adj A is formed by interchanging the two entries 
ad—bc L—«c , ad - : i e : 
on the main diagonal and negating the other two entries. For each of the 
2 x 2 matrices A in Exercises B8-10: 


(a) Obtain the inverse by this method. 


(b) Verify the inverse is correct by showing AA^! = I. 
—10 12 li -9 7 -9 
B8. | ke ii B9. E 4 B10. F H 
For the matrix A and vector Y given in each of Exercises B 11—20: 


(a) Use an efficient solver to obtain X, the solution of AX — Y. 

(b) Calculate X = A~'Y. (The reader is cautioned to accept this 
exercise as theoretical only and not to believe that computing 
an inverse is an efficient way of solving a linear system.) 


[-9 -6 —4 11 -12] [-8 
B11. 5 l-a B12. E o -8 
- 8 —4 -6 9 
B13. 2 PAH B14. | -3 6 10|.|-5 
L 6 6 6 —i 
[—8 7 -7 —3 4 -12 -9 —10 
B15. | 0 -8 -6],] 4 B16. | -8 2) 6 3 
3 9 7 11 8 9 =9 10 
—8 2 -12 1 1 
7 9. sf =f 6 
B17. | 3 —11 6 —12 —10 
L-4 6 10 —4 =12 
[—4 4 11 -4 —9 
1 4 9 -8 -3 
B18. —9 10 5 5 3 
| 8 -7 —9 -9 
rs +6 -4 19 12 
8 8 4 9. 2 
B19. -5 —42 = 5 =3 
| 1 8 6 —10 —5 


—] —3 -8 -—12 5 
8 =9 | 0 6 
BaN 3 —11 —10 oe le et 
—4 =7 11 10 3 
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B21. The geometric series X`? , x^ converges to ner provided 
1 1 


|x| < 1. If A= l ? 

à 5 

1-9 AX > (I — A)! as n increases. Is this result true for an 
arbitrary matrix A? 


| and A? = J, show computationally that 


Vectors and the Laplace Transform 


Recall from Section 12.1 how an initial value problem such as 
x'(t) = 9x — 14y 
' and x(0) = 2, y(0) = -1 
y(t) = 4x — 6y 


can be solved with the Laplace transform. Denoting the transforms of x(t), y(t) by X = 
X (s), Y = Y(s), respectively, we obtain 


sX —2-—9X —14Y (s —9)X -- MY =2 s-9 14 ][x 2 
or or - 
sY +1=4X —6Y 4i@+t@r=-1 ™ | -4 sur =, 


(12.19) 
and note that the matrix on the right in (12.19) is just sZ — A. Solving (12.19), we get 
X(s) 30 28 
s) = — , 
i me "» (t) = 30e? — 282 
$—9 g$—1 qp BO 8e 
Y(s) = NE y(t) = 15e? — 16e E 


s—2 s-—l 


Vector Version of Laplace Transform Solution 


We detail here a vector version of the Laplace transform solution to the initial value problem 
in Example 12.11. First, we fix notation. As usual, lower-case bold letters represent vectors. 
In particular, define 


m x(t) 2 Tm X(s) (12.20) 
= = Va E an = S= . 
vey y(t) 0 - Y (s) 


where an upper-case bold letter is the Laplace transform of a vector and X (s), Y (s) are the 
Laplace transforms of x (t), y(t), respectively. Thus, the Laplace transform of a vector is 
computed componentwise. If the IVP in Example 12.11 is written in matrix-vector form as 


v —Av  v(0)- vo (12.21) 
the Laplace transform of (12.21) gives 
sV — vo = AV 
To solve for V, the vector of unknown Laplace transforms, we first get 
(sI — A)V = vo 


which is just the formal statement of the equations on the right in (12.19). Solving for V 
gives as an explicit representation for V = V (s) 


V = (sI — A) 'vo = Ọvo 
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where ® = (sI — A)7! is the matrix inverse of the matrix s7 — A. The solution v = v(t) 
then follows by inverting the transforms in the vector V. This solution is denoted by 


y — v(r) — L[(sI — A) !]vo = $vo 
where @ = L~![(sI — A)7!]. 
EXAMPLE 12.12 For the IVP in Example 12.11, the vector vo is defined in (12.20) and the system matrix is 
A= D 1^]. The matrices ® = (sI — A)! and $ = L !((sI — A) !] = L7![®] are then 


1 i t = A v —Te' —14e” + 14e! 
and = 


& = -~ 5 5 
s?—3s+2]| 4 s—9 4e” —4e! | —7e^ + 8e! 


| (12.22) 


and the solution to the IVP is 


| 8e” — 7e —14e” + 14e! 2 30e” — 28e! " 
v—v(t) = py = " a = 5 ^ 
l 4e" —4e! | —7e^ + 8e! —] 15e“ — 16e! 


The Fundamental Matrix 


The matrix $ is called the fundamental matrix for the system x’ = Ax and is determined 
| by the matrix A. The recipe we used, namely, 6 = L^'[(s] — A) !], causes ¢ (0) = I. 


Section 12.9. 


EXERCISES 12.8-Part A 


| The fundamental matrix has many other interesting properties, which will be explored in 


Al. If A = f al compute ® = (s7 — A)~! out by the algorithm 
given in Exercise A5, Section 12.7. 


A2. For ® determined in Exercise Al, obtain $ = L-![&]. Show that 
$(0) — I. 


A3. Use the Laplace transform to solve the IVP x'(t) = 5x + 6y, 
y'(t) = —7x — 8y, x(0) = 3, (0) = -2. 


EXERCISES 12.8—Part B 


A4. Cast the IVP in Exercise A3 into matrix-vector form, and obtain 
the fundamental matrix $. 


AS. Use the fundamental matrix ó computed in Exercise A4 to obtain 
the solution of the IVP in Exercise A3. 


A6. For ¢ computed in Exercise A4, show that ¢’ = Ag, $(0) = I, 
where A is the system matrix for the [VP in Exercise A3. 


B1. Show that $ determined in Exercise A2 satisfies ¢’ = A@, where 
A is the matrix in Exercise A1. 


In Exercises B2-11, the given matrices A and initial vectors vo define an 
IVP v’ = Av, v(0) = vo. For each: 

(a) Obtain the solution v(t) using a computer algebra system. 

(b) Plot each component of v(t) on the same set of axes. 


(c) Write the solution in the vector form v(t) = bye E e! B,, 
where each B,, k — 1,2, is a constant vector. 


(d) Show that AB, = àB, k = 1,2. 


(e) Obtain the fundamental matrix @ = L^![(sI — A)-!]. 
(f) Show that v(t) = vo. 
(g) Verify that v’ = Av and that v(0) = vo. 


(h) Show that (0) = T. 


(i) If X, is the kth column of $, show that X; = AX;,k = 1, 2, 
making each column of $ a solution of the given differential 
equation. 


(j) Show that ¢’ = A9. 


(k) Show that X,(0) = ex, where e, is the kth column of the 
2 x 2 identity matrix. 


[is c "D as] f 
[X s[i] s» s 


zz 
N 


za 
> 


—9 -—12 6 35 36 —7 
ss "BL »[$ 35] 
25 14 —11 —26 12 2 
soj 5 X5 se [z s] 
B12. Discuss why the formalism v(t) = Vo should work for an n x n 
IVP. 
In Exercises B13—22, the given matrices A and initial vectors vo define 
an IVP v’ = Av, v(0) = vo. For each: 
(a) Obtain the solution v(t) using a computer algebra system. 
(b) Plot each component of v(t) on the same set of axes. 


(c) Write the solution in the vector form v(t) = - e** By, 
where each Bz, k = 1, 2, 3, is a constant vector. 


(d) Show that AB, = A, By, k = 1, 2, 3. 

(e) Obtain the fundamental matrix $ = L~'[(sI — A). 
(f) Show that v(t) = $vo. 

(g) Verify that v' = Av and that v(0) — vo. 

(h) Show that ¢ (0) = I. 


Motivation 


B13. 


B15. 


B17. 


B19. 


B21. 
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12.9 The Matrix Exponential 


(i) If X, is the kth column of $, show that X, = AXx, 
k = 1,2, 3, making each column of ¢ a solution of the given 
differential equation. 

(j) Show that ¢’ = A9. 

(k) Show that X,(0) = ex, where e; is the kth column of the 


3 x 3 identity matrix. 
-14 108 36] [-9 
. |-135 129 45],} 8 
54 —54 —24 4 


[—73 178 24 —11 
—41 98 12|,| 12 
| 74 -166 -14 —6 


le —30 -—60 -1 151 —34 -122] [5 
20 9 20|, 9 B16. | 482 -113 -374|.|1 
| 60 30 59| |-12 50 -10 -45| |4 


—204 
—158 


—41 
-30 |, 
-16 -12 


E —99 —33 —6 335 184 —252] 3 
320 —202 -—70|.|-4 B20. |-530 —289 Á 390|,| 9 
[-190 123 49 11 70 40  —59 -1 


7 8 -2] [9] 
. |134 97 -22|.|6 
591 444 -102] |7! 


| The Matrix Exponential 


The initial value problem x'(t) — ax, x(0) — xo, governs exponential growth or decay and 
has the solution x(t) = xoe^'. If A is a constant matrix, the IVP x’ = Ax, X(0) = xo, has 
the solution x(t) = $(t)xo, where $(r) = L~![(sI — A) !] is the fundamental matrix we 


saw in Section 12.8. 


Presently, we are going to see that the solution can also be represented as x(t) = e^' xo, 
where e^' is called the matrix exponential and, by the uniqueness of the solution of the IVP, 
must clearly be the same as the fundamental matrix $. We begin by defining the matrix 


exponential, e^. 


The Matrix Exponential 


The exponential of the matrix A is defined as a power series in A. Thus, motivated by 
the power series for e* in (12.232), we have, with A9 — I, the definitions in (12.23b) and 


(12.23c) 


xk x? x? 
Tealtetoe gt (12.23a) 
Ak A? A? 
A aItat State (12.23b) 
(n, a, A OU 12.23 
zo iat PS Pee (12.23c) 
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EXAMPLE 12.13 


EXAMPLE 12.14 


EXAMPLE 12.15 


EXAMPLE 12.16 


The following calculations yield eP for the 2 x 2 diagonal matrix D — fF EL. 


b 
pf! fe 9], 1[8 o], aye 9], 
e —7lo 1| |o ol 210 2| slo p 


œ k 
à «(CO : 
— | k=0 - Í E eto 
Ms oo c ~~ b x 
bk 0 e 
AB 


If D is the diagonal matrix of Example 12.13 and P is invertible, then for A = PDP~' we 
have e^ = PePP-!, We can show this as soon as we realize that for any power k we have 


A* = (PDP^ Y = (PDP- (PDP ^)... (PDP^ ) = PDP! 


and for e^ we have 


The matrices A = PDP™! in (12.24) determine e^ = Pe? P~! by the calculation shown in 
Example 12.14. 


" f 7 á f i : ý pel a |8?-7e —14e? + 14e 
= = = => 2° = 
4 —l 0 2 4 —6 4e? —4e | —7e? + 8e 
(12.24) 


\7 
~~ 


If A is the matrix in (12.24), then e^ is the matrix $ in (12.22). This is obtained by using 
a built-in command from a computer algebra system. We will consider access to such a 
“black-box” algorithm as a first recipe for computing the matrix exponential. $ 


e^! is the Fundamental Matrix 


Our second recipe for computing the matrix exponential is e^' = $ = L~'[(sI — A)^!]. 
Therefore, the matrix exponential is the fundamental matrix for the equation x’ = Ax, 
where A is a constant matrix. 


The Columns of the Fundamental Matrix 


The definition of e^' in (12.23c) assures us that e4’|,.9 = I = $ (0). A computation also 


based on the definition in (12.23c) leads to de^ = Ae” or ġ'(t) = A(t). (See Exercise 


Al.) Thus, each column of ¢ = e^' must itself be a solution of the differential equation 


x = Ax. In light of $(0) = J, $;, the kth column of 6, satisfies the initial condition 
9$; (0) = ez, where e, is the kth column of 7. Consequently, we have the following theorem. 


EXAMPLE 12.17 
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THEOREM 12.2 

The columns of the fundamental matrix @ = e^ are each a solution of x’ = Ax; 
and $,, the kth column, satisfies the initial condition @;(0) = e, where e; is the kth 
column of /. 


Fundamental Matrix: Recipe 3 


We now have a third recipe for finding the fundamental matrix ¢ = e^ for a constant 
matrix A. We can solve the initial value problems x, = Axx, x; (0) = ex, for the individual 
columns of the fundamental matrix and write $ = [x;, ..., Xn]. 


We next demonstrate Recipe 3 for the matrix A given in (12.24). The differential equations 
represented by x’ = Ax are x'(t) = 9x — 14y and y'(r) = 4x — 6y. Solutions satisfying 
the initial conditions x; (0) = e; and x2(0) = e» are found to be 

8e? — Te! —14e7 + 14e! 

x; = is and x; = : 

4e?! — 4et —Te* + 8e! 
which are precisely the columns of ¢ = e^ computed in (12.22). A matrix with these 
solutions as its columns therefore must be the fundamental matrix. $ 


Inverse of the Fundamental Matrix 


When A is a constant matrix, the inverse of the fundamental matrix $ (t) = e^ is [@(t)]7! = 
$(—t) = e-^'. This is consistent with the scalar exponential function where 1/e* = e^. 


Intuitively, e^'e7^' = e° = I, where O is the zero matrix, but a formal proof can be found 
in [40]. 
EXERCISES 12.9-Part A 
A1. Differentiate (12.23c) termwise to show that Ler = Ae, A4. If A = E nli obtain $ = L~'[(sJ — A)~'], the fundamental 
A2. Generally, two matrices A and B do not commute, that is, matrix. 
AB # BA. Show that for the constant matrix A, the fundamental AS. If A is the matrix in Exercise A4, obtain e^' by using the Laplace 
matrix e^' commutes with A. Hint: Look at the series definition of transform to solve x, = Ax;, x, (0) = ex, k = 1, 2. Compare to the 
ge results in Exercise A4. 


A3. If A — [tp al. show that A does not commute with A’, suggesting 
that the result in Exercise A2 would generally not be valid for 


nonconstant matrices A. 


EXERCISES 12.9—Part B 


B1. Let A — [i als Verify that 
" | e? (1 — t) 
e 


= —tet 


For e^', obtain the partial sum S (At)*/k! and, to the same 


tet order, the partial sums of the Maclaurin expansion of each 


e? (1 +f) 


component. Show that through terms of order four, the expansions 
match. 
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For the 2 x 2 matrix A and initial vector vo given in each of Exercises 
B2-11: 


(a) Use a computer algebra system to obtain ¢, the fundamental 
matrix for the initial value problem v' — Av, v(0) — vo. 

(b) Verify that $ = L^! [(sI — A)~'] as found in Section 12.8. 

(c) Construct $ columnwise as the matrix [x;, x2], where 
X, = AX, k = 1, 2, and x, (0) = ez. the kth column of the 
identity matrix. 

(d) Verify that $^; ,(At)*/K! > e^' = $ as n gets large by 
comparing a partial sum on the left with a comparable 
Maclaurin expansion of each component of the matrix on the 
right. 


(e) Verify that Ae^' = e^ A, indicating that A commutes with 
the fundamental matrix it generates. 


(f) Verify that 9' = Ae“. 

(g) Verify that [p (£)]! = $(—1). 
B2. Exercise B2, Section 12.8 B3. Exercise B3, Section 12.8 
B4. Exercise B4, Section 12.8 B5. Exercise B5, Section 12.8 
B6. Exercise B6, Section 12.8 B7. Exercise B7, Section 12.8 
B8. Exercise B8, Section 12.8 B9. Exercise B9, Section 12.8 


B10. Exercise B10, Section 12.8 B11. Exercise B11, Section 12.8 


For each 3 x 3 matrix A and initial vector vp given in Exercises B12—21 
(a) Use a computer algebra system to obtain $, the fundamental 
matrix for the initial value problem v' = Av, v(0) = vo. 

(b) Verify that $ = L~'[(sJ — A)~'] as found in Section 12.8. 

(c) Construct $ columnwise as the matrix [X;, X», X3], where 
X, = AX, k = 1,2, 3, and x, (0) = ej, the kth column of the 
identity matrix. 

(d) Verify that Ae^' = e^ A, indicating that A commutes with 
the fundamental matrix it generates. 

(e) Verify that 9' = Ae“. 

(f) Verify that [9 (£)]  — $(—1). 


B12. Exercise B13, Section 12.8 B13. Exercise B14, Section 12.8 
B14. Exercise B15, Section 12.8 B15. Exercise B16, Section 12.8 
B16. Exercise B17, Section 12.8 B17. Exercise B18, Section 12.8 
B18. Exercise B19, Section 12.8 B19. Exercise B20, Section 12.8 
B20. Exercise B21, Section 12.8 B21. Exercise B22, Section 12.8 


Eigenvalues and Eigenvectors 


Vectors Hiding in a Solution 


In (12.25) the matrix A and the vector xo for the IVP x’ = Ax, x(0) = xo, appears on the 
left, and the solution of the IVP appears on the right 


N- 22) „10t | (8, _ 2 9) JISI 
Ti *| w-[sxo-[. 5% + $B)e + Ge sp)e a 


12 7 


With a = —ia + Hz and b = Sa — 2B, the solution becomes 


x(t) = 


P -Fat Sp) e" + (Ta — $8)e 
(12.25) 
ae? + be!’ 1 1 
10r 15t 
PEE + be^ (12.26) 
bos i. 3 pe! A ; 


where on the right, a and b have been factored out from x(t). In (12.27), the definitions on 
the left put x(t) into the form on the right 


1 l 
vV = | | v= H => x(t) = ael?! v, + bey, 


2.2 
4 (12.27) 


The vectors v;, V2 appearing in (12.26) and (12.27) are special, being closely related both 
to the system matrix A and to the 10 and 15 in the exponentials in the solution. Presently, 
we explore these vectors, the scalars 10 and 15, and their relationship to the matrix A. 
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Eigenvalues and Eigenvectors 


ay I8. 2] HL [109] ol] = 10 
"=a Gilat” jas] lal 
18 -2][1] [i5 1 
AV = 12 7 3 — 45 = 15 3 = 15v> 


show that the relation between A, the vectors v; and v5, and the numbers 10 and 15 is 
expressed by the equations 


The calculations 


AV] = 10v; and AV2 = 15v> 


Vectors such as v; and v» are called eigenvectors, while the numbers 10 and 15 are called 
eigenvalues. 


Eigenvectors from the Start 


Eigenvectors and eigenvalues capture the behavior of the linear system of differential equa- 
tions. But we would like a more direct way of obtaining these eigenvalues and eigenvectors 
without having to extract them from a solution of x’ = Ax. Therefore, look for this solution 
directly in the form of the vector x — ve^', where 


bi 


and bı, b», and A are constants to be determined. 

Substitution into x’ = Ax gives Ave’ = Ave’, and upon canceling the exponential 
term on both sides Av = Av. Thus, the vector Av is a multiple of the special vector v Æ 0. 
Such a vector v is called an eigenvector, and the multiplier À is called an eigenvalue. The 
equation 


Av = ÀV 


determines both the eigenvalue and eigenvector. 

The general solution of the system of differential equations x’ = Ax is known as 
soon as the eigenvalues and eigenvectors are known. In fact, if the eigenvalues are A, A» 
and the corresponding eigenvectors are v;, v», then the general solution would be x — 
ae? v, + be?! vs. 


EXERCISES 12.10—Part A 


Al. The matrix A = em sl and initial vector X; = [;] define the IVP 
x' — Ax, X(0) — xo. 
(a) Using the Laplace transform, obtain the general solution. 


(b) Write the general solution in the form x(t) = ae y, + be? v5. 


(c) Show that Av; = A,v4, k = 1, 2. 


(d) Compute det(A 


(e) Obtain the null 
E =, 2. 


— AJ), k= 1,2. 


space for each of the matrices A — A, 7, 
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EXERCISES 12.10—Part B 


B1. The vector v = 0 is never considered an eigenvector of a matrix (f) Using appropriate technology, obtain the eigenvalues and 
A. However, A = 0 can be an eigenvalue of A. For the matrix eigenvectors of A and compare to the A; and v, determined in 
i 2 3 art (b). 
A= [ 5 s|, show that A = 0 is an eigenvalue and find the part4 - i - T 
7 8 9 (g) Plot v — [EI and Av for several different values of 0. 
associated eigenvector. Hint: Av = Av becomes Av = Ov = 0. : ; 
g2 [5 ^4] pg&[-5 —] pa [27 -2 
In Exercises B2-11, the given matrix A determines a linear system "[-4 -13 * | 28 9 “112 —18 
x' — Ax. For each: r 24 2 _ 
Mdh | w[ 3 [s 3j owps m 
(a) Obtain the general solution. L-40 —35 -21 19 12 -1 
(b) Write the general solution in the form ae^!' v; + be?! vz. B8 [1 | B9 | 22 i B10 [5 E: 
“16 —9 “|-18 -11 2 10 
(c) Show that Av; = A;v;, k = 1,2. L6 
[9 —20 
(d) Compute det(A — A), k = 1,2. Bil. |? J 
(e) Obtain the null space for each of the matrices A — 447, E 
k=1,2. 


Solutions by Eigenvalues and Eigenvectors 


From Solution to Eigenvectors 


In (12.28), the general solution of x' = Ax is given on the right for the matrix A given on 


the left 
9 —5 2 (—4c; + 3c; — c3)e! + (2c) — c3)e? + (3c, — 2c2 + c3)e” 
14 -8 4|-xc- | (-8c 6c — 2c3)e! + (2c) — c2)e” + (6c, — 4c; + 203)e* 
10 —7 5 (—4c; + 3e; — c3)e' — Qc, — c2)e” + (6c, — 4c + 2c3)e? 


(12.28) 


If the constants a, b, c are introduced by the equations on the left in (12.29), the solution 
assumes the form shown on the right 
l 
e--b| 1| +c 
-1 


—4c,; + 3c. — c3 =a 
2 —c;— b) Sx=a e” (12.29) 


3c; — 2c +63 — c 


—- Oo — 
N N — 


The equations on the left in (12.29) come from (arbitrarily) setting the coefficients of 
the exponentials in the first component of x to the single constants a, b, c. If the resulting 
equations are solved for cg, k = 1,2,3, and the results substituted back into the general 
solution on the right in (12.28), then the form of x on the right in (12.29) results. Defining 
the vectors 


l 1 l 
vV = 2 V = 1 Va = 2 (12.30) 
l —1 2 


means the general solution has the form 


x = ae'v, + be? v; + ce? v3 (12.31) 


EXERCISES 12.11-Part A 
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and computation shows 


1 2 3 
AV] = (2) = V1 Av» = 2 | = 2v2 AY3 =/6/= 3v3 
l -2 6 


Hence, v1, V2, V3 are eigenvectors with eigenvalues 1, 2, 3, respectively. 
From a general solution of the system we have extracted the eigenvalues and eigenvec- 
tors of the system matrix A. 


From Eigenvectors to Solution 


The general solution of x’ = Ax can be constructed from the eigenvalues and eigenvec- 
tors. If the eigenvalues are determined to be 1, 2, 3, with the corresponding eigenvectors 
V1, V2, V3 given in (12.30), then the general solution can be written immediately as the linear 
combinationreproduces the solution on the right in (12.29). 

Consequently, an efficient recipe for finding eigenvalues and eigenvectors is really a 
recipe for solving the linear system of differential equations x’ = Ax. Such a recipe is the 
subject of Sections 12.12, 12.14, and 12.15. 


A]. Solve the equations on the left in (12.29), thereby obtaining support this, calculate W(t) VW! (0)xo and show this is the solution 
cy, k = 1, 2,3, in terms of a, b, c. Substitute these values into the found in Exercise A2. 
general solution on the right in (12.28) and show that the form of A4. If A = [2 kid use the Laplace transform to obtain the general 


the solution on the right in (12.29) results. 


-3 
A2. If A is the matrix on the left in (12.28) and x; — | j , use (12.30) 
and (12.31) to solve the IVP x' = Ax, x(0) = xo. 


A3. Let W(t) = [vie', voe", v3e?' ], where the v; are as given in 
(12.30). Show ¥ (0) = [vi, V2, v3] Æ 7, so V (t) is not the 


solution of x’ = Ax. From the general solution, extract A, and vz, 
the eigenvalues and eigenvectors of A. Verify that Av} = À} Vz, 
& 1,2. 

AS. Show that v; = [7] and v; = [3] are eigenvectors, with respective 


eigenvalues —1, 3, for the matrix A = [55 '$]. From the 


. À ; eigenvalues and eigenvectors, construct the general solution of 
fundamental matrix $ (t). Form the matrix V(r£)[V(0)]^' and show x! = AX 
that at t = O it is Z, the identity matrix. Hence, it must be $ (t). To 
EXERCISES 12.11-Part B 
B1. Use appropriate technology to obtain the eigenvalues and (d) Apply the initial data to the general solution in part (c), 
eigenvectors of the matrix UE "a Verify that the technology forming and solving a set of algebraic equations for the 


used has given correct answers. 


In each of Exercises B2-13 a 3 x 3 matrix A and an initial vector xo is 


constants az, k = 1, 2, 3, thereby obtaining the solution of the 
given IVP. 


given. For the IVP x’ = Ax, x(0) = Xo, thereby determined: (e) Obtain the fundamental matrix ¢ either using an appropriate 


(a) Use an appropriate technological device to determine the 
eigenvalues A; and the corresponding eigenvectors Vg, 


jl RENDIR S 
(b) Verify that Av, = Av, k = 1 


(c) Write the general solution in the form x(t) = ee apek vy, 


technological device or by computing L^![(s7 — A)~']. 

(f) Obtain the solution of the initial value problem as $xo and 
compare to the result in part (d). 

(g) Obtain a solution of the initial value problem by a solver from 
a suitable technological device. 


where the az, k = 1, 2, 3, are arbitrary constants. 
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7 
2 =| E [=ð -8 | 
ij —37].]27 B10. | 21 22 —22|, 
ll -7 l | 14 16 -17 
2 
4 
l 


[32 97 32 4 |= -15 -8] [-1 
B12. | -7 —24 -8], 6 B13. 10 18 PN 1 
-1 1 


Finding Eigenvalues and Eigenvectors 


Computing Eigenpairs 


In (12.32), a matrix A and its eigenvectors vı and vz are listed 


j| 2 1 1 
a=; HELSA v=] (12.32) 


Calculations show that Av; = 3v; and Av? = —3v;, so the eigenvalues are A; = 3 and 
À» = —3. How are the eigenpairs, the pairs of eigenvalues and eigenvectors (Ax, Vi), k = 
1, 2, determined? 


E1GENVALUES The defining relationship for eigenvalues and eigenvectors is the equation 
Av = dv, so if v is a constant vector, the substitution 


HE 
v= into Av — Av 
bz 
bi + 2b» u Abi 
4b, —b3]| | Abo 


1 — 3951425; ik 2 Tf 0 
Ee PE "Ul esa (12.33) 
4bi--(—1 — A)b; 4 -1-A]|lb] |o 


The matrix form of the homogeneous equations on the right of (12.33) is (A —AJ)v = 0. 
If the determinant of the matrix A — A7 is not zero, then Cramer's rule applies and the 
only solution for (12.33) is b; = b2 = 0. (This is equivalent to applying Theorem 12.1 and 
concluding v — 0. 

To prevent bı = b» = 0 from being the only solution, the rows of A — AJ must be 
proportional so that instead of two independent equations in (12.33) there is only one. The 
rows of A — AJ will be proportional if A satisfies 

l 1—A 2 

| 4 — —1-4A 
The last equation on the right in (12.34) is just 

| det(A — AJ) =A7-9 =0 


gives the equations 


or 


=> (1—A)(-1-a) =8 3 7-9 =0 (12.34) 


which is called the characteristic equation, and the two values of 4 that satisfy it are called 
the characteristic roots, or eigenvalues of the matrix A. It is obvious from the characteristic 
equation A? — 9 = 0 that the eigenvalues are 3 and —3. How do we then use that information 
to get the corresponding eigenvectors? 


EXAMPLE 12.18 
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An eigenvector is a nonzero solution of the homogeneous equations de- 


fined by (A — A, /)v = 0. Hence, the eigenvector is a basis vector for the null space of the 
matrix A — ÀI. The first column of Table 12.3 lists the eigenvalues of A, and opposite 
them in the second column the matrices A — A47 are given. The third column lists the one 
independent equation in the homogeneous system (A — A4/)v = 0. Solving this equation 


leads to the eigenvector in the fourth column. 


X A —AI (A — AI)v 0 Basis for Null Space 
—2 2 bi l 
3 — D = = = 
3 | 4 4l b, —b, =0 V P => V] H 
4 2 bi 
—3 $ 4 2b; +b, =0 v P| >V= M 


TABLE 12.3  Eigenvectors as bases of null spaces A — A1 


If A = 3, the one independent equation in (A — 3/)v = 0 can be taken as bı — b; = 0. 
Solving for b2 = b, gives the vector v, from which the basis vector v; is determined when 


bb =1 


If à = —3, the one independent equation in (A + 3/)v = 0 can be taken as 2b; + b2 
= 0. Solving for b2 = —2b gives the vector v, from which the basis vector v2 is determined 


when b, = 1. 


The characteristic equation for the matrix A in (12.28) is 


9—1 -5 1 
det(A—A7) 2| 14 —8—-A 4 
10 = Head 


—(1—2)2—2)3—-2)20 


(12.35) 


so the eigenvalues are 1, 2, 3. The corresponding eigenvectors are obtained by the manipu- 
lations summarized in Table 12.4. The first column lists the eigenvalues, and the second, the 
reduced row-echelon form of the matrix A — A47. For each ^;, the matrix A — A447 contains 
two distinct rows and so has rank 2. Hence, the basis for each null space contains only 


À rref(A — XI) (A —AI)v -0 Basis for Null Space 
1.0 -1 b3 l 
=f, = 
i diio v-2|2b| 2v 2|2 
b; — 2b, zu) 
0 0 0 L bs l 
—b 1 
BiU 4 b; +b; =0 [^5 
2 O 1] |] v= | —-b;, | >v = 1 
by + b3 = 0 
0.0 0 L b —1 
1 0 -1 [ib l 
3 2 b, — 3b; =0 — " EM 
0 1 -I b—h=0 = b3 3= j4 
0 0 0 i b3 2 


TABLE 12.4  Eigenvectors for Example 12.18 


Chapter 12 Systems of First-Order ODEs 


EXAMPLE 12.19 


one vector. The third column lists the two distinct equations in the homogeneous system 
(A + AxI)v = 0. When these equations are solved, the eigenvector in the fourth column is 
determined. 

If A = 1, the two distinct equations in the third column are solved for b; = b3 and 
b» = 2b3, giving v. Setting b3 = 1 then gives the basis vector v1. 


If à = 2, the two distinct equations in the third column are solved for bj = —b3 and 
bz = —b3, giving v. Setting b3 = —1 then gives the basis vector v». 

If A = 3, the two distinct equations in the third column are solved for bı = ib, and 
b» = ba, giving v. Setting b3 = 2 then gives the basis vector v3. Ed 


For the matrix A given in (12.36), we will calculate the eigenvalues à = 2, 3,3 and the 
corresponding eigenvectors Vg, k = 1, 2, 3, shown on the right in (12.36) 


4 —1] -i 1 1 1 
A-|1 2 —1|2vi2|1 v2 = | 1 v3 = | 0 (12.36) 
1 —1 2 1 0 1 : 
> 

ErcENvALUES The characteristic equation for the matrix A is 
4—A -i —1 
det(A—A47) 2| 1 2-A -1 |=(2-AGB-A?*=0 (12.37) 
1 -1 2-4 


so the characteristic roots, or eigenvalues, are A = 2, 3, 3. 


E1GENvEcTors Table 12.5 summarizes the calculations leading to the eigenvectors in 
(12.36). To find the eigenvector corresponding to à = 2, obtain the reduced row-echelon 
form of A — 21, listed in the second column. The rank of this matrix is 2 because there are 
two distinct rows. This means there are two distinct equations in the homogeneous system 
(A — 21)v = 0. Displayed in the third column, these two equations are solved for b; = b3 
and b2 = b3, giving the vector v in the fourth column. Setting b3 = 1 then gives v; as the 
basis vector for the null space of A — 27, and this is the vector listed in (12.36) as the first 
eigenvector. 

To find the eigenvector corresponding to 4 = 3, obtain the reduced row-echelon form 
of the matrix A — 31, listed in the second column. The rank of this matrix is 1 because there 
is only one nonzero row. The homogeneous system (A — 3/)B = 0 will have just the one 
distinct equation b; — b» — b3 = 0, which we write as bj = b» + b3 in the third column. 
From this equation we obtain the vector v in the fourth column. The two free parameters b> 


À rref(A — AJ) (A —AI)vz-0 Basis for Null Space 
1 0 <3 —Ó bs 1 
2 0 1 —1 Ba Bee v= b3 — y= 1 
00 0 dics b 1 
| ob =] b; + b 1 1 
3 0 0 0 b; = ba + b; v= b» =b,|}1})+b3]0 
0 0 0 b3 0 1 


TABLE 12.5  Eigenvectors for Example 12.19 
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and b; are factored as shown in the fourth column, and the vectors they multiply are taken 
as v? and v3, the second and third eigenvectors listed in (12.36). 

The eigenvectors from the repeated eigenvalue à = 3 all lie in a plane, and any two 
distinct (independent) vectors from this plane can be taken as "the" eigenvectors. Every 
vector in this plane will satisfy the equation Av — Av. 


EXERCISES 12.12-Part A 


Al. Verify Av, = 3v, and Av; = —3v; for A and v;, k = 1,2, given 
in (12.32). 

A2. Verify det(A — AI) = A? — 9 for A given in (12.32). 

A3. Verify the entries in the second and third columns of Table 12.3. 


EXERCISES 12.12-Part B 


B1. For A and v;, k = 2,3, appearing in (12.36), verify that Ax = 3x 
for X = av» + Bv3, where o and £ are arbitrary real numbers. 


For the matrix A given in each of Exercises B2-11: 


(a) Use appropriate technology to obtain the eigenvalues and 
eigenvectors. 

(b) Obtain and solve the characteristic equation det(A — AJ) = 0. 

(c) Show that the characteristic equation is a direct consequence 
of making the rows of A — AJ proportional. 

(d) For each eigenvalue Àz, obtain the corresponding eigenvector 
v, as the solution of the homogeneous system of equations 
(A — ArI) =0. 

(e) For each eigenvalue A,, determine the null space of A — à41. 

(f) Verify that the rank of A — A447 plus the dimension of the null 
space of A — A41 equals n, which in this instance, is 2. 

(g) Verify that Av; = Asv;, k = 1,2. 

(h) Form P = [v;, v2], a matrix whose columns are the 
eigenvectors, and compute the product P^! AP. This should 
be a diagonal matrix whose diagonal entries are the 
eigenvalues Àz. 

(i) If u is the unit vector lie a solve the pair of equations 
represented by Au = Au for 0 and A, from which the unit 
eigenvectors u can be obtained. 


9 26 18 59 33 35 —18 18 
B2. E a B3. E E 3 B4. | a E] B5. [ 1 d 
5 


For the matrix A given in each of Exercises B12-21: 


(a) Use appropriate technology to obtain the eigenvalues and any 
eigenvectors. 


AA. Verify the calculation of det(A — A1) appearing in (12.35). 
AS. Verify the entries in the second and third columns of Table 12.4. 
A6. Verify the calculation of det(A — ÀI) appearing in (12.37). 


AT. Verify the entries in the second and third columns of Table 12.5. 


(b) Obtain and solve the characteristic equation det(A — AJ) = 0. 


(c) Observing that à; = A», show that the dimension of the null 
space of A — À; I is one. 

(d) Find the single eigenvector that arises as the solution of the 
homogeneous system of equations (A — A,7)v; = 0. 


(e) Verify that the rank of A — à; Z plus the dimension of the null 
space of A — à; Z equals n, which in this instance is 2. 


B12. | 63 a B13. | 14 | B14. [ao e] 


—49 —49 -25 —16 49 —32 
=i] 1 —41 81 5 -9 
BIS. e E B16. = A B17. I 7 


=3 =| —2) = -9 25 51 =25 
1 E 4 B19. l n | B20. B J B21. E e 
For the matrix A given in each of Exercises B22-36: 


(a) Use appropriate technology to obtain the eigenvalues and any 
eigenvectors. 


(b) Obtain and solve the characteristic equation det(A — AJ) = 0. 


(c) For each distinct eigenvalue A;, determine the rank of 
A — Ad. 
(d) By solving the homogeneous system (A — A,1)v = 0, obtain 
the eigenvectors associated with each distinct eigenvalue A4. 
(e) For each distinct eigenvalue A;, verify that the rank of 
A — A4I plus the dimension of the null space of A — Axl 
equals n, which in this instance is 3. 


(f) If three linearly independent eigenvectors have been obtained, 
form P = [v;, V2, V3], a matrix whose columns are the 
eigenvectors, and compute the product P^! AP. This should 
be a diagonal matrix whose diagonal entries are the 
eigenvalues A;. 


3 -35 
3 —30 
4 —43 


33 
43 
—44 


75 
83 
—90 
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—49 —18 —6 
B26. | 96 35 12 
48 18 5 


Li 


=5 
3 
9 


3 10 130 

B27. | -3 —9 —40 

5 1 3 4 
0 -16 —9 —15 
B30. 18 11 15 
2 12 6 12 


( 
1 


=17 =16 


3-5 4 -51 
B34. |-4 10 -7 B35. | -15 


-19 —22 —20 —4$ —142 +6 0 2 31) 

B31. | ?7 28 26 B32. | 2 7 6 B33. |1 -41 21 
4 2 33 

$ 7 =3 


System versus Second-Order ODE 


System to Second-Order 


In (12.32), a matrix A and its eigenvectors v; and v» are given. In addition, this matrix 
has characteristic equation A? — 9 = 0 and eigenvalues à = +3. Therefore, the system of 
differential equations x’ = Ax on the left in (12.38) has the general solution given on the 


right 
-— pst l + b —3t l 
— x= ae | be E 


The system of equations on the left in (12.38) can be converted to a single second-order 
ODE by the following procedure. 

Pick one equation, say the first, and differentiate it with respect to t, obtaining u” = 
u’ + 2v'. Having introduced v’ into this new equation, eliminate it using the second equation. 
obtaining u” = u’ + 2(4u — v), which now contains v. Finally, eliminate v by again using 
the first equation, obtaining u” = u' + 8u — 2(S*) or u” = 9u. 

This second-order ODE has the characteristic equation m? — 9 = 0 and characteristic 
roots m = +3, so its general solution is u(t) = cie? + coe ?'. To avoid introducing two 
more arbitrary constants, the solution for v(t) is found from the first differential equation as 
v(t) = l(u' — u) = cie? — 2c5e ?'. Except for a renaming of the constants, this solution 
is the same as the one from eigenvalues and eigenvectors. 


u'(t) =u+2v 


12.38 
v'(f) = 4u — v ( | 


Second-Order to System 
Given the second-order linear ordinary differential equation 
y (t) + poy T q()y() =r) 


itis useful to learn how to represent it as a first-order linear system. Do this by the following 
change of variables. Define u and v as on the left in (12.39) and then differentiate (and use 
the DE itself) to obtain the results on the right 


u'(t) = y'(t) = v(t) 

v'(t) = y"(r) = —p(t)y'(t) ^ q(Dy() +r) 
= —p(t)v(t) — q(t)u(t) 4 r(t) 

The matrix form of the resulting system is then 


MIB MH 


u(t) — y(t) 
v(t) — y'(t) 


(12.39) 


Third-Order to System 


The third-order equation 


M 


(t) 4- f (y" H+ ey (0) +A y(t) = r(t) 


y 
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12.13 System versus Second-Order ODE 


can be expressed as a linear system by the following steps. Define u, v, w as on the left in 
(12.40) then differentiate (and use the DE itself) to obtain the results on the right 


u'(t) = y'(t) = v(t) 
u(t) = y(t) 
v(t)= y(t) > 
w(t) = y"(t) 


, » Ke ; (12.40) 
w (t) =y (t) =— fy (t) - gy (0) — h(t)y(0) +r 


w'(t) = —f(t)w(t) — g(t)v(t) — hult) + r(t) 


The matrix form of the resulting system is then 


u| 0 l 0 [ u 0 
v| = 0 0 1 v| +10 
w —h -g -—f||w 7 


The second-order differential equation y”(t) + 4y'(r) + 13y(t) = 0 has characteristic 
equation m? + 4m + 13 = 0 and characteristic roots m = —2 + 3i. To convert the equation 
to a first-order linear system, define u and v as on the left in (12.41) and then differentiate 
(and use the DE itself) to obtain the results on the right 


u'(t) = y'(t) = v(t) 


a= (t) = y"(t) = —4y'(t) — 13y(0 (12.41) 
v'(t) — y = —Ay'(t) — 13y 4 
v(t) = y'(r) f ` hi 
v'(t) = —4v (t) — 13u (t) 
In matrix notation, the desired system is 
ul u 0 1] fu (12.42 
v| |-13 -4|lv ia 
The eigenvalues of the system matrix in (12.42) are à = —2 «3i, the same as the char- 
acteristic roots for the original second-order differential equation. However, the eigenvalues 
are a complex conjugate pair, dealt with at length in Section 12.14. s% 


A]. If the system x’ = Ax is defined by the matrix A in Exercise A4, 


A4. Cast into the form v’ = My, the second-order differential equation 


Section 12.11, obtain an equivalent second-order equation. Solve 
the second-order equation by the methods of Chapter 5, and from 
this solution, construct the general solution of the given system. 


. Repeat Exercise A1 for the matrix A of Exercise A5, Section 12.11. 


A3. Repeat Exercise Al for the matrix A of Exercise B1, Section 12.11. 


EXERCISES 12.13-Part B 


obtain in Exercise Al. Show that the eigenvalues of M are the 
same as those of A. 

AS. Repeat Exercise A4 for the second-order differential equation 
obtained in Exercise A2. 

A6. Repeat Exercise A4 for the second-order differential equation 
obtained in Exercise A3. 


B1. Let A be the matrix in Exercise Al and M be the matrix in 


Exercise A4. Let P = [? | ?] and set v = Px. Show that 


P3 P4 
v' = Mv becomes x = P^!MPx. By direct calculation, find all 


matrices P for which PIMP = A. 


B2. Repeat Exercise B1 for the matrix A in Exercise A2 and the 
matrix M in Exercise A5. 

B3. Repeat Exercise B1 for the matrix A in Exercise A3 and the 
matrix M in Exercise A6. 
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For the matrix A specified in each of Exercises B4-13: B14. 3y” +2y' +5y =sint B15. £y” - Aty' c 6y 20 


‘ 1 
(a) Write the general solution to x’ = Ax as x = ae*!'v, + B16. y" -e ? y - -y =cos2t B17. 5y" + 3yy’+4y = te 
be?' v;, where A, and vz, k = 1, 2, are the eigenvalues and BIS. 2" Tyr 3 àv—6 B19. y" A8 ] -— 
eigenvectors, respectively, for A. REP Rug cA maps QU ry amc Bu 


(b) By an appropriate combination of differentiations and B20. 67" + Suy" +y cost = Te 


eliminations, convert the system x' = Ax to a single B21. 2y" + 3y’ —7y = e sin2t 
second-order linear differential equation. B22. /ty' —Ay ty =V] -P B23. (14-12)y" 4 5y" -13y 21 
(c) Obtain the general solution of the second-order equation B24. 8y" — 2y" +3y' +9y =25t B25. sin(y’y”) +2y = aft 


found in part (b), and show it is the same as the general 


š ‘ B26. y” +y +y =y . B27. y" cy cy 
solution found in part (a). ` 


B28. ty” -2y" —e*y' — Ty 25 
B29. 12y" — 7y' -5y 224-3t — 
B30. 6y” + 7ty" — 5e” y' + 15y = e~* cos2t 


B4. Exercise B2, Section 12.12 B5. Exercise B3, Section 12.12 

B6. Exercise B4, Section 12.12 B7. Exercise B5, Section 12.12 

B8. Exercise B6, Section 12.12 B9. Exercise B7, Section 12.12 
B10. Exercise B8, Section 12.12 B11. Exercise B9, Section 12.12 
B12. Exercise B10, Section 12.12 B13. Exercise B11, Section 12.12 B33. 3/?y" + 2ty' — Sy = t sint 


t 
B31. 4y” + 13y’+6y = —— B32. yy" = y 
141 


For Exercises B14—33, convert the given nth-order differential equations 
to a first-order system. For each linear differential equation, put the sys- 
tem into the matrix form x’ = Ax + F. Be sure to specify x and F. 


1 Complex Eigenvalues 


Introduction 


When reduced to a system, the differential equation in Example 12.20, Section 12.13, led 
to the matrix A in (12.42) with complex conjugate eigenvalues. As a guide to solving the 
system with complex eigenvalues, we will use techniques from Chapter 5 to solve the 
second-order equation. 


EXAMPLE 12.21 The second-order differential equation y" (t) + 4y'(t) + 13y(t) = 0 with characteristic 
equation m? + 4m + 13 = 0 and complex conjugate characteristic roots —2 + 3i appeared 
in Example 12.20, Section 12.13. From our work in Chapter 5 we know that the fundamental 
set (e 7273)! , 972730!) is equivalent to {e~~! cos3t, e~~ sin 3t}, so the general solution is 
y(t) = e” (a cos3t + b sin3t). 

Reduction to a system is accomplished in (12.41) and results in the equation x’ = Ax 
detailed in (12.42). Using the known value of y(t), the general solution of the system can 
then be written as 


ges Ld » _ QA LINES [HR ERES (12.43) 
a(—2 cos 3t — 3sin3t) + b(3cos3t — 2 sin 3t) 


— ade, bee, — gut cos 3t "m sin 3t 
! —2 cos 3t — 3 sin 3t 3 cos 3t — 2 sin3t 


(12.43b) 


The system with complex eigenvalues appears to have a more complicated solution than 
the system with real eigenvalues. Our goal now is to see if this solution can be determined 
without first needing to solve the system as a second-order equation. $ 
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Complex Case for Systems 


The eigenvalues of the matrix A on the left in (12.44) are the complex conjugate pair 
A = —2 + 3i, and the eigenvectors v; and v2, complex conjugates, are on the right 


Kus] s 4 e]. T" 12.44 
Clm -4]*"-7l.sas| "V—l.a.9 QAM) 


The real and imaginary parts of the one complex solution e7?^9)' v, are then two distinct 
real solutions of the first-order system x' — Ax. In fact, applying Euler's formulas to both 
eC? 0t y, and ety, we get 


e^? cos3t , e^? sin3t 
nd ? " T l ? x 
—e ^ (2 cos 3t + 3 sin 3t) —e ^" (3 cos3t — 2 sin 3t) 


"m l 1 | e? cos 3t e? sin(3t) 
p =i 
2. — Bt —e ?' (2 cos 3t + 3 sin 3t) —e ?' (3 cos 3t — 2 sin 3t) 


so the linear combinations 


DN 
l 
N 
+ 
2 
| ee | 
| 
N 
n 
Q2 
E 
| 


—2t 


(—243i)t (—2-3i)t m e ^ cos3t 7 
(e M, +e V2) m 2t, " = X] 
—e ?' (2cos3t + 3 sin 3t) 


1 e ' sin 3f 
—2-13i Lu. y E 
-( (—2 Pry, (—2 301 y.) 


—e ? (3 cos3t — 2 sin 3t) 


are simply the real and imaginary parts of the one complex solution e 7?7??' y, 
The general solution of the linear system is then the linear combination x = ae ?'x, + 
be” x, given in (12.43b). 


Finding Complex Eigenvectors 


Matrix arithmetic already learned will also yield complex eigenvectors, provided the rules of 
complex arithmetic are heeded. To begin, recall how looking for a solution of the form ve^ 
leads to the eigenvalue/eigenvector equation Av = Av or (A — A7)v = 0. The eigenvalues 
are the roots of the characteristic equation, det(A — A7) = 0. For the matrix in (12.44), the 
characteristic equation is 


=)? +4 +13=0 12.45 
-B -ii +4 + ( ) 


det(A — A1) =| 


so the eigenvalues are —2 + 3i. 

Computation of the eigenvectors is summarized in Table 12.6. For each eigenvalue A 
listed in the first column, the matrix A — ÀZ is listed in the second column. In the third 
column, the one distinct equation in the homogeneous system (A — A/)v = 0 is given, and 
in the fourth column, the eigenvector is listed. 

For example, when A = 4, = —2 + 3i, the complex arithmetic masks the proportion- 
ality of the rows of A — A, Z, but multiplication of the first row by —2 — 3i yields the second. 
Hence, there is but one equation, say (2 — 3i)b; + b; = 0, as shown. Setting the arbitrary 
parameter b, = 1 in v gives v; in the fourth column. 


A 3 x 3 system with real coefficients will have either one or three real eigenvalues. The 
matrix A on the left in (12.46) has the real eigenvalue à = 2 and the pair of complex 
conjugate eigenvalues à = 2 + 3i. The corresponding eigenvectors vz, k = 1,2,3, are 
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À A — AI (A —AID)v-0 Basis for Null Space 
| 2 —3i 1 bi 1 
= ] — 3i 5 i= = = 
wii | 13 dca] posmvees " mm d Po 
2+ 3i l bi 1 
x = 9 1 eg = 9 -— 
2 — 3i ph p (2+ 31)b; +b. =0 v Pa pn 


TABLE 12.6 Eigenvectors for the matrix A = [_ R al 


shown on the right in (12.46) 


—88 42 
A= 21 =7 
123 —57 


| Thus, we have 


»* 
II 
a 
ON 
a 
| 
me NIW PID 


—72 


18 


101 


< 
I 
| 
æ NIY NIW 


—2i 2i 


1 
1 5; l 5; 
2 t 5! 2-5! 


(12.46) 


The general solution of the first-order system x’ = Ax is a linear combination of the three 
solutions x; = e^'v;, and x» and x3, the real and imaginary parts of e 


Q33Dt y, respectively. 


—2 cos 3t 
sin 3t 
2 cos 3t + i sin 3t 


2 sin3t 


2t 


cos 3t + ce 


1 NC 
3 COS 3t — 5 sin 3f 


If the initial data on the left in (12.47) were to be applied, the equations in the center 


would result. Solving these equations for a — —26, b — —37, and c — 19 then gives x on 
| the right in (12.47) as the solution to the IVP x’ = Ax, x(0) = xo. 
1 —ja—2c=1 e? (39 — 38 cos 3t — 74 sin 3r) 
x)—2|2|2 —ła+b=2=x= | e"(39—37cos3t + 19 sin 3t) (12.47) 
| 3 at+ib+ic=3 e?! (—26 + 29 cos3t + 102 sin 3t) 
| i 4e 


EXERCISES 12.14—Part A 


| Al. 
A2. 


Verify that the matrix A in (12.44) has eigenvalues 4 = —2 + 3i. 
Multiply out e*’v, = (cos 3t + i sin 3t)v; for the vector v; 
defined in (12.44). 

Multiply out e^?! v; = (cos3t — i sin 31)v; for the vector v; 
defined in (12.44). 

Verify the determinant in (12.45). 

Show that the rows of A — (—2 — 3i)1 in Table 12.6 are indeed 


proportional and that the corresponding entry in the third column 
of the table is correct. 


A3. 


A4. 
AS. 


A6. 


AT. 
A8. 


A9. 


A10. 


Explain why a 3 x 3 matrix with real entries will have either one 
or three real eigenvalues but not two. 


Verify that the matrix A in (12.46) has the eigenvalues 2, 2 + 3i. 


Verify that for A in (12.46), vı is the eigenvector corresponding to 
Ac. 


Verify that for A in (12.46), v2 is the eigenvector corresponding to 
à —2 3i. 


Verify that for A in (12.46), v3 is the eigenvector corresponding to 
À —2 -—3i. 


EXERCISES 12.14—Part B 


12.15 The Deficient Case 


B1. Solve the equations in the center of (12.47), and verify that (12.47) B8. | 4 E . E B9. | E d ] l e 
provides the correct solution to the IVP x' = Ax, x(0) = xo, ea = "DI 
where A is given in (12.46) and xo is given in (12.47). B10 h E | ‘l B11 Li 4 Ei 

“yd 6|'|-1 *|-4 10|'| 12 


In Exercises B2-11, where a matrix A and initial vector xo are given: 


In Exercises B12—21, where a matrix A and an initial vector xo are given: 


(a) Use an appropriate technology to obtain the eigenvalues and 


eigenvectors of A. 


(b) Obtain the fundamental matrix $ = e^ and use it to solve the 
initial value problem x’ = Ax, x(0) = xo, where x = [ 


(c) Convert the first-order IVP to a second-order IVP and solve, 
making sure the solution agrees with the one found in part (b). 


(d) Find v;, a solution to (A — A;7)v = 0. 


(a) From the eigenvalues and eigenvectors of A, construct the 

general solution for the first-order equation x’ = Ax. If A has 
0] complex eigenvalues and eigenvectors, express the solution in 
ye) terms of real functions. 


(b) Apply the initial data to obtain the unique solution of the IVP 
x’ = Ax, x(0) = xo. 


At 


(c) Obtain the fundamental matrix $ = e^ and use it to solve the 


(e) Obtain x, and x», the real and imaginary parts, respectively, IVP stated in part (b). Be sure the solution agrees with the one 


of e^!! v,. 


(f) Show that x, = Ax,, k = 1,2, so the real and imaginary parts 
of a single complex solution are themselves solutions. B12. 


(g) Write the general solution to the first-order system as 
X = ax, + bx; and apply the initial data. Show that the 
resulting solution agrees with the solution found in part (b). B14. 


(h) Plot x(t) and y(t) on the same set of axes. 


i) Plot y(x) as a traje m the tt I: 112 565 337 11 [-23 —46 4 2 
(i) ot y(x) as a trajectory 1n the phase plane. B16. |—20 —98 —so|.| 8 B17. oo I. ^ 
-3 -3 —6 —13 -20 4 

»[Hi3s s[ as | 


mB CY afi Sh 


-1 


EXAMPLE 12.23 


HD 


ri B18. 


found in part (b). 


21 20 5 12 16 12 39 — 
—22 = —$:|,|—3 B13. | -6 -6 —13|.| 5 
40 41 5 —2 —6 —4 —15 1 


—34 —14 1 —10 | 49 66 —22 =Í 
64 26 -2|.| 12 B15. | -44 —61 22],] 11 
—16 —33 0 =) —22 —33 16 —9 


| 10 24 — 


53 40 —60 12 [—-51 39 —55 3 
—30 27 30],] 7 B19. | 8 26 —30|,|—7 
30 20 —37 —9 L 20-10 22 —5 


—20 —18 36 —l1l1 24 —18 12 1 
—72 —50. 108|, 0 B21. |33 —25 18|,| 5 
—48 —36 76 10 11 -9 8 10 


6 


1 B20. 


The Deficient Case 
Difficulty Articulated 


When all the eigenvalues for a system of first-order ODEs are different, there will be one 
eigenvector for each eigenvalue and enough eigenpairs with which to construct the general 
solution. When there is a repeated eigenvalue, there may or may not be enough eigenvectors 
for constructing the general solution. Example 12.19, Section 12.12, contains in (12.36) the 
matrix A with a repeated eigenvalue but a full slate of eigenvectors. The case we study here 
is that of the repeated eigenvalue where there are not enough eigenvectors. This is called 
the deficient case for which we need to learn the form of the "missing solution." 


Table 12.7 contains a deficient matrix A for which the eigenvalues are the repeated à = 2, 2. 
There is just the one eigenvector v, the vector b with b2 = 1. That A will be deficient can 
be seen from the third column of the table where the reduced row-echelon form of A — 21 
has one nonzero row, so its rank is 1 and the dimension of its null space is 2 — 2 — 1. 

To solve the differential equation x’ = Ax, we have x; (t) = e?'v as one solution but are 
in need of a second independent solution. If y; (f) is a solution of a second-order constant- 


Chapter 12 


Systems of First-Order ODEs 


A —2I rref(A — 2I) (A —- 271)bz 0 b v 


1 3 bi + 3b; =0 b —3 
0 0 => b, = -—3b, ed 


TABLE 12.7 Calculations for Example 12.23 


coefficient differential equation with repeated characteristic roots, Section 5.7 shows that 
a second independent solution is y2(t) = ty,. Unfortunately, the situation for the first- 
order linear system is a bit more complicated. Not only must the one available solution be 
multiplied by t, but a constant multiple of the associated exponential must be added as well. 
Thus, the form of the second solution x>(r) is 


X(t) = tx; + ce? [2] 
,  wherec — 
= (tv + c)e* C2 


where the constant vector c is determined from the differential equation by the following 
calculation 


X^ = Axo (12.48a) 

ev + ey = Ales + Ge (12.48b) 

2(tv + c)e™ + ve? = Ace? + A(rv)e? (12.48c) 
2(tv 4- c) 4- v — Ac - fAv (12.48d) 

2tv +2c +v = Ac + tv) (12.48e) 

2tv + 2c 4- v = Ac 4-2tv (12.48f) 

2c 4 v — Ac (12.48g) 

v = Ac—2¢ (12.48h) 

(A —21)e— v (12.48i) 


The derivative in (12.48b) leads to (12.48c), where every term contains e” , the removal 
of which gives (12.48d). On the right in (12.48d) we find Av — 2v since v is an eigenvector 
with eigenvalue 2. Hence, we get (12.48e), on the right of which we find t (2v) = 2rv. 
Hence, we get (12.48f), which simplifies to (12.48g) because 2tv appears on both sides of 
(12.48f). Simple transposition gives (12.48h), and factoring gives (12.481). 

The matrix A — 2/ in (12.481) has rank 1 and only one independent row. Therefore, 
the vector c satisfies the single equation cı + 3c; = 1, which has the solution 


1 —3c l —3 1 , 
“(les ae 


Since we only need a single particular solution for building a fundamental set, we set c> 
equal to any convenient value. Here, the choice c; = 0 gives 


l 5, | 1 — 3t 5, | —3 b(1 — 3t 
C= X) = e^ and x — ax; + bx; — e^ EEEN ) (12.50) 
0 l a+bt 


>, 
bod 
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12.15 The Deficient Case 


A]. Verify that the only eigenvalue of the matrix A in Table 12.7 is 
À -2. 

A2. Verify the reduced row-echelon form for A — 2/ given in Table 
12:3; 

A3. Set c; — 3 in (12.49) and show that the resulting general solution 
X = ax, + bx», where x, = (tv + c)e*", is really the same as the 
one in (12.50). 

A4. Suppose c» remains arbitrary in (12.49). Show that the general 


solution x = ax; + bx, where x; = (tv + c)e?', is really the same 
as in (12.50). 


EXERCISES 12.15—Part B 


B1. Let y(t) satisfy the third-order equation y" + 6y” + 12y’+ 
8y = 0, which we will call (*). 


(a) Show that the characteristic equation for (*) has a repeated 
eigenvalue A of multiplicity three. 


(b) Obtain the general solution for y(t). 


(c) Convert the third-order equation into a system x’(t) = Ax, 
with x(t) having components u(t), v(t), w(t). 


(d) Show that the eigenvalues of A are the characteristic roots for 
the third-order equation. 


(e) Show that the rank of A — AJ is two so that there is only one 
linearly independent eigenvector associated with A. 


(f) Find the one eigenvector of A. 
(g) Use the solution in part (b) to obtain a general solution for the 
system in part (c). 


In Exercises B2-11 a deficient matrix A is given. 


-3 
2 


(a) In each case, take x(0) = xo = [ ] as the initial data in the 
initial value problem x' — Ax, x(0) — xo, and obtain the 
solution by finding and using the fundamental matrix $. 


(b) The solution v; = e^'v, where v is an eigenvector, was 
obtained earlier. Now, obtain the second linearly independent 
solution v; = (c + tv)e“’, and write the general solution 
X = avi + by. 


(c) Apply the initial condition, making sure the resulting solution 
agrees with the solution found in part (a). 

B2. Exercise B12, Section 12.12 B3. Exercise B13, Section 12.12 

B4. Exercise B14, Section 12.12 B5. Exercise B15, Section 12.12 

B6. Exercise B16, Section 12.12 B7. Exercise B17, Section 12.12 

B8. Exercise B18, Section 12.12 B9. Exercise B19, Section 12.12 

B10. Exercise B20, Section 12.12 B11. Exercise B21, Section 12.12 


AS. If A is the matrix in Table 12.7 and x(t) = li 


v(t 


(a) Reduce the system x' — Ax to a single second-order equation 


in u(t). 


(b) Obtain u(t), the general solution of the equation determined in 


part (a). 


(c) Use u(t) to determine x, the general solution of the system in 


part (a). 


(d) Reconcile x found in part (c) with x given in (12.50). 


In Exercises B12-26, the given matrix A may be deficient. Some of the 
deficient matrices are missing one eigenvector, and some are missing 


two. 


(a) For each matrix, take x(0) = xy = 


. Exercise B24, Section 12.12 
. Exercise B29, Section 12.12 
. Exercise B34, Section 12.12 


1 
i as the initial data in 


the initial value problem x' — Ax, x(0) — xo, and obtain the 
solution by finding and using the fundamental matrix $. 


(b) If the matrix A is missing one eigenvector, there are two 


solutions of the form V, = vje! and V; = v5e?', where 


Vg, k = 1,2, are eigenvectors. The third solution is of the 
form V3 = (c + fv2)e’2’, where v; is the one eigenvector 
from the repeated eigenvalue A5. Find this third vector, and 
write the general solution in the form aV; + DV» + cV3. 


(c) Apply the initial condition, making sure the resulting solution 


agrees with the solution found in part (a). 


(d) If the matrix A is missing two eigenvectors, there is just one 


solution of the form V, = ve^’, where v is an eigenvector. 
The second solution is of the form V; = (c; + vie, and 
the third solution is of the form V3 = (c; + fe; + Event, 
The constant vector c; is a single solution of the equation 
(A — A, D)e; = v, whereas the constant vector €» is a single 
solution of the equation (A — à 7)c2 = cı. Obtain the 
solutions V; and V3, and then write the general solution in 
the form aV, + DV» + cV3. 


(e) Apply the initial condition, making sure the resulting solution 


agrees with the solution found in part (a). 


—28 18 -41 
-35 23 —47 B13. Exercise B23, Section 12.12 


5 -3 9 
B15. Exercise B28, Section 12.12 
B17. Exercise B33, Section 12.12 
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B19. i s E] B20. Hi 7 4 B21. l : El (b) Show that there are two eigenvectors vı and v2. 
1 2 -2 (c) By row-reducing the augmented matrix [A — AJ, av; + bv;] 
[3.1 e -3 0 1 -2 -1 -1 to an upper triangular form, find the constants a and b which 
ri ] B23. E 3 "| B24. l t : | make the resulting equations consistent. Then, using the 


-4 0 1 : à i 
resulting eigenvector av; + bv», obtain the constant vector c, 


[20 —20 20 —51 18 17 : ; e - : : 
B25. |85 84 84 Bag 2: da i and z, the third solution of the differential equation. 
| [59 —56 55 —98 35 33 [ 4 —8 -4 14 8 -4 17 -9 27 
| : : : ; -2 -2 .|-5 0 2 B29. | 10 -4 18 
| The cases considered in Exercises B22—36 do not exhaust the complex- d à 3 n S dem 8 8 
| p= 2 -2 -5 3- 


| ities that can be encountered. The astute reader will notice that there is > i 
. > = - PE — + 15] 

one configuration that has not yet been presented. Consider the case of E E a = =a] 

: i j A ; Oe: B30. 5 14 1 B31. | 12 8 -21 B32. 

a deficient 3 x 3 that has a single eigenvalue of algebraic multiplicity Ea o8 à git 

3 and two eigenvectors vı and v2. The third solution of the differential = g ` 

equation x’ = Ax has the form z = [(av, + bv2)t + c]e^', where a and B33 H Bou B34 = B = 

b are chosen to make the equations (A — AI)c = av, + bv» consistent. ` : ' -i i ] Bp n 

To explore this case, take A as any of the matrices given in Exercises AT 7 

B27-34. 


| (a) Show that there is a single eigenvalue with algebraic 
| multiplicity 3. 


16 | Diagonalization and Uncoupling 


| Coupled Systems 
| We refer to the pair of equations 
x'(f) = 18x(t) — 2y(t) and y(t) = 12x(t) + 7y(t) 


as coupled since both x(t) and y(t) appear in each equation. We apply the same term to the 
equivalent system x' — Ax, where 


Ael =] uud oe | 12.51 
=| | W x= yD (12.51) 


It is this coupling that makes it difficult to solve the system. 


Uncoupled Systems 


The pair of differential equations on the left in (12.52) forms a system of the form u’ = Bu, 
where the diagonal matrix B and the vector u are given on the right in (12.52). We refer 
to such a system as uncoupled since u(t) appears just in the first equation and v(t) appears 


just in the second 
u'(t) = 10u(t) i] P | 
= B= 12.52 

ceo 9 es 0 15 (2023 


Uncoupled equations of this type are easily solved by separating variables. Each of 
u(t) and v(t) are just constants times exponentials; specifically, they are u(t) = cye!™ and 


v(t) = cel. 


Uncoupling Coupled Equations 


Since uncoupled systems are so simple to solve, we ask if there is a way of uncoupling cou- 
pled systems. Consider the change of variables defined on the left in (12.53) and expressed 
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in matrix form by x — Pu, where the matrix P is defined on the right in (12.53) 
x(t) = au(t) + bv(t) a b 
y(t) = cu(t) + dv(t) = f A 
Making this change of variables in the original coupled system x' = Ax, we obtain 


(Pu) = A(Pu) or w = (P^!AP)u 


(12.53) 


where we isolated u’ by multiplying through by P ^1, the inverse of P. We want our change 
of variables to result in a system of the form u' — Bu, where B is a diagonal matrix. If A 
is the matrix in (12.51), then we want 

1 — 12ba — 2dc — The 11bd — 12b? — 2d? | 


P'AP = ——_— — 
ad — bc —llac + 12a* + 2c* —18bc + 12ba + 2dc + Tad 


to reduce to a diagonal of the form C = [5 à 


B. The solutions of the four equations in the six unknowns a, b, c, d, a, and £ contained in 
PAP =C are 


eel v ale F ed esl " "LAE. 
| o 15 zu DUE ? L0 10 a e d 


The diagonal matrices C, and C; differ only in the order of the diagonal elements. 
Correspondingly, the matrices P; and P» are really the same, except for the order of the 
columns. If, for example, in P; we set c = 4 and d = E and in P5 set c = 3 and d = 4, we 


obtain 
] 1 1 1 
and |z | 
4 $ ; 4 


(Since we solved four equations in six variables, there are two free variables left in the 
solution for P.) The matrix P, diagonalizes the coupled system, resulting in the diagonal 
matrix C4; while the matrix P» also diagonalizes the coupled system, resulting in the diagonal 
matrix C5. 

The eigenvalues of A are 10 and 15, and the corresponding eigenvectors are 


= | 


Thus, the columns of the matrix P; (or P5) are the eigenvectors of A, and the diagonal entries 
of C, (or C2) are the eigenvalues. Hence, knowledge of the eigenvalues and eigenvectors 
leads to an uncoupling, or diagonalization, of the system of differential equations. In fact, 
let us state this as a theorem. 


] for some as-yet unknown values of œ and 


THEOREM 12.3 


1. P is a square matrix; its n columns are the n eigenvectors of the n x n matrix A. 


2. D isa diagonal matrix; its entries are the corresponding eigenvalues of A. 


3. x— Pu 

=> 

d PAP SD 

2. w = Duis the uncoupled version of x’ = Ax. 
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EXAMPLE 12.24 


EXAMPLE 12.25 


Of course, if we know the eigenvalues and eigenvectors of A, we can immediately write 
the general solution of x’ = Ax. We wouldn't find the eigenpairs just to uncouple the system 
for the purpose of solving it. However, we will see in Section 12.17 that uncoupling the 
equations describing oscillations of a mechanical system yields the normal modes, certain 
fundamental vibrations that characterize the system. 


Similar Matrices 


The matrix A is similar to the matrix B if there is an invertible matrix P for which P^! AP = 
B. The matrix P is said to generate a similarity transform of A to B. 

Theorem 12.3 says that if the n x n matrix A has n linearly independent eigenvectors, 
then it is similar to a diagonal matrix D whose entries are its eigenvalues. The similarity 
transform from A to D is accomplished by the matrix P whose columns are the eigenvectors 
of A ordered in correspondence with the eigenvalues in D. 

The exercises contain additional information about similar matrices. 


In (12.54), the coupled system of differential equations on the left has the system matrix A 
given on the right 

x'(t) = x(t) + 2y(t) 1 32 

' A= (12.54) 
y'(t) = 4x(t) — y(t) 4 -l 


The change of variables x = Pu, where P is the matrix of eigenvectors of A, results in the 
diagonal (uncoupled) system u' = Du, where D is a diagonal matrix whose entries are the 
eigenvalues of A. The matrices P and P^! AP = D are then 


1 1 = 3 0 
P= and P AP = =D 
1 -2 0 -3 


Defining the vector u on the left in (12.55) gives the uncoupled system on the right 


'(ft) = 3u(t 
u = A E | ccn (12.55) 
v(t) v'(t) = —3v(t) 


for which the solution is immediately u(t) = cje% and v(t) = coe ?'. The solution to the 
coupled system is then 
cje” +e M 
x= Pu= 3 " Lx 
cie” — 2c9e ^! 


The matrix A on the left in (12.56) has eigenvalues à = —3, —2, —5. The corresponding 
eigenvectors are the columns of the matrix P on the right in (12.56). The system x’ = Ax 
is therefore coupled. 


358 —447 384 L = —8 
A-|-228 279 —242 P-|À 1 1d (12.56) 
—606 750 —647 1 2 ag 


The change of variables x = Pu results in the diagonal (uncoupled) system u' = Du, 
where D = P~'AP is a diagonal matrix whose entries are the eigenvalues of A and u is 
the vector whose entries are u(t), v(t), and w(t). In (12.57), the uncoupled system is on the 
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left, its solution is in the center, and the solution for the coupled system is on the right 


u'(t) = —3u(t) u(t) =cje cie ? — sce ™™ — 3c3e 7! 
vt) 2 —2v(t) => v(t)=oe% 2x-Pu- cie t oe 7 + cze 7 
w'(t) = —5w(t) w(t) = ce?! cie + Lene + 4c3¢e75t 
(12.57) 
4 


Normal Coordinates 


It is sometimes convenient to think of the equation x — Pu as a change of coordinates 
in the phase plane. The coordinates x and y in the phase plane are changed to the new 
coordinates u and v. If the equations x’ = Ax uncouple in the new coordinate system 
defined by u = P^!x, we call the new coordinates the normal coordinates. 


EXERCISES 12.16—Part A 


A]. Compute the eigenpairs for the matrix A in (12.51). 


A2. Show that if a matrix A is similar to a matrix B, then B is similar 
to A. 


A3. Show that if A is similar to B and B is similar to C, then A is 
similar to C. 


EXERCISES 12.16—Part B 


A4. Find a similarity transform that diagonalizes A — le: “phe 
Uncouple the system x’ = Ax, and use the solution of the 
uncoupled system to obtain the general solution of the coupled 


system. 


AS. Show that [ 7; _!°] is not similar to a diagonal matrix. 


B1. Calculate the eigenpairs of the matrix A given in (12.56). 
For the 2 x 2 matrix A given in each of Exercises B2-7: 


(a) Diagonalize A by applying the appropriate similarity 
transformation. 

(b) Uncouple the first-order linear system x' — Ax by setting 

: 1 b u(t) y 

x = Pu, with P = E «i and u — [ST Make the 
substitution x = Pu in x’ = Ax so that u’ = P^! APuis 
obtained. Set up and solve four equations in six unknowns 
corresponding to P^! AP = D, where D = [^ HE Show that 
except for the two arbitrary constants that scale the 
eigenvectors in P, the solution of these four equations are the 


P and D matrices used in part (a). 

(c) Solve u' = Du for u, where u will contain two arbitrary 
constants of integration. 

(d) Setting the two free parameters in P to 1 (or any other 


convenient values), obtain x = Pu as the general solution to 
/ 
x’ = Ax. 


(e) Verify the general solution found in part (d) by computing óc, 
where $ = e^', the fundamental matrix, and c = [2] is a 
vector of arbitrary constants. Í 
B2. Exercise B2, Section 12.10 B3. Exercise B3, Section 12.10 
B4. Exercise B4, Section 12.10 B5. Exercise B5, Section 12.10 
B6. Exercise B6, Section 12.10 B7. Exercise B7, Section 12.10 
For the matrix A given in each of Exercises B8-13: 
(a) Diagonalize A by the similarity transform P^! AP — D, 
where the columns of P are the eigenvectors of A. 


(b) Use the results in part (a) to uncouple the system x' — Ax, 
thereby obtaining its general solution. 


(c) Verify the solution in part (b) by computing x(t) = e^'c for 
an appropriate constant vector c. 
B8. Exercise B2, Section 12.11 B9. Exercise B3, Section 12.11 
B10. Exercise B4, Section 12.11 B11. Exercise B5, Section 12.11 
B12. Exercise B6, Section 12.11 B13. Exercise B7, Section 12.11 
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AA Coupled Linear Oscillator 


ky m, k3 n» ky 
AAZ YOA ASI OY Awl 
x x 
*1 ^2 


FIGURE 12.13 Coupled spring-mass 
system 


Forces acting on mass mı 


—kixi 
—k3(x1 — x2) 


Forces acting on mass m2 


—k»x» 


—k3(x2 — x1) 


TABLE 12.8 Forces acting on masses in 
Figure 12.13 


EXAMPLE 12.26 


The Model 


Consider m, and m2, two masses connected by three springs with spring constants k1, k2, ks 
as shown in Figure 12.13. The system thereby consists of two linear, undamped oscillators 
coupled together by the middle spring and held in place by the outside springs that are 
attached to vertical supports. Displacements of the masses from their respective equilibrium 
positions are, respectively, measured by the variables x; and x2. At equilibrium, the two 
masses are L units apart. 

By applying F = ma, Newton's Second Law of Motion, to the forces F = —Kxi exerted 
by the springs on their attached masses (see Table 12.8), we obtain 


mix, + (ky 4- k3)xi — kaxo =O and mx} — kaxi + (k2 + k3)x2 = 0 (12.58) 
a coupled system of second-order differential equations as the equations of motion for the 


two masses. Since the equations are linear, we profit from a matrix formulation. 


Matrix Formutation To put the two equations of motion into the form Mx" + Kx = 0, 


define 
m 0 kı +k —k; xı (t 
ares Pal : gem (12.59) 
O0 m» —ka ky + k3 xo(t) 


as the mass-matrix, the stiffness matrix, and the vector of displacements, respectively. Initial 
conditions would consist of the initial displacements and initial velocities of each of the 
two masses. Thus, define 


xı(0) =a; mO0)=a x,0)=b, x50) =k (12.60) 
By picking values for the masses and spring constants, we realize a specific version of the 
coupled-oscillator system. Suppose, then, we specify the parameter values 
m=1 m=2 k=l kg=2 a3 L=4 (12.61) 
With these values, the equations of motion become 
xj (t) + 4x1(t) — 3x2(t) =0 and 2x5 (t) — 3x1 (t) + 5x2(t) = 0 (12.62) 


For this specific case of the model, the exact solution, obtained by Laplace transform (see 
Exercise B1), is 


X1(f) = pı sint + p2 cost + 203 sin x22 + 24 cos 422, 
- n (12.63) 
X2(t) = pı sint + p cost — pa sin ule p4 COS v2, 
where 
pı =3(b1+2b2) pm = F(a, +2a) 
(12.64) 


p3 = X (ht — b2) p4 = F(a y az) 


Note the appearance of trig functions with two different angular frequencies. The motions 
will contain components with angular frequency 1 and components with angular frequency 
xm The motion of the system is governed by the interaction of oscillations with these two 
different angular frequencies. 


FIGURE 12.14 Solution curves x; (f) 
solid) and x2(t) (dotted) for Example 
12.25 


0 2 4 6 8 10 12 14 


FIGURE 12.15 Physical separation of 
masses in Example 12.26 


FIGURE 12.16 Lissajous figure for 
Example 12.26 
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Suppose we displace mass m one unit to the left and mass mz one unit to the right and 
then impart an initial velocity of one unit to the right for both masses. For these specific 
initial conditions a, = —1, a, = 1, b, = 1, and b; = 1, so the solution becomes 


x(t) = sint + t cost — 4 cos 2r and x(t) = sint + 1 cost + 2 cos 2r (12.65) 


$. 
v 


GnaPHs We try several different types of graphs in an effort to analyze and understand 
the motion of the system. In Figure 12.14 we plot the displacements, using a solid curve for 
the motion of mass m and a dotted line for the motion of mass m». While there is apparent 
periodicity, we also note the motions are not synchronous. The first time mass m; attains a 
relative maximum displacement to the right, mass m2 seems to experience a local minimum 
in its displacement to the left. Then, the second time mass m, attains a relative maximum 
displacement to the right, mass mz is moving toward a relative maximum displacement to 
the right also. Consequently, the motion is not simple. 

In Figure 12.15 we graph d = 4 + x2 — x, the physical distance between the two 
masses, assuming the equilibrium positions of the two masses are L — 4 units apart. In this 
graph we see what appears to be periodic behavior in the distance between the masses. So, 
the absolute motion seems to consist of oscillatory motion between the two masses, with 
translational motion superimposed. 

Another way to study the motion of the coupled oscillator is to plot x? against x. Figure 
12.16 shows the resulting parametric plot that forms a kind of phase plane diagram and the 
paths (orbits), called Lissajous' figures, after the person who first studied them. 

Ultimately, to understand the interactions between the two masses, we need to uncouple 
the system and describe the motions in terms of the normal coordinates. 


Diagonalization to Normal Coordinates 


To uncouple the equations in (12.58), isolate x", the second-derivative term in Mx" + Kx = 
0, by multiplying through the equations of motion by M ^, the inverse of the matrix M, to 
obtain x" + (M^! K)x = 0. Then, defining the matrix U as the matrix product M^! K, we 
get the equations x" -- Ux — 0. For the general system under consideration, the matrix U 
would be 


ktk k 
m; mı 
Ü = (12.66) 
k3 ky + k3 
m m2 


and the differential equations would now be 
» kj +k 
x(t) + ——— 920 
mı 


k + k3 


m2 


x(t) — (12.67) 


k ; k 
2 x(t) and xj(r)— 2 xi(f) + 
mı m2 


If P is a matrix whose columns are the eigenvectors of U, then P-!UP = D, adiagonal 
matrix with the eigenvalues of U on its diagonal. Moreover, the change of variables defined 
by x = Pr gives 


x’ +Ux=05 (Pr)”+UPr=0=5>r’+P'UPr=0=>r'+Dr=0 


and the system Mx” + Kx = 0 has been uncoupled. The uncoupled form r" + Dr = 0 
consists of the two equations 


ri(t) --oXri(t) 2 0. and rf (t) + oXra(t) =0 (12.68) 


320 


Chapter 12. Systems of First-Order ODEs 


EXAMPLE 12.27 


each of which is the equation of simple harmonic motion in one variable. The coordinates 
defined by rı (f) and r2(t) are the normal coordinates, and the oscillations exhibited by the 
functions rı (t) and r2(t) are the normal modes of vibration. 


For the parameter values specified in (12.61), the matrix U, given in (12.66), becomes Uj, 
given on the left in (12.69). In the center of (12.69) we have the matrix P whose columns 
are the eigenvectors of U4, and on the right we have the diagonal matrix D = P !UjP 


4 -3 MES. T 1 0 
US] a g(r a => PUP = =D (12.69) 
—5 z ] 1 o0 u 
2 2 
The uncoupled equations (12.68) are then 
ri (f) -ri(f) 20 and r(0 REO =0 (12.70) 


Each equation in (12.70) describes an undamped harmonic oscillator, with fandamental 
sets (cos t, sin t) and {cos v Ht, sin v 2r), respectively. The general solution of r" -- Dr — 
0 is then 


cı cost + c sint 


CS 
c3 cos JJ 1t + c4 sin / Ut 


and harmonic motions with angular frequency 1 or ad. are called the normal modes of 
vibration for the physical system described by (12.62). - 

We want to know cz, k = 1,..., 4 (which belong to r), in terms of the given initial 
conditions (12.60) on x, since these latter quantities are the physical initial conditions over 
which control can be exerted. Using x — Pr, we have the equations 


€] = 1 ay 

r(0) = =P ~ x0) =P (12.71a) 
C3 a2 

=| e p-ly() = p-1 |^ (12.71b) 

r = = x = . 

Hes by 
from which we find 

2a2 + ay 


2b; : 
3 cos t + 7+ sint 


a2 S cos V 11 + x22 (p, — bi) sin Je 


The initial conditions b; = b» = 0 and a, = a» isolate the angular frequency w; = 1, 
whereas the initial conditions bj = —2b» and a, = a» = Q isolate the angular frequency 


(12.72) 


w =v E = ae Substitution into (12.72) confirms these claims, giving, respectively, 


a cost 0 
T -| 0 | and r2 = (12.73) 


/22 . 
“T b» sin at » 
es Sd 


NonMaAL Mopzs REALIZED IN THE PHYSICAL COORDINATES Again using X = Pr and 
applying it to rg, k = 1, 2, in (12.73), we find 


11 


iy CES by sin ,/ >t 


a COS t = 2x25, sin Hy 
x, = Pr, = and x; = Pr = " (12.74) 
“Tr 
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When the initial conditions are b} = b; = 0 and a; = a», the solution is x, and just the 
angular frequency w; = | is observed, with the two masses moving as if the center spring 


were a rigid rod. If the initial conditions are b; = —2b and a, = a» = 0, then the solution 


2, but perfectly out of 


is x; and the two masses oscillate with angular frequency œ = 
phase, the effect of the minus sign in the first component of x2. 


EXERCISES 12.17—Part A 


. Use Table 12.8 and Newton’s Second Law (F = ma) to obtain the 
equations in (12.58). 


. Show that (12.62) and (12.60) give (12.65) when a, = 
an = bi =b,=1. 


=e 


AA. 


AS. 


Using the parameters in (12.61), show that U in (12.66) becomes 
the matrix U; in (12.69). 


Solve the equations in (12.712) and (12.71b) to obtain the vector r 
given in (12.72). 


A3. If M and K are as given in (12.59), obtain U as given in (12.66). A6. For rz, k = 1,2, given in (12.73), verify that Pr; gives x, in 
(12.74). 
EXERCISES 12.17—Part B 
B1. Use the Laplace transform to obtain (12.63) and (12.64) from B2. Data from row 1 of Table 12.9 i 


(12.62) and (12.60). 
Exercises B2-9 use the data from one row in Table 12.9. For each: 
(a) Obtain r" + Dr = 0, the uncoupled differential equations 


that define the normal modes for the system. 


(b) Find initial conditions x; (0) = a), x2(0) = a, x; (0) = bi, 
x5(0) = b», that separately excite each normal mode, that is, 
that cause the physical system to oscillate with one 
fundamental frequency or the other. 


(c) Solve the initial value problem determined by the appropriate 
entries in Table 12.9. 


(d) Plot x;(t) and x2(t) on the same set of axes. 


(e) Assuming the distance between the masses at rest is 4, plot 
the quantity 4 + x2 (t) — xı (t), the dynamic distance between 
the moving masses. 


(f) Plot x2 against xı, thereby forming a Lissajous figure. 


B3. 
B4. 
BS. 
B6. 
B7. 
B8. 
B9. 
B10. 


B11. 


Data from row 2 of Table 12.9 

Data from row 3 of Table 12.9 

Data from row 4 of Table 12.9 

Data from row 5 of Table 12.9 

Data from row 6 of Table 12.9 

Data from row 7 of Table 12.9 

Data from row 8 of Table 12.9 

If the left-hand mass in Figure 12.13 is driven by the external 

force f(t) = cost, and mj, = m; = kı =k, = k; = 

(a) write the governing differential equations for the motion of 
x4 (f) and x» (t). 


(b) using the initial data x, (0) = x; (0) = 0, k = 1,2, solve for 
the motion. 


(c) Plot the resulting solutions as functions of time. 


For the system in Figure 12.13, set kı = k» = 0, kz = k, thereby 
making the masses free to translate horizontally. 


ky kp k my m a a2 bi b; (a) Write the governing differential equations for the system. 
(b) Obtain and interpret the general solution. What are the natural 
| 2 2 5 l 3 =] 2 2 =l frequencies for the system? 
22 4 5 1 3 -1 -2 -1 1 sua , : ; 
3 2 3 1 1 3 1 2 0 —1 (c) Uncouple the differential equations and determine the normal 
4 5 3 1 1 3 S 9 E 0 modes for the system. 
5 2 2 5 3 1 0 1 0 9) B12. The general form for the equations governing harmonically driven 
6 2 4 $5 3 1 0 MES 1 coupled damped oscillators is Mx" + Bx’ + Kx = F where 
m m|2 = fe bi2 EN ki2 _ [Fi cosa 

95 5 Y S Y - Ll 3 wes essc mnes Leste. 
8 5 3 3 1 a " 0 0 Multiplying through by M~! gives equations of the form 


TABLE 12.9 Data for Exercises B2-9 


X" + Ax’ + Ex = G. Show that if there exists a matrix P for 
which P-!AP = D; and P-! EP = Dy, then x" + Ax’ + 
Ex = G becomes the uncoupled r” + Dır’ + Dor = P^!G upon 
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making the change of variables x = Pr. The matrices D; = 
[^ e and D> = [5 zl are diagonal matrices, and the matrices 
A and E are said to be diagonalized simultaneously. 


k — 1,..., 4. The equations are nonlinear and do not have 
unique solutions. There are, in fact, two free parameters in P. 


(c) Fix the values of the two free parameters in P by requiring 


B13. If, in Exercise B12, M — i p B= 
F = f= Los k 


(a) Find A and E. 


(b) Find P = [?' .?] by brute force, solving the eight equations 


P3 P4 


P-'AP = D,, PEP = Dy, for the eight unknowns pz, dg, 


EXAMPLE 12.28 


13 ok - les 2. 


35 42 


ES dj that the columns of P be vectors of length 1. 

(d) Use the results from parts (b) and (c) to uncouple the 
differential equations. 

(e) Solve the uncoupled equations for r. 


(f) Obtain x — Pr. 


Nonhomogeneous Systems and Variation of Parameters 


The First-Order Linear ODE 
Consider, from Sections 3.4 and 3.5, the nonhomogeneous scalar differential equation 
y'(t) — ay(t) + f (t) (12.75) 


where the coefficient a is a constant. Writing the equation as y'(t) — ay(t) = f(t), the 
form of the first-order linear equation used in Section 3.4, and multiplying through by the 
“integrating factor" e- /^^* = e7% , we obtain the general solution 


y(t) = e” J e *' f (t) dt + ce” 


Setting c = 0 leaves the particular solution 


Yp = e fer dt 


This same particular solution can also be obtained by the technique of variation of 
parameters. The homogeneous solution is yy (t) = ce”, and we look for a particular solution 
of the form u(t)e^', with brute force leading to u'(t) = e~” f(t), and hence, u(t) = 
f € *' f (t) dt. Clearly, the resulting particular solution is again (12.76). 


(12.76) 


The Nonhomogeneous Linear System 


The matrix analog to (12.75) is x'(r) = Ax(t) + F(t), and the matrix analog to the partic- 
ular solution (12.76) is 


Xs =o J e ^'F(t) dt (12.77) 


where e is replaced by e^', the fundamental matrix $ of Section 12.9. The integral is 
applied to each component of the integrand, a vector. 


The fundamental matrix for the nonhomogeneous first-order system 


x(t) f _ 1 2] [x n t 
yA] [4 -1|v»() el 
is on the left in (12.79), and its inverse, $7! = $(—t), is on the right. 


1 2e? ob e e — e? i 1 2e-3t Ji: et e? za e 
ier áp (12.79) 


(12.78) 


3 Jet — 2e ^t e Sis 2e t 3 2e t - 2e? eg ^? + 2e?! 
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Consequently, if F(t) is the vector on the right in (12.78), the integrand in (12.77) becomes 


1 
—At == 
e F(t) = 3 E 


Integrating, we obtain 


—At TTL. D 
E F(t) dt = 108 |. 


and after simplifying, we find 


x= eM fe “'K(t) dt = 


EXERCISES 12.18—Part A 


Cet ogi 1 (p 9t — phy 
ET 2e) «ef (e JE 2e Jet (12.80) 
(12t — 4)e?' — (24t + 8)e — 9e*t — 18e? 

^ an - »—3t 4t —2t (12.81) 

24t 4- 8)e (24t + 8)e ^" + 18e 18e 
1 [9e c 4(r 4-1) 15:83 
36 16t waa 
D 


A1. Verify that @ given in (12.79) is the fundamental matrix for the 
matrix A given in (12.78). 


A2. For the fundamental matrix $ given in (12.79), verify that 


OI = et. 


EXERCISES 12.18-Part B 


A3. Verify the product e^ ^'F(r) given in (12.80) is correct. 
A4. Verify the integration in (12.81). 
AS. Show that x, given in (12.82) satisfies (12.78). 


Bl. Let v — e and consider the initial value problem v’(t) = 


( 
Av(t) +f(t), vO) = vo = bl Let V(s) — E ] be the Laplace 


transform of v, and let F(s) be the Laplace transform of f. 

(a) Take the Laplace transform of the differential equation and 
show that V (s) =#@(sI — A) vo + (sI — A) 'E(s). 

(b) Invert V(s), and show that v(t) = $vo + 
L-[(sI — A)-!F(s)], where $ is the fundamental matrix e^' 

(c) Since (s7 — A)~'F(s) is the product of two Laplace 
transforms, we have L^![(s1 — A)! F(s)] = $ (t) * f(t), the 
convolution of the fundamental matrix $ (t), and f(t). Show 
that Ø f = e^ f e ^f(s) ds = v, the particular solution. 


(d) Show that v = vi + Vp, a sum of the homogeneous solution 
and the particular solution. 


In Exercises B2-11, the matrix A — [ 2 d ;] and the given vectors F(r) 


and xo determine an IVP of the form x’(t) = Ax(t) + F(t), x(0) = xo. 
For each: 


(a) Solve by Laplace transform: compute the transform of each 
equation, solve for the unknown transforms, and invert each. 


(b) Obtain the fundamental matrix $ = e^ 


(c) Obtain the homogeneous solution Xp 
vector of arbitrary constants. 


— $c, wherecisa 


(d) Obtain the particular solution x, = e^ f e ^'F(r) dt. 

(e) Obtain the general solution x, = Xy + X, and apply the data, 
making sure the resulting solution agrees with the result in 
part (a). 


B2. 


B4. 


B6. 


B8. 


B10. 


In Exercises B12— 


(f) On the same set of axes, plot x(t) and y(t), the components 
of x(t). 


(g) Plot y(x), the parametric curve determined by (x(t), y(t)). 


B3. F() = pul ee pi 
sint 1 
0 


B9. F(t) = | "I 
gt 


sin , 
-1 e 4 
ae s Bi. ro - [, |. | 5] 


21, the vector F(t) = [7] and the given matrix A and 


t 
F(t) = | 1 
12 


initial vector xo determine an IVP of the form x'(t) = Ax(t) + F(t), 
X(0) = xo. For each: 


(a) Solve by Laplace transform: compute the transform of each 
equation, solve for the unknown transforms, and invert each. 


(b) Obtain the fundamental matrix $ = e^ 


(c) Obtain the homogeneous solution Xy 
vector of arbitrary constants. 


(d) Obtain the particular solution x, = e^ f e ^'F(r) dt. 


= $c, where c isa 
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(e) Obtain the general solution X, = xy + xy and apply the data, 
making sure the resulting solution agrees with the result in 
part (a). 

(f) On the same set of axes, plot x(t) and y(t), the components 
of x(t). 


(g) Plot y (x), the parametric curve determined by (x(t), y(¢)). 

B13. Exercise B3, Section 12.14 
B15. Exercise B5, Section 12.14 
B17. Exercise B7, Section 12.14 
B19. Exercise B9, Section 12.14 
B21. Exercise B11, Section 12.14 


B12. 
B14. 
B16. 
B18. 
B20. 


Exercise B2, Section 12.14 
Exercise B4, Section 12.14 
Exercise B6, Section 12.14 
Exercise B8, Section 12.14 
Exercise B10, Section 12.14 


In Exercises B22—27, the vector F(t) = [<.., |, the initial vector Xp = [ 1]. 


CO: 1 
and the given matrix A determine an IVP of the form x’(t) = Ax(t) + 


F(t), x(0) = xo. For each: 
(a) Solve by Laplace transform: compute the transform of each 
equation, solve for the unknown transforms, and invert each. 
(b) Obtain the fundamental matrix $ = e^'. 


(c) Obtain the homogeneous solution x, = $c, where c is a 
vector of arbitrary constants. 


(d) Obtain the particular solution x, = e^ f e-^'F(t) dt. 

(e) Obtain the general solution x, = Xp + Xp and apply the data, 
making sure the resulting solution agrees with the result in 
part (a). 

(f) On the same set of axes, plot x(t) and y(t), the components 
of x(t). 


(g) Plot y(x), the parametric curve determined by (x(t), y(t)). 
B22. Exercise B6, Section 12.10 B23. Exercise B7, Section 12.10 
B24. Exercise B8, Section 12.10 B25. Exercise B9, Section 12.10 
B26. Exercise B10, Section 12.10 B27. Exercise B11, Section 12.10 
In Exercises B28—33, the vector F(t) = lel the initial vector X; = [ 3]. 


and the given matrix A determine an IVP of the form x(t) = Ax(t) + 
F(t), x(0) = xo. For each: 


(a) Solve by Laplace transform: compute the transform of each 
equation, solve for the unknown transforms, and invert each. 


Phase Portraits 


The Phase Plane 


(b) Obtain the fundamental matrix $ = e^. 


(c) Obtain the homogeneous solution x, = $c, where c is a 
vector of arbitrary constants. 


(d) Obtain the particular solution x, = e^' f e^ ^'F(t) dt. 
(e) Obtain the general solution X, = Xp + x, and apply the data, 
making sure the resulting solution agrees with the result in 
part (a). 
(f) On the same set of axes, plot x(t) and y(t), the components 
of x(t). 
(g) Plot y(x), the parametric curve determined by (x(t), y(t)). 
B28. Exercise B3, Section 12.12 B29. Exercise B5, Section 12.12 
B30. Exercise B7, Section 12.12 B31. Exercise B8, Section 12.12 
B32. Exercise B10, Section 12.12 B33. Exercige B11, Section 12.12 
In Exercises B34—39, the vector F(t) = ['*"], the initial vector xo = [ 7]. 


and the given matrix A determine an IVP of the form x'(f) = Ax(t) + 
F(t), x(0) = xo. For each: 
(a) Solve by Laplace transform: compute the transform of each 
equation, solve for the unknown transforms, and invert each. 
(b) Obtain the fundamental matrix $ = e^'. 
(c) Obtain the homogeneous solution x, = $c, where c is a 
vector of arbitrary constants. 
(d) Obtain the particular solution xy = e^ f e-^'F(t) dt. 
(e) Obtain the general solution X, = x + Xp and apply the data, 
making sure the resulting solution agrees with the result in 
part (a). 
(f) On the same set of axes, plot x (t) and y(t), the components 
of x(t). 
(g) Plot y(x), the parametric curve determined by (x (t), y(t)). 
B34. Exercise B12, Section 12.12 B35. Exercise B14, Section 12.12 
B36. Exercise B15, Section 12.12 B37. Exercise B17, Section 12.12 
B38. Exercise B19, Section 12.12 B39. Exercise B21, Section 12.12 


A damped spring-mass system is governed by the second-order differential equation my" (t) 
+ by'(t) + ky(t) = 0, which translates into a first-order system via the change of vari- 
ables u(t) = y(t), v(t) = y'(t) since u'(t) = y'(t) = v(t) and v'(t) = y"(t) = —£ y(t) — 


mA 


———— X 
—1U -5 5 10 
PON 
Ky 
/ —104- 
i 635 


FIGURE 12.17 Phase portrait for 
=x+2y,y'’=4x-y 
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mY (t) = —Fu(t) — zv(t), so 


u(t] 0. Ljug 
[o] -|-& —2 Lo] 
m m 
A parametric plot of v(t) against u (t) is actually a plot of y’(t) against y(t). The system 
point (y(t), y’(t)) traces a history of position and velocity for the mechanical system. Such 
acurve is called an orbit (also, path or trajectory) and the uv-plane is called the phase plane. 


A graph of several orbits in the phase plane is called a phase portrait and is a characteristic 
geometric profile categorizing the behavior of the system. 


A Phase Portrait 


Consider the system of differential equations x'(f) = x(t) + 2y(t) and y'(t) = 4x(t) — y(t) 
for which Figure 12.17 shows solutions through the eight initial points (1, 1), (—1, —1), 
(5, —10), (—5, 10), (6, —10), (4, —10), (—6, 10), and (—4, 10). The directions on the trajec- 
tories correspond to the motion of the system point (x(t), y(t)) as the parameter t increases 
along the curve. These directions are obtained from the differential equations. Table 12.10 
indicates how directions are obtained for paths through the four points labeled A, B, C, and 
D in Figure 12.17. 


Point (x, y) x' y! Conclusion 
A (pos, 0) x =x>0 y =4x>0 Both x and y increase 
B (0, pos) x’=2y>0 y=-y <0 x increases, y decreases 
C (neg, 0) y =pl y =4x<0 Both x and y decrease 
D (0, neg) X= 2y = 0 y =-y>0 x decreases, y increases 


TABLE 12.10 Points on the trajectories in Figure 12.17 


Equilibrium Points 


An equilibrium point in the phase plane is a point at which x’(t) = y’(t) = 0. Such a point 
represents an equilibrium solution, a constant solution where the system point sits and does 
not travel along an orbit. For the typical linear system we find the only equilibrium point to 
be the origin, (0, 0), provided the system matrix is not singular. 

There are four kinds of equilibrium points; and they have the names node, saddle, 
center, and spiral. Table 12.11 summarizes these names and briefly characterizes each type 
of equilibrium point. 


Name Description 

Node All paths either enter or leave equilibrium point 
Saddle Two paths enter, two leave, all others “swoop by” 
Center Orbits are closed curves around equilibrium point 
Spiral Each path spirals around equilibrium point 


TABLE 12.11 Equilibrium points 
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FIGURE 12.18 Phase portrait for the 
(outward) node of Example 12.29 


FIGURE 12.19 Phase portrait for the 
center in Example 12.31 


FIGURE 12.20 Phase portrait for the 
(inward) spiral of Example 12.32 


Table 12.12 gives an example of each type of equilibrium point. A phase portrait for 
each example is given in the indicated figure. For system L; Table 12.12, the equilibrium 
point at the origin is a node “out,” sometimes called a repeller. (See Figure 12.18.) Were the 
trajectories in this node to point inward toward the origin, the node would be a node “in,” 
sometimes called an attractor. 


Designation Equations Equilibrium Point Figure 


x'(t) = 7x(t) — 2y(t) 
= y(t) = 15x(t) — 4y(t) Node 


x'(t) = x(t) + 2y(t) 


Figure 12.18 


2 a "ieur .] 
La yA) = 4x (t) = yt Saddle Figure 12.17 
x'(t) = x(t) — 2y(t) j 
’ re 12.19 
L3 3 (0) = xir — te) Center Fjgure 12.1 
c(t) = —x(t) — 2y ; p 
La iia. A= AYN) Spiral Figure 12.20 


y(t) = x(t) — 3y(t) 


TABLE 12.12 Examples of equilibrium points 


For system L», Table 12.12, the equilibrium point at the origin is a saddle. This is the 
same system whose trajectories appear in Figure 12.17. A trajectory that enters or leaves 
the origin is called a separatrix (plural, separatrices). Trajectories starting on one side of 
a separatrix remain on that same side. The equations for the separatrices are considered in 
Exercise 1. 

For system L3, Table 12.12, the equilibrium point at the origin is a center. A center is 
surrounded by closed trajectories. (See Figure 12.19.) 

For system L4, Table 12.12, the equilibrium point at the origin is an inward spiral. 
Like the inward node, the inward spiral is sometimes called an attractor. (See Figure 12.20.) 
Clearly, if the trajectories spiral outward, the phase portrait would be that of an outward 
spiral and it would likewise be called a repeller. 


Eigenvalues and the Phase Portrait 


For the linear system x' — Ax, the eigenvalues of the matrix A characterize the nature of 
the phase portrait at the origin. These relationships are summarized in Table 12.13. 


Equilibrium Point Eigenvalues 
Node Same sign 
Saddle Opposite signs 
Center Pure imaginary 
Spiral Complex conjugates 


TABLE 12.13 Characterization of equilibrium points 
by eigenvalues 
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Representative Examples 


Table 12.14 gives representative examples of the four types of equilibrium points and their 
eigenvalues. We distinguish between a proper node and an improper node. For the moment, 
the improper node is characterized by repeated eigenvalues. In Section 12.20, we will see 
that the improper node poses a minor difficulty when studying the stability of nonlinear 
systems. Nodes and saddles have exponential solutions that tend either to zero or infinity. 
Hence, trajectories for these systems will either tend toward or away from the origin. The 
center has trigonometric solutions that are the parametric representations of closed curves. 
The spirals have solutions with the trigonometric terms of the center but have exponential 
factors that force the solutions either toward or away from the origin. 


Equilibrium Point Eigenvalues Solutions 
Proper node in e: gt ert 

Improper node in —1,—1 ete 

Proper node out 1,2 e, e 

Improper node out Ll e', te 

Saddle —1,2 e, e 

Center Si cos 3f, sin 3f 

Spiral in -1 2i e~ cos 2t, e ' sin 2t 
Spiral out 13:21 e! cos 2t, e' sin 2t 


TABLE 12.14 Eigenvalues and representative examples of equilibrium points 


EXERCISES 12.19 


1. Find the eigenvectors for the system matrix in Example 12.30, Table (e) Use the differential equations to determine the direction of 
12.12. Show that any solution x(ż) starting at xo on the line through increasing f on each trajectory drawn in part (d). 


the origin having jirection of an eigenvector remains along that 


: : 3 (£) Use an efficient technology to obtain a phase portrait for the 
line. Hence, the separatrices are determined by the eigenvectors. 


system of differential equations. 
The 2 x 2 matrix A given in each of Exercises 2—21 determines a ho- (g) If the origin is a saddle, show that the eigenvectors determine 
mogeneous system x’ = Ax, where the components of x(t) are x(t) and the separatrices. 
t). For each system: 
(a) Determine the nature of the equilibrium point (0, 0) by 
computing the eigenvalues of A. 


(b) Obtain xp, the general homogeneous solution to the linear 


initial points (x, y) = (1, 1), (—1, 1), (—1, —1), (1, —1). 


(d) In the phase plane, plot the trajectories determined by the four 


system. 10. [12 ~? T -3 15 p, [? 0 13 1 5 
(c) Obtain x(t), k = 1,..., 4, solutions through each of the four ` | 1 al : [. 1 : » M j E -1 
solutions found in part (c). | 


2 ES 2 
4 - 1 "1 56. E i "i i "| 
2 iz Ë 12 -18 1 3 
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Nonautonomous Systems 


The general nonlinear system in two unknowns would typically be of the form 


A e F(x(t), y(t), t) -m G(x(t), y(t), t) 

dt dt 
When the independent variable f is explicitly present on the right-hand sides of the differ- 
ential equations, the system is called nonautonomous. A time-varying breeze blowing the 
smoke coming from a chimney would give rise to a nonautonomous system. Table 12.15 lists 
several examples of both linear and nonlinear nonautonomous systems. In the table, sys- 
tem (b) is a linear nonautonomous system, while system (f) is a nonlinear nonautonomous 


system. 


Linear Nonlinear 
x’ =2x+3y x! —2x—3ixy 
Autonomous (a) y 5x —4y (c) oe gr ds ixy 
x’ = x(60 — 3x — 4y) 
(d) , : 
y = y(42 — 3y — 2x) 
x e 
E) ; a 
y = —sinx 
Nonautonomous (b) i-i ada (f)sf12.20 scope 
y = 5x — 4y — e' UU y =x ysint 


TABLE 12.15 Examples of autonomous and nonautonomous systems 


Autonomous Systems 


When the independent variable t is not explicitly found on the right-hand sides of the 
differential equations, the system is called autonomous and would be of the form 

dx F dy GG 

ZU (x(t), y (1) me (x(t), y (t) 
For the autonomous system, the notion of a fixed geometry in the phase plane, giving rise to 
time-invariant phase portraits, makes sense. Thus, we also have the notion of an equilibrium 
point, a point (x, y) in the phase plane where both a = 0 and E — 0. System (a) in Table 
12.15 is a linear autonomous system, while systems (c)-(e) are nonlinear autonomous 
systems. System (a) is typical of the systems we have been studying in Sections 12.1— 
12.19. System (c) is a predator-prey model that we will examine in some detail in Section 
12.21. System (d) is a competing-species model, also studied in Section 12.21. System (e) 
models the nonlinear pendulum, studied in Section 12.23. 


Isolated Equilibrium Point 


An isolated equilibrium point is one that can be surrounded by a circle containing no other 
equilibrium point. A linear autonomous system with constant coefficients and determinant 
zero would not have any of its equilibrium points isolated. For example, the system whose 


matrix is A = [E 1] has determinant zero, and every point on the line x — —2y is an 


y 


FIGURE 12.21 
center 


Example 12.29: Stable 


EXAMPLE 12.29 


EXAMPLE 12.30 
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12.20 Stability 


equilibrium point, none of which can be surrounded by a circle containing just the one 
equilibrium point. 

Henceforth, we will assume each equilibrium point in our discussions is an isolated 
equilibrium point. In particular, the linear autonomous system for which det A Æ 0 has just 
one equilibrium point, the origin. 


Stability of an Equilibrium Point 


An isolated equilibrium point for an autonomous system of differential equations is said 
to be orbitally (neutrally) stable if all solutions sufficiently close to the equilibrium point 
remain close to that equilibrium point as t — oo, asymptotically stable if it is orbitally 
stable and, in addition, all solutions sufficiently close to the equilibrium point actually tend 
toward that equilibrium point as t — oo, and unstable if at least one solution near the 
equilibrium point at f = f; > 0 does not remain close to that equilibrium point as t > oo. 

Table 12.16 lists Examples 12.29-12.31, which we will use to illustrate these terms 
and motivate precise mathematical definitions. 


Example System A Eigenvalues Phase Portrait 
(12.29) a E 1 "T Figure 12.21 
(12.30) ui ia d [a d 6.2 Figure 12.22 
(12.31) 2c scam E 4 +i Figure 12.23 


TABLE 12.16 Examples of orbitally stable, asymptotically stable, and unstable systems 


The system in Example 12.29, Table 12.16, has an orbitally stable equilibrium point at the 
origin. To see what this means, note the eigenvalues of the coefficient matrix A are the pure 
imaginary conjugate pair +i. Hence, the phase portrait is that of the center. The origin is 
the center of closed orbits that neither spread apart nor approach each other, the essential 
meaning of orbital stability. Any solution starting near the origin remains near the origin. 
It does not necessarily get arbitrarily close to the origin, but it does not get far from the 
origin either. The phase portrait in Figure 12.21 is useful in this regard because it shows that 
solutions starting near the origin remain near the origin, tending neither toward nor away 
from the origin. Hence, the following definition of orbital stability. 

The equilibrium point P is orbitally stable if the solution x can be kept within € of P, 
that is, ||x(t) — P|| < £, provided x initially starts out sufficiently close to P by satisfying 
lx(0) — P || < 6 for an appropriate ô > 0. $ 


The system in Example 12.30, Table 12.16, has an asymptotically stable equilibrium point 
at the origin. The eigenvalues of the system matrix A are —3, and —2. The eigenvalues are 
of the same sign and negative. Hence, the phase portrait is that of the inward node. That 
makes the origin an attractor; and hence, all solutions will be drawn into the origin, making 
the system asymptotically stable. Any solution that starts near the origin will tend toward 
the origin as t — oo. For example, the solution starting at (a, b), namely, 


x(t) = (6a — 3b)e^' — (5a — 3b)e™™ and y(t) = (10a — 5b)e~* — (10a — 6b)e ~” 
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FIGURE 12.22 Example 12.30: 
Asymptotically stable (inward) node 


EXAMPLE 12.31 


FIGURE 12.23 Example 12.31: Unstable 
saddle 


satisfies lim; x(t) = 0 and lim;., 5 y(t) = 0. As promised, an arbitrary solution starting 
near the origin not only remains near the origin but tends to the origin as  — oo. Hence, 
all solutions, not only those near the origin, tend toward the origin with increasing 1, as 
seen in the phase portrait in Figure 12.22. 

In the nonlinear case where there may be other equilibrium points that attract some 
solutions starting some distance away from the origin, the more precise wording "starting 
near enough to the equilibrium point" is critical. Hence, we formulate the definition of 
asymptotic stability as follows. 

If the equilibrium point P is a (neutrally or orbitally) stable equilibrium point for which 
lim, X(t) = 0 whenever any solution x satisfies ||x(0) — P || < ô for a sufficiently small 
and positive ô, then P is also asymptotically stable. 

It is actually necessary to require that the equilibrium point be orbitally stable before 
checking that nearby solutions satisfy the limit condition. Examples can be constructed 
in which a sequence of solutions all starting near the equilibrium point successively tend 
arbitrarily far from the point before finally approaching it. Such nonuniformity in the limit 
is ruled out by first demanding that all solutions near enough to the critical point remain 
near the critical point, that is, by first demanding orbital stability. e 


The system in Example 12.31, Table 12.16, has an unstable equilibrium point at the origin. 
The eigenvalues of the system matrix A are +1, so the corresponding phase portrait is that 
of the saddle. There are two trajectories that will enter the origin, but all other solutions, 
no matter how close to the origin they begin, will tend toward infinity as t increases. Since 
at least one solution starting near the origin does not remain near the origin, the origin is an 
unstable equilibrium point. Solutions starting on the y-axis will tend toward the origin. 
In fact, such solutions are precisely x(t) = 0, y(t) = ae ', for which lim;s.x(t) = 
lim; >æ y(t) = 0. Any other solution x(t) = ae’, y(t) = a(e! — e~')be™ will not remain 
near the origin since, for a > 0, lim;+. x (f) = lim;.. y(t) = oo, and for a < 0, 
lim; x(t) = lim; >œ y(t) = —oo. As promised, all other solutions, no matter how near 
the origin they may have started, tend toward infinity. As seen in Figure 12.23, the phase 
portrait, that of a saddle, makes the instability of this equilibrium clear. 

An equilibrium point that is not stable is called unstable. Thus, if at least one solution 


starting near the equilibrium point does not remain near it, the equilibrium point is unstable. 


S. 
ksd 


Summary 


Table 12.17 summarizes the relationships between phase portraits, eigenvalues, and stability. 


Equilibrium Point Eigenvalues Conditions Stability 
Node (in) Real and negative Asymptotically stable 
Spiral (in) a t bi a<0 Asymptotically stable 
Center +bi Pure imaginary Orbitally stable 
Node (out) Real and positive Unstable 
Spiral (out) atbi aso Unstable 
Saddle Real, with opposite signs Unstable 


TABLE 12.17 Eigenvalues and the stability of equilibrium points 


EXERCISES 12.20-Part A 
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Nonlinear Systems 


For Exercises A1—5, the given matrix A determines a linear system 
x’ = Ax. For each, classify the equilibrium point at the origin 
according to Table 12.17. Sketch a few representative trajectories that 
support your conclusion about stability. 


EXERCISES 12.20—Part B 


B1. Example 12.31, Table 12.12, is a system for which the origin is a 
center. Its phase portrait in Figure 12.19 shows ovals as the closed 
trajectories. Example 12.29 , Table 12.16, is a system for which 
the origin is a center. Its phase portrait in Figure 12.21 shows 
what appears to be circles as the closed trajectories. Investigate 
these two examples. Can centers have noncircular closed 
trajectories? How? 


In Exercises B2-21, the given 2 x 2 matrix A determines the homo- 
geneous system x’ = Ax, where x has components x(t) and y(t). For 
each: 


(a) Determine the nature of the equilibrium point (0, 0) by 
computing the eigenvalues of A. 


(b) From the eigenvalues, determine if the equilibrium point is 


(f) In the phase plane, plot the trajectories determined by the four 
solutions found in part (d). 


(g) Use the differential equations to determine the direction of 
increasing ¢ on each trajectory drawn in part (f). 


(h) Use an efficient technology to obtain a phase portrait for the 
system of differential equations. 


B.[5 | Beda ] sef 5] BS (ai ol 


lis 9 1 — -11 0 

[9 —2 —9 4 3 10 11 -9 
Bé. |^ M B7. i 2 B8. 5 | B9. E 2| 
Bio. | ? jl B11 » "i B12 3 


B13. | s [5i] Bis. [3 7 efh 
asymptotically stable, orbitally stable, or unstable. L 1 T -$ 3 -6 BS 
(c) Obtain x, the general homogeneous solution to the linear B17. P | B18. r * B19 [2 d 
system. aJa 7 
B3 | 9 2] wal’ $ 
(d) Obtain solutions through each of the four initial points "3 4 “la 10 
(x, y) = (1, D, 1, D, (71, -1), (1, —1). 
(e) For each solution in part (d), plot x(t) and y(t) and obtain 
lim,.o0 x (t) and lim; y (t), if they exist. 
Nonlinear Systems 


EXAMPLE 12.32 


Autonomous and Nonautonomous Systems 


The general nonautonomous system is nonlinear and, by definition, contains the independent 
variable explicitly. The general autonomous system is also nonlinear but does not contain 
the independent variable explicitly. This "reversal" of negations can be confusing. The 
autonomous system does not contain, and the nonautonomous system does contain, the 
independent variable explicitly. 


Predator-prey model Lotka and Volterra proposed the following model to explain the 
relationship between two species, one a predator feeding off the other, the prey. 

Let x(t) and y(t) be the numbers, respectively, of rabbits (prey) and foxes (predators) 
in an ecosystem. Assume that rabbits eat only clover and that the clover is an unlimited 
resource. Assume further that foxes eat only rabbits. Moreover, assume that if there were 
no foxes to limit the rabbits, the number of rabbits would grow exponentially, whereas if 
there were no rabbits to sustain the foxes, the foxes would die out exponentially. 
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FIGURE 12.24 Example 12.32: x(t) 
(solid), prey, and y(t) (dotted), predator 


10 


0 5 10 15 20 25 


FIGURE 12.25 Phase portrait for 
Example 12.32 


EXAMPLE 12.33 


FIGURE 12.26 Phase portrait for 
Example 12.33 


Assume that the number of rabbits eaten by the foxes is proportional to the frequency 
of fox-rabbit encounters and that the number of fox-rabbit encounters is proportional to 
x(t)y(t), the product of the population sizes. A particular example embodying these as- 
sumptions would be the initial value problem (see system (c), Table 12.15) 


x'(t)2x— lyy 
ü with x(0) = 10, y(00 2 5 (12.83) 


y() = -2y + by 


Thus, if there were no foxes, y(t) would be zero, in which case x’(t) = x(t) and the rabbits 
grow exponentially. On the other hand, if there were no rabbits, x(t) would be zero, in 
which case y'(t) = —2y(t) and the foxes die off exponentially. 

Unfortunately, there is no closed-form solution for this system of differential equations. 
The study of such systems must be done indirectly through numerical, graphical, and logical 
(analytical) investigations. As a first step in the investigation, we find all equilibrium points. 
For nonlinear systems, there may be equilibrium points at locations other than just the origin. 
For this system, there are two, (0, 0) and (8, 2), obtained as the solutions of the equations 


x'—x—ixy-20 and y'= —2y + ixy =0 


It is instructive to obtain solutions both in the phase plane and in the time domain. 
Figure 12.24, computed numerically, shows time-domain graphs of x(t) (solid curve) and 
y(t) (dotted curve). The populations of the rabbits and the foxes vary periodically. As the 
number of foxes starts to increase, the number of rabbits will begin to decline. As the number 
of rabbits begins to increase, the population of foxes, though lagging the increase in the 
rabbits, begins increasing also. 

Since x(t) and y(t) represent numbers of rabbits and foxes, respectively, only the first 
quadrant of the phase plane makes sense physically. Figure 12.25 shows the equilibrium 
point (8, 2) inside closed orbits y (x) in the phase plane. These orbits, traced counterclock- 
wise, are consistent with periodic motion in the time domain since the system point keeps 
repeating values over and over again. Moreover, the phase portrait suggests (8, 2) is a cen- 
ter. However, at this stage of our study, we cannot assert this with surety. It does appear, 
however, that the origin is a saddle point since there is one path (the y-axis) entering and 
one path (the x-axis) leaving. Section 12.22 discusses analytic techniques for determining 
the behavior of nonlinear systems in the vicinity of an equilibrium point. E 


Competing species The equilibrium points of the system (see system (d), Table 12.15) 
x'(t) = (60 —3x)x —4xy and y'(t) = (42 — 3y)y — 2xy (12.84) 
are (0, 0), (20, 0), (0, 14), and (12, 6), obtained as solutions of the equations 
x’ = x(60 — 3x — 4y) =0 and y'= y(42—3y -2x) 20 (12.85) 


From (12.84), we can see that each species, in the absence of the other, obeys a logistic 
model. The interaction terms proportional to the product of the population sizes have nega- 
tive coefficients, making interactions harmful to both species. Hence, the model represents 
competition between members of two species. 

Figure 12.26 contains a phase portrait showing trajectories in the first quadrant of the 
phase plane. From the phase portrait, it would appear the equilibrium points are an outward 
node, a saddle, a saddle, and an inward node, respectively. However, these inferences require 
the analytical tools of Section 12.22 for verification. kd 
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12.22 Linearization 


Al. The system x’ = x — xy, y' = —2y — xy can be thought of as a 
competing-species model where growth/decay for one species is 
exponential in the absence of the other. Find the equilibrium 
points, and describe the fate of the populations. 


/ 


as a competing-species model where the first species obeys a 
logistic model in the absence of the second, but the second decays 
exponentially in the absence of the first. Find the equilibrium 
points, and describe the fate of the populations. 


. The system x’ = x — xy, y' = (1 — y)y 
a competing species model where the first species grows 
exponentially in the absence of the second, but the second obeys a 


EXERCISES 12.21—Part B 


. The system x’ = (1 — x)x — xy, y' = —2y — xy can be thought of 


xy can be thought of as 


AA. 


AS. 


A6. 


logistic model in the absence of the first. Find the equilibrium 
points, and describe the fate of the populations. 


Remove the interaction terms from the model in (12.84), leaving 
two uncoupled logistic models. Determine the carrying capacities 
for these two models. 

Write the first equation on the left in (12.83) as E =1- iy, and 
integrate over 0 < t < T, where T is the period for a cycle around 
one closed orbit in Figure 12.24. Let y — i h y(t) dt be the 
average value of y(t). Using x(0) = x(T) (from periodicity), show 
that y — 2. 


Repeat Exercise A5 for x(t), obtaining x = 8. 


B1. The system x'(t) = (2 — x)x + Ixy, y(t)=(2-—y)y+ ixy 
represents two species for which interactions are mutually 


beneficial. Each obeys a logistic model in the absence of the other. 


Obtain the equilibrium points. From a phase portrait or direction 
field drawn in the first quadrant, hypothesize about the nature of 
the equilibrium points. 


For the autonomous systems in Exercises B2-21: 


(a) Find all equilibrium points. 


(b) Plot x(t) and y(t), numeric solutions passing through (1, 1) 
att = 0. 


(c) In the phase plane, plot y (x), the trajectory corresponding to 
the solution found in part (b). 


(d) Using appropriate software, obtain a phase portrait or 


direction field, and from it, attempt to determine the nature of 


the equilibrium points found in part (a). 


~x' =x(-3+x—Yy), y’ = y(—9 — 2x + 3y) 
B3. x’ = x(—9 + 3x + 2y), y = y(-l+x+y) 


B4. x’ = x(5 + x), y! = y(-5 +x — y) 


Linearization 


BS. x’ = y(—2 — x + 2y), y' 2 x(14 + 3x — Ty) 

B6. x' = x(3x + y +6), y' = y(3 +4x + y) 

B7. x’ = x(—12 + 4x + 3y), y' = y(—2 +x + y) 

B8. x’ = y(—1 +x + y), y 2 x(4 — 2x — 3y) 

B9. X =x(2 +x + y), y' = y(7 — 8x — Ty) 
B10. x' = x(4 — x — 2y), y' = y(6 +x + 3y) 
B11. x' = x(30 — 6x + 7y), y' 2 y(24 — 5x + 6y) 
B12. x’ = y8 +x — y), y' 2 x(-20 — Ax + 3y) 
B13. x' = x(15 + 3x + 2y), y = y(3-2x + y) 
B14. x’ = y(—3 + 8x + y), y =x (1 — x) 
B15. x’ = x(—2 + 2x — 3y), y' = y(—1 — x + y) 
B16. x' = x(3x + 4y + 9), y' = y(—3 + 2x + 3y) 


B17. x’ = x(18 + 6x + 7y), y = y(—5 — x — y) 
B18. x’ = y(1 — x + y), y' 2 x(—14 + 7x — 6y) 
B19. x’ = y(—1 + 4x — y), y' = x(2 — 5x + y) 
B20. x’ = x(—5 + x), y' = y(4 + 3x — y) 

B21. x’ = y(28 — 6x + 7y), y' = x(—35 + 7x — 8y) 


Tangent-Line Approximation 


Near the point of contact, the curve y = f(x) is approximated by its tangent line. For 
example, the function f(x) = (x — 1)? + 2 and its tangent at the point (2, 3) appear in 
Figure 12.27. Near the point (2, 3) the function f (x) very much resembles its tangent line 
y — 2x — 1. Analytically, the tangent line is the Taylor polynomial of degree 1, 2x — 1. 
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FIGURE 12.27 — Tangent-line 


approximation 


EXAMPLE 12.34 


Tangent-Plane Approximation 


From multivariable calculus, we know the tangent plane approximates a function of two 
variables. This is the two-dimensional version of linearization. For example, at the point 
where (x, y) = (2, 2), the tangent plane approximating the function f (x, y) = 3x^ 4: Dy? 3 
5x — 7y —9is z = 7x + y — 29. This first-degree polynomial approximation of f (x, y) is 
just the multivariable Taylor polynomial of degree one. 


Linearizing Autonomous Systems 


Near an equilibrium point of the autonomous nonlinear system dx = F(x(t), y(t)), d = 


G(x(t), y(t)), the behavior of solutions can be studied by linearizing the functions F (x, y 
and G(x, y) at each equilibrium point. Indeed, let (a, b) be an equilibrium point determined 
by the equations F (a, b) = G(a, b) = 0. Then, lumping the higher order remainder terms 
into the functions f(x, y) and g(x, y), the first-degree Taylor expansions 

F(x, y) 2 F(a, b) + F(a, b)(x — a) + Fy(a, b)(y — b) + f(x, y) 

G(x, y) = G(a, b) + G,(a, b)(x — a) + Gy(a, b)(y — b) + g(x, y) 
become 


F(x, y) = Fy(a, b)(x — a) + Fy(a, b)(y — b) + f(x, y) 
G(x, y) = Gx (a, b)(x — a) + Gy (a, b)(y — b) + g(x, y) 


because (a, b) is an equilibrium point at which F(a, b) = G(a,b) = 0. The nonlinear 
autonomous system now reads 


1 
E = F,(a, b)(x — a) + Fy(a, b)(y — b) + f(x, y) 
dy 
3 G,(a, b)(x — a) + G,(a, b)(y — b) + g(x, y) 
Define the change of variables u(t) = x(t) — a, v(t) = y(t) — b so that E = ie and, 


) dy 
dv — ® and the system now reads 


dt dt 
Hi F,(a,b) F,(a,b) H 4 | £659 
|! = = 
v Gx(a,b) G,(a,b)| LV g* (u, v) 
or u' = Au + P, where the matrix 


A F,(a,b) | Fy(a, b) 
" |G.(a,b) G,(a,b) 


is the Jacobian matrix and the functions f*(u, v) and g* (u, v) are just the functions f(x, y) 
and g(x, y) under the change of variables x = u + a, y = v + b. 

The equilibrium point (a, b) in the xy-plane has been translated to the equilibrium point 
(0, 0) in the uv-plane. If the perturbation term P is dropped, the resulting system u' — Au is 
a linear system with an equilibrium point at (0, 0). The behavior of the nonlinear xy-system 
at (a, b) can often be deduced by analyzing the behavior of the linear uv-system at (0, 0), 
as we will shortly show. 


Recall the competing-species system (d), Table 12.15, examined at some length in Exam- 
ple 12.33, Section 12.21, where the system equations written in (12.84) give F(x, y) — 
x(60 — 3x — 4y) and G(x, y) = y(42 — 3y — 2x). From Figure 12.26, the phase portrait 
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for this system, we guessed the nature of the four equilibrium points (0, 0), (0, 14), (20, 0), 
and (12, 6) to be an outward node, a saddle, a saddle, and an inward node, respectively. 
The Jacobian matrix is 


(12.86) 


60 — 6x — 4y —4x 
—2y 42 — 6y — 2x 


and at each of the equilibrium points this matrix evaluates to 


60 o0 —60 -—80 4 0 —36 -—48 
, ; ; (12.87) 

0 42 0 2 —28 -42 —]2 -18 
respectively. The eigenvalues of these four matrices are 60, 42; —60, 2; 4, —42; and —27 4- 
34/73 = —1.37, —27 — 34/13 = —52.6. From the eigenvalues of the linearized systems, 
we have a node out, a saddle, a saddle, and a node in, respectively. But rules are needed 


for deducing the nature of the critical points of the nonlinear system from the information 
generated for the linear system. These rules appear in the next paragraph. $ 


Interpretation Rules 


The following five rules summarize how to convert information about the linearized system 
into information about the nonlinear system. They form a hierarchy and are applied from 
top to bottom. 


1. Equilibrium points that are unstable or asymptotically stable in the linearized system 
will be the same in the nonlinear system. 


Saddles and spirals in the linearized system remain the same in the nonlinear system. 


Proper nodes (A’s real and distinct) in the linearized system remain the same in the 
nonlinear system. 


4. Improper nodes (A's real and equal) in the linearized system can be nodes or spirals in 
the nonlinear system. 

Such nodes are called improper because of the slight ambiguity in passing from 
the linearized to the nonlinear system. However, instability and asymptotic stability 
will persist by Rule 1. Thus, an improper outward node will be either an outward node 
or an outward spiral. An improper inward node will be either an inward node or an 
inward spiral. So even though there is a slight ambiguity, it is still possible to determine 
whether the nonlinear system is unstable or asymptotically stable. 


5. Centers in the linearized system can be centers or spirals in the nonlinear system. 

This is the difficult case. Since centers are not asymptotically stable to begin with, 
the center that becomes a spiral can become an inward or an outward spiral. Centers 
are neither unstable nor asymptotically stable, so Rule 1 does not apply. Thus, the very 
nature of the behavior of the nonlinear system is in complete doubt if the linearized 
system has a center. No decision can be made on the basis of the linearization, and 
far more powerful tools are then necessary to determine the behavior of the nonlinear 
system at such an equilibrium point. 


It is often exceedingly difficult to distinguish between a spiral and a stable center in a 
nonlinear system. You can never be sure if the spiral behavior is an artifact of numerical 
(round-off) error in your numerical scheme. Analyzing the stability of such a point requires 
a great deal more mathematical skill than we have time to develop here. 
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EXAMPLE 12.35 To analyze the stability of the nonlinear autonomous system given on the left in (12.88). 
obtain the equilibrium points (0, 0) and (4, 1) and the Jacobian matrix A given on the right 


y x! = F(x, y) = 5x(1 — y) 4 ies —5x | 


12.88 
y = G(x, y) = yx — 12) 3y 3x — 12 ( ) 


Evaluate A at each equilibrium point, and compute the corresponding eigenvalues, obtaining 


the matrices 
5 0 0 —20 
12.89 

lo P i P ol DAS 


and the respective eigenvalues (5, —12}, and +27 V15. The point (0, 0) is a saddle, and 
unstable, for the linearized system; therefore, it is a saddle, and unstable, for the nonlinear 
system. The point (4, 1) isa center for the linearized system; therefore we cannot determine 
the behavior for the nonlinear system. The best we can do is try to infer the behavior from 
FIGURE 12.28 Phase portrait for Figure 12.28, a phase portrait for the system. The phase portrait suggests that (4, 1) may 
Example 12.35 well be a center in the nonlinear case. + 


EXERCISES 12.22-Part A 


A1. Show that the origin is a center for the linearized version of the A3. Show that the origin is a center for the linearized, and 
system x’ = y + 2x,/x? + y?, y' = —x + 2y / x? + y? and is an nonlinearized, versions of the system x’ = y + y /x? + y?, 
unstable spiral for the nonlinear equations. Hint: The nonlinear y = —x — xx? + y?. (See the Hint in Exercise A1.) 
equations can actually be solved by changing to polar coordinates. A4. For the competing-species model in Example 12.34, verify the 


Make the change of variables x(t) = r (t) cos0(t), y(t) = 

r(t) sin 0 (t). Eliminate 0' to obtain an equation that can be solved . j Biss bs S n 
for r(t), then eliminate r to obtain an equation that can be solved A5. Obtain the four matrices in (12.87), and verify their eigenvalues 
for 0 (t) have been correctly given in the text. 


Jacobian matrix given in (12.86). 


A2. Show that the origin is a center for the linearized version of the A6. Obtain the Jacobian matig given 1n (12.88), verify that at the 
system x’ = y — 2x./x? + yl, fe 2y./x? + yi andisan equilibrium points it becomes the matrices in (12.89), and then 
asymptotically stable spiral for the nonlinear equations. (See the verify the eigenvalues have been correctly stated in the text. 
Hint in Exercise A1.) 


EXERCISES 12.22-Part B 


B1. The nonlinear system x’ = y + x(x? + y?), y = —x + y(x? + y?) (g) Show that the change of variables x(t) = r (t) cos 6 (t), 
is an example where the linearized system has a center that is not a y(t) = r(t) sin 8 (t) converts the differential equations to 
center for the nonlinear system. r'(t) = r5,0'(t) = —1. (Hint: Either compute x’ = cos @ — 
r sin 6’, etc., and combine the equations, or start with 


(a) Show that the origin is the only equilibrium point. : s : 
" z " / S d / 
ae : . . r^ = x* + y^ and obtain rr’ = xx' + yy’, etc.) 
(b) At the origin, linearize and state the matrix A for the . . . — 
linearization (h) Solve the equations in part (g), and show that for any initial 
. : : "n conditions, r (f) becomes unbounded in finite time. Hence, the 
(c) Obtain the eigenvalues for the matrix in part (b). Pau "m 2 

el origin is an unstable equilibrium point. 
(d) On the basis of the eigenvalues of the linearization, categorize 


meee ee : B2-21. For the nonlinear system given in each of Exercises B2-21 
the equilibrium point for the linear system. 


in Section 12.21, linearize at each equilibrium point and determine 


(e) Obtain a phase portrait for the nonlinear system. the behavior of the nonlinear system in the neighborhood of the 
(f) Use the phase portrait to determine the nature of the equilibrium point. If the equilibrium point is a center for the 
equilibrium point. linearized system, use a phase portrait to predict the behavior of the 


nonlinear case. 


D 


m 


FIGURE 12.29 The plane pendulum 


FIGURE 12.30 Phase portrait for the 
nonlinear plane pendulum 
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The Nonlinear Pendulum 
Pendulum Equations 


SECOND-ORDER ODE The differential equation for an undamped pendulum is 
mLO0" (t) 4- mg sin = 0 (12.90) 


where m is the mass of the bob, L is the length of the pendulum, g is the gravitational 
constant, and 0 is the angle the pendulum makes with the vertical. (See Figure 12.29.) The 
equation is a nonlinear second-order differential equation for which the solution cannot be 
given in terms of elementary functions, so interpretation of the motion of the pendulum 
must come from numerical work and phase-plane analyses. 


FIRST-ORDER SysTEM In anticipation of a phase-plane analysis, we rewrite the pendulum 
equation as a first-order system, a revision that does not remove the nonlinearity. The first- 
order system will also be nonlinear. As usual, define x(t) = 6(t) and y(t) = 6’(t), and then 
differentiate these definitions to obtain 


; ; , 5 mg sin 0 . 
x =@=y and y 20 M Lo LP P 
mL L 


For simplicity, set L = g so that the equations become 


x (f) 2 y and y'(r) 2 —sinx 


Equilibrium Points 


The equilibrium points are clearly (nz, 0), with n = ..., —2, 21,0, 1, 2, .... The nature 
of most of these equilibrium points can be determined by linearization. The Jacobian matrix, 
evaluated at the equilibrium points, is 


0 l 0 1 
—cosx Ol, |-(-1)" 0 


and has eigenvalues +7 when n is even and +1 when n is odd. At the even-integer multiples 
of x, the eigenvalues are pure imaginary, so the corresponding equilibrium points for the 
linearized system are centers. Unfortunately, this tells us nothing about the behavior of 
these points in the nonlinear case. At odd-integer multiples of zr, the eigenvalues are real, 
but of opposite signs, so the corresponding equilibrium points for the linearized system are 
saddles. Hence, the corresponding points are also saddles in the nonlinear case. A phase 
portrait will be used to interpret the nonlinear system at the indeterminate equilibria. 


Phase Portrait 


In the phase portrait shown in Figure 12.30, the points (—27x, 0), (0, 0), and (27r, 0) appear 
to be centers in the nonlinear case also. The solution starting at (0, 1) has initial displacement 
0 = 0, 6’ = 1, so a pendulum hanging down at rest is given a positive initial (angular) 
velocity, causing the bob to swing counterclockwise. Moving counterclockwise, the bob 
rises, slowing down until it stops at its maximum displacement. The phase point on the 
closed orbit crosses the x-axis. As the bob begins swinging back down, its velocity becomes 
negative and its displacement is decreasing back to zero. When the bob again is vertical, 
it has negative velocity that will carry it in the clockwise direction. The return to vertical 
corresponds to the orbit crossing the y-axis at y — —1. The bob swings in the clockwise 
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direction until it attains its maximal height. The system point on the orbit crosses the x-axis 
to the left of the origin. As the bob descends to the vertical, it moves counterclockwise. The 
system point on the orbit moves clockwise toward its initial point at (0, 1). 

The solution starting at (0, 2.5) has initial displacement 0 = 0,6’ = 2.5, so a pendulum 
hanging down at rest is given a positive initial (angular) velocity, causing the bob to swing 
counterclockwise. The initial velocity is large enough to cause the bob to “go over the top,” 
rotating it in a complete circle. 

The orbit starting at (0, 2) in the phase plane ends at the saddle point (z, 0). It takes an 
infinite amount of time to arrive at the saddle point. Correspondingly, the physical motion 
sees the bob move counterclockwise from the vertical, with just enough energy to coast to 
a stop (y = 0) in the inverted position above the pivot (x = 7). 


EXERCISES 12.23 


1. Linearize the equations for the nonlinear pendulum by replacing 3. Derive (12.90), the equation for the nonlinear plane pendulum. Hint: 
sin ð with 0. Obtain and interpret the phase portrait for the linearized Put the origin of an xy-coordinate system at the fulcrum of the 
equations. pendulum so that the bob is located at x = L sin0, y = —L cos. 


Apply Newton's Second Law in the form F = ma, where F = —mgj 


2. Add linear damping to the equation for the nonlinear pendulum, se J : 
and a = x”i + y"j. Eliminate (0^)* from the resulting equations. 


obtaining the differential equation m L0" + b0' + mg sind = 0. 
Obtain and interpret the phase portrait for this differential equation. 


Chapter Review 
1. Formulate a two-tank mixing problem in which brine enters the first 7. Obtain the general solution to the homogeneous equations 
tank, is recirculated through the second tank, and leaves the second x — 5y — z = 0, x + 3y — 3z = 0, —Ax + 4y + 8z = 0. Write the 
tank through a drain. Decide on flow rates, concentrations, solution as the sum of homogeneous and particular solutions. 


recirculation rates, and drainage rates. Be sure that the fluid levels in 8. If A = P 8j B= E " andx = [7] compute (2A — 3B)2x 
$ —le ah A= i = Lol? ] 


each tank remain constant, and select meaningful initial conditions. 4 9 i S ood . 
9. If A= E An apply Gaussian elimination to the augmented matrix 


[A, I] to obtain A^, its inverse. Verify that the inverse has indeed 
been found. 
3. Use the Laplace transform to obtain a solution to the IVP in 10. Given the IVP x’ = 7x + 4y, y = —18x — 10y, x(0) = 2, 
Question 2. As a function of time, plot the salt content in each tank. y(0) = —3: i 
Obtain a graph of the system’s trajectory in phase space. Label the i 
initial point on the trajectory, and indicate the direction of 
increasing time along the path. (b) Write the system as x' = Ax, and find the eigenvalues and 
eigenvectors of the matrix A. 


2. Write an IVP that describes the salt content of each tank in the 
system devised in Question 1. 


(a) Obtain the solution by Laplace transform. 


4. Write the differential equations in Question 2 in matrix form. From 


the Laplace transform solution in Question 3, deduce the (c) From the eigenvalues and eigenvectors, construct the general 
eigenvalues of the system matrix. Use a technological tool to obtain solution. 
the eigenvalues of the system matrix, and compare. (d) Apply the initial data to the general solution and thereby 

5. Use a technological tool to obtain the eigenvectors of the system reconstruct the solution found in part (a). 
matrix. From the eigenvalues and eigenvectors, obtain the general (e) Using the Laplace transform, find two solutions of the 
solution of the first-order system of differential equations in differential equations, one solution satisfying the initial data 
Question 2, then apply the initial data, and reconstruct the solution x(0) = 1, y(0) = 0, and the other solution satisfying 
found by the Laplace transform. x(0) 20 y0) =i - 


6. Solve 2x + 3y = 5, 4x — 7y = 1 by Cramer's rule. 


11. 


(f) From the solutions in part (e), obtain the fundamental matrix, 
and use it to solve the original IVP. 

(g) Find a matrix P and a diagonal matrix D for which 
A = PDP™!, define the new variable r = P~'x, and thereby 
uncouple the original differential equations. 

(h) Solve the uncoupled system found in part (g), and from this 
solution obtain the general solution of the original system. 

(i) By differentiation and elimination, write the system as a single 
second-order differential equation. 

(j) Obtain the solution of the equation in part (1), and from it, 
recreate the solution found in part (a). 

(k) Obtain a phase portrait for the system x’ = Ax. 

(1) Show the origin is the only equilibrium point, and categorize it 
as a node, saddle, center, or spiral. 

(m) Make a definitive statement about the stability of this 
equilibrium point. 
Given the IVP x’ = —x — Sy, y' = x + 3y, x(00 = —1, y(0) = 1: 

(a) Obtain the solution by Laplace transform. 

(b) Write the system as x’ = Ax, and find the eigenvalues and 
eigenvectors of the matrix A. 

(c) From one complex eigenpair, obtain two linearly independent 
solutions, and, from these two solutions, construct the general 
solution. 

(d) Apply the initial data to the general solution and thereby 
reconstruct the solution found in part (a). 

(e) Using the Laplace transform, find two solutions of the 
differential equations, one solution satisfying the initial data 
x(0) = 1, y(0) = 0, and the other solution satisfying 
x(0) 20, y(0) = I. 

(f) From the solutions in part (e), obtain the fundamental matrix, 
and use it to solve the original IVP. 

(g) Find a matrix P and a diagonal matrix D for which 

= PDP~', define the new variable r = P~'x, and thereby 
uncouple the original differential equations. 


(h) Solve the uncoupled system found in part (g), and from this 
solution obtain the general solution of the original system. 

(i) By differentiation and elimination, write the system as a single 
second-order differential equation. 


12. 


13. 


14. 
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(j) Obtain the solution of the equation in part (i), and from it, 
recreate the solution found in part (a). 

(K) Obtain a phase portrait for the system x' — Ax. 

(D Show the origin is the only equilibrium point, and categorize it 
as a node, saddle, center, or spiral. 

(m) Make a definitive statement about the stability of this 
equilibrium point. 

Given the IVP x’ = —6x + y, y' = —16x + 2y, x(0) = 3, 

y(0) = —2: 

(a) Obtain the solution by Laplace transform. 

(b) Write the system as x' — Ax, and find the eigenvalues and the 
single eigenvector of the matrix A. 

(c) From the results in part (b), obtain one solution of the system 
of differential equations. 

(d) Obtain a second linearly independent solution. 

(e) From the solutions in parts (c) and (d), construct the general 
solution. 

(f) Apply the initial data to the general solution and thereby 
reconstruct the solution found in part (a). 

(g) Using the Laplace transform, find two solutions of the 
differential equations, one solution satisfying the initial data 
x(0) = 1, y(0) = 0, and the other solution satisfying 
x(0) = 0, y(0) = 1. 

(h) From the solutions in part (g), obtain the fundamental matrix, 
and use it to solve the original IVP. 

(i) By differentiation and elimination, write the system as a single 
second-order differential equation. 

(j) Obtain the solution of the equation in part (i), and from it, 
recreate the solution found in part (a). 

(K) Obtain a phase portrait for the system x’ = Ax. 

(1) Show the origin is the only equilibrium point, and categorize it 
as a node, saddle, center, or spiral. 

(m) Make a definitive statement about the stability of this 
equilibrium point. 

Write 3y” + Sy’+7y =e, y(0) = 1, y'(0) = 2, as a first-order 

system of differential equations. Be sure to include the initial 

conditions. 

Find and classify all equilibrium points of the system 

x! 2 yl x4 y). y -(4-2x —3y). 


EXAMPLE 13.1 


it t Lt 
0 | 2 3 
FIGURE 13.1 Example 13.1: Exact 
solution (solid) and asymptote y = /2 
(dotted) 
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Chapter 13 


Numerical Techniques: First-Order 
Systems and Second-Order ODEs 


INTRODUCTION The second-order differential equation can be solved numer- 
ically by specialized techniques such as the Runge—Kutta—Nystrom method. Alternatively, 
they can be solved by converting them to first-order systems and applying a vectorized ver- 
sion of one of the methods of Chapter 4. The vector version of the fourth-order Runge-Kutta 
technique is demonstrated. 


Runge-Kutta-Nystrom 


A second-order initial value problem In (13.1), the second-order initial value problem 
on the left has the exact solution shown on the right, the graph of which is seen as the 
solid curve in Figure 13.1. The dotted line in the figure is the horizontal asymptote y. = 
lim;.,o5 y(t) = JZ. 


y" (t) 4- y'(t)y(t) 20 t 
i dg => y(t) = V2tanh — 13.1 
y(0) = 0, y'(0) = 1 Ó J2 ( ! 
«v 


The rkn4 Algorithm 


In 1925 the Finnish mathematician E. J. Nystrom proposed, for second-order equations, 
a variant of the fourth-order Runge-Kutta method. For an initial value problem whose 
differential equation is y” (t) = f(t, y(t), y’(t)), the following algorithm, the fourth-order 
Runge-Kutta-Nystrom (rkn4) method, yields a numeric solution 


Fi = hf (te, Yk, y) Fa = h (y, + ih) 
F> — hf (tk + $h, ye + 4 Fa, yt + 5 F1) Fs — hf (tk + 3h yg + 3Fa yt SES) 
F, =A (y, +353) F4 = hf (tk+1, yg + Fos y, + Fs) 

Yer = yk +A (y; + iF + P + FJ) Ypi =); + EF +2F + 2F3 + Fa) 


If the IVP in (13.1) is solved numerically with this algorithm, using a step size of h = 
0.1, the solution at t = 3 is 1.374145628, as opposed to the exact solution of 1.374145962. 
The error of 3.34 x 1077 is too small for a graph to illustrate. 


EXERCISES 13.1 
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13.2. rk4 for First-Order Systems 


1. Using rkn4 implemented in a programming language of your choice, 
compute and plot the solution to each of the following initial value 
problems. Then, compare your solution with that generated by your 
favorite numeric differential equation solver. (Use h = 0.1 and 
integrate forward over an interval of length 3.) 

(a) t?y" + y'sint — y cost = evi y(1 =z, y (1) =e 

(b) yy” — t(y' — /yY — arcsinh(ry) = 0, y(1) = 1, y'(1) = —2 
(€) y" + yy’ +siny =e”, y(0) = —1, y'(0) 23 

(d) y'y" + arctan y =e’, y(1) = V2, y'(1) = V3 


3 
(e) y" + y?y' — ~ = cosh y, y(0) = 2, y' (0) = —5 
y" «3^ [ry y, y0) y (0) 
In each of Exercises 2-6, use the given second-order IVP to test empiri- 
cally whether rkn4 is a fourth-order method. As in Section 4.1 where this 
was done for rk4, integrate numerically from t = 0 to t = t;, where the 


error in the computed solution is determined by comparing to the exact 
solution. Thus, in each case, carry out the following steps. 
(a) Obtain yo. the exact solution of the initial value problem. 
(b) Using rkn4, and step sizes A; = 1/2*, k = 0, 1, 2, 3, 4, obtain 
Yapprox (Ag), numeric approximations of Yexact (tf). 
(c) Examine the constancy of 
[Yexact (fr). — Yapprox (he )| 
hi 
2. y" --3y' +7y =tcos3t, y(0) = 2, y'(0) = 
3. Ay" + 5y' + 13y = e'cos2t, y(00 = 1, y'(00 = —1;t — 5 
4. y" + /2y' + 10y = 5cos3t, y(0) = 0, y'(0) = 0; t; = 10 
5 
6 


3i; —35 


. 3y" -2y' + 8y = te! cos 5t, y(0) = 2, y'(00 = 1; t — 5 
. y" -- 2y' + 18y = 3cos4t, y(0) = 5, y (0) = —2; t = 5 


EXAMPLE 13.2 


_ rk4 for First-Order Systems 


Conversion to First-Order System 


A standard technique for obtaining a numeric solution of an initial value problem with a 
second-order differential equation is the conversion of the equation to a first-order system. 
The system is then solved by applying a method like the fourth-order Runge-Kutta algorithm 
adapted for such a system. 


Using the technique of Section 12.13, the change of variables u(t) = y(t), v(t) = y'(t) 
converts the second-order IVP on the left in (13.2) to the first-order system on the right 


y’+yy=0 u'(t) 2 y'—-v 
y(0) 20 becomes v(t) = y" = —y'y = —vu (13.2) 
y (0) 21 u(0) = 0, v(0) 21 
4 


Fourth-Order Runge-Kutta for Systems 


The fourth-order Runge-Kutta algorithm of Section 4.4 generalizes to systems if each of 
the functions is interpreted as a vector. Specifically, for the initial value problem 


u'(t) = f(t, ult), vt) v(t) = g(t, u(t), v(t)) u(0) = uo 
the algorithm would be given by the formulae 
F, = hf (th, Uk, Vk) 
Fy = hf (tk + sh, uj + ;h. UE + 1G) 
F; — hf (tk + sh, uy + iP. v. + 5632) 
F4 = hf (tyi, ug + F3, vy + G3) 
Ue) = Uk + «WM + 2Fo + 2F3 + F4) 


v (0) = vo 


G, = hg(ty, Uk, vx) 
G2 — hg (tk + sh, uy + iB. UR T 361) 
G3 — hg (t + ih, uy + iP. UR + 162) 
G4 = hg (tk+1, Uk + F3, v + G3) 

Vel = Ue + 1(61 +2 G2 +2 G5 + Ga) 
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y Applied to the IVP in (13.2), the algorithm yields the graphs of u(t) and v(t) shown in 
Figure 13.2. The graph of u(t) (solid) is recognized as the graph of y(t) from Figure 13.1, 
while the graph of v(t) (dotted) is the plot of y’(t). 


FIGURE 13.2 Example 13.2: y(t) = u(t) 
(solid) and y'(t) = v(t) (dotted) 


EXERCISES 13.2 


1. Convert each initial value problem in Exercise 1, Section 13.1, into this numeric solution with the numeric solution generated by rkn4 and 
the form of a first-order system and obtain a numeric solution with a with the exact solution. (Use h = 0.1 and integrate forward over an in- 
system-implementation of the fourth-order Runge-Kutta algorithm. terval of length 3.) 


Compare this numeric solution with a numeric solution generated by 


rkn4. (Use h = 0.1 and integrate forward over an interval of 
length 3.) 4. Exercise 4, Section 13.1 5. Exercise 5, Section 13.1 


2. Exercise 2, Section 13.1 3. Exercise 3, Section 13.1 


In Exercises 2-6, convert the given IVP into a first-order system and 6. Exercise 6, Section 13.1 


obtain a numeric solution with a system-implementation of rk4. Compare 


aM. — O 


Chapter Review 


1. Write Euler's method of Section 4.2 for the IVP x’ — f (t, x, y), 3. Solve the IVP of Question 2 by the Runge-Kutta-Nystrom 
y = g(t, x, y), x(0) = xo, y(0) = yo. algorithm, and graphically compare the solution with that generated 
2. Apply the results of Question 1 to the solution of y" + 3y’+ by Euler’s method. 


2y =e, y(0) = 2, y'(0) = —3. Obtain the exact solution of the 
IVP, and compare graphically with the numeric solution. 


Chapter 14 


Series Solutions 


INTRODUCTION Second-order linear differential equations can be solved 
exactly if they have constant coefficients. Some equations with variable coefficients, like 
the Euler equation, can also be solved exactly. But in general, the solution of second-order 
ODEs with variable coefficients can only be expressed as power series. Hence, we consider 
techniques for obtaining power series solutions of ODEs directly from the differential 
equations themselves. 

Points about which solutions have power series expansions are called regular points. 
All other points are then singular points. At regular singular points the linear ODE will 
have either two generalized power series solutions or a generalized power series solution and 
a series solution containing a logarithm. Techniques for obtaining these kinds of solutions 
are examined. 

If the coefficients of the ODE are not analytic, its solution may be expressible only as 
an asymptotic series. This case is also examined in the chapter. 

Nonlinear second-order ODEs containing a parameter and describing mechanical and 
electrical systems can sometimes be solved with perturbation series, which are a special 
kind of asymptotic expansion. The Poincaré perturbation scheme is described. However, the 
Poincaré series often fails because it can generate secular terms that become unbounded in 
finite time. Hence, we also discuss Lindstedt's method for generating perturbation solutions 
that have no such secular terms. When applied to the equation of a damped spring-mass 
system in which the spring is nonlinear, this method shows that the period of oscillation 
now depends on the initial amplitude, quite the contrary to the behavior of the equivalent 
system with a linear spring. Although Lindstedt's method can determine the dependence 
of frequency on initial amplitude and find periodic solutions of some nonlinear equations, 
it does not provide approximations valid away from the periodic solution itself. These 
solutions are better found by the method of Krylov and Bogoliubov appearing at the end of 
the chapter. 


Power Series 
Series Solutions at Regular Points 


REGULAR Point The point tọ is a regular point of the differential equation 
a(t)y" (t) + b(t)y' (t) + c(t) y(t) 20 (14.1) 


if a solution y(t) can be obtained as a power series 3-4 a(t — to)*, where each a, = 
y* (to)/k! is computed directly from the differential equation itself. 
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EXAMPLE 14.1 


If a(t), b(t), and c(t) are analytic at t = fo and if a(to) Æ O, then to is a regular point 
for the differential equation, such a power series solution exists for y(t), and its coefficients 
a, are determined from (14.1) as follows. Write (14.1) as 


b(t) , c(t) 
y(t)— 

a(t) a(t) 

from which y" (to) follows, provided initial values for y'(t9) and y (to) are given and a (tọ) # 


0. Additionally, higher derivatives such as y" (tọ) can be computed from y” (t), since by our 
assumptions, the functions p(t) and q(t) possess the requisite derivatives. 


y"(t- y(t) = —p(Dy'() — gy) 


In (14.2), the IVP on the left has the exact solution shown on the right. Also shown on the 
right are the first few terms of a Taylor series expansion of the exact solution 


y" + 4y’ + 13y = e™ y(t) = e“ -— e” cos 3t — 1 sin 3t 
Vaya Byset Ospe o) a 
y(0) = y'(0) 2 0 —-i?-ipPlitaiD-.. 


Table 14.1 shows how the differential equation itself is used to compute y (0), and hence, 
—— x 3 
ay = yv (0)/ kt. 


y? (0) 
k y? (t) y (0) E EXT 
2 y" =e" — 4y' — 13y 1 — 4(0) — 13(0) = 1 i-1 
3 y" = —e — 4y" — 13y' —1 — 4(1) — 13(0) = —5 -3 =? 
4 — y® set — Ay" — 13y" 1 — 4(-5) — 13(1) - 8 473 
5 y = —e™ —4y — 13y” —1 — 4(8) — 13(—5) = 34 vad 


TABLE 14.1 Using the IVP y" + 4y’+ 13y =e, y(0) = y'(0) = 0 to generate the Taylor 
series for y(t) 


A more practical technique for obtaining the series solution in (14.2) begins with the 
polynomial 3 a at^, which already satisfies the initial conditions y(0) = y'(0) = 0. 
Substitution of this polynomial into the differential equation then gives 


(14.3) 


where, on the right, e~’ has been replaced by a Maclaurin polynomial. Matching coefficients 
for t^, k = 0, 1,2, on either side of (14.3) then gives, in (14.4), the equations on the left 
and the coefficients aj, k = 2, 3, 4, on the right 


2a, = | a = 


| 
N= 


6a3 +84 = —1 > = (14.4) 


Ain 


we 


12a4 + 12a3 + 13a» = 


Ni 


>: 
0 02 04 06 08 1 


FIGURE 14.1 Example 14.1: Exact 
solution (solid) and Taylor approximation 
(dotted) 
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The behavior of the approximate solution can be seen in Figure 14.1 where, as the 
dotted curve, it is compared to the exact solution, the solid curve. The approximate solution 
is accurate to about t = 0.4, whence it radically departs the oscillatory exact solution. 
Any order Taylor approximation will ultimately diverge from the exact solution since each 


Taylor approximation is but a polynomial that ultimately must become unbounded. — ** 


Taylor Series Solution 


For the Taylor series solution to remain faithful to y(t) for all time t > 0, the series would 
have to be an infinite sum, not just a polynomial (partial sum). The resulting manipulations 
with the formal sum y(t) = beat a,t* involve substitution, leading to 


oo co (—1)*t k 
Yo klk = Dau? AM kage +13 Da! Ju IUE "m 


k=2 k=2 k=0 


where, on the right side, we wrote the Taylor series for e~'. Next, bring all terms to the left 
side, writing all sums with like exponents. Changing the summation index on each of the 
first two sums on the left gives 


x + 2)(n + 1)an+2t" +4 a J a 413 Y ant" — pop (— s 7 


n=0 n-l n=2 n=0 


Since the index in the third sum starts at n = 2, the other three sums must be made to start 
at that same index by extracting all terms prior to the n = 2 term. Thus, we have 


(2a, — 1) + (6a3 + 8a» + Dt 


+ b» (v 4- 2)(n + 1)ay42 4- (n + 1)a444 + 13a, 


oo 
—1)" 
= ( ) )r —0 
om n! 


The coefficients of each power of t must vanish, giving us the equations 2a? — 1 = 0, 
6a3 + 8a5 + 1 = 0, and 


(—1)" _ 


n! 


(Q 4 n)(1 4- 1n)a244 4-4(14- n)aj44 + 13a, — 


The first two equations determine az and a3, yielding a; = 1 and a3 = -i. whereas the 
third equation actually represents an infinite set of equations, one for each value of the index 
n = 2,3,.... Solving this two-term recursion (or recurrence) relation for a,+2 in terms of 


4,4. and an, we find 
—4(n + 1)n!a,44 — 13a,n! + (—1)" 
n'(n + 1)(n + 2) 
We don't anticipate obtaining a closed-form solution for the general coefficient a,+2, 


but we can compute as many coefficients in succession as we need. Recalling that the initial 
conditions determined ag = a, = 0 and that the differential equation determined a? = ; 


(14.5) 


an+2 = 


and a3 = -2, we can compute the next few coefficients as a4 = L, üs — n: a= —J5 
a= i= etc., thus yielding the corresponding terms of the series solution as 
fi 1 
y(t) = $07 — 2 443044 30 — Feo + eU + 508 + OW) (14.6) 


ALTERNATE ALGORITHM The following technique from [29] is an interesting alternative 
for obtaining the recurrence relation governing the coefficients in the Taylor series solution 
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of certain differential equations. We illustrate the technique for 
y'() - ry ( yq) =0 


a differential equation with polynomial coefficients. Instead of using a full infinite sum for 
y(t), write a finite sum, containing general terms that span the nth term, as in a, 11^! + 
ant” + a4 071 + dn4ot"**. Substitute into the differential equation, and extract 24,42 + 
3an42n + d, 2n? + a, 1n — à, + Gn, the coefficient of the general term rt”. Setting this 
expression equal to zero, and solving for a4», we find the recurrence relation 


1—n)a,-1—4a 
ds43 = ( ) n—1l n (14.7) 

(n+ 1)(n 4-2) 
Define a_; = 0 and compute the first few coefficients determined by (14.7), obtaining 
a= — $40. a= —tay, a4 = -5a -— 3; 40; and a5 = 5540 4 pa. Each coefficient 


is given in terms of ao and a;, the two arbitrary constants in the general solution of the 
differential equation. 


Series Solutions at Regular Singular Points 


REGULAR AND IRREGULAR SINGULAR Points For the differential equation 
y") + p()y' (t) 4 q()y() 20 (14.8) 


points that are not regular are called singular points. 

A point tọ can fail to be regular if either p(t) or g(t) fails to have a power series at 
t = tọ. For example, t = 0 would be a singular point if p(t) = e'/t since p(t) does not have 
a Taylor series expansion about t = 0. In fact, the series representation for this function is 


gx 1 ign fo. 13 
FEN T _ 47 lg T 4. 1.43 4 
p(t) = = 2 3 ga Lt ptt BP FO 
k=0 
Along with a “Taylor series” part, there is an additional term, namely L, that expresses the 
singularity of p(t) att = 0. This series expansion is called a Laurent series and is valid for 
0 < |t| < R for some positive R. The function p(t) is therefore said to have a pole of order 


one att = 0. 
Similarly, the function g(t) = e'/t? has a pole of order two at t = 0 because its Laurent 
series 
e lali "9 qoc o 1,2 i 43 4 
qt) 7 p? atte tat tt at + pf 00 


. 1 . : . . " 
contains the term >. Consequently, we segregate singular points into two types, regular 


and irregular. The regular singular point is a singular point for which the singularities in 
p(t) and q(t) are within certain bounds, and the irregular singular point is one for which 
these singularities exceed the prescribed bounds. In particular, fo is a regular singular point 
provided that it is not a regular point of the differential equation and that p(t) has no worse 
than a pole of order one at tọ while q(t) has no worse than a pole of order two at fo. 


SOLUTIONS AT REGULAR SINGULAR Points’ Notation for the following discussion is 
greatly simplified if we assume the regular singular point f = tọ has been translated to 
the origin. Thus, let t = 0 be a regular singular point of the differential equation (14.8). 
At t = 0, the function p(t) has, at worst, a pole of order one and the representation shown 
on the left in (14.9), whereas g(t) has, at worst, a pole of order two and the representation 


EXAMPLE 14.2 


EXAMPLE 14.3 
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shown on the right in (14.9) 


pi k q-2 , d-1 k 
f) = n= + d H= FÅ 1 14.9 
pt)- — 2 Ph q(t) = += +2 (14.9) 


Let o and f be the roots of the indicial equation 
r? t (p.i— Dr 4-520 


ordered so that Re(B) > Re(o). Then the two linearly independent solutions of (14.8) will 
be 


oo oo oo 
yi =t’ > as and Y, =t" X bet or Y 2 Yilnt 4- t? yat (14.10) 
k=0 k=0 k=0 

There is always a solution of the form Y;. If æ = £, the second solution will be of the 
form Y3. If 8 — æ = s, a positive integer, then the second solution may be of the form Y? or 
Yz. At great length, texts such as [74] develop criteria for distinguishing the nonlogarithmic 
case from the logarithmic case. We eschew the entanglement and instead rely on several 
examples to illustrate the two cases. 


The differential equation 


2 


202 y" E t(5t +3)y' + Ot — ly 20 (14.11) 


surely has t = 0 as a singular point, since the coefficient of y”(t) vanishes at t = 0. The 

nature of this singular point follows from the identification and analysis of the coefficients 
11 

20 


d TI 
a 4^ EN 
Thus, p(t) has a pole of order one at / = 0 and p-ı = 3; while q(t) has a pole of order 
two and q—2 = -i. Hence, the indicial equation is r? + 5r — E = 0, with roots a = —1 
and B = 5: Since the difference f — a = 5 is not an integer, the general solution is 


y(t) = c1yı (t) + c2yo(t), where 
yi = Vil — Br + Si? - BBP +004) 


[m 


y =t (1+ 2t — 72 + 8 + O5) e 


The differential equation 
212 y" + 5y + (7t - 3) y 20 (14.12) 


surely has t = 0 as a singular point, since the coefficient of y”(t) vanishes at t = 0. The 
nature of this singular point follows from the identification and analysis of the coefficients 


(f 5 d at) 71 " 11 
— Jui n — D dies 
dum abc CRT. 
Thus, p(t) does not have a pole at t = 0, so p-; = 0; while q(t) has a pole of order two and 


q-2 = 1. Hence, the indicial equation is r?—r +} = 0, with the repeated roots a = f = 5. 


The general solution is therefore y(t) = ci yi (t) + c3y3(t), where 


y=- oe Ge — Fgh +O) 


$, 
ho d 


y = yi lnt + t(1t — UB? + SP + O(*)) 
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EXAMPLE 14.4 


EXAMPLE 14.5 


EXERCISES 14.1—Part A 


The differential equation 
At y" 4-212 y! — (t +3)y 20 (14.13) 


has t = 0 as a singular point, since the coefficient of y”(t) vanishes at t = 0. The nature of 
this singular point follows from the coefficients 


] 11 31 

p(t) = 5 and q(t) = we = ap 
Thus, p(t) does not have a pole t = 0, so p_; = 0; while q(t) has a pole of order two, and 
q-2 = —$. Hence, the indicial equation is r? — r — 2 = 0, with roots a = —} and f = 3, 


differing by an integer. The general solution of the DE is y(t) = cy (t) +c2y2(t), where 


y - P2 (1— 1r i0— 40-40(0*) and y 2:712(—2-4:— 1? 3; Oo) 


(14.14) 
so, although B — a = 2, the second solution does not contain a logarithm. Surprisingly, 
1 ei? ] t—2 
gn h= T and abo = = "3 (14.15) 
so (fi(t), fo(t)} is an alternate fundamental set for (14.13). (See Exercise A1.) s 
The differential equation 
At? y" (t) + 5t7y'(t) + (7t —3)yt)=0 (14.16) 


surely has t = 0 as a singular point, since the coefficient of y"(r) vanishes at t = 0. The 
nature of this singular point follows from the identification and analysis of the coefficients 


5 71 31 

p(t) — 1 and q(t)— ds CA 
Thus, p(t) does not have a pole at t = 0, so p_; = 0; while q(t) has a pole of order two, 
and g_2 = —j. Hence, the indicial equation is the same as it was in Example 14.4, namely, 
r—r— 5 = 0, with roots œ = -i and p = 3, roots that again differ by an integer. The 


general solution is y(t) = c1yı (t) + c3y3(t), where 


ys o 23/12 29 371 42 18,473 ,3 4 
y = P? (1— 2r- 220 — SS P +004) 


y =a lat Sr 2-297 19 (5 + O(g^) 
1 3 171 4 8 768 


so y; is of the form Y, = tf Y 7 o agt* while ys is of the form Y3 = Y; Int + 1% 3 7 o drt“. 
«4 


Al. Using (14.14), verify (14.15). 


A2. Verify that the coefficients in (14.6) are given by (14.5). 


A3. Substitute y(t) = t” into (14.11) and show that the indicial 
equation of Example 14.2 results when the coefficient of t” is 


forced to vanish. 


A4. With £ determined as in Example 14.2, substitute y(t) = 
t? (1 + ayt + apt?) into (14.11) and verify aj, a» in yy. 


AS. Substitute y(t) = t” into (14.12) and show that the indicial 
equation of Example 14.3 results when the coefficient of t" is 
forced to vanish. 

A6. With £ determined as in Example 14.3, substitute y(t) = 
I (V + ayt + apt?) into (14.12) and verify a), a» in yj. 


AT. Substitute y(t) = t^ into (14.13) and show that the indicial 
equation of Example 14.4 results when the coefficient of t” is 
forced to vanish. 


A8. With 6 determined as in Example 14.4, substitute y(t) = 
P (1 + ait + at?) into (14.13) and verify a), a in yı. 


A9. Substitute y(t) = t" into (14.16) and show that the indicial 
equation of Example 14.5 results when the coefficient of t” is 
forced to vanish. 


EXERCISES 14.1—Part B 
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14.1 Power Series 


A10. With £ determined as in Example 14.5, substitute y(t) = 
t?(1 + ait + at’) into (14.16) and verify aj, a in y. 


B1. The differential equation 1? y" + ty’ — y = 0 is a Euler's equation 
with solutions of the form t". Show that r = +1. Then, show 
t = 0 is a regular singular point of the equation, and find the 
indicial equation and its roots. Is the technique for solving the 
Euler equation in Section 5.12 at odds with the results in (14.10)? 
Explain. 


In Exercises B2-7, t = 0 is an ordinary point of the given differential 
equation. 


(a) Use a computer algebra system to generate n byt*, a 
Taylor polynomial approximating the solution of the IVP 
consisting of the given ODE and the data y(0) — 1, 

y'(0) = —2. 

(b) Obtain the exact solution to the initial value problem, and, 
from this solution, obtain an approximating Taylor 
polynomial that should agree with the polynomial found in 
part (a). 

(c) Write the differential equation as y" = f (t, y, y’) and use this 
to determine bz, k = 2,..., 5, as was done in Table 14.1. 

(d) Write y = 1 — 2t + Le a,t* and use the initial value 
problem to determine the coefficients ag, k = 2, ..., 5, which 
should agree with bg, k = 2,..., 5. 


(e) Write y = Y yat or y = e a,t* and use the 
differential equation to obtain a recurrence relation for the 


coefficients a;. 


(f) Use the recurrence relation found in part (e) to determine 


Bie KO) uu. 
(g) On the same set of axes, graph the exact solution and the 
polynomial approximation found in part (a). 
o kt) pk yk 
cos (= )2*t 
B2. y" -- 2y' + 10y =cos2t Hint: cos(2t) = X, d) 
k=0 
B3. y" +4y' - 13y=e'sint B4. y”+5y’+6y = cos5t 


B5. y” -2y' -5y 2 e 


S 


2H 57) pk 
k! 


oo 
cos 
B6. y" +7y + 10y = sint. Hint: sint = » ( 
k=0 
B7. y" + 6y' + 18y = e' cos 2t 
In Exercises B8-11, £ = 0 is a regular point of the given differential 
equation. 


(a) Use a computer algebra system to generate sna b,t*,a 


Taylor polynomial approximating the solution of the IVP 


consisting of the given ODE and the data y(0) = 2, 
y'(0) = —1. 

(b) Write y — ia RM a,t* and use the DE to obtain a 
recurrence relation for the coefficients az. 


(c) Use the recurrence relation found in part (b) to determine 


1 
1 ¢? 
B11. y" + 6y’+9y = cosht 


1 
B8. y” + 10y' + Aly = — 
1+t 


B10. y" -8y' - 17y 2 /1—t 


In Exercises B12-26, t = 0 is a regular point of the given differential 
equation. 


B9. y" +7y’ + 12y 


Il 


(a) Use a computer algebra system to generate =. b,t*, a 
Taylor polynomial approximating the solution of the initial 
value problem for which the data is y(0) = 2, y'(0) = —1. 


(b) Write the differential equation as y" = f(t, y, y’) and use this 
to determine bz, k = 2,...,5, as was done in Table 14.1. 


(c) Write y =2— t + YT a,t* and use the initial value problem 
to determine the coefficients ag, k = 2, ..., 5, which should 
agree with bz, 


(d) Write y = Y; , axt* and use the differential equation to 
obtain a recurrence relation for the coefficients az. 


(e) Write y — Cj oec t a,t* and use the differential equation to 


obtain a recurrence relation for the coefficients ag. 


(f) Use the recurrence relation found in either part (d) or (e) to 
determine aj, k = 0,...,5. 


B12. 
B13. 
B14. 
B15. 
B16. 
B17. 
B18. 
B19. 
B20. 
B21. 
B22. 


(5t? — 9t + 7)y” + (11t — 17)y’ + (082? + 6)y = 0 
(18? — 3)y" + (4t — 707) y’ + (2+ 94 — 407)y =0 
(7t? — 13)y" + (9t? + 10)y’ + (18t — 407) y = 0 
(31t — 3)y" + (7t + 102? + 4)y’ + (112 — 6t)y =0 
(9 — 9t?)y" + Gt — 7? —7)y' + (0 y =0 

(t + 2€ 4- 2)y" + (9 + 202) y! + (100t --4)y 0 
(13 — 7t - 02)y" +5y’ + (5t + 32 +2)y 20 

(5t? — 6 + 10r) y" + —9ty’ + (8? — 10 — 2t)y =0 
(1682? + Dy" + (? — 5t -2)y' + 8t —5y 50 
(14t — 2)y" + (4? +9)y + (1— 5t -302)y 20 
(5t? + 8 — 20) y" + (14 + 60) y' — 272 y =0 
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B23. (i? — 4 — 4t)y" + (10t +P +4)y’ -(02-82)y =0 
B24. (3 + 1712)y" + (8 — 13)y' + (10-4? — 4t)y 20 
B25. (t? + 11t + 10)y" + (? — 6t)y’ + (11 — 8t)y = 0 
B26. (5t — 1Dy" + (8t 2 —212)y' + (112 4-5 +5t)y 20 


In Exercises B27-41: 
(a) Show t = 0 is a regular singular point of the given differential 
equation. 
(b) Obtain and solve the indicial equation. 
(c) Obtain the recurrence relation for each independent solution. 
(d) Write the first few terms of each of the independent solutions. 
(e) Use a computer algebra system to obtain a series solution, and 
compare this solution to the results in part (d). 
B27. 
B28. 
B29. 
B30. 
B31. 
B32. 
B33. 


—61? y" + t(—8t + 5)y! + (-4t +7)y 20 
51? y" + t(8t — 3)y' + (5t -3)y «0 
51? y" +t(—6t — 9)y' +8y 20 
(—2t? — 7t)y" + Bt — 1)y' -2y 20 
6r? y" + t(8t — 1)y' -2y 20 
—81? y" -- Aty! + Qt +8)y 20 
—4t y" + t(—5t — Ty +y 20 
B34. 8?y" +t — 6)y' +3y 20 

B35. (61? + 7t)y” + (—-5t — 6y' +5y 20 
B36. 91? y" + Ory’ + (2t — 1)y =0 

B37. —7t?y" + t(—8t — 2)y' -2y 20 
B38. 3? y" + £(3t +2)y’ 2 2y 20 

B39. —8r? y" + t(5t? — 2)y' - 5y 20 
B40. —81?y" + t(6? -- 4)y' + 8y 20 
B41. (4t? — 5)y" — (6t +.4)y’ + 8y — 0 


In Exercises B42—46: 


(a) Show t = 0 is a regular singular point of the given differential 
equation. 

(b) Obtain and solve the indicial equation, noting that the roots, a 
and B, where Re(8) > Re(q), are real and differ by the 
positive integer s — f — o. 

(c) Using a computer algebra system, obtain a (truncated) series 
solution, thereby determining if the second solution contains 
Int. 


(d) Obtain the recursion relation for the solution y; = 
P y ya. 

(e) Use the recursion relation in part (d) to determine the first few 
terms of the solution y;. 


(f) Obtain the recursion relation for the solution yz = 
i" y D bi. 

(g) If part (c) suggests the second solution does not have a 
logarithmic term, use the recursion relation found in part (f) 
to determine the first few terms of the solution y». 

(h) If part (c) suggests the second solution has a logarithmic term, 
use the recursion relation found in part (f) to show that it 
leads to the first solution, y. 

(i) If part (c) suggests the second solution has a logarithmic term, 
use the differential equation and y» = Int Y; o aut? + 

1-9 dit ^*, for some suitable value of n, to determine the 
first few coefficients d}. Compare the resulting solution to the 
solution found in part (c). 


. 21? y" + t(—3t — 4)y' + (9t +4)y 20 
. y" + t(5t — T)y' + Ty 20 

. (t? — 3t)y" + 3ty’ — 8y «0 

. 21? y" + t(3t -- 6)y' —6y =0 

. 2^y" + t(8 — 5t?)y' — 8y 20 


Asymptotic Solutions 


EXAMPLE 14.6 About the regular singular point t = 0, the differential equation 


2 
y" (t) — (: — 3 y(t) 20 


has independent solutions y; = te’ and y2 = yı Int + 1 — 37? — 2p + O(t^), so there is in- 
deed a logarithmic term as seen in Section 14.1. On the other hand, for large t, the differential 
equation appears to be y"(t) — y(t) = 0, which has the general solution y(t) = cie! + cae" '. 
This inspires the guess that for large t the solution of the original equation might be of the 
form y(t) = e f (t), where perhaps we can take f(t) = t*(1 + XX, ait^). We therefore 


substitute the more pragmatic 


(14.17) 


; dq a a 
y-e't? (4245 3) 
t D 


- (14.18) 
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for y(t) in (14.17), obtaining e^ as Ay? = 0, where 
Ao — 3-1 
A1 = —2 +a, + 2ha — 01 
A> = 12a34-2Aaa, — 24a, — a +a? — a — 2a, 
; g (14.19) 
A3 = ìà*az — 4Aaz + 2ì&a — a3 — 2a + 2a, + a^a, — 31 
Ag = —6AXa3 + 2Aad3 + 6a — 2a3 + aa — Saar 
As = 12a + a7a3 — Tea; 
Setting Ao = 0 yields à = +1. If we pick A = 1, then A; = 2(a — 1) = 0, soo = 1, 
and A; = —2a,— 0, A3 = —4a = 0, A4 = 2(a2—3a3) = 0, and As = 6a3. Consequently, 
a, and a; must clearly vanish, and after a casual inspection of A4 we see that a = 0 also. In 


general, all the remaining coefficients are zero and one solution of the differential equation 
is te’. 


To find a second solution, pick A = —1, in which case 
Á] = —2 — 2a 
A» =a? — a —2aa; 
: (14.20) 

A3 = 2a5 + 2a, + at^a,— 3aa; == 2aaz 

A4 = 6a + 4a3 + à2a5 — Saan — 2003 
Setting A; = —2(1 + œ) = 0 determines a = —1, so Ap = 2(1 + aı) = 0, A3 = 4a» + 
6a,— 0, and A4 = 6(a3 + 2a) = 0. Hence, we have a; = —1, a? = 3, a3 = —3,....In 
general, the coefficients are determined by the recursion a,» = im — 1)a,—3, whose so- 
lution is a, = (—2) *(k + 1)! d 


This example illustrates the following more general theorem from [46]. 


THEOREM 14.1 


1. y"(t)-F f()y' (0 t g(y(t) =0 


oo oo 
2I ET) — yar and g(t) = Ja where ao and bo are not both zero. 
k=0 k=0 


3. A,ando,,k = 1, 2 are defined by the equations 
A? +a +bo=0 and (2A +ao)a + Aa, +b; =0 


=> There are solutions that, for large t, have asymptotic expansions of the form 
eMtt (1 MY Vct), k = 1,2. 


Thus, this theorem prescribes, for large t, the asymptotic form of solutions to a linear 
second-order differential equation with a regular singular point att = 0. Of course, for small 
values of t, the general solution may well be of the form y(t) = cy y(t) + c» (In(t)yi(t) + 
y2(t)), that is, may well have a logarithmic term, as we learned in Section 14.1. 
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EXERCISES 14.2 


1. Carry out the substitution of (14.18) into (14.17), obtaining (14.19). (e) Make the change of variables t = i so that y(t) = y) ES 
w(x) leads to the differential equation x*w" + (2x? — 
x? f (3)w + gw = 0. If x = 0 is a regular (singular) point 


2. Verify that when A = 1, the equations in (14.19) determine 


y(t) = te’. : ale: . 
j ne for the equation in w(x), then t = oo is also a regular 

3. Show that when A = —1, the equations in (14.19) become the (singular) point for the equation in y(t). Show that t = oo is an 
equations in (14.20). irregular singular point of the given equation. 


4. For (14.17), write the solution for which A = « = —1. 


5. (4t? + 3t + 8)y" + (6t? — 8t — 9) y’ + 20? +9t — 1)y =0 
In Exercises 5-14: 6. Qr? — 3t — 4)y" + (6P — ty’ + (4? — 6t +5)y 20 

(a) Write the given differential equation in the form y" + f (1) y' + T. GO 5r — Ay" + 2 — Th + Dy (OP y =O 
g(t)y — 0, and show that the hypotheses of Theorem 14.1 8. Qi? + 5t + 8)y" + GP? +3t +9)y' + (0 y 20 
are met. 9. (£? —t — 8)y" + (T — 9t +3) y’ — (8? + 6t + 1)y =0 

(b) Obtain asymptotic expansions for f(t) and g(t), thereby 10. (32 — 7t + 6)y” — (5? — 2t)y' — (22? — 3t —5)y =0 
determining ao, bo, a1, bj. 11. (272 - 4t — 1)y" — (32 +t — Ay' — QU +t 4-4)y 20 

(c) Obtain A,, Az, o1, a2. 12. (32? — 9t — y" — Qr? +t + 6)y’ — (t? +2t —7)y =0 

(d) Obtain the asymptotic solutions y; = ef (1 + Dy, cyt), — 13. (82 + 4t 4 2)y" + (220 4-31 — 6)y' — 6(? + 6t + Dy =0 
i58 14. (t — 9t — Ty" + (-A£ + 94 -2)y' + GP E At 5)y =0 


| Perturbation Solution of an Algebraic Equation 


Perturbation Solutions 


A differential equation containing a parameter a will have a solution that depends on that 
parameter. For some equations, that solution can be computed exactly. For most equations of 
interest, an exact solution is not possible. In these cases it is sometimes useful to obtain the 
solution as a perturbation series a x,(t)a*, where the functions x(t) are determined 
by the differential equation. For each fixed value of the independent variable t, such a series 
is generally an asymptotic power series in powers of a. Such solutions are the subject of 
Section 14.3. 

To clarify how a perturbation series provides a solution to an equation containing a 
parameter, we first consider the simpler case of algebraic equations. 


EXAMPLE 14.7 An algebraic equation The algebraic equation 
ax? —x+1=0 (14.21) 


can be solved exactly for x, since it is a cubic. We will use (14.21) to illustrate a perturbation 
solution, using the exact solution to determine the accuracy of the approximate solution. 
Table 14.2 lists numeric values of x for two values of a. For a “small,” there are three real 
solutions, one of which is close to x = 1. For a “not small,” there is one real and a pair of 
complex conjugate roots. The real root is not near x = 1. Hence, the solutions appear to 
have a significant dependence on a. 


If A = (12/34 2/4-* — 108)a?, then 


AV3 2 AV3 1, iv3 AV3 9 
6a AB 12a Al/3 2 \ 6a Al 


(14.22) 


FIGURE 14.2 Example 14.7: fı (solid), 
fə (dotted), f3 (dashed) 


-- -— i +> a 
0.05 0.1 0.15 0.2 


FIGURE 14.3 Example 14.7: f; asa 
function of a 


- — + — >a 
0 0.05 0.1 0.15 


FIGURE 14.4 Example 14.7: f; (solid) 
and fi (dotted) 
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a x 
0.1 —3.577089445, 1.153467305, 2.423622140 
0.2 —2.627365085, 1.313682542 + 0.4210528070i 


TABLE 14.2 Roots of ax? — x + 1 = 0 for two values of a 


are the exact solutions of (14.21). In their present form, the expressions in (14.22) are 
difficult to interpret and/or use. We do see, however, that each solution depends on the 
parameter a. Since the quantity A containing 4/27a — 4 appears repeatedly in the three 
solutions, we are surprised to realize that for a “small,” this radical is a complex number! 
However, there are other complex numbers in the expressions for the roots and, together, 
these roots can be real if a < + = 0.148. Consequently, for0 < a < + the three solutions 


27 27 
are real and simplify to 
: AP 
= sin À 
fi T À 
1 fsinA 1 /A—27 
j= (= + cos i) where A = - arctan | ~~“ + (14.23) 
va \ v3 3 3/3a 6 


f l ( sin À i) 
B= cos 
va \ V3 

The dependence of the roots on a can also be seen in Figure 14.2, where the roots f|, 
Jo, and f3 are represented by the solid, dotted, and dashed curves, respectively. Equation 
(14.21) is more easily solved for a — a(x) — xu , from which the curves x = x(a) can be 
obtained by reflecting the graph of a(x) across the line a = x. Figure 14.3, obtained in this 
way, clearly shows the behavior of the root represented by f3, the root “near 1,” which is 
continuously connected to x = 1, the solution of (14.21) when a = 0. Consequently, we 
seek a series expansion in powers of a for this root. $ 


Perturbation Series 
A series expansion for the root near a = 1 gives f3 = F; + O(a9), where 
F;—1-ra-4-3a? + 12a? + 55a* + 273? (14.24) 


Figure 14.4 shows the exact solution as a solid curve and the series approximation as a 
dotted curve, illustrating the validity of the series for small a. 

The growth in the coefficients suggests the series is an asymptotic series that does not 
converge. The following construction obtains this same expansion as the perturbation series 
Y o x,a^. Substitute the truncated sum 7; , xza* into the cubic equation, collect like 


, 5 A 
powers of a, and obtain X`}; A,a* = 0, where 


A =1- X1 
Ad = 3x1 —X*2 
A3 = 3x14-3x5—x3 (14.25) 


A4 = —Xx4--Ax 1xa-3x34-x1 (47 +222) 
As = —Xs--x$ 3x44 Ax xax 1 Qa 2x 1x2) + x; (x1--2x2) 
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Then, set the coefficient of each power of a to zero, obtaining x, = 1, x? = 3, x3 = 12, 
X4 = 55, and x5 = 273, giving, to degree five, the perturbation solution x = 73. Alterna- 
tively, invoke the following theorem. 


THEOREM 14.2 LAGRANGE EXPANSION THEOREM 


1l. x= yc ag(x) (14.26) 


oo d k—1 l 
= r=xay +) |(&) se (14.27) 
k=1 3 x=y 


Equation (14.21) is a special case of (14.26) where y = 1 and g(x) = x?. Theorem 14.2 
then gives, by (14.27), x =1+ 954 eg LES el The differentiations are performed 
first, and then evaluated at x = 1, giving the first five coefficients as 1, 3, 12, 55, and 273, 
in agreement with our previous calculations. 

The interested reader is referred to [8] for a complete statement of the Lagrange Ex- 
pansion Theorem, and its generalization to the case where a perturbation series for f(x), 


not just x, is to be computed. 


EXERCISES 14.3—Part A 


Al. Evaluate (14.22) for a = 0.13 and a = 0.16. A4. Verify that the solution of (14.25) reproduces (14.24). 
A2. Evaluate (14.23) for a = 0.13 and a = 0.16. A5. Use (14.27) to obtain (14.24). 


A3. Perform the calculations leading to (14.25). 


EXERCISES 14.3—Part B 


B1. Equation (14.21) prompts us to define the function f (a, x) = surface and the plane intersect in the curve x — x(a) defined 

ax? —x +1. implicitly by f(a, x) = 0. 

(a) Using appropriate technology, obtain a plot of the surface (c) Using appropriate technology, obtain a plot of the function 
determined by z = f(x, a). In this plot, include a x(a) determined implicitly by the equation f (a, x) = 0. 
representation of the plane z — 0. The surface and the plane (d) In the neighborhood of each point (a, x) = (0, ox), the 
intersect in the curve x — x(a) defined implicitly by equation f (a, x) = 0 implicitly defines x, = x; (a), functions 
f (a, x) 2 0. that have formal Maclaurin expansions in a. Obtain the 

(b) In the neighborhood of the point (a, x) — (0, 1), the equation coefficients of these series by subjecting f(a, x) = 0 to 
f(a, x) = 0 implicitly defines x = x(a), a function that has a implicit differentiation, thereby computing x; = 
formal Maclaurin expansion in a. Obtain the coefficients of 0 + Yo a X” (0)a" /n!. 
this series by subjecting f(a, x) = 0 to implicit (e) Obtain the expansions found in part (d) by assuming series of 
differentiation, thereby computing x = 1 + the form >>,  c,a", substituting into the equation 
3a x9 (0)a* / kt. f (a, x) = 0, and matching coefficients of like powers of a in 


In Exercises B2-7, a function f (a, x) is given. order to determine the coefficients c,,. 
B2. f(a, x) 2x? 1) ca B3. f(a,x) 2 x? 3x - 2a 
B4. f(a, x) 2 x? — 3x +a 


Bs. f(a, x) 2 x) 45x? -2x -24 +a 


(a) Determine oz, k = 1,...,3, then solutions of f(x, 0) = 0. 


(b) Obtain a plot of the surface determined by z = f(a, x). In 
this plot, include a representation of the plane z — 0. The 


B6. f(a, x) =x? +x? -2x +a 
B7. f(a, x) = xt + 5x3 —22x? — 56x +a 


In Exercises B8-12, an equation of the form (14.26) is given. For each: B12. x 25-ax?e- 


(a) Use the Lagrange expansion formula to obtain series 
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B8. x = 1 + ae* B9. x = 2 + a cosh (5) 


B10. x = 1+ ax sinx B11. x = 3 + ae“ cosx 


x 


B13. Use implicit differentiation to obtain the formula for the Lagrange 
expansion of x(a), the solution of the equation x = y + ag(x). 


representations of the solutions, x = x (a). Hint: x(a) = Y, x (0)a*/ k!, and the derivatives x (0) are 
(b) Graph the approximate solution found in part (a) along with computed by implicit differentiation. 
x — x(a) defined implicitly by the given equation. 


EXAMPLE 14.8 


>t 


FIGURE 14.5 Example 14.8: Exact 
solution (solid) and series approximation 
dotted) 


Poincaré Perturbation Solution for Differential Equations 


Parameter-dependent damped oscillator For 0 <a < 1, the damped linear oscillator 
whose governing differential equation is 


x" (t) + 2ax'(t) + x(t) =0 (14.28) 


is underdamped. Consequently, for a mass displaced one unit and released (therefore satis- 
fying the initial conditions x(0) = 1, x'(0) = 0), the solution is given by 


i 1 — a?t 
zii = (cem + cos (V1 — 2) et (14.29) 
= 


and the exponentially decaying oscillation exhibited by the solution is apparent. These 
motions were the concern of Chapters 5 and 6. 

Presently, we seek to approximate the solution with a perturbation series of the form 
x(t) = Yo x (t)a*, which for each fixed t is an asymptotic power series in powers of a. 
Obtained from a Maclaurin series expansion of (14.29) in powers of a, the first few terms 
of such an expansion are 


cost + (sint — t cost)a — }(tsint — t? cost)a? + i3 sint — t cost(3 + (2))a? 
(14.30) 


In the coefficient of a, we find the term ¢ cost, a bounded trig term multiplied by a 
power of t. Such terms are called secular terms, and they eventually become large, no 
matter how small a is taken. This behavior is shown in Figure 14.5, where the solid curve 
represents the exact solution and the dotted curve the approximate solution. Initially, and 
up to about t = 9, the two solutions are close, but thereafter, the approximation quickly 
becomes severely impaired. The secular terms dominate for large t and make the series an 
unbounded approximation to a solution that actually goes to zero. $ 


Our goal, clearly, is to obtain useful approximations to solutions that could not otherwise 
be expressed in closed form. Thus, we first study a technique for generating perturbation 
solutions and then examine a technique for eliminating the secular terms. 


The Regular Perturbation 


The regular perturbation is developed by assuming a solution of the form 5 7^, xy (r)a*, 
substituting it into (14.28), and letting the differential equation itself determine the functions 
x,(t) by equating to zero each coefficient of the powers of a. Substituting the truncated sum 


xolt) + x1 (Na + xo(0a? + x3 (ta? (14.31) 
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EXAMPLE 14.9 
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FIGURE 14.6 Example 14.9: Solutions 
fora = +, 2,0.15 


FIGURE 14.7 Example 14.9: Taylor 


series approximation for a — x 


into (14.28), we obtain Y; $ (t)a* = 0, where 
do = xg (t) + xo(t) $1 = xj (t) + x(t) + 2xo(0) 
p2 = x5 (t) + x2(t) + 2x; (t) $3 = x3 (t) +X) + 2x'(t) 


The functions x(t) are determined by the requirement that each œx = 0, the initial 
conditions xo(0) = 1, x5(0) = 0, and the initial conditions x, (0) = x,(0) = 0, k > 1. 

The zeroth-order equation contains just xo(r). The solution satisfying the initial condi- 
tions corresponding to “displace one unit and release" is therefore given by x(t) = cost. 
Each of the other differential equations contains solutions of previous equations. Hence, the 
equations must be solved in sequence, with information propagated forward into successive 
equations. The solutions to the remaining equations, using the inert initial conditions of no 
displacement or velocity, are then 


(14.32) 


xı(t) = sint — t cost 
x2(t) = —}(t sint — t’ cost) (14.33) 
x3(t) = TE sint — t(3 + t?) cost) 


Hence, to third order in a, the perturbation solution is precisely the same as (14.30), the 
Maclaurin expansion of the exact solution (14.29). 


We give one further example of creating a regular perturbation solution for a differential 
equation, this time, one for which an exact solution is not known. We will illustrate how 
one might use a numeric solution to check the validity of the series solution. 

Numeric solutions of the first-order IVP 


xX) +x) = 1+axt) x0) =0 (14.34) 


for three different values of a (G5. A 0.15) are shown in Figure 14.6. The differential equa- 
tion has equilibrium solutions near x(t) = 1 fora < + because the equilibrium solutions 


E 
are solutions of the equation x = 1 + ax?, the derm equation studied in Section 14.3. 
Since a = 0.15 > E — 0.148, the corresponding curve does not at all resemble the curve 
x(t) =1. i 

Lest the reader dismiss the utility of a regular perturbation solution, we instead obtain 
the Taylor series solution, 


1, 14 a 1\ 4 1 7 5 
T NN NE E- | EN LRL TR m 14.35 
d a i (5 x) * (s 20 a) = lia 


that is, a solution of the form x(t) = axo clat". Figure 14.7, which shows a graph of 
the solution for a = +, indicates just how poor such an approximation actually is. 

It is our intent to show that the regular perturbation solution is very much better at ap- 
proximating solutions when a < £. To obtain this regular perturbation solution, substitute 
(14.31) into (14.34) and group terms of like powers of a, obtaining LT o,(t)a* = 0, 


where 


xj) + x1 (1) — xolt)? 
x4(t) + xs(1) — 3xo(t?xo (t) — 3xo()xi (0? 
(14.36) 


Demanding that the coefficients of each power of a must vanish determines the x;(t) as 
solutions of the differential equations o; = 0 subject to the initial conditions x,(0) = 0. 


09 = xQ(t) + x(t) — 1 ogl 
05 = x4 (t) + x2(t) — 3x0 (t) x1 (1) 03 


>t 
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Thus, we compute 
xo(f) 21—e^* 
xi(t) = $(2+ G — 60e — 6e + e) 
xt) = 3 + ($—3r—-20)e* — 8 18067 — (2 — 21) e + 4e" — Be 
x3(t) = 12 + 31 (4% — BrP — 200) e + (8 54t — 54e? 


(= J 5. = 81 72) e^* — (23 — 48t)e-^ 


+ [5 si) e 5 24 o6 n" Se 
Figure 14.8 shows a graph of the approximate solution (dotted), along with the numeric 
solution (solid) for a = 0.15. Even for a = 0.15 > E — 0.148, the perturbation solution 


remains near the equilibrium solution x — 1, whereas the numeric solution departs from 


a = 0.15, numeric solution (solid) and 
perturbation solution (dotted) 


EXERCISES 14.4-Part A 


x = l.Incomparison, recall that the Taylor series solution, even fora = 
the equilibrium solution x = 1 except very close to t = 0. 


ll 
27 


A1. Use the Laplace transform (or other pertinent method) to obtain 
(14.29). 


A2. Verify the expansion in (14.30). 
A3. Verify that substituting (14.31) into (14.28) results in (14.32). 


EXERCISES 14.4—Part B 


A4. Obtain the solutions listed in (14.33). 


AS. Substitute x(t) = p= c, (a)t* into the DE in (14.34) and obtain 
(14.35). 


A6. Substitute (14.31) into (14.34) to obtain (14.36). 


B1. Given the initial value problem y" + y' + ay = 0, y(0) = 1, 
y'(0) = 0: 


(a) Obtain the exact solution for 0 < a < 7. 


(b) For the exact solution found in part (a), obtain a Maclaurin 
expansion about a = 0. 


(c) Obtain a regular perturbation solution of the form y(t) = 
Yo Ye(ta*, showing that the perturbation series agrees 
with the expansion found in part (b). 

(d) On the same set of axes, and for a = 0.1, graph the exact 
solution, yo + ayı, and yo + ay; +a7yp. 

(e) Repeat part (d) for a = 0.2. 

B2. Given the initial value problem y" + 2y' + 2y = a cost, 

y(0021,y'(0) 21: 

(a) Obtain the exact solution. 

(b) For the exact solution found in part (a), obtain a Maclaurin 
expansion about a = 0. 

(c) Obtain a regular perturbation solution of the form y(t) = 
Yo ye (t)a*, showing that the perturbation series agrees 
with the expansion found in part (b). 


(d) On the same set of axes, and for a = 0.25, graph the exact 
solution and yo. 


(e) Repeat part (d) for a = 1. 
B3. Given the initial value problem y" + y' + ay? = 0, y(0) = 1, 
y'(0) 2 0: 
(a) Obtain, and graph, a numeric solution for a — 0.3. 
(b) Obtain a regular perturbation solution of the form y(t) = 
Yo Xi (ta. 
(c) On the same set of axes, graph the numeric solution, 
yo 4- ayi, and yo + ay; 4- a?ys. 
B4. Given the initial value problem y" + y + ay? = 0, y(0) = 1, 
y'(0) = 0: 
(a) Obtain, and graph, a numeric solution for a — 0.5. 
(b) Obtain a regular perturbation solution of the form y(t) — 
ko Xx (0)a*. 
(c) On the same set of axes, graph the numeric solution, 
yo + ayı, and yo + ay, + à? ys. 
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B5. 


B6. 


B7. 


Chapter 14 Series Solutions 


0, 


Given the initial value problem y" + y’ + y + ay? 

»(0) = 1, y'(0) =0: 

(a) Obtain, and graph, a numeric solution for a = 0.1. 

(b) Obtain a regular perturbation solution of the form y(t) = 
Nx Yk (t)a*. 

(c) On the same set of axes, graph the numeric solution and 
yo + ayı. 

Given the boundary value problem y" + ay = 0, y(0) = 0, 

y(r) = 1: 

(a) Obtain the exact solution for a small. Hint: Solution is a 
multiple of sin(A/at). 


(b) For the exact solution found in part (a), obtain a Maclaurin 
expansion about a = 0. 


(c) Obtain a regular perturbation solution of the form y(t) = 
iso Ye (t)a*, showing that the perturbation series agrees 
with the expansion found in part (b). 

(d) On the same set of axes, and for a = 0.25, graph the exact 
solution, yo + ayı, and yo + ay; + a? y2. 

(e) Repeat part (d) for a — 0.5. 

Given the boundary value problem y" + ay’ + 2y = 0, y(0) = 0, 

y) 2t: 

(a) Obtain the exact solution for a small. Hint: Solution is a 
multiple of e^*' sin(/1 — a?t). 

(b) For the exact solution found in part (a), obtain a Maclaurin 
expansion about a = 0. 

(c) Obtain a regular perturbation solution of the form y(t) = 
Yo ye(t)a*, showing that the perturbation series agrees 
with the expansion found in part (b). 


B8. 


B9. 


B10. 


(d) On the same set of axes, and for a = 0.2, graph the exact 
solution, yo + ayı, and yo + ay; + a°y2. 

(e) Repeat part (d) for a = 0.9. 

Given the initial value problem y’ + y = ay’, y(0) = I: 

(a) Obtain the exact solution for small a. (Hint: It's a Bernoulli 
equation, Section 3.6.) 


(b) For the exact solution found in part (a), obtain a Maclaurin 
expansion about a — 0. 


(c) Obtain a regular perturbation solution of the form y(t) — 
YE o y (0a*, showing that the perturbation series agrees 
with the expansion found in part (b). 


(d) On the same set of axes, and for a — 0.5, graph the exact 
solution, yo + ayı, and yo + ay; + aà2y». 

(e) Repeat part (d) for a — 0.75. 

Given the initial value problem y” + a(y’)? + y 4- ay — 0, 

y(0) = 1, y'(0) = 0: 

(a) Obtain, and graph, a numeric solution for a — 0.5. 

(b) Obtain a regular perturbation solution of the form y(t) = 
Deoa". 

(c) On the same set of axes, graph the numeric solution, 
yo + ayı, and yo + ayı + a? yz. 

Given the initial value problem y” + a(2(y)? — y) + y = 0, 

y(0) = 1, y'(0) = 0: 

(a) Obtain, and graph, a numeric solution for a — 0.5. 

(b) Obtain a regular perturbation solution of the form y(t) = 
Drao Yi(t)a*. 

(c) On the same set of axes, graph the numeric solution, 
yo + ayy, and yo + ay; + a?ys. 


E E The Nonlinear Spring and Lindstedt's Method 


A Nonlinear Oscillator 


The differential equation 


x" (t) - x(t) + ax(t)? 20 (14.37) 


governs an undamped oscillator whose spring obeys a nonlinear restoration law, F = 
—(x + ax?). For a > 0, the spring is called “hard,” while for a < 0, it is called "soft." The 
magnitude of the restorative force for the hard spring is greater than that of the linear spring 
(whose restorative force is just —kx). Likewise, the magnitude of the restorative force for 
the soft spring is less than that of the linear spring for small enough displacements. 

When a — 0 the system is just a simple harmonic oscillator that clearly supports peri- 
odic solutions. We wish to show that for a 4 0 the system also exhibits periodic solutions. 
We can show this by obtaining a first integral (a function constant on the trajectories in the 
phase plane) and showing that its level curves, the trajectories, are closed curves. To this 


|> u 
0.7 


(b) 


FIGURE 14.9 Level curves of the first 
integral E(x, x’) 


FIGURE 14.10 Frequency of the 
nonlinear oscillator depends on amplitude 
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end, multiply (14.37) by x’(t) and integrate with respect to t, obtaining 
jew +x+ax*)dt = foa =E 


The term on the right is the constant E, and each term on the left is an exact differential. 
Hence, we obtain 
loy: E T + = = Ex, X^) 
2 2 4 
For each value of a, the level curves of E = E(x, x’) define solutions of (14.37). 
Indeed, differentiating E with respect to t yields x/(x" + x + ax?) = 0, which is (14.37) 
multiplied by x’. Hence, a solution of (14.37) is a level curve of E(x, x’), and a level curve 
of E = E(x, x’), defines a solution of (14.37). 
It is easier to plot the level curves of E(x, x’) if we change variables according to 
u = x(t), v = x'(t), so that u’ = x’ = v and v' = x" = —u — au’, which then gives 
E(u, v) = 5v? + ju? + £u^. The contour plot in Figure 14.9(a) used a = 1, while the 
contour plot in Figure 14.9(b) used a = 5. We rely on this figure to support the claim that the 
trajectories for this differential equation are closed curves. Hence, for a # 0 the undamped 
oscillator with the nonlinear spring supports periodic solutions. 


Dependence of Frequency on Initial Displacement 


In the nonlinear case, the (angular) frequency depends on the initial displacement. If we 
let that initial displacement be first 1, then 2 (along with an initial velocity x'(0) = 0), we 
obtain Figure 14.10, which shows two solutions corresponding to a — 1. The graph clearly 
indicates different periods, and hence frequencies, for the two solutions, which start with 
different initial displacements. 

This is in distinction to the behavior of the linear oscillator, where for a — 0 the angular 
frequency is @ = VE = 1, a constant depending on just the spring constant k and the mass 
m. Indeed, for a = 0 we have x(t) = cı cost + c2 sint and the angular frequency is w = 1. 

In the nonlinear case, the dependence of the angular frequency on the initial displace- 
ment can be computed from the first integral E(u, v). First, evaluate the constant E from 


the initial conditions (u, v) = (x, x’) = (A, 0), obtaining Ep = 1A? + 1 Ata, Next, solve 
dx 
dt? 


v(u) = +5/2Ata — 4u? — 2u4a + 44? 


the equation E(u, v) = Eo for v = obtaining the two solutions 


If we set v(u) = 4&* = “ and separate variables, we get 


dt dt 
U final 
du 
t= —— du 
‘A v(u) 


On a closed trajectory in the phase plane, motion is clockwise. At (u, v) — (A, 0), the 
differential equations u’ = x’ = v and v’ = x” = —u — ai? give v/ = —A — aA? < 0, so 
motion at this point is downward and, hence, clockwise around the trajectory. Thus, we pick 
the negative square root for v(u) and integrate to uasa; = 0, one-quarter of the way around 
the trajectory. Thus, the total time for one orbit is 


(14.38) 


o 8 
T= / du 
A A2A*a — 4u? — 2u*a + 4A? 


. . . 2 . H 
To third order, a series expansion of œ = + in powers of a is then 


o = 1 + A?’a — 3LA'a? + Aah (14.39) 
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Thus, for the nonlinear oscillator, the angular frequency depends on the initial dis- 
placement, and we have obtained a series expansion of this dependence. Shortly, we will 
compute this same expression by Lindstedt's perturbation technique. 


Regular Perturbation 


As we saw in Section 14.4, a regular perturbation will lead to an expansion containing 
secular terms that are not periodic. Hence, the regular perturbation series of Poincaré cannot 
approximate the periodic solutions of the nonlinear oscillator. We therefore fail to learn 
about the dependence of the frequency on the initial displacement. However, for the sake of 
completeness, we will develop the regular perturbation. The purpose is to justify the claim 
that it contains secular terms that prevent it from approximating the periodic solutions of 
the nonlinear oscillator. 

Assume a regular perturbation series of the form xo(t) + x1(f)a + x»(t)a? and substi- 
tute this into (14.37), obtaining S ed A,a* = 0, where 


Ao — x9 (t) -- xo(f) | Ai 9 x1) doi) +.x0(t) — Aa = x1 (t) + x0(t) + 3xo(t)?xi (1) 


The identical vanishing of the A, gives differential equations for the xg. The first equation 
depends only on xo(t) and so can be solved immediately. For simplicity, we choose the 
initial point as (1, 0), thereby obtaining xo(t) = cos t. Each successive differential equation 
contains terms depending on the solutions of previous equations. We solve this sequence 
of equations, taking the initial point as (0, 0) for each successive approximation, obtaining 


xi(f) = —45 cost — it sint + 4 cos3t 
xY(f) = qr (121 (8 sint — 3 sin 3t — 6t cost) + 23 cost — 24cos3t + cos 5t) 


The solutions for both x; (t) and x» (t) contain secular terms, as predicted. The regular 
perturbation series is not useful for studying the dependence of the frequency on the ini- 
tial displacement. We therefore consider Lindstedt's method for generating a more useful 
asymptotic expansion. 


Lindstedt's Method 


In the Lindstedt method, the angular frequency is made to depend on a by assuming w = 
o(a) — 1-- Y, oxa* and then carrying out a perturbation solution of (14.37) by writing 
x(t) = Y oxi(t)a*. Since the angular frequency o is related to the period T by oT = 27, 
the two expansions in the Lindstedt method are merged by the change of variables t = ct. 
In terms of z, the solution assumes the form 


x() =x(=)= U(t) = Yin! (14.40) 


and the differential equation (14.37) becomes 
w U" (x) + U(x) +aU (tY =0 (14.41) 
where now, primes denote differentiation with respect to t. (The change of variables rests 


on the chain rule, which gives £: = 2 = Wo, A second application of the chain rule 


then gives the œ multiplying U"(r).) 

Write U (T) = uo(t) + 1 (t)a + uo(x)a? + us(1)a? and substitute the expansions for 
both U (t) and ex) into Ln differential equation, collect coefficients of like powers of a, 
and thus obtain Ta —0 ca* = 0, where oz, k = 0,...,3, are given in Table 14.3. 
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Oo = ug(T) + uo(1) 
2, =u (t) + uilt) + 20,ud (x) + uo(t)> 
o = u5(1) + u5(1) + 2m ul (t) + 3ug(t)?u4 (tT) + (c + 205)ug(1) 


| H ? a h 1 
03 = U^ + us + (2a + e )u] + 3ugu» + 3ugu] + 2u5 + 2(w3 + ww )ug 


TABLE 14.3 Lindstedt’s method applied to (14.37) 


The identical vanishing of the o; give differential equations for the ug. The first equation 
contains only w(t), so this equation, and the initial conditions u9(0) = A, ug (0) = 0, lead to 
the solution u9(t) = A cos t. The equation for u, (Tt) contains terms in uo(r). Incorporating 
this solution and the initial conditions u; (0) = u$(0) = 0, we obtain 


u(r) = (aA — $4) T sint + 44° cos 3t — 3; A^ cos t (14.42) 


As with the regular perturbation, we have secular terms appearing. However, the coefficient 
€ is as yet undetermined, so we choose a value for it that will guarantee the vanishing of 
the secular term œw; A — £A), thus determining o, = 2A? and consequently 


u(t) = 35; A? cos3r — $A? cost (14.43) 


The equation for w(t) contains terms involving uo(T), u;(1), and c. Thus, making 
the appropriate substitutions, we solve for the function u» (1) satisfying the initial conditions 
u2(0) = u5(0) = 0, obtaining 


u(t) = (X A5 +A) v sin c + 35; A? cos St — 3g A? cos3t + 73, A^ cost (14.44) 


We then determine a» by the requirement that there be no secular terms in u2(t). Hence, 


the equation 2 AP + aA = 0 yields œ = -2At and thus 
u;(1) = qq; A^ cos 5t — 75, A^ cos 3t + 5; A> cos (14.45) 


The equation for u3(r) contains terms in uo(T), uı(T), uz (1), œi, and c». Making 
the appropriate substitutions and solving for the w3(t) that satisfies the initial conditions 
u3(0) = u3(0) = 0, we obtain 


me pee A i ud A cu eei AT 
u3 =| 59454 c 3A) t sin t + 3255 4 C08 7t — zug À' cosSt (14.46) 
297 47 20541 47 
+a cos 3t — zg cost 


To choose the œ; that eliminates the secular term from u3(t), solve — 4A’? + œA = 0 


i 46 d 2048 
for w3 = 55g A^, thereby obtaining 


g 
u3(T) = zg A! cos 7c — ug A cos St + 723, A’ cos 3t — 34, A’ cost 


and, the first few terms of the expansion o are those in (14.39). 

The Lindstedt solution is then given by U(t) = 5. sui(x)a^, where U(t) = 
U (ot) = x(t) and o is as above. To judge the viability of the Lindstedt expansion, write 
the approximation as a function of f, obtaining 


x) Y ucona* 
k=0 


where c is given by (14.39). Since our test of the utility of the expansion will be a graph, 
assign the values A = 2 anda = E to the initial displacement and spring parameter, 


362 Chapter 14 Senes Solutions 


respectively. Thus, the approximate solution is 


— 506,893 36.461 2537 109,383 1 36.461 L ana 255,227 
x(t) = 356000 COS 32.090! + 128,000 COS 32,000 / + 8000 COS 6400 T 256,000 COS 32,000 


t 


Figure 14.11 shows the Lindstedt solution (dotted) and a numeric solution (solid) for 
100 < t < 110. In the neighborhood of t = 105, the two solutions are still in agreement. 
Figure 14.12 shows these two solutions for 150 < t < 160. In the neighborhood of t = 155, 
the two solutions start separating. However, with a — b and t = 100, the Lindstedt expan- 
sion gives remarkable accuracy. 


X x 
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mit 


0 H i oe ee 0 1 


100%, 102 £104 106%, 108; 110 150%, 1527 154 i. 158 160 
-2 -2+ i 
FIGURE 14.11 Lindstedt solution FIGURE 14.12 Lindstedt solution 
(dotted) and numeric solution (solid) (dotted) and numeric solution (solid) 
EXERCISES 14.5 
1. On the same set of axes, plot |x + x?| and |x|, the magnitudes of 9. Using uo(1) = A cos T, œ = 3A”, œ = — 34 At, and (14.45), 
the restorative forces for the hard spring and linear spring, solve the IVP defined by o; = 0 (from Table 14.3) and 
respectively. Is the magnitude of the restorative force for the hard u3(0) = u4(0) = 0 and obtain (14.46). 


spring greater than that of the linear spring? ‘ : - : ; "m y 
prng prng In Exercises 10-24, the given differential equation and the initial condi- 


2. On the same set of axes, plot |x — x?| and |x|, the magnitudes of tions y(0) = A, y’(0) = 0, form an IVP. For each: 
the restorative forces for the soft spring and linear spring, 
respectively. Is the magnitude of the restorative force for the soft 
spring less than that of the linear spring? 


(a) Show that the regular Poincaré perturbation scheme leads to 
secular terms. 


(b) Obtain a perturbation solution using the Lindstedt method, 


3. Carry out the change of variables t = wt by which (14.37) : : z : ; 
being sure to provide the frequency-amplitude relationship. 


becomes (14.41). 


4. Set A = | anda = } in (14.38) and evaluate numerically to 
determine w = z, Compare with the value given by (14.39). (d) Obtain and plot numeric solutions for a = 0.1 and A = 1, 2, 3. 
5. Obtain (14.39) from (14.38) as follows. Do the graphs show a dependence of the frequency on the 
initial conditions? 


(c) Write the solution found in part (b) as a function of t. 


(a) Expand the integrand of (14.38) in a Maclaurin series in powers 


of a and integrate termwise. (e) Along with the corresponding perturbation solution from part 


(c), plot, for A = 2, the numeric solution obtained in part (d). 


(b) Write w = E and obtain a Maclaurin expansion, again in 
powers of a. 10. '-y-2ay 11. y” +y =a(y? + iy’) 
6. Solve the IVP defined by o; = 0 (from Table 14.3) and 12. y” -y-a(y? 20 13. (1E ay)y" cy =0 
uo(0) = A, u$(0) = 0, obtaining uo(T) = A cos T. 14. y" + y - a(? + 1») =0 15. y”"+y+ay>=0 
7. Using uo(t) = A cos q, solve the IVP defined by e; = 0 (from 16. y" +y +a -2y)20 17.(1+y*)y”+y=0 
Table 14.3) and uy (0) = u^ (0) — 0 and obtain (14.42). 18. y" $ y— a((y? + y?) =0 19. y” En y- ayy’ 


8. Using uo(t) = A cost, w = 3A’, and (14.43), solve the IVP 
defined by oz = 0 (from Table 14.3) and u5(0) = u5(0) = 0 and 
obtain (14.44). 


"IGURE 14.13 Phase portrait for the 
an der Pol equation 


FIGURE 14.14 Solutions of the van der 
Pol equation corresponding to trajectories 
m Figure 14.13 
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The Method of Krylov and Bogoliubov 


Limit Cycles 


Some nonlinear second-order differential equations have special periodic solutions whose 
trajectories in the phase plane are closed curves called limit cycles. A limit cycle is a closed 
trajectory for which no nearby trajectory is also closed. Hence, the nearby trajectories must 
spiral in toward, or away from, the limit cycle. 

A limit cycle C is called stable if every trajectory starting sufficiently close to C 
approaches C as t — oo. If every trajectory starting sufficiently close to C approaches C 
as t — —oo, it is called unstable. If trajectories approach C on one side but depart from it 
on the other, then C is called semistable. 


van der Pol's Equation 


van der Pol's equation 
x" (t) -- x(t) = a(1 — x(t)))x'(t) (14.47) 


arising in the study of triode vacuum-tube oscillatory circuits, has a limit cycle throughout 
a range of values for the small parameter a. Setting a — i and writing the system u'(f) = 
v,v(t) = iu — u?)v — u, we obtain the phase portrait in Figure 14.13. The limit cycle, 
representing a periodic solution of the differential equation, is the thick curve whose initial 
point is (2, 0). The trajectory starting at (1, 0) spirals out toward the limit cycle, whereas 
the trajectory starting at (3, 0) spirals in toward the limit cycle. These nearby trajectories 
that spiral toward the limit cycle represent oscillations approaching the periodic solution. 
The time-domain view of these three solutions is provided by Figure 14.14. 

The limit cycle supported by the van der Pol equation illustrates a second significant 
difference between the behaviors of the linear and nonlinear equations. In Section 14.5 we 
saw that the nonlinear system could have solutions whose frequency depended on the initial 
displacement. In other words, for a nonlinear spring, the larger the initial displacement, the 
faster the oscillation. For the linear spring, the frequency is determined by the mass, spring 
constant, and damping coefficients and not by the initial displacement. 

In addition, we have just now seen that regardless of the initial displacement, the 
nonlinear system can have a system-determined amplitude of oscillation. Whether the initial 
displacement is 1 or 3, the solution of the van der Pol equation tends toward the periodic 
solution whose amplitude is determined by the solution that starts with initial displacement 
2. This is in contradiction to the behavior of the damped linear oscillator for which all 
oscillations will gradually decay to zero. 


Lindstedt's Solution to van der Pol's Equation 


Lindstedt's method, studied in Section 14.5, finds periodic solutions of nonlinear equations. 
Applied to van der Pol's equation, it approximates the solution corresponding to the limit 
cycle of the equation. Using Lindstedt's method (with details to follow), we obtain the 
approximation 


x = 2cos ot + ui(ot)a + u»(ot)a? + ua(ot)a* Tee 
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N 


FIGURE 14.15 — Lindstedt's 
approximation to the limit cycle for 
van der Pol's equation 


where w = 1 — $ taa 44... and 
ui (ot) = 1 sin ct — sin 3a) 
ur(@t) = — 3 (13 cos ot — 18 cos 3wt + 5 cos ot) 
us(wt) = 783, cos wt — 25, cos 3ot + eg cos Swot — 4352 cos Tot + 3 AH 35g COS 9ot 


The leading term in the Lindstedt expansion is 2 cos wt, indicating that the method 
isolates the periodic solution of the van der Pol equation. At the moment, the point is not 
the computation of the expansion, but the need for a more robust method of approximating 
solutions of nonlinear equations. We find that method in the work of Krylov and Bogoliubov 
[62]. 

With a — 1 the Lindstedt approximation (computed to terms in a^) is 


2 5,873,363 261,103 . 261.108, _ 1 qi. 783,309 1521 783,309 
X = 5949-120 COS 262.144! T s SIN 555144! — 16 SIM 2621441 + 131,072 COS 262.144 (14.48) 
14,755 1,305,515 455 1,827,721 2,349,927 . 
4,718,592 COS 262.144 | — 9,437,184 COS 262,144 | + 3, T 880 COS 362,144 | 


The phase-plane trajectory determined by this approximation is shown in Figure 14.15. 
The Lindstedt expansion approximates the limit cycle, the closed trajectory representing 
the periodic solution of the 

van der Pol equation. 


DETAILS OF THE LINDSTEDT APPROXIMATION TO THE VAN DER Por Equation Appli- 
cation of the Lindstedt method to the van der Pol equation presents a few challenges not 
met in our work in Section 14.5. However, we do begin with the same form for the angular 
frequency, namely, 


oo 
o=14+ Y ak (14.49) 


and make the change of variables t = wt to obtain 
oU" (x) + U(t) = a(l - U(1)))eU'() (14.50) 
Fourth-order truncations of (14.49) and (14.40), substituted into (14.50), lead to the equation 
f_o Axa* = 0, where 
Ao = ug(T) + uo(t) 
Ay =u (T) t i (0) + 2a, u(t) + (uo()? — 1)ug(t) 
A3 = us + u3(t) + 20102u + 2o0»u1 + 203 + 201u5 + 0X ui "a (u? — Du 
+ (ug — 1)eo1 + 2ugu1)u + (us, — 1)o» + 2ugu40 + 2ugu» + uiu) 
Ag =u} + ua + 2oy + 20105 + 2003u5 + qu^ + 20w] + 20w 
Tr oXug + 203u/| + (us —1)u,4+ (up — Do + 2uguj)u5 
+ ((u$ — 1)» + 2ugu16 + 2uouz + uu, 
+ (ug — 1)a@3 + 2upuy@2 + uou» + u7)e + 2uou3 + 2uiu»(1))ug 


The identical vanishing of each A; gives differential equations determining the u id^ 
As in Section 14.5, we solve the first equation subject to the initial conditions u9(0) = 
ug(0) = 0, obtaining uo(r) = Acost. The solution wo(t) is needed in the "rode 
equation for u, (T). Making the appropriate substitution and imposing the initial conditions 
u31(0) = u4 (0) = 0, we obtain 


u(t) = ((5A — $4?) cost + oi Asinz)  — à A^ sin3r + (54? — 3A)sinv 
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As expected, the solution for u;(t) contains secular terms that are eliminated by setting 
€, = 0 and A = 2, giving 


35 e . 
uj(r) = 3 sint — isin3c 


Even with u(t) = uo(t) = A, Lindstedt's method forces us to set A = 2 
All this information is needed in the differential equation determining u2(t), whose 
solution is then 


3 cos 5t + + cos3r — B cost 


sl A i 
u5(1) = (5 + 20) tsint — a 06 


Again, there are secular terms that are eliminated by solving i c 20» = 0 for w — ic. 


yielding 


u(t) = — a; cos 5r + Š 3 cos3t — Ë cost 


9 96 


Passing all this information to the equation for u3(t), we compute that function to be 


sin3t — 22 sinc 


u3(t) = (x cost + 20 sin ) c + 4 sin7t — 2x sin5t + H 334 


576 576 128 
but another complication has arisen. The coefficient of t in the secular term contains both 
sin t and cos v. Hence, no choice of w3 will eliminate this secular term. Our only recourse 
is to set u3(t) = 0 and take w3 = 0. 

Finally, the equation for u4(t) contains terms in each previous u(t), so making the 
appropriate substitutions we obtain 


—(9 AT : L 38 455 
alt) = (204 + 355) € sint + aigo COSOT — 4552; COSTE 
2605. u 
+ 1g43; COS ST ay cos 3c + 7 uu COS T 
and eliminate the secular terms by solving the equation 2@4 + a5 = 0 for w4 = cd so 
that u4(T) is 
_ _33 455 - _605_ 
u4(T) = 35 Fg COS 9r — zega COS 7t + 18.43; COS 5t — ES cos3r + ii iss COS T 
Thus, w(a), to terms in a^, is o = 1 — uec = ma and x(t) is then, to the same 
order, given by 
= 9 -—! 3. = 13 
U(t) = 2cos x + (sinc — 1sin3r)a — ($ cos5t — È cos3t + È cost) a? 
455 
Z5 (a3 48g 00897 — ag ug COS 7T + d - cos St — 375 cos3t + ij. Tan cos r)a! 


Finally, the Lindstedt approximation for x(t) is 


x(t) = 2cos T + (sin T — 1sin3T)a — (i; cos5T — $ cos3T + # cos T) a? 


458. nme 605 - EB 
+ E agp C08 9T. — zega COS 7T + 14255; COSST — 315; cos 3T + 7 S cos T) a’ 


- Ao LLLA ue 
where T = t(1 — ja pd )- 


The Method of Krylov and Bogoliubov 


The first term of the Krylov-Bogoliubov (KB) approximation to the solution of the van der 
Pol equation is 


2Ao sin(t 
Sen = s OM (14.51) 


(4 - Adena + AQ 


where Ao and ġo are determined by the initial conditions x(0) = o and x'(0) = £. Setting 
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$o = 5 and Ao = A means the KB approximation will satisfy the initial conditions x (0) = A 
and x’(0) = taA(4 — 42). Shortly, we will show how to determine Ao and ġo to ensure 
the KB approximation satisfies the arbitrary initial conditions x(0) = «œ and x'(0) = £. 
From left to right in the top row of Figure 14.16 we have, for van der Pol's equation 
with a — i a numerically computed trajectory in the phase plane, corresponding results for 
the Lindstedt approximation (14.48), and the results for the KB approximation. The bottom 


(e) 
FIGURE 14.16 Witha = i in van der Pol’s equation, (a) and (5) are numeric solutions, (c) and (d) are 
Lindstedt’s solution, and (e) and (f) are the KB solution. For each pair, the first member is in the phase 
plane, and the second, in the time domain. 
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row shows the corresponding time-domain representations. The initial conditions for the 
numeric solution are x(0) = A = 5 and x'(0) = 0. The Lindstedt approximation depicts 
the limit cycle. The KB solution uses x(0) — A — 5and x'(0) — gaA(A? —4)= n. The 
KB approximation is "better" than the Lindstedt approximation because the former shows 
solutions approaching the limit cycle, whereas the Lindstedt approximation to the van der 
Pol equation only finds the periodic solution as represented by the limit cycle itself. 


Tue ALGORITHM The Krylov-Bogoliubov approximation [45] to the differential equation 


Pe , 
: 5 ox taf (x a= exif) (14.52) 


for a small is of the form x(t) = A(t) sin(wt + @(t)), where the functions A(t) and $ (t) 
are determined by the differential equations 


dA a a . ; 

di = -5f cos(0) f (A sin 8, Aw cos 0) dé 

p ue A (14.53) 
T = zu] sin(8) f (A sinÓ, Ac cos 0) dé 


Each A in the integrals on the right-hand sides of these two differential equations is 
iens P a constant. The reader is cautioned that some texts [62] write the equation as 

CX t ax = aF(x, dx) and the solution as x(t) = A(t) cos(@t + $(t)), in which case 
A and $ (t) are shame by 


dA a . 

— ———— sin(0) F(A cos0, —Ac sin0) d0 
dt 2z0 Jo 

do a d . 

— —— cos(0) F(A cos0, —Aw sin 0) dé 
dt 2x Aw 0 


The reader is further advised that an extension of this method to terms of higher order in a 
is known as the method of Krylov, Bogoliubov, and Mitropolsky. 


The van der Pol equation in (14.47), with œ = 1 and f (u, v) = —(1 — u?)v, is a candidate 
for approximation by the method of Krylov and Bogoliubov. The integrals in (14.53) give 


A'(t) = -f A cos? 0(1 — A? sin? 0) d0 = — ta A(—4 + A?) 
0 


$'(t) =- A sinf cos0(1 — A? sin? 0) d8 = 0 
0 


so that 
2Ao 
A(t) =+ and ¢(t) = do 
(4 - Ape" + Ai 


The KB approximation A(t) sin(t + $ (r)) therefore agrees with (14.51). 
Finally, we consider the question of initial data. The KB approximation satisfies x (0) — 
a, x'(0) = B if the equations 


a : a : 
Ap sings =a and Agcos¢do + 5 Ao sin do — g^ sin dp = f 


are satisfied. Since the equations are at least cubic in Ao, a closed-form solution for Ao and 
go will be exceptionally complex. We demonstrate, instead, a numeric solution in the event 
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x c= i a = 3, B = 0. Thus, we compute Ag = 3.039977166, po = —4.874742954; obtain 


the formula for the KB approximation 
sin(t — 4.874742954) 


Xkp = 6.079954332 
T J9.241461170 — 5.241461170e-"/4 


and graph its phase-plane trajectory in Figure 14.17. $ 


DzRrIvarION For the case a = 0, the differential equation (14.52) will have the solution 
x(t) = Asin(wt + $), which necessarily satisfies a = wA cos(wt + $), where A and ó 
are arbitrary constants of integration. For small values of a, Krylov and Bogoliubov assumed 
the solution satisfied x(t) = A(t) sin(wt + @(t)) and e = wA(t)cos(wt + $(t)). The alert 
reader will immediately notice that the formal derivative of x(t) does not have the form 


FIGURE 14.17  xkg for assumed by Krylov and Bogoliubov. Hence, the original nonlinear differential equation and 
a=7,a=3,8=0 the two assumptions of Krylov and Bogoliubov are used to determine the functions A(t) 
and $ (t). 


Formally differentiate x(t) and equate the result to the assumed form of c resulting 
in the equation 


A' (t) sin(ot + $(t)) + A(t) cos(ot + b(t) (o + 9 (£)) = wA(t) cos(ot + $(t)) 
Substitute into (14.52) the two assumptions of Krylov and Bogoliubov. Do this by differ- 


entiating the assumed form of x'(t) = E to get x” (t), then using the assumed forms for 


x(t) and x/(t) = dx in each other instance where these terms are needed. The result is 
wA'(t), cos(wt + $ (t)) — wA (t) sin(ot + Alo + P) +o A(t) sin(wt + $(t)) 
CF af (A(t) sin(ot + $(t)), wA(t)coslæt +¢(t))) =0 


We now have two equations in the derivatives A’ and ¢’. Solving for these derivatives, 


we obtain 
Alt) = . €os(ot + (taf (A(t) sin(ot + $(1)), oA (1) cos(wt + $(1)) 
w 
é'() af (A(t) sin(wt + 6 (t)), @A(t) cos(wt + ¢(t))) sin(ot + ¢(t)) 
B wA(t) 


A slight simplification follows if we define 6 = wt + $ (t), leading to 


Al(t) = cos(0)af (A(t) sin(0), wA(t) cos (0)) 


af (A(t) sin(@), AG) cos(@)) sin(@) 

wA(t) 
In the right-hand sides of these equations, we treat A(t) as the constant A, yielding 
acos6f(Asin@, wA cos @) 


$'(t) = 


A'(t) — 
w 
; a sin f(A sin0, wA cos) 
$ (t)— 
oA 


Finally, the right-hand sides are replaced by their averages over one period, and the result 
is (14.53). 


EXERCISES 14.6 
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1. Carry out the change of variables r = wt by which (14.47) 
becomes (14.50). 


. Obtain the Lindstedt approximation to the van der Pol equation. 
Show where the Lindstedt approximation to this equation is forced 
to select the periodic solution having x(0) = A = 2. 


nN 


3. For y" + ay’ + y = 0, y(0) = 1, y'(0) = 1, an initial value 

problem for a linear differential equation: 

(a) Obtain the exact solution. 

(b) Obtain the Krylov-Bogoliubov approximation. 

(c) Set a — 0.1 and graph, on the same set of axes, the solutions 
found in parts (a) and (b). 

In Exercises 4—9 take the initial conditions as y(0) = 1, y'(0) = 0. 

(a) Write the differential equation as a first-order system and 

determine all equilibrium points. 


(b) By linearizing, determine (when possible) the nature of each 
equilibrium point found in part (a). 


(c) For a small, obtain a regular Poincaré perturbation expansion. 
(d) Obtain a Lindstedt expansion. 


(e) Obtain the Krylov-Bogoliubov approximation. 


Chapter Review 


1. Given the IVP y" + 2y' + y = cost, y(0) = y'(0) = 0: 
(a) Obtain the exact solution. 
(b) Expand the exact solution in a Maclaurin series. 


(c) Substitute y — d a,t* into the differential equation, and by 
matching coefficients, recreate the first few terms of the series 
solution of the IVP. 


(d) Construct the first few terms of the series solution by repeatedly 

differentiating the differential equation itself. 
2. For a differential equation of the form p(t)y" + q(t)y' + 

r(t)y = f(t): 

(a) What is a regular point, a regular singular point, and an irregular 
singular point? 

(b) For each, illustrate with a differential equation. 

(c) What can be said about the form of a solution at each such point? 


3. Let f(t) = + 1 


1--t 1-27 


and g(t) = 


(a) Obtain the asymptotic expansions f ~ Y; 9 a,t~* and 
~ yr. bt^* 
gv bU. 


(f) Set a — 0.1 and obtain a numeric solution. 


(g) Use appropriate graphs to compare the four solutions found in 
parts (c)-(f). 
(h) In the phase plane, plot the trajectory corresponding to the 
numeric solution found in part (d). 
4.y"+y-a(l+y?=0 5. y"+y+ay =0 
6. y’+ytay=0 7.y"—-y-ca(yy 20 
8. y" -yca((y?-y)20 9. y" +y+al(y + y3) =0 


In Exercises 10—17, take the initial conditions as y(0) = 1, y'(0) = 0. 


(a) Obtain the Krylov-Bogoliubov approximation. 
(b) Graphically compare the approximation in part (a) with a 
numeric solution of the given IVP. 
10. y” -y - a3? — ») 20 
11. y" + y - a(y' + y?) = 0, y(0) = 1, y'(0) = —1 
12. y" - y - a(y' +y?) 20 
13. y" + y +a}? + y)y' = 0, yO) = A, y'(0) 20 
14. y" -y c a((y) -y)y' 20 15. y" - y c a((y - y?) 20 
16. y" -y c a(y) -y)20 17. y" cy - a(y' - y)y 0 


(b) Determine A and o by the equations A? + agA + by = 0 and 
(24 + ag)a + Aa, +b, — 0. 
(c) For the differential equation y" + f (1) y' + g(t)y = 0, determine 
asymptotic solutions of the form y ~ e"t*(1 + 3 7. , cxt ^). 
4. Obtain x(a) ^ Y; , x,a*, a perturbation series solution of the 
equation x = 1 + ae*. 
5. For the IVP y" + 2ay' + y = cost, y(0) = A, y'(0) = 0: 
(a) Obtain the exact solution and expand it in a Maclaurin series 
about a = 0. 
(b) Obtain a regular (Poincaré) perturbation solution of the form 
oso (x (t)a* and compare it with the series obtained in part (a). 
(c) Obtain a perturbation solution using Lindstedt's method, being 
sure to provide the frequency-amplitude relationship. 


(d) Obtain the Krylov-Bogoliubov approximation. 


6. Explain the difference between the regular (Poincaré) perturbation, 
the Lindstedt perturbation, and the Krylov-Bogoliubov 
approximation. What are the distinguishing characteristics and ideas 
for each of these three approximations to the solution of an IVP? 
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Chapter 15 


Boundary Value Problems 


INTRODUCTION Up to this point, the initial value problem has been the 
focus of our study. We now consider the boundary value problem in which restrictions are 
placed on the solution at the endpoints of an interval. Such problems arise, for example, if 
position at initial and terminal times is prescribed, or if temperatures are prescribed at both 
ends of an object like a rod. Techniques and theory for such problems will guide us when 
we study the related eigenvalue problem. 

As with initial value problems, exact solutions are available for a small class of BVPs. 
In the general case, numeric methods and the analytic approximation technique are needed. 
Hence, we study the shooting method and the technique of finite differences to obtain 
numeric solutions of BVPs. We also study the analytic approximations generated by least- 
squares, Rayleigh—Ritz, Galerkin, and collocation techniques. These methods all begin with 
a solution containing undetermined parameters that the methods determine by minimizing 
the residual in some way. These four methods differ in how that residual is minimized. 

A final analytic approximation is provided by the finite element method. If the Rayleigh- 
Ritz, Galerkin, or collocation techniques are used with functions that are nonzero only on 
subsets of the solution interval, the method becomes a finite element technique. Depending 
on the approximating functions used, the finite element method can generate a classical 
(strong) solution or a weak solution that, like the Green's function, does not possess enough 
derivatives to satisfy the DE pointwise. 


Analytic Solutions 


Suppose a shock absorber is being designed so that an attached unit mass, displaced one unit 
from rest, returns to the equilibrium position at t — 1. Suppose further that the mathematical 
model for the system uses 


y'(t) -- Ay(t) + 13y(0) 20 (15.1) 


as the equation of a damped oscillator. Thus, the two boundary conditions y(0) — 0 and 
y(1) = 0 must be imposed on the solution of (15.1). The differential equation and the two 
conditions, imposed at the endpoints of the interval 0 < t < 1, constitute a boundary value 
problem that has the solution 


y(t) = e~~ (cos3t — cot(3) sin 3t) (15.2) 


whose graph is found in Figure 15.1. 
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It is interesting that the mass must be displaced more than three units in order for 
the displacement to be zero at t = 1. Thus, the behavior of solutions of boundary value 
problems (BVPs) will be at least as interesting as the behavior of initial value problems 
(IVPs) has proven to be. $ 


Suppose we wanted to know how the displacements in Example 15.1 would depend on a 
if the condition at t = 1 were changed to y(1) = a. The solution can be found by applying 
the two boundary conditions to the general solution 


y(t) = e? (ci cos 3t + C2 sin 3t) 
thereby producing the two equations 
cy =1 and e^? (c cos3-Fcosin3) =a 
whose solution gives 


" 

ae“ — cos3 ! 

yalt) = e ?' cos3t + —— — ——e ? sin 3t 
sin3 


Figure 15.2(a) shows the displacement's dependence on the terminal value at t = 1 in 
a three-dimensional plot of the solution considered as a function y(t, a). Each plane section 
a = c, constant, is a solution curve for the differential equation and the boundary conditions 
y(0) = 1, y(1) = c. Several such plane sections are shown in Figure 15.2(b). $ 


(a) (b) 


FIGURE 15.2 Example 15.2: (a) shows y, (t) as the surface y(t, a) while (b) shows as plane sections, 
solutions of BVPs determined by several values of a 


EXAMPLE 15.3 The differential equation 


y(x)y"(x) — y'a? 2-120 (15.3) 


determines the curve that, when rotated about the x-axis, generates a surface of revolution 
of minimal surface area. (See Unit Nine.) If the curve must connect the points (0, 1) and 
(1, 2), we have the boundary conditions y(0) — 1 and y(1) — 2. The general solution of 
the nonlinear differential equation is y(t) = L cosh(ao (x + £)), and the solution satisfying 
the boundary conditions is 


y(t) = 0.9499888271 cosh(1.052643959x + 0.3230741021) (15.4) 


372 Chapter 15 Boundary Value Problems 


EXAMPLE 15.4 


since the algebraic equations for the constants o and £ virtually demand a numeric solution. 
The curve appears in Figure 15.3(a), and the resulting surface of minimal surface area 
appears in Figure 15.3(b). $ 


N 


E 0 
l 


(a) (b) 


el 


FIGURE 15.3 Example 15.3: (a) is the curve generating 
minimal surface of revolution while (5) is the generated 
surface 


Some BVPs have only the trivial solution y(x) — 0, some have multiple solutions, and some 
have no solution. The only solution of the first BVP in Table 15.1 is y(x) = 0 because the 
two equations in the rightmost column, obtained by applying the boundary conditions to the 
DEs general solution in the middle column, determine the coefficients to be c; = c2 = 0. 


BVP General Solution y(x) Equations 
y"(x) + y(x) 20 i ej —0 
(1) cı COS X + c sinx ! 
y(0) 2 y(1) 20 cicos1 +c sinl — 0 
Q) y" (x) + y(x) =0 4 . c= 0 
2 €; COS X + c5 sin x 
y(0) = y(1) 20 l e — ih 
(3) T GU s +c) cos x +c) sinx co 
Fe x C X C S J 
y0) = yr) 20 r ; z—c 20 


TABLE 15.1 Example 15.4: BVPs with one, many, and no solutions 


The second BVP in Table 15.1 has infinitely many solutions of the form y(x) = c» sin x 
because the equations in the rightmost column both determine c, = 0. 

The third BVP in Table 15.1 has no solution at all since the equations in the rightmost 
column place contradictory requirements on c1. E 


Fredholm Alternative 


The results in Example 15.4 illustrate the Fredholm alternative, an existence-uniqueness 
theorem named after the Swedish mathematician Ivar Fredholm, who proved similar results 
for more general equations. 


EXAMPLE 15.5 
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IGURE 15.4 Solution of the BVP in 
Example 15.5 
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THEOREM 15.1 


If p(x) and q(x) are continuous, the boundary value problem 
y" + pG)y t qG)y = f(x) and y(a) =0, y(b) =0 
has a solution for all continuous f(x) precisely when the completely homogeneous 
BVP 
y” + pG)y' 4 q(x)y =0 and y(a) =0, yb) =0 


has only the trivial solution y(x) = 0. When the completely homogeneous BVP has 
multiple solutions, it clearly has at least one nontrivial solution. When the completely 
homogeneous BVP has multiple solutions, the nonhomogeneous BVP has no solution. 


On the right in (15.5) is the general solution of the nonhomogeneous, but linear, DE on the 
left 


x?y" (x) — 2xy'(x) + 2y(x) = x? > ye) = ex + cox? + ix? (15.5) 
The BVP consisting of the ODE in (15.5) and the mixed, but linear, boundary conditions 
2y(1) — 3y’(1) + 5y(2) —4y'(2) =0 3y( -2y (D  4y2) + 5y' (2) = 4 


is considered nonhomogeneous, both because of the ODE in (15.5) and because of the 
second boundary condition. Solving this BVP requires solving 


5c) — 2 20 and 2c 4 116; - 2 24 


the algebraic equations obtained when applying the boundary conditions to the general 


solution in (15.5). A bit of algebra yields c; = E ĉz = -5, and the solution 

y(x) = 3x — 2x? + jx (15.6) 
whose graph is seen in Figure 15.4. The graph suggests, and calculation confirms, that the 
unspecified endpoint values are y(1) = 2; and y(2) = £. $ 


11 


Thus, the general second-order linear BVP is of the form 
ao(x) y^ +a, (x)y’ + a3(x)y = f(x) 
Bi(y) = cn ya) + ei»y'(a) + dıy (b) + digy'(b) = a 
Bo(y) = c1 y(a) + cy'(a) + dz y(b) + do2y'(b) = B 


The BVP is called regular if ag(x) # O in the interval [a, b] and singular otherwise. Special 
cases of the general mixed boundary conditions are the separated boundary conditions 


cu y(a) - ci2y (a) =a and dy y(b) + diy (b) = B 
and the periodic boundary conditions 


y(a) = y(b) and y'(a) = y'(b) 


Green’s Functions 


Given the inhomogeneous BVP whose differential equation is y"(x) = x? and whose 
boundary conditions are y(0) = y(1) = 0, we have the immediate solution y(x) = 5x4 — 
bx. Recalling Sections 5.13 and 6.11, we seek a Green’s function for the inhomogeneous 
BVP. The Green’s function will be a fundamental solution that also satisfies the given 


374 Chapter 15 Boundary Value Problems 


boundary conditions. A fundamental solution is a particular solution of the equation y"(x) — 
8(x — t). Taking the Laplace transform with respect to x and writing y'(0) = œ, we obtain 
Ys) = at e^* /s? and therefore y(x) = ax + (x — t)H(x — t), where H(x) is the 
Heaviside function. The endpoint condition y(1) = 0 then gives a = (t — 1)H(1 — t), so 
the Green's function is 


G(x, t) = (x — ))H(x — f) + (t — DxH(1 — t) (15.7) 


The solution of the inhomogeneous BVP then follows from the Green's function G(x, t) 
via the integral y(x) — n G (x, t) f(t) dt, where f(x) = x? is the right-hand side of the 


differential equation. Hence, we again find y(x) — 3x4 — bx. 
EXERCISES 15.1—Part A 
A1. Verify that (15.2) solves the BVP of Example 15.1. A6. An insulated rod is coincident with the interval [0, 1] on the x-axis. 


A2. Verify that y(x) — i cosh(a (x + 8)) is the general solution of 
(15.3). Apply the boundary conditions, and obtain the solution 


given in (15.4). 


A3. Verify the general solution given in (15.5). 
AA. Show that the general solution given in (15.6) satisfies the BVP of 


Example 15.5. 


Its left end is kept at a temperature of zero, and its right end at one. 
The steady-state temperatures in the rod are determined by the 
BVP —u"(x) = 0, u(0) = 0, u(1) = 1. Obtain u(x), and explain 
its physical significance. 


AT. The rod in Exercise A6 has both ends kept at a temperature of zero. 
However, there is a heat source internal to the rod so that the 
steady-state temperatures are now determined by the BVP 


AS. Verify that as a function of x, the Green's function given in (15.7) —u"(x) = x(1 — x), u(0) = u(1) = 0. Obtain and graph u(x). 
satisfies the boundary conditions y(0) = y(1) = 0. Verify that 
yx) 2 fo GG, 0f(ndt =- ix bs. 


EXERCISES 15.1- Part B 


B1. Carry out the steps of the following algorithm that finds the For the BVPs in Exercises B2-11: 
Green's function G(x, t) for the BVP y" --3y' -2y =x, 


y(0) + y'(0) = 0, y(1) — y'(1) = 0, and then gives the solution 


of the BVP. 


(a) Let y; (x) be a solution of the homogeneous DE ao y" + 
aiy’ + ay = O satisfying the boundary condition B; (y) = 0 


atx — a. 


(b) Let y»(x) be a solution of the homogeneous DE satisfying the 


y» are linearly independent. 


(d) The Green's function is 


y G)yx(t) 


Gat) = do(t) W(t) 


(a) Obtain an analytic solution with a suitable computer algebra 
system. 

(b) Graph the solution. 

(c) Obtain the general solution of the differential equation. 


(d) Form, and solve, the two algebraic equations that result from 
applying the boundary conditions to the general solution. 


boundary condition B(y) = 0 at x = b. Be sure that y, and (e) Write the solution of the BVP as per the results of part (d), 
comparing it to the solution found in part (a). 
(c) Let W(x) be the Wronskian of y; (x) and y2(x). B2. 2y” — 5y' +3y 20, y(0) = —1, y(1) = 1 
B3. 40y" — 47y' + 12y = 0, y(0) = 2, y'(1) = 0 
a<x<t B4. 28y" — 41y’+ 15y = 0, y(00 = —2, y(2) = 1 
B5. 6y" — 13y’+ 7y = 0, y(0) = 0, (1) = 1 
t<x<b B6. 5y” — 8y' + 3y = 0, y(00 = 5, y(3) 2-14 


yi (t)y2(X) 


ao (t) W(t) 


(e) The solution of the BVP is y(x) = r G(x,t)tdt — 


"X yi (t) yo (x) | ^b yi (x) y2(t) 
Ja wowo et ] Í wowo ! dt 


B7. x2y" - xy' — 25y = 0, yd) = 1, y 3) 1 
B8. x?y" — 2xy' — 4y = 0, y(1 20, y/2) = 1 


B9. x?y" — 4xy' + 6y = 0, y (1) = 21, y(3) «0 


B10. x?y" + 7xy/ + 8y 20, y' (1) 20, (2) = 1 
B11. x?y" — 2xy' - 4y 20, y(1) = 22, y(3) 22 


For the BVPs in Exercises B12-21: 


(a) Obtain the general solution of the differential equation. 


(b) Form, and solve, the two algebraic equations which result 
from applying the boundary conditions to the general solution. 


(c) Write the solution of the BVP. 
(d) Graph the solution. 


(e) From the solution, determine the values of y(x) at the 
endpoints. 
(f) Apply the differential equation solver in your favorite 
computer algebra system, and if it succeeds, compare the 
solution to that found in part (c). 
B12. 16y" — 86y' + 63y = 0, 5y(0) + 9y/(0) + 7y(1) 4-9y'(1) = 8, 
y(0) — 5y'(0) — 9y(1) — 2y'(1) 24 
B13. 9y” — 26y’ + 16y = 0, 8y(0) — 3y'(0) + 5y(1) + 3y'(1) = —9, 
3y(0) — 7y'(0) + 7 (1) + 4y'(1) = 7 
B14. 24y" — 37y' + 14y = 0, 3y(0) — 6y'(0) — 8y(1) + 3y’(1) = —5, 
3y(0) — 6y'(0) + 8y(1) — y'(1) 22 
B15. 40y" — 33y' — 18y = 0, 4y(0) + 9y'(0) — 4y(1) = 3, 
4y(0) + 4y'(0) + 8y(1) 4-9y'(1) = —2 
B16. 24y" + 14y' — 5y = 0, 7y(0) + 7y'(0) + y(1) — 6y'(1) = —9, 
6y(0) + 8y'(0) + 8y(1) — 6y'(1) 24 
B17. 21y" — 22y' — 63y = 0, y(0) + 7y'(0) — 5y(1) 2 3y'(1) = 7, 
2y(0) + y'(0) + y(1) — 8y'(1) = - 1 
B18. y" + 4y' + 13y = 0, 6y(0) — 5y'(0) — 4y(1) + 9y'(1) = 6, 
5y(0) + 9y’(0) — 9y(1) — 9y'(1) = —4 
B19. y" — 10y' + 21y = 0, 3y(0) — 8y'(0) + 6y(1) — 9y'(1) = —7, 
3y(0) + 3y'(0) + 5y(1) — y'(1) = —8 
B20. y" — 4y' + 3y = 0, 9y(0) + 8y'(0) — 7y(1) — 7y'(1) = 3, 
4y(0) — y'(0) + y(D) + 4y'(1) = —6 
B21. 40y" + 57y' + 20y = 0, 7y(0) + 6y' (0) — 8y(1) — 7y'(1) = —6, 
y(0) + 8y'(0) + 8y (1) — 2y'(1) 22 


In Exercises B2231, the given BVPs have a differential equation of the 
form L[y(x)] = f(x), where L represents the operations on the left- 
hand side and have boundary conditions of the form B,(y) = œ and 
B;(y) = $. For each: 
(a) Obtain an analytic solution with a suitable computer algebra 
system. 
(b) Graph the solution. 
(c) Obtain the general solution of the differential equation. 
(d) Form, and solve, the two algebraic equations that result from 
applying the boundary conditions to the general solution. 


(e) Write the solution of the BVP as per the results of part (d), 
comparing it to the solution found in part (a). 
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(f) Obtain the Green's function G(x, t) by the prescription of 
Exercise B1. 
(g) Obtain the solution of the boundary value problem as 
y(x) = l^ G (x, t) f (t) dt. 
B22. 40y" — 53y' + 9y = x, y(0) 20, y(1) 20 
B23. 7y" — 50y' + 7y = 1 — x?, (0) 20, y(1) 20 
B24. 18y" —21y' + 5y = cos x, y(0) = 0, y(1) 20 
B25. 2y" + 15y’ — 27y = e, y(0) 20, y(1) 20 
B26. 27y" + 3y’ — 10y = 1 — sin x, y(0) 20, y(1) 20 
B27. 2y” —y' — 3y =x + e*, y(0) 20, y(1) 20 
B28. 36y” — 73y' — 18y = 2 + 3x, y'(0) = 0, y(1) 20 
B29. 16y" + 18y' + 5y = 3 — cos 2x, y'(0) = 0, y'(1) 2 0 
B30. 4y” + 15y' + 9y =x + 2sin x, y'(0) = 0, y(1) 20 
B31. 5y" + 24y' + 27y = 3x? + sin zx, y'(0) = 0, y(1) 20 


In Exercises B32—41, the given BVPs have a differential equation of the 
form L[y(x)] — f(x). where L represents the operations on the left- 
hand side and have boundary conditions of the form B,(y) = @ and 
B2(y) = f. For each: 


(a) Solve the completely homogeneous problem L[y(x)] — 0, 
Bi(y) = 0, B3(y) = 0, 

(b) If the homogeneous problem in part (a) has only the trivial 
solution y = 0, solve the nonhomogeneous problem. 


(c) Obtain the general solution of the nonhomogeneous 
differential equation. 


(d) To the solution obtained in part (c), apply the 
nonhomogeneous boundary conditions, thereby obtaining two 
algebraic equations in two unknowns. 

(e) Show that the solution of the equations in part (d) leads to the 
solution of the nonhomogeneous BVP, provided the only 
solution found in part (b) is the trivial solution, y = 0. 
Otherwise, the algebraic equations formed in part (d) will 
have no solution and the nonhomogeneous BVP will also 
have no solution. 


(f) If the nonhomogeneous BVP has a solution, obtain its graph. 


(g) If the nonhomogeneous BVP has a solution, obtain it by the 
following extension of the method of Exercise B1. For the 
BVP with homogeneous boundary conditions where 
Bi(yi) = Bo(y2) = 0, obtain G(x, t) as in Exercise B1. Then 
write y(x) = p G(x,t)f(t) dt + z) (x) + op 22): 
where B;(y) = œ and B5(y) = P are the given 
nonhomogeneous boundary conditions. 


B32. y" +2y' + 26y = 1, y(0) = t.» (Z) sag 


B33. y" + 10y +41y =x, yO) — —1, y (=) = 


B34. y" + 4y’ + 20y = 1 +x, y(0) =2, y(x) = —1 
B35. y" + 8y’ + 20y =e, y(0) = —2, y(1) = 1 
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B36. y” + 8y' + Aly =x, yO) — 0, y’ (5) = B39. y” + 6y’ + 18y = xe™, y'(0) =2, y (1) = 1 
B37. y" + Ay! + 13y = cosx, y'(0) = 1, yr) = —1 B40. y" + 2y' + 17y = x cosx, y'(0) = —2, yen) =1 
BAG, / 425 $y = sina, 9/0) = i, y (Z) E B41. y" + 10y’ + 50y = x sinx, y'(0) = 0, y (3) =j 


; Numeric Solutions 


The Shooting Method 


The shooting methodis a numeric technique for solving a two-point boundary value problem. 
Based on the image of firing an artillery shell from a cannon, the method converts the bound- 
ary value problem into an initial value problem. The launch angle, y'(0), is parametrized, 
and the solution is "launched" repeatedly until the "target is hit" at the endpoint of the 
interval. 


EXAMPLE 15.6 Consider the BVP defined by 
y'(x) -2y'(x) + 10y(x) 2sinx and y(0)20,y(1) 21 (15.8) 


Numeric solvers for ODEs actually solve initial value problems, so we convert (15.8) to the 
initial value problem 


y'(x) -2y'(x)--10y(x)-—sinx and y(0)—0,y'(0)—a (15.9) 
by replacing the boundary condition at x — 1 with the initial condition y'(0) — a. This IVP 


is solved for various values of a until a solution is found that attains y(1) — 1. The exact 
solution of (15.9) is 


ya (x) = 555 Q7 sin x — 6cosx + e 7 (6cos3x + (85a — 7) sin 3x)) (15.10) 


and Figure 15.5 shows how y; (x) varies with a. 
Of course, it would be inefficient to hunt at random for a value of a that puts the solution 
through the point (1, 1). Analytically solving the equation y,(1) = 1 for a gives a = A, 


FIGURE 15.5 Several members of the 


family x, (f) in Example 15.6 where R l l 

_ e(255 + 6cos 1 — 27 sim 1) — 6cos3 4- 7 sin3 2 53.95 (15.11) 
85 sin3 
n Figure 15.6 shows y4 (x), the exact solution of (15.8). 

n However, we need to consider the case where y;,(x) cannot be found analytically. 
Certainly, we don't want to engage in an inefficient search for the right value of a. We want 
104. to be able to determine a as the numeric solution of an “equation” F(a) = y,(1) — 1 = 0. 
gd Each evaluation of F(a) invokes a numeric differential equation solver that returns y, (1). 


Newton's method from elementary calculus solves the equation f(a) = 0 by comput- 
ing the iterates a4; = a, — f (as)/ f ' (an), starting from some initial ag. To avoid computing 
Ki f'(a) required when solving f(a) — 0 by Newton's method, we use the secant method, 

which replaces the derivative with the difference quotient ( f (an) — f (aj 1))/(a& — Gn-1), 
resulting in the iteration 


IA x 


0 1 


a ag f (Gy) (a, —a,—1) 
FIGURE 15.6 Exact solution of the BV n+1 = An 
hs cM T xact solution of the BVP f(a,) — fa.) 


(15.12) 


Applying (15.12) to F(a) = 0 with a; = 0 and a? = 1 gives 53.95021153, 53.95018460, 
53.95018462, 53.95018463, and 53.95018463 as the next five iterates. $ 


FIGURE 15.7 Exact (solid) and 
finite-difference (dotted) solutions of the 
BVP in Example 15.7 


EXAMPLE 15.7 


EXAMPLE 15.8 


yo =0 

yi — 5.578937329 
y2 = 9.637253870 
y3 = 12.08338677 
y4 = 12.98896509 
ys = 12.55261795 
yo = 11.05881799 
y7 = 8.836404040 
yg = 6.220612425 
yo = 3.521430481 
yo = 1 


TABLE 15.2  Finite-difference 
solution in Example 15.7 
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The Finite Difference Method 


Replacing derivatives with approximating difference quotients leads to the finite difference 
method, an alternative for solving a boundary value problem. We will illustrate the method 
for a linear differential equation, but the method works for any equation that is easily put 
into the form y"(x) = f (x, y(x), y'(x)). Initially, we consider boundary conditions of the 
form y(a) = a, y(b) = P but later show how more general boundary conditions can be 
treated. 

The interval [a, b] is uniformly partitioned into N subintervals of length h = EK 
resulting in the partition points xy = a + kh, k =0,1,..., N. The derivatives at x, are 
replaced with the O(A?) centered approximations 


Ye -2Y- YA Yk+1—Yk—1 

h? 2h 
where y, approximates y(x). (The formula for y” is derived at the end of the section.) 
Substitution of these approximations into a linear differential equation yields a set of linear 
algebraic equations for yg, k = 0, 1, ..., N. Nonlinear equations result in a set of nonlin- 
ear algebraic equations best solved with iterative methods such as Gauss-Seidel iteration 
(discussed in Section 39.5). 


3 dg) = and y(x) = 


To implement the finite difference scheme for the BVP in (15.8), set N = 10 so that h = E 
and x; = kh. Next, define the function f (x, y, y") = sin x — 10x — 2x’. At each "interior" 
node xy, k = 1,2,..., N — 1 = 9, the discretization yields a single equation 


. k 
100(yn41 — 2yk + yk-i) = sin 10^ 10(yk+1 + yk — Yk-i) 


There are N + 1 = 11 unknowns, namely, yo, yi. .... Yio, SO We need two more equations. 
The endpoint conditions yield the remaining two equations yo = 0 and yo = 1. Solving 
this set of 11 equations in 11 unknowns yields the values in Table 15.2 and the piecewise 


linear curve (dotted) in Figure 15.7. The solid curve is y4 (x), the exact solution of (15.8). 
D 


The finite-difference method can be adapted to more general boundary conditions. For 
example, in (15.8), change the condition at x — 1 to y'(1) — 1. The equations at the nine 
interior nodes remain the same as in Example 15.7. But we must write one more equation 
of the same type at the endpoint x = x19. The resulting 10 equations are then 


k 
100(yk+1 — 2yk + Ye-1) = sin 10 — 10(yk+1 + Yk — Yk-1) ko uos 10 


The 10th equation introduced the new unknown y;;. An 11th equation arises from the 
boundary condition at x = 0, and a 12th equation is generated by applying the finite- 
difference approximation to the derivative in the condition at x — 1. Thus, we have the two 
additional equations yo = 0 and 5y;; — 5yo = 1, where the second of the two is actually 
y'Guo) = AD — ]. The numeric solution of this set of 12 equations in 12 unknowns is 
given in Table 15.3. 

The exact solution of the BVP is y(x) = A(o1 +e *o5 + e!-*o3), where 


A = 510 cos 3 — 170 sin 3 
0, = 3 cos(x + 3) + 25 sin(x — 3) — 15 cos(x — 3) + 29 sin(x + 3) 
05 = Asin(3x — 3) + 12cos(3x — 3) 
05 = 170 sin 3x — 9sin(3x + 1) — 9sin(3x — 1) — 2cos(3x — 1) + 2 cos(3x + 1) 
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yo = 0 ys = —0.4533344866 ye = —0.3947154904 yo = —0.0760352663 
yı = —0.2109224910 y4 = —0.4830077653 y7 = —0.3004187839 yio = 0.03132355666 
y» = —0.3634130898 ys = —0.4598359387 yg = —0.1900996102 yıı = 0.1239647337 
TABLE 15.3  Finite-difference solution in Example 15.8 
0 1 Figure 15.8 graphs the finite-difference solution (dotted) against the exact solution (solid), 
" > X with the remarkable result that the finite-difference solution in Example 15.8 is much more 
accurate than the finite-difference solution in Example 15.7. $ 
T , Derivation of the Central Difference Formula for f” 
a The central difference formula which replaced y" is obtained by adding the following two 
y Taylor series expansions and solving for f"(x). 
FIGURE 15.8 — Exact (solid) and fG ch) = fle) + f'GOh 4 3 f" o)? + 1 f" Gon? + Od) 


finite-difference (dotted) solutions of the 


BVP in Example 15.8 f(x —h) = f(x) — f'G)h + $ f" Go)? — Ef" @h + OF) 


EXERCISES 15.2—Part A 


Al. Using the methods of Chapter 5, obtain the exact solution of (15.8). — A4. Starting with xo = 3 and x, = 2.5, obtain the next five secant- 
A2. Use the Laplace transform to obtain the exact solution of (15.8). method iterates when f (x) = x° — 3x + 2. 
Treat y'(0) = @ as unknown, and use the condition y(1) = 1 to AS. Obtain the exact solution of the BVP in Example 15.8. 
determine a. 
A3. Show that the solution in Exercise A2 reflects the process by which 
Ya (x) is obtained as the solution of (15.9) and by which y,(x) is 
obtained as the exact solution of (15.8). 
EXERCISES 15.2-Part B 
B1. To extend the shooting method to the BVP y" + 3y’+ 2y — 0, (£) Obtain the solution by the shooting method. 
»(0) + y1) = 0, y'(0) — y'(1) = 1, solve the IVP consisting of (g) Taking h = +, obtain the solution by the finite-difference 
the same DE and the initial conditions y(0) = a, y'(0) = b. Solve method. 
this IVP analytically, and apply th ditions t , . : : 
: e ana guoa > nies Yu Ce RUN : ds (h) Compare the two numeric solutions with the exact solution. 
determine appropriate values for a and b. A numeric 
implementation of this process would lead to the desired B2. 3y" — Ty’ + 4y = xe ?*, y(0) = 2, (0 = 1 


extension of the shooting method. 
For the BVP in each of Exercises B2-11: 


(a) Obtain an analytic solution using a computer algebra system. 
(b) Graph the solution. 
(c) From the analytic solution, obtain the value of y'(0). 


(d) Obtain G(x, t), the Green's function for the homogeneous 
problem. 


(e) Obtain the solution as in Exercises B32—41, Section 15.1. 


.2y" —7]y'-3y = 1 — x + x sin x, y(0) = —1, y(1) 23 
. 21y” — 8y' —4y = 1 — 3x”, (00 = 1, y(1) = -2 
. 10y" + y' - 3y = x, y(0) = 2, y(1) = 0 on the right in BS, just x 


survives 


. 3y” + 5y' — 2y = x —3sin 2x, y(0) = —4, y(1) 22 
. 15y” + 52y' + 45y = x, y(00 = -7, (1 = 1 

. y" + 2y' + 10y = 7e? +4, y(0) = 2, y(1) = —5 

. 56y" — 99y' + 40y = 1 3x4, y(0) = x, y(1) =e 


B10. y” — 2y' — 3y = 6x? sin 2x, y(0) = 2e, y(1) = 5 
Bll. y" + 10y' + 26y = 2cos(3x — 1), y(0) = —6, y(1) 25 
For the BVP in each of Exercises B 12-26: 
(a) Obtain an analytic solution by using a computer algebra 
system 
(b) Graph the solution. 
(c) From the analytic solution, obtain the value of y’ (0). 


(d) Obtain G(x, t), the Green's function for the homogeneous 
problem. 


(e) Obtain the solution as in Exercises B32—41, Section 15.1. 


(f) Obtain the solution by an extension of the shooting method. 
(Define a function h(a) which, for each value a = y'(0), 
returns a numerically computed y'(1).) 


(g) Obtain the solution by the finite-difference method. 

(h) Compare the two numeric solutions with the exact solution. 
B12. 
B13. 
B14. 
B15. 
B16. 
B17. 
B18. 
B19. 


12y” — 8y' + y = e™, y(0) 22, y (1) 20 

Ty" — 16y' + 4y = x, y(0) = —3, y'(1) 22 

2y” —9y' + Ty = 1 — x?, yO) = 5, y'(1)=3 
21y” — 46y' — 7y = cos 2x, y(0) = —4, y'(1)= 1 
21y” — 2y' — 3y = 2 — 3 sin x, y(0) 2 7, y (1) 20 
Ty” + 40y’ — 63y = xe*, y(0) = —1, y (1) 22 
3y” + lly’ + 8y = 1 — 2e*, y(0) = 1, y' (1) = —1 
18y” + 39y + 20y = xe™, y(0) =z, y (1) =e 
B20. 3y” + 5y + 2y = 1 — x - x?, y(0) =e, y' (1) =x 
B21. 9y” + 56y' + 12y = 5, y(0) 20, y (1) 23 

B22. y” + 8y' +25y = x3, y(0) = —6, y'(1)= 1 

B23. y” + 10y’ + 41y = e™ cosx, y(0) = 3, y (1) = —2 
B24. y” + 8y’ + 20y = 1 — x3, y(0) = 9, y'(1) = —1 
B25. y" +2y' + 10y =x +e*, y(00 = 11, y (1) 20 
B26. y" + 10y' + Aly 22x + 1, y(0) = —8, y'(1) 22 


For the BVP in each of Exercises B27—36: 


(a) Obtain an analytic solution using a computer algebra system. 


(b) Graph the solution. 
(c) From the analytic solution, obtain the value of y'(1). 
(d) Obtain the general solution of the differential equation. 


(e) Form, and solve, the two algebraic equations resulting from 
applying the boundary conditions to the general solution 
found in part (d). 


(f) Write, and compare to part (a), the solution corresponding to 
the results of part (e). 


B27. 
B28. 
B29. 
B30. 
B31. 
B32. 
B33. 
B34. 
B35. 
B36. 
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Numeric Solutions 


(g) Obtain G(x, t). the Green's function for the homogeneous 
problem. 


(h) Obtain the solution as in Exercises B32—41, Section 15.1. 

(i) Obtain the solution by the finite-difference method. 

(j) Obtain the solution by the shooting method. 

(k) Compare the two numeric solutions with the analytic solution. 
xy" xy —y =x, y(1) = —1, y) 

x?y" + Axy! -2y = x°, (0) 22, y(2) 23 
x*y" —xy' - 15y = 1 + 2x, y(1) 20, y3) =2 

x2y" — 3xy'+3y 2 x 1, y(1 = —3, y'2) 21 

4y = 5, y(1) 2 7, y'(3) 20 

x?y" +3xy' — 15y = 1 — 3x32, y(1) = 5, y(2) 2 7 
xy" + Ixy’ +5y = x3, y(1) = 1, y(5) = -1 

x^y" — 5xy' + 8y = x(2 + 3x), y(1) = —4, y'(4) 20 
x?y" + 2xy’ — 12y = x, y(1) = 22, y(2) = 1 

x?y" + 10xy’ + 20y = 7x, y(1) = 12, y'(83) =0 


x y" + xy’ 


For the BVP in each of Exercises B37—40: 


B37. 


B38. 


B39. 


B40. 


(a) Obtain the general solution of the differential equation. 


(b) Form, and solve, the two algebraic equations that result from 
applying the boundary conditions to the general solution 
found in part (a). 

(c) Write, and graph, the solution of the BVP. 

(d) From the exact solution, obtain the values of y(0) and y'(0). 


(e) Try to obtain the solution directly with a computer algebra 
system. 


(f) Obtain the solution by the finite-difference method. (Partition 
[0, 1] into N = 10 equal subintervals with the 11 nodes 
xp x, B= 0, 000% 10. Discretize the differential equation at 
each of the 11 nodes, thereby introducing the two additional 
unknowns y_, and y;;. Obtain two additional equations from 
the boundary conditions, and solve for the 13 unknowns, 
yj; A 15:235 11. Graph the solution.) 


3y" — 25y' + 28y = cos2x, 8y(0) + y'(0) + 8y(1) — 3y'(1) = 2, 
4y(0) — 7y'(0) — 2y(D + 7y'(1) 24 

9y" — 86y' + 45y = x7, 3y(0) + 9y'(0) + 6y (1) + 5y'(1) = 6, 
8y(0) + 9y'(0) + 8y(1) — 8y'(1) = 1 

42y" —73y'+28y = 1— x, 7y (0) 4-6y (0) 4-6y (1) 4-5y'(1) = 0, 
8y(0) — 3y'(0) + 8y(D + y' (10 25 

2y" + Ty’ — 4y = 3, y(0) + 8y'(0) + y (D) + 2y'(1) = 2, 

y) + 2y (0) + 5y(1) — 6y'(1) = —9 
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EXAMPLE 15.9 


: Least-Squares, Rayleigh-Ritz, Galerkin, 


and Collocation Techniques 


Introduction 


The least-squares, Rayleigh-Ritz, Galerkin, and collocation techniques for approximating 
solutions of the differential equation 

fo. y. y y") 20 (15.13) 
all stem from a central idea. An approximation in the form of a linear combination of some 
basis functions $, (x) is assumed to be a solution. Substitution into (15.13) results in either 
a Zero or nonzero result. If the result is zero, then an extremely astute guess at the solution 
has been made and an exact solution has been found. In the more likely event that the result 
is not zero, we don't have an exact solution and the nonzero result is called the residual, R. 
However, the "closer" to zero we can make R, the "better" our guess approximates the true 
solution. What distinguishes one method from another is the manner in which “R close to 
zero" is defined and implemented. 


We will illustrate the least-squares, Rayleigh-Ritz, Galerkin, and collocation techniques for 
(15.13), the BVP of Example 15.6 in Section 15.2, that is, for 
y'(x) -2y'(x) + 10y(x) 2sinx y(0)=0, y(1) 1 


The differential equation and the boundary conditions appear in (15.8), and the exact solution 
is given by (15.10) when a — A, given by (15.11). A graph of this exact solution is given 
in Figure 15.6. e 


Common Preliminaries 


For each method, we use the same approximation, namely, 


$9 (x) + bhi (x) + có» (x) 
where $o(x) = x is introduced to satisfy the inhomogeneous boundary condition y(1) = 1 
and $,(x) = x(x — 1) and $5(x) = x(x? — 1) both satisfy the homogeneous boundary 
conditions y(0) = y(1) = 0. Thus, y(x) is approximated with the polynomial 
yp — x t bx(x — 1) + ex(x? — 1) (15.14) 
The residual is 
R — 2 — 2c + (10 — 4c — 6b)x + (6c + 10b)x? + 10ex? — sin x (15.15) 
The least-squares, Rayleigh-Ritz, Galerkin, and collocation techniques differ in how the 


residual is manipulated in an effort to determine values of the two constants b and c that 
optimize R in some sense. 


Least-Squares Method 


. — 1 
In the least-squares technique, b and c are chosen so as to minimize Q = h R? dx, a 
measure motivated by convergence in the mean, studied in Section 10.4. Thus, we seek the 
minimum of 


1 
Q =f R? dx = 338 + Bp + 120 + 2b? + 10cb + 1292 
à : 3 


+ (44c — 28b — 20) sin 1 + (24 — 32b — 124c) cos 1 — +cos(1)sin(1) 


105 


15.3 


FIGURE 15.9 Least-squares method: 
Q= l^ R? dx 


»-X 


FIGURE 15.10 Least-squares solution 
. (dotted) and exact solution (solid) for 
Example 15.9 
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a function of the two parameters b and c. Figure 15.9, showing Q as a surface over the 
bc-plane, suggests a minimum at some point with coordinates (b, c). The minimum sits at 
the bottom of a very narrow well. 

In practice, finding such minimums using purely numerical techniques is a challenge. 
However, in this instance, experience in multivariable calculus suggests differentiation with 
respect to b and c, leading to the equations 

154 + 10c — 28sin1 — 32cos1+4b = 0 
160 + 282 e + 10b — 124cos 1 +44sin1 =0 
whose solution is 


2) 3 . L o 
b= en + sin | uM cos | = —13.77 
s — 7875 _ 11,970 |. 4620 ane 1 2 
c= 5 e; sin] + cos 1 = 4.46 


This gives the least-squares approximation 
yı = 10.30992325x — 13.76946002x? + 4.45953677:? 


which is graphed against the exact solution in Figure 15.10. The least-squares solution 
(dotted) is not a very good approximation to the exact solution (solid) because the approx- 
imating polynomial with which we started was too limited. In fact, the minimum value of 
the residual is 29.6635146, which is not very close to zero. 


LEAST-SQUARES AND ORTHOGONALITY For a linear differential equation of the form 
Liy] = aoy"aiy azy = f(x) 
the least-squares algorithm assumes a solution of the form y = 7, $ció,(x), where 
co = 1, and generates the residual 
n n n 
R-L I ap | — £0) = 3 ceL be) — fe) = Y cea) — fF) 
k=0 k=0 k=0 

where y}(x) = L[@;(x)]. Linearity allows the operations associated with L to pass through 
to the functions ¢;; and except for the nonhomogeneous term / (x), the residual is a linear 
combination of L acting on these functions. 

Now, when Q(ci, c2, ..., Cn) = fi R? dx is minimized, the equations 


n 2 f r(2R) a 0 
— — pe —— A 
cy a CK 


determine the c. From the definition of R we find 
a 
—R = y, = Lig] 


OC, 


so the equations determining the c; are really 


b b 
| as] RLI[$,] dx — 0 


a a 
from which we conclude that the residual R is orthogonal to each function that results when 
oy is acted on by L. 
Thus, the least-squares algorithm sets out to minimize Q = [^ R? dx and ends up 
making the residual orthogonal to a set of functions. It is the orthogonality that generalizes 
to the Rayleigh-Ritz and Galerkin techniques. 
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Rayleigh-Ritz Technique 


The Galerkin strategy generalizes the least-squares technique by making the residual or- 
thogonal to each member of a set of functions called the weighting functions. Thus, Galerkin 
techniques are often called weighted residual techniques. 

If the weighting functions are the same functions x used in the approximation y = 
Y so Ck; (X). the method is generally called the Rayleigh-Ritz technique. If the weighting 
functions are other than these functions, then the method is generally called a Galerkin 
technique. If the weighting functions are Dirac delta functions, then the method becomes a 
collocation method. The weighting functions are often taken as orthogonal. 

A rich enough set of orthogonal functions behaves like the unit basis vectors i, j, and k 
in three-dimensional Cartesian space R?. Just as a vector v in R? can be expressed as a sum 
of the form v = ai + bj + ck, so too can functions be expressed as linear combinations of 
orthogonal functions. 

The Fourier series from Chapter 10 is an example. On the interval [0, 7], the Fourier 
sine series, namely f (x) = Y. by sin kx, represents f (x) in terms of the set of orthogonal 
functions $; (x) = sin kx. The functions $, (x) play the role that the vectors i, j, and k play 
in R?. 

The fundamental insight of the Rayleigh-Ritz and Galerkin techniques resides in the * 
following observation. The only vector in R° that is orthogonal to all three basis vectors 
i, j. and k is the zero vector. There are only three mutually perpendicular directions in 
R?, so there cannot be any new vectors perpendicular to all three basis vectors. A vector 
perpendicular to all three basis vectors must be the zero vector. 

For functions, there are a countably infinite number of “basis vectors” and, correspond- 
ingly, a countably infinite number of mutually perpendicular “directions.” The only function 
perpendicular to all of these directions is the zero function. The more basis vectors to which 
the residual is orthogonal, the closer the residual is to this zero function. Hence, the Galerkin 
methods seek to make the residual as close as possible to the zero function by making the 
residual orthogonal to as many of the members as possible in the set of weighting functions 
whether orthogonal or not. 

Making the residual (15.15) orthogonal to $; = x(x — 1) and $» = x(x? — 1) gives 
the two equations 


1 
Í R(x* —x)dx = $c + 2 — sin 1 — 2cos 1 = 0 


A 0 
1 
104 "ees ^ Í R(x? —x)dx = -c — M — $b + 4sin 1 — 6cos 1 =0 
¥ T é ke" which then determine the parameters 
6 : É 
T b = —185 80 gin 1 — S cos] and c= —25 4-30sin 1 + 60cos 1 
4+ ; 1 
2 i * so that the Rayleigh-Ritz approximation is 
+ b> x yi = x — (x? — x) (3 — €? sin 1 + 1729 cos 1) — (x3 — x)(25 — 30 sin 1 — 60cos 1) 
l 
FIGURE 15.11 Rayleigh-Ritz solution Figure 15.11 compares the exact solution (solid curve) and the Rayleigh-Ritz approx- 
(dotted) and exact soam (solid) for imation (dotted curve), and we conclude that the Rayleigh-Ritz solution, for this problem, 


Example 15.9 at least, appears to be “better” than the least-squares solution. 
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i Pe 


FIGURE 15.12 Galerkin solution (dotted) 
and exact solution (solid) for Example 15.9 


FIGURE 15.13 Collocation solution 
(dotted) and exact solution (solid) for 
Example 15.9 


Galerkin Method 


In practice, the Galerkin technique differs from the Rayleigh-Ritz technique in the choice 
of weighting functions. There are also some additional differences in the nature of the 
differential equation being solved, with the Rayleigh—Ritz being restricted to a smaller 
class of problems. (See, e,g., [73] for more of the theory of the Rayleigh-Ritz method.) 

Suppose we make the residual orthogonal to the weights w = sin krx, k = 1, 2. Then, 
the Galerkin orthogonality conditions are the two equations JE Ru, dx = 0,k = 1,2, which 
lead to 


(sin 1 — 4b — 8c — 14)z* + (44b + 92c + 14)x? — 40b — 84c — 0 
(4sin 1 — 16b — 48c — 40)x* + (4b + 72c + 10)x? — 15c =0 


Although an exact solution is possible, we settle for a numeric solution that then yields the 
Galerkin solution as the cubic polynomial 


ys = 60.62190067x — 95.01456923x? + 35.39266856x? 


A graph of the exact solution (solid curve) and the Galerkin solution (dotted curve) is 
provided in Figure 15.12. Surprisingly, this Galerkin solution seems to be a better approx- 
imation than the Rayleigh-Ritz approximation. 


Collocation 


If the residual is made orthogonal to Dirac delta functions ó(x — x),), where the x; are in 
the interval [a, b], we then have the equations f R(x)é(x — xy) dx = R(x;,) = 0. This is 
the method of collocation. The residual is made to vanish at enough points in the interval 
[a, b] to generate the right number of equations for determining the coefficients in the 
approximation for y(x). Typically, the points are taken as uniformly distributed, but that is 
not essential. 

1 


Evaluating the residual (15.15) at x = 1, $ 


yields the collocation equations 
—Sc — b+ £ — sini =0 and Ket ib+% -sin = 0 


whose solution 


1521 117 279 .— 306 27 27 542 
b=-! + 35 si ni + sin + and c= = — sin 4 sin $ 
then gives the collocation approximation 


2 521 IT ase 1 279 306 27 
y4 — x — (x^ x) (8 — 39 Sinz — So Sin $ i) (x3 — x) (3$ — S sini — 


0 = sin 3) 


Figure 15.13 compares the collocation solution (dotted) with the exact solution (solid). 


Comparing Solutions 


Figures 15.10—15.13 suggest that the Galerkin approximation of the solution to the BVP 
in Example 15.9 is best. Comparing the four approximations requires a way of assigning a 
number to the “difference” between two functions f(x) and g(x). We again employ (10.8) 
from Section 10.6 as the square of the “distance” between functions. 

Evaluating the integrals 
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0 1 


FIGURE 15.14 Optimal cubic solution 
(dotted) and exact solution (solid) for 
Example 15.9 


E |x 


we obtain 39.48, 0.092, 0.049, 8.18, respectively, as the values of the square of the measure 
of difference between the exact solution and the least-squares, Rayleigh-Ritz, Galerkin, and 
collocation approximations. On the basis of this measure, the Galerkin technique produced 
the best of the four approximations. 


A COLLOCATION EXPERIMENT Lety, in (15.14) be a polynomial approximation to y4 (x), 
the exact solution of the BVP in Example 15.9. Determine the optimum values of b and c 
by minimizing 


] 
vats) — yl = f Gut —»yf de (15.16) 
0 


This gives the very best mean-squared approximation possible with the polynomial y,. 
Then, determine x = u and x = v, two collocation points that generate these values of b 
and c by collocation. 

The integral in (15.16) evaluates to 


5 


" b^ bc 
2.731555731b + 4.012228765c + 0.07619047607c* + 57.50018075 + 30 + us 
and has the minimum value 0.0187102577 when 
b — —94.58938829 and c — 35.74403492 (15.17) 


Thus, the best approximation possible with the polynomial y, in (15.14) is 
ys = 59.84535337x — 94.58938829x? + 35.74403492x? 


Figure 15.14 compares the exact solution y4 (x) (solid curve) with the best approximat- 
ing cubic polynomial ys (dotted curve). The ratio DA — 1.62 compares the perfor- 
mance of the Galerkin solution and the optimal solution, showing that the optimal solution 
is indeed closer to the exact solution than even the Galerkin solution. 

Finally, we ask where are u and v, the two optimal collocating nodes that give us 
(15.17)? To obtain these nodes, we evaluate the residual (15.15) at x = u and x = v and 
then substitute for b and c using (15.17). The points u and v are determined by setting the 


residuals to zero, giving the two very symmetric equations 


434.5601900u — 69.48806984 — 731.4296734u? + 357.44034921? — sinu = 0 
434.5601900v — 69.48806984 — 731.4296734v? + 357.4403492i? — sin v = 0 


which we solve numerically for 


u = 0.2593792693 and v = 0.6732659011 


The two optimal collocation points, while symmetrically located in [0, 1], are not uniformly 
spaced. 

Our route to the optimum collocation points u and v was through the exact solution 
YA (x), which was used in (15.16). Although being able to locate collocation points optimally 
without using the exact solution would be valuable, we simply refer the reader to texts such 
as [73] for further study of this topic. 
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EXERCISES 15.3-Part A 
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Al. Obtain y,, the exact solution to the BVP y" = e*, y(0) = 2, 
yd) =e. 

Find $o(x), a linear function that satisfies the two boundary 
conditions in Exercise Al. 


A2. 


A3. If y, = bo + bó, + có», where ġo is the function determined in 


Exercise A2 and 4, $» are as in (15.14), obtain R, the residual y, 


A6. 


AT. 


Using R and y, from Exercise A3, obtain ys, the Galerkin 
approximation to the solution of the BVP in Exercise Al. Use 
wy = sin krx, k = 1, 2, for the weighting functions. 

Using R and y, from Exercise A3, obtain y4, the collocation 
approximation to the solution of the BVP in Exercise A1. Use 
x = 4, $ for the collocation points. 


generates for the BVP in Exercise A1. A8. Evaluate the integrals i (ye — P dx, k = 1,..., 4. 
A4. Using R and y, from Exercise A3, obtain y;, the least-squares A9. Graph y, against each of yj, k = 1,..., 4. 
approximation to the solution of the BVP in Exercise Al. 
AS. Using R and y, from Exercise A3, obtain y2, the Rayleigh-Ritz 
approximation to the solution of the BVP in Exercise Al. 
EXERCISES 15.3-Part B 

B1. In Exercise A6, obtain the Galerkin approximation using the (k) Plot y,(x) and yk, k = 1,..., 5, all on the same axes. 
weighting functions (D Compute || ye(x) — yell, ES 5 
(a) sinx,sin2x (b) x — (c) I, cosx (m) Obtain R, and R,, the residual at x = u and x = v, 

B2. Compare each approximation found in Exercise B1 with ys, the respectively. Using the optimal values of c, and c5 
Galerkin approximation found in Exercise A6. Explain your determined in part (j), solve for u and v, the unevenly spaced 
Observations. collocation points that generate the same solution as ys. 

In Exercises B3-7, the given differential equation and the boundary con- B3. 25y" — 55y/ + 24y = x? B4. y" — 9y' + 14y = e™ 
ditions y(0) = 0, y(1) = 1, comprise a BVP. For each: BS. y'.-2y-10y —cos2x Bey —7y'+6y =1—sinx 
(a) Obtain y, (x), the exact solution of the BVP. This can be B7. 9y” — 16y/ 4y = 1 - 2x2 
done with a computer algebra system's differential-equation BS Show that heweightlug functions ay cc gp and i ca] = ix) 


solver, with a Green's function, or with a general solution to 
which the boundary conditions have been applied. 

(b) Set y, — Y s CQ (x), where co = 1, $9 = x, $1 = 
x(x — 1), @ = x(x? — D), and obtain R(ci, c2) = 
L{y] — f (x), the residual for the differential equation whose 
form is L[y(x)] = f (x). 

(c) Plot O(c), c2) = £ R? dx as a surface over the c;c;-plane, 
being sure to capture the minimum in the graph. 

(d) Obtain a contour plot of O(c), c2). 

(e) Using R, determine yı, the least-squares approximation to 
ye (x). 

(f) Obtain Y = Lior], k = 1, 2, and show that the equations 
0$/0c, = 9/8c; i R? dx = 0 are equivalent to 


fy Ry, dx — 0. 
(g) Using R, determine y», the Rayleigh-Ritz approximation to 
ye (x). 


(h) Using R, and the weighting functions w, = sin kzrx, 
k = 1,2, determine y3, the Galerkin approximation to y, (x). 


(i) Using R and two uniformly-spaced collocation points, 
determine y4, the collocation approximation to y, (x). 


(j) Obtain ys, the solution that minimizes ||y.(x) — y, = 
] 
h (y. (x) — Yp) dx. 


are orthogonal on the interval [0, 1]. 


In Exercises B9—-13, the given differential equation and the boundary 
conditions y(0) = 0, y(1) = 1, comprise a BVP. For each, repeat the 
steps used for Exercises B3—7, but take y, = x +c) sin zt x +c? sin 27x. 
For the Galerkin method, use the weighting functions w; and wz defined 
in Exercise B8. 


B9. 


B11 
B12 
B13 


27y” +60y' — 7y 2xe* B10. y" +6y' +25y=5 


. Sy” + 12y' + 7y = x cosx 
. 21y” + 10y + y 22—3x 
. y" + 6y' + 10y = 2x 


In Exercises B14—18, the given differential equation and the boundary 
conditions y(0) = 0, y(1) = 1, comprise a BVP. For each, repeat the 
steps used for Exercises B3-7, but take y, = sin pU + c,sinax + 
c5 sin 2x x. For the Galerkin method, use the weighting functions w; and 
w» defined in Exercise B8. 


B14. y" + 8y - 17y = 
B15. y" --8y' -25y = 
B16. 
B17. 
B18. 


l —2sinzx 
1x —x? 
28y" — 67y' + 40y = x + 4x? 
63y" + 17y' — 10y = x? + 2e* 
9y” + 16y' +7y = 3 cosh x 


For 


B20 
B22 
B23 
B24 


B26. 
B27 


k= 


B21. 


B25. 
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B19. Starting with the polynomial ax + bx? + cx?, obtain the form 


CoQo(X) + c1d1(x) + c2¢2 (x) appropriate for the boundary 
conditions y(0) = 0, y'(1) = a. Show that cp = a,c; = b, 
€; =c, and do = x, pı = x(x — 2), by = x(x? — 3). 


the BVP given in each of Exercises B20—27, repeat the steps used for 


Exercises B3-7, buttake y, = va Crd (x), the polynomial determined 
in Exercise B19, with o chosen in accordance with the given boundary 
conditions. For the Galerkin method, use the weighting functions w; and 
w» defined in Exercise B1(c). 


. 4y” — 12y' + 9y = cos x, y(0) = 0, y'(1) = 1 
9y" — 61y' + 42y = sin 2x, y(0) = 0, y'(1) = -1 
. y" +2y' + 10y = e, yO) 20, y'(1) 2 

. Ty” — 12y' — 4y = e7*, y(0) = 0, y'(1) = —2 

. 18y” + 17y' — 15y = 5, (0) = 0, y'(1) 23 

y" +2y' +2y =x, (0) = 0, y (1) = —3 

. 4y” + Ty’ +3y =x, y(0) 20, y'(1) =z 

. y" +4y’ + 29y 23—2x, y(0) = 0, y (1) = —1 


For the BVPs in each of Exercises B28—34, repeat the steps used in Exer- 
cises B20—27. However, this time, use y, = ox + XT c, (1 — cos kz x) 
where o is chosen in accordance with the given boundary conditions; 
for the Galerkin method, use the weighting functions w, = sin krx, 


1,2. 


B29. 
B30. 
B31. 
B32. 
B33. 
B34. 
B35. 


y" + By’ + 17y = xe*, y(0) 20, y'(1) = —2 

y" + 8y' + 32y = x sin zx, y(0) = 0, y'(1) 22 

y" -4y'-20y = x — e, y(0) 20, y' (1) = —3 

2y" — 9y' + Ty 22e, y(0) = 0, y (1) 23 

25y" + 10y’ — 24y = 2 + 3x — 5x?, y0) = 0, y'(1) = 4 

12y" +7y' + y = e? coszx, y(0) 20, y'(1) = —4 

Consider the nonlinear boundary value problem y" + (y)? + y? = 
sin x, y(0) = 0, y(1) = 1. 


(a) Using y, from Exercises B3-7, obtain the Rayleigh-Ritz 
approximation to the solution of the given BVP. Note that the 
equations for determining c; and c; are now quadratic. Show 
graphically that there are two solutions for the c; and, 
consequently, there are two Rayleigh-Ritz solutions. 


(b) Plot the two solutions found in part (a). 


(c) Use the shooting method to obtain the two solutions of this 
BVP. Plot the two numeric solutions, and compare them to the 
Rayleigh-Ritz solutions. 


(d) Using the weighting functions wą = sin krx, k = 1, 2, obtain 
the two Galerkin solutions and compare them to the numeric 
(shooting method) solutions. 


(e) Using collocation at two uniformly spaced nodes, obtain the 


B28. 8y" + 26y’ + 15y = 3x? — 5x, y(0) 20, y (1) 21 


two collocation solutions and compare them to the numeric 
(shooting method) solutions. 


| Finite Elements 


Introduction 


Historically, the approximation methods in Section 15.3 evolved into finite element methods, 
particularly important in solving boundary value problems involving partial differential 
equations. These methods are characterized by two features. First, the approximation is a 
linear combination of functions ¢; (x), typically splines (piecewise polynomials of sufficient 
smoothness), each having compact support. The support of a function is the set over which 
it is nonzero. Functions with compact support are nonzero on a closed finite interval. 

The way the residual is made “small” is the second characteristic of finite element 
methods. One finds the names Rayleigh-Ritz, Galerkin, and weighted residual in the finite 
element literature. For some classes of problems, the Rayleigh—Ritz and Galerkin methods 
lead to exactly the same solution and to confusion when the names of the methods are used 
interchangeably. We will use the names as detailed in Section 15.3. 

Thus, a finite element method is a Rayleigh-Ritz, Galerkin, or weighted-residual 
method where the approximating function is a linear combination of polynomial splines Ø% 
with compact support. When the functions $; are sufficiently differentiable, the method will 
be equivalent to the comparable method of Section 15.3. However, when the functions $; 
are not sufficiently differentiable to be substituted into the differential equation, the finite 
element method generates a weak solution, to be described. 

The term finite element itself is elusive. For example, [7] identifies the finite element 
with a subregion of the domain over which the differential equation is solved, but [47] 
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gives a more elaborate definition. The finite element is a triple consisting of a subregion, a 
collection of functions defined on the subregion, and a set of nodal values for the unknown 
and its relevant derivatives. In our examples where the finite element method will be applied 
just to ODEs, the subregions are subintervals along the real axis and the functions defined on 
these subintervals are the polynomials from which we construct the approximating splines. 


Formulating the BVP 


d 


Let L = ao(x) d + a\(x)= + a(x) represent the operations performed on y(x) in the 


dx 
differential equation 


L[yQ)] = aoQ)y" + ai()y' + a)y = f (x) (15.18) 
To change the BVP defined by (15.18) and the nonhomogeneous boundary conditions 
yaj=a yb)=8 (15.19) 


into a BVP with homogeneous boundary conditions, choose any function u(x) satisfying 
u(a) = a, u(b) = f, define g(x) = f(x) — L[u(x)], and let Y (x) be the solution of the 
BVP 


L[Y(x)] = g(x) and Y(a)=Y(b) =0 
Then, y(x) = Y (x) + u(x) satisfies the nonhomogeneous conditions (15.19) because 
y(a)=O0+a=a and y(b)=0+f8=8 
Moreover, y(x) satisfies (15.18) because 
L[y(x)] = LIY (x) + u(x)] = LIY )] + L[u@)] 
= g(x) + L[u(x)] = f(x) — L[uQ)] + L[u(x)] = f (x) 


To convert the BVP of Example 15.9, Section 15.3, to one with homogeneous boundary 
conditions, write its differential equation as 


y" (x) + 2y'(x) + 10y(x) = sin x 


define f(x) = sin x, and set u(x) = x. Then, g(x) = sin x — 2 — 10x, and the differential 
equation with homogeneous boundary conditions that we will solve by finite elements is 
L[Y (x)] = g(x) or 


Y"(x) + 2Y'(x) + 10Y (x) = sinx — 2 — 10x 


Strong Solution 


A classical (or strong) solution of a differential equation is one that satisfies the differen- 
tial equation pointwise. This means the solution is sufficiently differentiable so that when 
substituted into the equation, an identity results at each point in the relevant domain. Such 
solutions are precisely what we have been discussing to this point in the text. By contrast, 
we will shortly find weak solutions that do not satisfy the differential equation pointwise. 
The difference is necessitated by a choice of basis functions $; (x) from which to build an 
approximate solution. 

First, we pick basis functions $;(x) having compact support and second derivatives. 
From such basis functions we can construct a classical (or strong) solution. After that, we 
will pick basis functions that do not possess two derivatives and will have to accept weak 
solutions as a result. In each case, our basis functions will be B-splines, special piecewise 
polynomial functions with compact support. 
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FIGURE 15.15 Cubic B-spline on 
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t 
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FIGURE 15.16 First derivative (a) and 
second derivative (5) of the cubic B-spline 
in Figure 15.15 


Cusic B-Spiines_ A carpenter thinks of a spline as a strip of wood inserted into grooves 
in each of two pieces of wood whose joining is strengthened by the insertion. A draftsman 
thinks of a spline as a thin, flexible rod that can be bent into the shape of curves to be drawn. 
A numerical analyst thinks of a spline as a piecewise smooth polynomial. For example, a 
cubic spline is a collection of cubics defined on contiguous subintervals of the real axis 
and joined so that the resulting curve has a continuous second derivative. Such splines are 
discussed at length in Section 40.4. 

A cubic B-spline is a cubic spline that is nonzero on a prescribed finite interval. The 
letter “B” designates “basis,” and the cubic B-splines are used as a collection of basis 
or building-block functions when approximating solutions of differential equations. The 
following piecewise cubic polynomial is an example of a cubic B-spline of subinterval 
width h = i 


" 
0 X x 
4 " Jor 125.58 , 2 qm 
3 t 10x + 25x Tu; 5; 23 <m 
2 25.3 
2 — 25x? — 1g -i<x<0 
B= j i j 
2. 46,2 , 125,3 1 
q = 25%" + x 0 Ke 
4 ; 2... 125,3 1 pag Bi 
3 — 10x + 25x -FX Puget 
Do] 
A uw 
0 = íx 


Four distinct cubic polynomials, defined on four separate but contiguous subintervals, are 
joined together to form a function that is twice differentiable, as shown in Figure 15.15. The 
domain of this B-spline is the interval [-2, 2], and the endpoints of the subintervals over 
which the cubic polynomials are defined are -i, -i 0, d 2. The values of the spline at 
these endpoints are 0, B Z, H, 0. (The reader is cautioned that not all texts define the cubic 
B-spline the same. Some texts adopt a normalization that renders this sequence of values 
as 0, 1, 4, 1, 0.) 

The smoothness of the cubic B-spline can be seen from the graphs of the first and 
second derivatives shown in Figure 15.16. The cubic B-spline is therefore a piecewise- 
continuous function which is zero outside a closed and finite interval and which has a 
continuous second derivative. By translating and scaling such functions, we obtain a basis 
(64) of twice-differentiable functions which are zero outside the closed finite intervals that 
are their domains. 

The B-spline is nonzero over an interval of length 4h, where h is the length of each 
subinterval over which one of the four cubic polynomials in the B-spline is defined. To 


illustrate the finite element technique, we will pick n — i as the number of B-splines to 


use in the approximation. If we take h = i, we will need all appropriate B-splines that are 


nonzero over the interval [0, 1]. Thus, we define, forn = 5, the eight B-splinesb;, j = —1, 0, 
1,...,6, whose graphs are shown in Figure 15.17. For those who find it difficult to keep 


track of each separate B-spline, we graph each one individually and also all at once. 
There are eight cubic B-splines that are nonzero somewhere in the interval [0, 1] if 
h = 1. We next demonstrate that these functions can, indeed, be the basis of a representation 
of the form h (x)= Ys Cy b, (x) for the exact solution of the BVP. Eight equations for the 
eight coefficients cg, k = —1, 1,0, ..., 6, are obtained by collocating at eight equispaced 
points in the interval [0, 1]. If y4(x) is the exact solution of the BVP of Example 15.9, 


Section 15.3, the eight equations Ah (xy) — ya (xz) = 0, x; = E, k = 1,...,8, written as 
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FIGURE 15.17 The eight cubic B-splines with support of length E and which are nonzero somewhere in [0, 1] 


0.1666666667c_; + 0.6666666667c, + 0.1666666667c, = 0 


389 


0.008789062500c_; + 0.3981119792co + 0.5524088542c; + 0.04069010417c. = 5.813154399 
0.07031250000cp + 0.6119791667c, + 0.3151041667c2 + 0.002604166667c3 = 9.548911635 
0.0003255208333cp + 0.2360026042c, + 0.6520182292c; + 0.1116536458c; = 11.15867842 

0.02083333333c, + 0.4791666667c2 + 0.4791666667c3 + 0.02083333333c4 = 10.89467103 
0.1116536458c2 + 0.6520182292c3 + 0.2360026042c, + 0.0003255208333c5 = 9.208933635 
0.002604166667c; + 0.3151041667c3 + 0.6119791667c4 + 0.07031250000c5 = 6.647426235 
0.04069010417c3 + 0.5524088542c, + 0.3981119792c5 + 0.008789062500cg = 3.754726150 


0 1 


FIGURE 15.18 Exact solution (solid) of 
Example 15.9 and its B-spline 
approximation (dotted) 


FIGURE 15.19 Adjusted B-splines 
B,,k = 0,1, 4,5 
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have solution 
Cc. = —12.37483789 
co = 0.7748798126 


cı = 9.275318644 
c2 = 12.03389744 


c3 = 10.05884153 cs = 0.8341753103 
C4 = 5.535894545 cg = —5.090589006 


so a graph of the resulting approximation (dotted curve) and the exact solution (solid curve) 
is shown in Figure 15.18, establishing that an extremely accurate approximation of the exact 
solution can be constructed from these cubic B-splines. 


THE ADJUSTED SPLINE BAsıs We are particularly concerned with the leftmost and right- 
most B-splines, since these are not zero at the endpoints of the interval. The homogeneous 
boundary conditions we assumed dictate the need for picking a set of B-splines that satisfy 
the homogeneous endpoint conditons of our BVP. Hence, we write the following linear 
combinations By = bg — 4b. 4, Bı = bg — Abi, B4 = bs — 4b4, and Bs = bs — Abg, which 
will reduce the number of basis splines to six from eight. The graphs of these four new basis 
functions are shown in Figure 15.19. 

The remaining two B-splines are renamed as By = b; and B3 = b; so that we have 
a uniformly designated set of basis elements Bo, B),..., Bs. Anticipating the inclusion 
of some matrix notation in our solution, we realize that a better choice of indexing would 
bel, 2; 0005 6 instead of 0, 1,...,5, since most computer languages do not support matix 
elements indexed with zero indices. Thus, we again rename the basis elements, this time 
calling them S|, $5. ..., So instead of Bo, B1,..., Bs. 


FINITE ELEMENT SOLUTION According to the nomenclature of Section 15.3, the following 
computations constitute a Rayleigh—Ritz method for approximating the solution of a bound- 
ary value problem. In the spirit of that section we seek to solve the differential equation 
L|Y (x)] = g(x) by writing the solution in the form Y (x) = De Ck S, (x), which leads to 
ESS ce S, (x)] = D ck L[Sy(x)] = g(x) as a form of the residual. Then, minimiz- 
ing the integral of the square of the residual leads to the orthogonality conditions of the 
Rayleigh-Ritz algorithm, namely, 


1 6 6 1 l 
Í iL [Zas] S,(x) dx =Y c f L[S$;(x)]$;(x) dx = i S)(x)g(x) dx 
0 k=l = 0 0 


The numbers f L[Si(x)]S; (x) dx constitute the 6 x 6 matrix 


—3.1365079 4.2809524 0.73492063 0.039285714 0 0 
1.32539682  —46.012698 —0.77619048 — —3.5289683 0.62857143 0 
rw 1.0238095 —5.9095238 | —2.3746032 0.41706349 —3.5289683 0.039285715 
m 0.044841270 | —4.7678571 1.7781746 —2.3746032 —0.77619048 0.73492063 
0 0.71746032  —4.7678571 —5.9095238 —46.012698 4.2809524 
0 0 0.044841270 1.0238095 1.3253968 3.1365079 
and the six integrals [^ S; (x)g(x) dx constitute the vector G on the left in 
—0.2053713398 3.040147671 
2.703416259 —2.268660776 
—1.122634001 11.63588707 
G= C= (15.20) 


—1.487822107 
6.017227144 
—0.6687257465 


9.456015632 
—1.186172705 
0.9556239255 
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FIGURE 15.20 Exact solution (solid) and 
finite-element solution (dotted) of Example 
15.9 
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FIGURE 15.21  Degree-one B-spline of 
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Careful inspection of the left-hand side reveals the sum yi cy Ax; is a sum on k, the 
row-index of the matrix A. To interpret the numbers c; as members of a column vector C, 
we would need to write the equations as ATC = G, where AT is the transpose of A, the 
matrix obtained from A by making the ith row of A become the ith column of AT. 

Hence, the solution for the vector C is given on the right in (15.20) and y(x) — 
j^ Cy S, (x) = C* S, where S is the vector of basis functions $;,..., Ss. A graph of the 
solution y(x) = Y (x) + u(x) (dotted) compared to the graph of the exact solution (solid) 
is given in Figure 15.20. It is gratifying to see how remarkably accurate the finite element 
solution actually is! The two curves are indistinguishable. 


Weak Solution 


Splines formed from piecewise-linear polynomials are also used in finite element methods. 
However, as we shall shortly see, such B-splines do not possess two derivatives and, hence, 
cannot be used for the pointwise approximation of solutions to second-order differential 
equations. The simplicity of the linear B-spline will require introducing the notion of the 
weak solution. 


PIECEWISE-LINEAR SPLINES The degree-one B-spline is a piecewise-linear function that 
consists of two linear functions defined on intervals of length / and is nonzero on an interval 
of length 2h. For example, such a spline would be 


0 t «—z4 
1+5t -—i 
] — 5t 0t « 
0 ict 


which is graphed in Figure 15.21. With n = 5 so thath = + = 1 as with the cubic B-splines 
above, there are six piecewise-linear splines bg, k = 0,...,5, whose values are nonzero 
somewhere on the interval [0, 1]. They are graphed in Figure 15.22. 

We again demonstrate that a linear combination of such B-splines can represent an 
arbitrary function and, in particular, yA(x) from Section 15.3. Thus, we form the sum 
A(x) = Fe cxb;(x) and then use collocation at equispaced points to generate the six 
equations 


c0 —0  05,—11.24351066 20 c4 -— 5.501487521 = 0 
c; —11.24351066 20 c3 — 9.634145453 = 0 e5—1290 


There is an obvious and immediate solution leading to Figure 15.23, where a graph of 
the resulting approximation (dotted) along with the graph of y4(x) (solid) show that the 
piecewise-linear B-splines produce a piecewise-linear approximation! 

More important, we realize from the values cy = 0, cs = 1 that these two basis elements 
are not needed for the approximation of a function satisfying homogeneous endpoint data. 
Consequently, for the solution of a BVP with homogeneous endpoint conditions, since the 
first and last linear B-splines do not vanish at the endpoints, we take as the basis elements 
of our piecewise-linear approximation just the four splines with support completely within 
the interval [0, 1]. In fact, these splines are shown in Figure 15.24. 


GENERATING THE WEAK SoxuTion If we follow the Rayleigh-Ritz procedure with a 
piecewise-linear approximation, we will have to take second derivatives of each of the 
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FIGURE 15.22 The six linear B-splines with support of length i and which are nonzero somewhere in [0, 1] 
y B 
m d 
10 EnO Y 
F +> x i 
0 1 0 02 04 06 08 1 
FIGURE 15.23 Exact solution y4(x) FIGURE 15.24 Linear B-splines which 
(solid) and its approximation by linear are nonzero somewhere in [0, 1] 


B-splines (dotted) 


piecewise-linear B-splines. Recall that the Rayleigh- Ritz algorithm would have us compute 
the numbers Ps L[bx (x) ]b; (x) dx. In particular, what happens when we try to compute the 


] ; 
term f, bbz dx? Since 


undefined t=O 
undefined ft = i 
b, = 5 
undefined t= 4 


0 else 
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FIGURE 15.25 Exact solution y,(x) 
(solid) and weak linear B-spline solution 
(dotted) for Example 15.9 
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the integral will vanish. To avoid this outcome, we integrate each such term by parts, 
shifting one derivative off the factor b; and onto the factor b;. Thus, [^ bib; dx = b;bi |} — 
jo 49, ds — 5. 

Finally, we remind the reader that because the piecewise-linear approximation we are 
developing cannot be differentiated twice, it is not a pointwise (classical) solution. It will 
be the weak solution we are about to obtain. 


FINITE ELEMENT SOLUTION Weare ready to implement the final stage of the finite element 
version of the weak solution for the problem L[y(x)] = f(x), y(0) = 0, y(1) = 1. Set 
u(x) = x and g(x) = f(x) — 2 — 10x. Then solve L[Y (x)] = g(x), Y(0) = Y(1) = 0, 
after which y(x) = Y (x) + u(x) is obtained. Writing Y = S ud cxby, LIY (x)] = g(x) 
becomes B L[Y (x)]b; dx = [^ gb; dx or 


4 1 l 
Laf (b! + 2b; + 10bj)b; dx = f gb; dx 
= 0 0 | 
Integrate by parts in the second derivative term, obtaining 
4 1 1 
M» i (—b;b'; +2b,b; + 10b;bj)dx = Í gb; dx 
= 0 0 


Define the matrix A;; = f (—b,b' + 2b,b; + 10b;b;) dx, which evaluates to the array on 
the left in 


-% B 0 0 —$ + 10sin i —5Ssin2 
19 26 413 6 WE " " 
uw ocu cu 0 —$ —5sin; + 10sin = — 5sinz 
Agel! * L Lx w| F9] 2 . 2. i| B 
Q FF = —$3 — 5sin á + 10 sing — 5sin $ 
0 0 #2 -% —2 — 5sin 2 + 10sin $ — 5sinl 


The simplicity of the banded nature of this coefficient matrix is a strong reason why the theo- 
retical entanglements of the weak solution are tolerated. That observation not withstanding, 
obtain F, on the right in (15.21), as the vector of values for [4 gb; dx, the right-hand side 
of the equation. 
As noted in the case of the cubic B-spline solution, we now have the matrix equation 

ATC =F, the solution of which is, in floating-point form, 

6.932757137 

9.366867891 

7.897136620 

4.162838280 


and y(x) = Y (x) + u(x) would be C - B + x, where B is the vector of B-splines bi, ..., b4. 
A graph of the exact solution (solid) and the weak solution (dotted) appears in Figure 15.25. 


C= 


A]. Verify the entries in the matrix A on the left in (15.21). 
A2. Obtain bz, k = 1, 2, the two linear B-splines with h = 1 and 


support completely in the interval [0, 1]. 


A3. If by, k = 1,2, are as defined in Exercise A2, show that 
fo —bib, dx —3. 
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A4. If L — 5 + 24 + 10 and b, k = 1, 2, are as defined in Exercise 
A2, obtain the 2 x 2 matrix A whose entries are given by A;; = 


Jy Libklb; dx = fo (—b;b', + 2b;b; + 10b,b;) dx. 


A5. Obtain the vector F whose entries are given by l^ g(x)b; dx, 
where g(x) — sinx — 2 — 10x. 


EXERCISES 15.4—Part B 


A6. From Exercises A4 and A5, obtain the vector C, the solution of 
ATC — F. 

AT. If cy, k = 1,2, are the components of C obtain Y = cb; + cob» 
and y(x) = Y + x. Graph y(x) and y4 (x), the exact solution of 
(15.8), on the same set of axes. (See also, Example 15.9.) 


Bl. Letn = 4 and h = I and obtain bj, k = —1,..., 5, the seven 
cubic B-splines that are nonzero somewhere in the interval [0, 1]. 

B2. Form the adjusted B-splines Bo = bo — 4b—1, Bı = bo — 4b;, 
B5 = by — 4b3, By = b4 — Abs. Let B; = b>. Then renumber 
Bik =O) navy 4,as S,k=1,..., SP 

B3. Compute A;; — h L[S;]S; dx, the entries of the 5 x 5 matrix A, 
if L is as given in Exercise A4. 

B4. Compute G; = fy g(x)S;dx,k=1,..., 5, the entries of the 
vector G, if g(x) is as given in Exercise A5. 

B5. Obtain C, the solution of the system ATC = G. 


B6. If cj, k = 1, ..., 5, are the components of C, obtain Y — 
Ya c, $, and y(x) = Y + x. Graph y(x) and y4(x) on the same 
set of axes. 


For the BVP in each of Exercises B7-11: 


(a) Using a computer algebra system's built-in solver, a Green's 
function, or a general solution to which the boundary 
conditions have been applied, obtain the exact solution. 


(b) Taking as u(x) the lowest degree polynomial that works, 
convert to an equivalent BVP L[Y] = g, Y (a) = Y (b) = 0, 
where Y (x) = y(x) — u(x). 


(c) Obtain an n = 5 cubic B-spline approximation to y(x) by 
finding a strong solution to the BVP formed in part (b). 


(d) Graph the exact solution and the approximate solution found 
in part (c). 


(e) Obtain an n = 5 linear B-spline approximation to y(x) by 
finding a weak solution to the BVP formed in part (b). 


(f) Obtain an n = 10 linear B-spline approximation to y(x) by 
finding a weak solution to the BVP formed in part (b). 


(g) Graph the exact solution and the two approximate solutions 
found in parts (f ) and (g). 
B7. 8y" -21y' + 10y = x, (0) = —-1, y(1) 22 
B8. 9y” —52y' + 35y = 1 — x, y(0) = 1, y(2) = —3 
B9. y" +2y' -2y = x?, y(0) = —2, y(1) = 5 
B10. x?y" — 9xy' + 24y 22— x?, (1) 23, y(3) = —4 
B11. 14y" — 65y' + 9y = 3x + 32, (0) = 5, y(2) = -1 


B12. To solve a boundary value problem for which an endpoint 
condition is a derivative, the cubic B-spline basis and the function 
u(x) must be adjusted accordingly. For example, if the condition 


at the right endpoint is y’(b) = £, then define Y (x) = 

y(x) — u(x), where u(a) = «a but u/(b) = B. If n = 5 as in the 
example in the text, then By = bo — 4b_), Bı = bo — 4b), B2 = 
b», B3 = bz, By = b4 + be, Bs = bs. 


(a) Show that B;(1) = b,(1) + b¢(1) = 0 and that 
Bi) = b; (1) = 0. 
(b) Show that the boundary conditions y(a) = œ, y'(b) = B 
admit u(x) = fx + (a — Ba). 
For the BVP in each of Exercises B13-17: 


(a) Using a computer algebra system's built-in solver, a Green's 
function, or a general solution to which the boundary 
conditions have been applied, obtain the exact solution. 

(b) Taking u(x) as detailed in Exercise B12(b), convert the given 
BVP to the equivalent problem of the form L[Y] = g, 

Y (a) = Y'(b) = 0, where Y (t) = y(x) — u(x). 

(c) Obtain an n — 5 cubic B-spline approximation to y(x) by 
finding a strong solution to the BVP formed in part (b). Use a 
basis of cubic B-splines modified as per Exercise B12(a). 

(d) Graph the exact solution and the approximate solution found 
in part (c). 

B13. y" + 6y’+ 18y = e, y(0) = —5, y' (1) 22 

B14. 4y" — 8y/ — 45y = 1 + x —332, y(0) 2 7, y'(1) 22 
B15. x?y" + xy’ — 64y = x”, (1) 24, y'(3) = -1 

B16. y" + 6y’ + 25y = 1 — e*, y(0) = —1, y' (3 = 1 
B17. 7y” -20y' — 3y = x +e, y(0) = 1, y (1) 23 
B18. 


Rework Exercise B12 for a derivative condition at the left 
endpoint where instead of the boundary condition y(a) = o the 
condition y'(a) = « is imposed. 


For the BVP given in each of Exercises B19—23: 


(a) Using a computer algebra system's built-in solver, a Green's 
function, or a general solution to which the boundary 
conditions have been applied, obtain the exact solution. 


(b) Taking u(x) as detailed in Exercise B18(b), convert the given 
BVP to the equivalent problem of the form L[Y] = g, 
Y'(a) = Y(b) = 0, where Y(t) = y(x) — u(x). 


(c) Obtain an n — 5 cubic B-spline approximation to y(x) by 
finding a strong solution to the BVP formed in part (b). Use a 
basis of cubic B-splines modified as per Exercise B18(a). 


(d) Graph the exact solution and the approximate solution found 
in part (c). 

10y" —27y' — 81y =e, y'(0) = 2, (3) = 1 

x?y" + 10xy' + 14y 2 x7?, y'(1 = 8, y(3) =3 

56y" + 67y' + 20y = x sin x, y'(0) = —8, y(3) = —5 

y" + 10y' + 24y = x cos 2x, y'(0) = —3, y(2) = 1 

y" + 6y’ + 10y = 1 — cos 3x, y'(0) = 3, y(3) 21 

Rework Exercise B2 so as to combine the results of Exercises 

B12 and 18, obtaining an adjusted B-spline basis suitable for a 

BVP with derivative conditions at both ends. In particular, instead 

of the boundary conditions y(a) = a, y(b) = f, impose the 

conditions y'(a) = a, y'(b) = p. 


B19. 
B20. 
B21. 
B22. 
B23. 
B24. 


For the BVP given in each of Exercises B25—34: 


(a) Using a computer algebra system's built-in solver, a Green's 
function, or a general solution to which the boundary 
conditions have been applied, obtain the exact solution. 


(b) Taking u(x) as detailed in Exercise B24(b), convert the given 
BVP to the equivalent problem of the form L[Y] — g. 
Y'(a) = Y'(b) = 0, where Y (x) = y(x) — u(x). 


Chapter Review 


1. Give an example of a boundary value problem for a second-order 
ODE. Explain why, in general, it is reasonable to impose two 
conditions on the general solution of the second-order differential 
equation. 


2. Describe the process by which one might obtain the analytic 
solution to a BVP for a second-order ODE. 

3. Give an example of a BVP that does not have a solution. 

4. Give an example of a BVP for which the solution is not unique. 


5. Give an example that illustrates the claim that when the completely 
homogeneous BVP has multiple solutions, the inhomogeneous 
BVP has no solution. Show, in your example, where the solution 
process described in Question 2 breaks down. 

6. What is the difference between a regular and a singular BVP? 

7. Give examples of separated boundary conditions and periodic 
boundary conditions. 

8. Describe the essential idea behind the shooting method for 
numerically solving a BVP. Illustrate your discussion with an 
analytic example in which the numerical computations are replaced 
by algebraic calculations. 

9. Describe the finite-difference technique for solving a BVP. 
Illustrate your discussion with an example. 

10. Describe the least-squares technique for solving a BVP. Illustrate 
your discussion with an example. 


B25. 
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15.4 Finite Elements 


(c) Obtain an n = 5 cubic B-spline approximation to y(x) by 
finding a strong solution to the BVP formed in part (ii). Use a 
basis of cubic B-splines modified as per Exercise B24(a). 

(d) Graph the exact solution and the approximate solution found 
in part (c). 


y" +2y' +y =2x4+3sinx, y'(0) = —2, y'(1) 23 


B26. 24y" -85y' + 56y = xe? + 1, y(0) 22, y'(3) = -1 
B27. y" + 6y' + 10y = cos zx, y'(0) = —1, y'(2) 23 

B28. y" + 6y’ + 25y = 5, y(00 = 1, y/(3 25 

B29. 24y" + 50y' + 25y = xe* sin xx, y'(0) = —5, y''22 = 1 
B30. y" -2y' + 17y = 3x, y'(0 = 5, y' (1) = —2 

B31. x?y” — 2xy' — 28y = 14 3x, y' (1) 22, y/8) = -1 


B32. x?y" — 4xy' + 6y = x 2, y'(1 23, y'2) 21 
B33. x?y" + xy’ — 36y = 5x?, y (1) = —4, (3) 22 


B34. 


16. 


17. 


18. 


19. 


20. 


24y" — 10y' + y = sin x —2cosx, y'(0) 22, y'(1) = -1 


. Describe the Rayleigh-Ritz technique for solving a BVP. Illustrate 


your discussion with an example. 


. Describe the Galerkin technique for solving a BVP. Illustrate your 


discussion with an example. 


. Describe the collocation technique for solving a BVP. Illustrate 


your discussion with an example. 


. What is the unifying principle for the methods of Questions 10-13? 


. What are B-splines? Give examples of both linear and cubic 


B-splines. 

Describe how the linear B-splines are adjusted to form a basis 
conformable to representing a solution to a BVP posed on the 
interval [0, 1]. 

Describe how the cubic B-splines are adjusted to form a basis 
conformable to representing a solution to a BVP posed on the 
interval [0, 1]. 

Describe the process by which a finite element solution of a BVP is 
obtained with linear B-splines. Illustrate with an example. 

Describe the process by which a finite element solution of a BVP is 
obtained with cubic B-splines. Illustrate with an example. 


Describe the difference between a strong or classical solution of a 
BVP and a weak solution. Why will the use of linear B-splines 
necessarily lead to a weak solution? 
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Chapter 16 


The Eigenvalue Problem 


INTRODUCTION The eigenvalues of a differential equation are very often 
of great physical significance. In mechanics, the eigenvalues and eigenfunctions determine 
mode shapes and buckling modes for structures such as plates, beams, and columns. In 
physics, the eigenvalues determine energy levels for electrons in atoms and molecules. Thus, 
the determination of eigenvalues for a differential equation has an inherent importance. 

Unit Five details the method of separation of variables, the classical analytic technique 
for solving BVPs for partial differential equations. In this method, the PDE is reduced 
to several ODEs, one or more of which form an eigenvalue problem. Determining the 
eigenvalues and eigenvectors is then an essential step in solving the BVP for the partial 
differential equation. 

The regular Sturm—Liouville eigenvalue problem for ODEs generates an infinite se- 
quence of eigenvalues and a complete orthonormal set of associated eigenfunctions. The 
complete orthonormal set of eigenfunctions is an infinite “basis” for functions, much like 
{i, j, k} is a basis for vectors in three dimensions. 

Unfortunately, many of the interesting problems of engineering science and mathemat- 
ical physics lead to singular Sturm—Liouville problems. Two of the more important cases are 
Bessel's equation and Legendre's equation, each of which is studied in the chapter. Bessel's 
equation frequently arises when solving partial differential equations in cylindrical regions, 
and Legendre's equation generally arises when solving them in spherical domains. 

Of course, analytic techniques must be supplemented by numerical methods, and we 
demonstrate how to find a finite-difference solution of an eigenvalue problem. 


; Regular Sturm-Liouville Problems 


The Eigenvalue Problem for Differential Equations 


An eigenpair for a matrix A consists of a scalar A, called an eigenvalue, and a nonzero 
vector x, called an eigenvector, satisfying the equation Ax — Ax. Similarly, an eigenvalue 
problem can also be formulated for boundary value problems in differential equations. For 
example, 


y'(x) 2 Ay(x) and y(0) = y(L)20 (16.1) 
constitutes an eigenvalue problem on the interval 0 < x < L. A solution consists of a scalar 


^, called an eigenvalue, and a nonzero function y (x), called an eigenfunction, that satisfy 
(16.1). The parallel with the matrix eigenvalue problem is strengthened if the left-hand side 


EXAMPLE 16.1 
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of the DE in (16.1) is written as the operator A acting on y(x), where A — £. so that the 
differential equation becomes Ay — Ay. 

The differential equation is linear with constant coefficients. Hence, we will make an 
exponential guess, trying y(x) = e"* and obtaining the characteristic equation m? — A = 0. 
The characteristic roots are then +./2. We must distinguish between the case of repeated 
roots and distinct roots. If à = 0, the characteristic roots are 0,0 and the solution has a 
different form than in the distinct root case. 


The Case X = 0 


When A = 0, the solution is y(x) = 0 because the general solution is y = c; + cox, and 
application of the boundary conditions leads to the algebraic equations c; = 0 and c, + 
c2 L = 0, whose solution is c; = c? = 0. Hence, à = 0 is not an eigenvalue because the 
corresponding solution is just y(x) = 0. 


The Case X Æ 0 


When A Æ 0, the general solution of the differential equation is 
y(x) = cue + coe (16.2) 
Applying the boundary conditions, we obtain the equations 


VAL VAL —0 


ci +c =0 and cje + cee 


These are homogeneous equations, so the only solution is c; = c? = 0 unless the deter- 
minant of the coefficient array vanishes, that is, unless e VAL _ eval — Q, Equivalently, 


the first equation gives c? = —c;, so the second equation becomes c; (e ^^ — e~¥*“) = 0, 
from which we have eY^* — e~V*" = 0. This difference of exponentials inspires us to write 
gi Li _ e iMi AE 
: = sin —— =0 
2i i 
with xL real, from which we conclude xL -—nmnun-l3,usotbatas = -NE, n= 
1,2,..., as an infinite sequence of eigenvalues. The general solution, now in the form 

Yn (x) = eer + fg me (16.3) 

upon application of the left-point boundary condition, becomes 
-— - gix/L = g mL . nux . NTX 
ya (x) = aj, (eE — g7inmx/L) — ig, 2i = 2ia, sin y nm dj Sin "E 


nux 


so that y,(x) = a, sin "7^, n = 1,2,..., is the corresponding infinite sequence of eigen- 


functions. 
The reader should see a connection between the eigenfunctions and the Fourier sine 
series of Section 10.4. 


Additional Examples 


We next obtain solutions to several important eigenvalue problems often met in the appli- 
cations. We leave the details to the exercises. 


Consider the eigenvalue problem 
y"(x) — AyQ) and y'(0)— y'(L) =0 (16.4) 


When 4 = 0, the differential equation becomes y"(x) = 0, the general solution is y(x) = 
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EXAMPLE 16.2 


EXAMPLE 16.3 


a + bx, and application of the boundary conditions gives yo(x) = do as an eigenfunction. 
Thus, A = 0 is an eigenvalue! 
When A + 0, the general solution of the differential equation is again (16.2). The 


left-point boundary condition gives c; = c» and the right-point, c; (e^t — e^ ^L) = Q, 
from which we conclude A, = —"72-, n = 1,2, ...,asaniinfinite sequence of eigenvalues. 


The general solution, again in the form (16.3), upon application of the left-point boundary 
condition, becomes 


inzx/L —inzx/L i " 
; pow e +e nux nux 
yn (x) = ay (e "*/L 4 g7inm/L) = Je, 5 = 2a, cos uo An COS 
so that y, (x) = a, cos( =), n = 1,2,..., is the corresponding infinite sequence of eigen- 
Jn n E 
n . + 
functions. ~ 


Again, the reader should see a connection between these eigenfunctions and the Fourier 
cosine series from Section 10.4. 


Consider the eigenvalue problem 
y(-L) = y(L) 
y'(-L) = y'(L) 
The constraints on the right in (16.5), called the periodic boundary conditions, arise in 
problems where y (x) and y'(x) must be continuous when x = —L is identified with x = L. 
In particular, if x is the polar angle 0, then these boundary conditions impose smoothness 
across the negative x-axis. 

When 4. = 0 we again have the equation y"(x) = 0 and the general solution y(x) = 
cı + cx. The periodic boundary conditions give the equations 


y"(x) =Ay(x) and (16.5) 


c(—co)L—c(-4c coL and a= c 


from which we conclude c; = 0, A = 0 is an eigenvalue, and yo(x) = ao. 
When à Æ 0 we again have the general solution (16.2). The boundary conditions give 


(e^t — e ^ (e, +c.) =0 


from which we must conclude eV^- — e~¥*4 = 0. Hence, as before, A, = —22-,n = 
1.2, eon but now, starting with (16.2), we get 


P ET innzx/L —inzx/L 
ys (x) = aye" mL + Bye! 


NIX | . nZzux nax  , , NTX 
— 0, (cos "ET +isin —) + Bn (cos sx i sin =) 


L 
nx 0. . NIX 
= (o, + Bn) cos —— + 1(Qy d Bn) sin —— 
L L 
nax _ BAX 
= d, COS —— + b, sin —— 
L L 
. . . r . a >. 
For each nonzero eigenvalue, there are two eigenfunctions, cos “= and sin =. ld 


L L 


Once again we point out the obvious connection with the Fourier series from Section 
10.1. 


Consider the eigenvalue problem 


y"(x) =Ay(x) and y(0) = y(L)=0 (16.6) 
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which arises in Chapter 25 for heat transfer calculations where one end of a rod or uniform 
slab is held at temperature y = 0 and the other end is simply insulated. 

The case A = 0 reduces the differential equation to y"(x) = 0, which has the solution 
yo(x) = a + bx. The boundary conditions then give the equations a = 0 and bL = 0, so 
a = b = Q, yo(x) = 0, and A = 0 is not an eigenvalue. 

For the case à #0, the general solution of the differential equation is again given 
by (16.2). The left-point boundary condition gives c2 = —c ;, so the solution becomes 
y(x) = cie? — e^ Y^). The right-point boundary condition is applied to the deriva- 
tive, so we have the equation eY^L 4 e-Y^L = 0. The strategy in Example 16.1 now leads 


to cos VAL = 0, so VAL = Hg and àn = — (zx) ,n=1,2,.... (The phrase “odd 
half-multiples of z” is useful when seeking the zeros of the cosine function.) The corre- 
sponding eigenfunctions are then y, (x) = a, sin( 7H z), $ 
Sturm-Liouville Theory 
The regular Sturm-Liouville (or self-adjoint) boundary value problem consists of 

the finite interval [a, b]. 

the functions p, p’, q, w, all continuous on [a, b], with p and w positive on [a, b]. 

the differential equation 

(py) + (q-Aw)y =0 (16.7) 


4. the unmixed boundary conditions o, y(a) + o/2y'(a) = 0 and By y(b) + B5y'(b) = 0 
or the periodic boundary conditions y(a) — y'(a) = 0 and y(b) — y'(b) = 0 


For this important class of eigenvalue problems it can be proved [87] that there is an 
infinite sequence of real eigenvalues, with the corresponding eigenfunctions y; (x) satisfying 


b 
/ W(X) Vn (X) Vin x) dx =0 
a 

whenever n ~ m. Thus, the eigenfunctions are said to be orthogonal with respect to the 
weight function w(x). If the eigenfunctions are normalized so that 


b 
Í w(x)yz(x) dx =1 
a 
then the eigenfunctions are said to be orthonormal, that is, both orthogonal and normalized. 
For the separated boundary conditions as in (16.1), (16.4), and (16.6), the eigenspaces 
are one-dimensional. For each eigenvalue, there is but one eigenfunction. (An eigenspace 
consists of all constant multiples of this one eigenfunction.) For periodic boundary condi- 
tions as in (16.5), the eigenspace can have dimension greater than one. In Example 16.3, 


nax nax 


each eigenvalue A, = — (Ey has two independent eigenfunctions, cos ^7 and sin ^7. 

In either event, the eigenfunctions form an orthonormal basis for function space, much 
like the unit vectors i, j, and k form a basis for vectors in three-dimensional Cartesian space. 
For each such basis of eigenfunctions, we can expand functions in Fourier-type series. In 
fact, in each of Examples 16.1—16.3, sets of orthonormal eigenfunctions resulted, and the 
theorems of Sturm and Liouville guarantee that these sets are complete, that is, contain 
enough members that Fourier-type series built from them converge to the functions they 
represent. 
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The differential equation (16.7) is the eigenvalue equation for the formally self-adjoint 
operator defined by L[y(x)] = (pyy + qy. We briefly consider the formal adjoint for a 
differential equation and the idea of a self-adjoint operator. In a series of papers (1836-7), 
Charles Sturm (1803-1855) and Joseph Liouville (1809-1882) published many more than 
the results summarized here. The concepts of the adjoint operator, and self-adjointness, 
are deep, interesting, and more significant than the following cursory introduction might 
suggest. 


Tur ApyointT Given the differential operator 
2 


d d 
L — a(x) —— + b(x) — - c(x) 
dx? dx 


we define L*, its adjoint, as 


2 


- ; t Qa'(x) — sp S. + (a" (x) — b'(x) + c(x)) 
dx? dx 


and J (u, v), the bilinear concomitant (or conjunct) of u and v, as 


L* — a(x) 


J(u, v) = a(vu! — uv) + (b — a'")uv 


These definitions arise from Green's formula 
firm — uL*[v]] dx = J(u, v) (16.8) 
which is established by integrating f vL[u] dx by parts to obtain 


J vL[u] dx = { v(au" + bu’ + cu} dx 
= J v(au" + bu’ + cu} dx 
= { u((av)" — (bv) + cv} dx + a(vu' — uv) + uv(a — b’) 


= Í uL*[v] dx + J(u, v) 


We are particularly interested in the case where b = a’, since then, 


d d d " 

L=— (oF) tot +e=L (16.9) 
and J(u, v) simplifies to just a(vu' — uv’). The operator L is then called symmetric, or 
formally self-adjoint. 

With these results at hand, we can show two things. First, we can define the “self-adjoint 
boundary value problem.” Second, we can prove that the eigenfunctions from a self-adjoint 
eigenvalue problem are always orthogonal. 


SELF-ADJOINT BOUNDARY VALUE ProBLEMsS_ For the formally self-adjoint operator L, 
(16.9), Green's formula (16.8) for the interval wa < x < f becomes 


B 
Í (vL[u] — uL[v]} dx = J(u, v)(B) — J(u, v)(o) (16.10) 
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If both u and v satisfy the same boundary conditions and these boundary conditions cause 
the right side of (16.10) to vanish, then we will say the boundary value problem is self- 
adjoint. For example, the boundary conditions y(o) = y(f) = 0, if satisfied by both u and 
v, lead to a self-adjoint BVP, since J(u, v) = a(vu' — uv’) and 


J(u, v)(B) — J (u, v)(a@) = a(f)(v(B)u' — u(B)v’) — a(a)(v(o)u' — u(a)v)) = 0 


In fact, for both separated and periodic boundary conditions, J(u, v)(B) — J(u, v)(a) = 0, 
so that with these conditions, the formally self-adjoint operator L forms a self-adjoint BVP 
for which 


B 
f (vL[u] — uL[v]}dx = 0 (16.11) 


ORTHOGONALITY OF EIGENFUNCTIONS The symmetric operator (16.9), along with sepa- 
rated or periodic boundary conditions, form the eigenvalue problem L[y] + Awy = 0 for 
which there is a countably infinite set of eigenfunctions orthonormal with respect to the 
weight function w(x). The existence of these eigenfunctions is established in [87]. The 
orthogonality follows from (16.11). 

Let y,(x) and y,,(x) be eigenfunctions corresponding to the distinct eigenvalues A, 
and Àm, respectively, where Àn # Àm. Then the two differential equations 


Lily, |+A,wy, — 0 and L[y,] 4 Aj wy,, =0 


are identically satisfied. Multiply the first by y,, and the second by y,. Subtract the second 
equation from the first and integrate over a < x < P, obtaining 


B B 
0z J lyn L [y] = yaLIy,l) dx + 0,39) | WYn Ym dx 
The first integral on the right vanishes in light of (16.11), leaving 
B 
0= (An = Àm) / WYn Ym dx 
Since A, Z À, we must conclude that 0 = É WYn Ym dx, which establishes the orthogonal- 


ity, with respect to the weight function w(x), of eigenfunctions corresponding to different 
eigenvalues. 


EXERCISES 16.1—Part A 


. Supply the details for the eigenvalue problem solved in Example AS. If L[y] = 3y” + 4y’ + 5y, obtain the formal adjoint L* and the 


16.1. bilinear concomitant J(u, v) and then verify Green’s formula 
. Supply the details for the eigenvalue problem solved in Example (16.8). 

16.2. A6. Show that the only spring-mass systems my” + by’ + ky = 0 that 
. Supply the details for the eigenvalue problem solved in Example ae formally self-adjoint are those without damping. Hence, 

16.3. self-adjointness is lost in nonconservative systems. 


. Solve the eigenvalue problem defined by y” = Ay, 


y'(0) = y(L) ^ 0. 
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EXERCISES 16.1—Part B 


B1. The eigenvalues of y" — Ay = 0, y(0) + 3y'(0) = 0, 
y Gr) + 2y'(1) = 0 are solutions of a transcendental equation that 
must be solved numerically. 


(a) Obtain, for the case à Æ 0, a general solution of the 
differential equation. Following the examples in the text, this 
solution will be of the form (16.2). 


(b) Apply each boundary condition, resulting in two homogeneous 
algebraic equations in the two arbitrary constants o and £. 

(c) Write the two algebraic equations from part (b) in matrix 
form. Since the equations are homogeneous, the two arbitrary 
constants will be zero unless the determinant of the system 
matrix is zero. Thus, the condition that will determine the 
eigenvalues is obtained by setting the determinant of the 
system matrix to zero. 


(d) Use a graph to determine if there are real solutions for A. 


(e) Replace V/A with ij and again use a graph to determine if 
there are solutions for real ju. 


(f) Compute several solutions for either A or y numerically. From 
these solutions, obtain the corresponding eigenfunctions. If the 
eigenvalues arise from the case VA = ij, it might be simpler 
to rewrite the general solution in terms of trig functions rather 
than continue to wrestle with imaginary exponentials. This 
will lead to simpler real solutions for the eigenfunctions. 


(g) Determine if these several eigenfunctions are mutually 
orthogonal on the interval [0, zr]. 

(h) Graph the eigenfunctions found in part (f ). 

(i) Next, consider the case A = 0 (the repeated-root case), again 
obtaining a general solution of the differential equation and 
applying the boundary conditions. Determine if there are 
nonzero solutions to these equations. 


In Exercises B2-10, the differential equation y" — Ay = 0 and the given 
boundary conditions determine an eigenvalue problem. In each: 


(a) Obtain all eigenvalues and eigenfunctions. In some cases, the 
eigenvalues are solutions of transcendental equations and 
must be calculated numerically. 


(b) By brute-force integration, determine whether or not the 
eigenfunctions from different eigenvalues are orthogonal on 
the interval [0, x]. Compare your conclusions with the 
predictions of the Sturm-Liouville theory. 


(c) Graph two eigenfunctions, one from each of two different 
eigenvalues. 

(d) Determine if the eigenspaces are one-dimensional or not. 
Sturm-Liouville theory guarantees that separated boundary 
conditions generate one-dimensional eigenspaces. However, 
the boundary conditions in B9 and 10 are not separated. 


B2. y'(0) 2 y(x) 20 B3. y(0) 20, y'Gr) + y(1) «0 
B5. y'(0) 2 0, y'Gt) + y(t) 20 


B4. y'(0) + y0) = 0, y(1) 20 


B6. y'(0) + y(0) 20, y'(1) 20 
B7. y(0) + y'(0) = 0, y(t) + y'a) 20 
B8. y(0) + 2y/(0) = 0, y(r) 4-3y'(1) 20 
B9. y(0) + y'Gr) = 0, y'(0) + y60) = O 
B10. y(0) = y(x), y'(0) = y'r) 
B11. Show that the differential equation y" + y’ + Ay = 0 is not 
formally self-adjoint. 
In Exercises B12—23, the differential equation y" + y’ + Ay = 0 and the 
given boundary conditions determine an eigenvalue problem. For each: 


(a) Obtain all eigenvalues and eigenfunctions. In some cases, the 
eigenvalues are solutions of transcendental equations and 
must be calculated numerically. 


(b) By brute-force integration, determine whether or not the 
eigenfunctions from different eigenvalues are orthogonal on 
the interval [0, zz]. Compare your conclusions with the 
predictions of the Sturm-Liouville theory. 


(c) Graph two eigenfunctions, one from each of two different 
eigenvalues. 


(d) Determine if the eigenspaces are one-dimensional or not. 
B12. (0) 2 y(x3) 20 B13. y'(0) = y'(1) 20 
B14. y(0) = y'G) 20 B15. y(0) = y(x), y'(0) = y(x) 
B16. y'(0) = y(x) 20 B17. y(0) 20, y'G) + yr) 20 
B18. y'(0) + y(0) 20, y(1) 20 
B19. y'(0) = 0, y'Gr) 4- y(1) 20 
B20. y'(0) + y(0) 20, y'(1) 20 
B21. y(0) + y'(0) = 0, y(r) + y'Gr) 20 
B22. y(0) + 2y'(0) = 0, y(r) -3y'(1) 20 
B23. y(0) + y'Gr) —0, y'(0) + y(x) «0 


The differential equations given in each of Exercises B24—38 determine 
an operator L. For each: 


(a) Obtain L*, the adjoint differential operator, and J(u, v), the 
bilinear concomitant. 

(b) Determine if the operator is formally self-adjoint. 

(c) Evaluate J(u, v) 5 = J(u, v)Gr) — J(u, v)(0). 

(d) Apply the separated boundary conditions of Exercise B12 to 
both u and v in J(u, v) XZ . 

(e) Apply the separated boundary conditions of Exercise B13 to 
both u and v in J(u, v) [15 . 

(f) Apply the separated boundary conditions of Exercise B14 to 
both u and v in J(u, v) XZ - 

(g) Apply the separated boundary conditions of Exercise B17 to 
both u and v in J(u, v) XZ . 
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(h) Apply the separated boundary conditions of Exercise B21 to B30. cosx)y" + xy’ +y=0  B3L ey" +x’ y'—-y=0 


both u and v in J(u, v) |; = 


B32. 3y" + 2xy'+5y=0 B33. y" - 2xy' -3y =0 


(i) Apply the periodic boundary conditions of Exercise B15 to B34. (1—x2)y" -xy'2-9y 20 B35. x? (1 — 3) y" +3xy' —4y 20 


both u and v in J(u, v) [175 
B24. x?y" + 3xy’ —5y 20 
e xy" y -x?y =0 


B25. 4y" + 2y’+7y 20 B37 
B27. xy" -2y' -xy 20 B38 


B36. 2xy" — 3(1 — x?)y +e*y 20 
. xy" (1 —x)y' 4 6y 20 


. sin(x)y" + cos(x)y' +e*y 20 


«y" t eyl'-2y =0 


2xy' -3y 20 


Bessel’s Equation 


Bessel’s Equation of Order v 
The differential equation 
x?y" (x) + xy’ (x) + (x? — v?)y(x) = 0 (16.12) 


known as Bessel’s equation of order v, occurs often in the applications. It typically arises 
in problems formulated in cylindrical coordinates. 

The equation has variable coefficients, and its solutions cannot be given in terms of 
elementary functions. In fact, the solutions must be given as series. However, these series 
solutions occur so often that they have become “named functions.” This equation, then, is 
the first instance of a new function being defined by the differential equation it satisfies. 
This is far from the exception and often a surprise for students whose experience is with 
just the elementary functions of the calculus. 

In general, the “special functions” of engineering, science, and applied mathematics are 
defined as solutions of a differential equation. In addition to the hypergeometric function, we 
mention the orthogonal polynomials of Legendre, Hermite, Laguerre, Jacobi, Gegenbauer, 
Bernoulli, and Chebyshev and the functions named after Bessel, Legendre, Airy, Mathieu, 
Hankel, Struve, Kelvin, and Weber. Details of these and other special functions can be found 
in [1]. 

Preparing for a series solution of Bessel’s equation, we notice that x = 0 is a regular 
singular point. For v not an integer, there are two nonlogarithmic solutions; otherwise, the 
two solutions are generalized power series. (See Section 14.1.) Following [1], when v is 
not an integer, we take the two linearly independent solutions of Bessel’s equation as J, (x) 
and J_,,(x), Bessel functions of the first kind, where 


. xA (4) 
J(x) = (3) È, KIT (v +k +1) 


" — k-0 


We remind the reader (see (6.5), Section 6.2) that the gamma function, generalizing the 
factorial function, satisfies the recursion T(z + 1) = zI (z). Hence, if z is the integer n, 
then I'(z + 1) =n. 
The Bessel function of the second kind is defined by 
J (x) cos (vir) — J_, (x) 
sin(vzt ) 


YQ) = 


If v is the integer n, the two linearly independent solutions of Bessel’s equation are taken as 
Jn(x) and Y,,(x) = lim,-., Y, (x). The limiting process generates the expected logarithmic 
term, but the reader is referred to [1] for the results. Examples of series expansions of Bessel 
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-0.2 + 


-0.4+ 


FIGURE 16.1 The Bessel functions 
Jk(x), k = 0, 1,2 


n=0 n=1 n=2 


FIGURE 16.2 Bessel functions of the 
second kind, Y;(x),k = 0, 1,2 


x 


functions are 


1 2 1 4 1 6 8 10 
Ur NND x5 + OG 
8" — 96° t372  184:0^ TOC? 


4 5, 1 1 x 3 
Yx(x) = ——x ^—— + (n : Fy-— je + O(x^) 
T m An 


Jo(x) = 


5 4 


In the expansion for Y>(x) we see the appearance of the logarithm. We also see Euler's 
constant, 


n 
: 1 . 
y = lim (È ;) — ln n| = 0.5772156649 

More interesting are the graphs of the Bessel functions J,(x),n = 0, 1,2, seen in 
Figure 16.1, illustrating that Jo(0) = 1 but, for n 4 0, J (0) = 0. The oscillations are not 
periodic, but for large x, the asymptotic relation 


2 nu T cd 
I(x) = JZ os (x J 7) +0 (Ix ) 


reveals that Bessel functions of the first kind eventually resemble phase-shifted cosines 
enveloped by a multiple of i 

Figure 16.2 shows graphs of Y,(x), n = 0, 1, 2, indicating that these functions also 
oscillate; but in addition, they are all unbounded at the origin. For large x, they have the 
asymptotic representation 


Xo ka nz m m 
1o = | 2 sin(x 5 1) * 9 (il ) 


By manipulating the full power series representations of 


oo (—1)*x2* oo (1t et 
J = Aa d J =— "Re a 
i 3 aqu 5 Ae. 2 FEDE 1) 
it is possible to establish the relation — = —J,. An example of a Bessel function of 


fractional order is 
2 (—1) x24 1/3 


3 oco 
A 59/3 
"pi = 7 var (3) 4k (3), k! 


k=0 


T(z+a) 
r(z) 


where (z)a = is called the Pochhammer symbol. 


An Eigenvalue Problem 


In Section 16.1 we defined the regular Sturm-Liouville boundary value problem as one 
with a formally self-adjoint differential equation 


(py) + (q+aw)y 20 


where p and w are positive on the interval over which the equation is being solved. The 
self-adjoint form of (16.12), the Bessel equation, appears if it is divided by x, resulting in 


j i y(x)v? 
xy (x) + y (x) + xy(x) — =0 


d. 
dx 


Clearly, the first two terms can be written as [x e ], so p(x) = x. Restricting the equation 


to the case v = 0 and the interval to [0, c] for c finite, we see that p(x) is not positive on 


FIGURE 16.3 Zeros of Jo(214) 


FIGURE 16.4 The eigenfunctions 
R,(r) = Jo(pr), k=1,2,3 


FIGURE 16.5 Comparison of Jo (24) 
(solid) and cos(2u — 7) (dotted) 
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[0, c]. Hence a boundary value problem for the equation 
xy" (x) + y'(x) 4- xy(x) 20 (16.13) 


on this interval is not regular and is called singular. In place of a boundary condition at x = 0, 
we impose the physically based requirement of boundedness. The general solution of (16.13) 
is y(x) = ci Jo(x) + czYo(x), a linear combination of Jo(x) and Yo(x). Remembering that 
Jo(0) = 1 but Yo(x) is unbounded at x = 0, we conclude that c; = 0, making the solution 
a multiple of just Jo(x). 

The typical appearance of Bessel's equation in applications arising from cylindrical 
coordinates has the form 


1 B 
R'(r) + - R'(r) + u R(r) 0 (16.14) 
" 


where u? plays the role of A in the eigenvalue problem. The singular Sturm-Liouville 
boundary value problem for (16.14) on the finite interval [0, c] simply has the conditions that 
R(r) be bounded and R(c) = 0. Traditionally, the equation in R(r) is explicitly converted 
to Bessel's equation by the change of variables x = ur. Then, R(r) = RD) = y(x) and 
y(x) satisfies the equation 


py" (x) + FEL + p’y(x) =0 


which we recognize as Bessel's equation (16.13) as soon as we “divide out" the factor u? 
and multiply through by x. 

Under the boundedness requirement, the solution of (16.13) is y(x) = C Jo(x) for some 
constant C, so can write R(r) = y(x) = y(ur) = CJo(ur) as the solution of (16.14). To 
apply the boundary condition R(c) = 0, we take the specific example c = 2 and solve 
the equation R(2) = Jo(2u) = 0 for u. In fact, any value of u satisfying the equation 
Jo(2j) = Ois an eigenvalue for this singular BVP. In essence, the eigenvalues are the zeros 
of the Bessel function Jo(2x), and these zeros can be seen from the graph in Figure 16.3. The 
first three eigenvalues are m, = 1.202412779, m; = 2.760039055, andm3 = 4.326863956. 

The corresponding eigenfunctions are then R;y(r) = Jo(ugr), plotted in Figure 16.4. 
For students with experience only with sines and cosines as eigenfunctions, the graph of 
the eigenfunctions is useful, if not essential. Each eigenfunction has one more oscillation 
than its predecessor, and between a pair of zeros of an eigenfunction there is a zero of the 
next eigenfunction. These are some of the observations proved by Sturm and Liouville as 
general properties of self-adjoint BVPs. 


ORTHOGONALITY OF THE EIGENFUNCTIONS ‘The eigenfunctions Ry(r) = Jo(pur), where 
[4x is the kth zero of Jo(cx), are orthogonal with respect to the weight function w(r) = r. 
We can establish this by appeal to the general Sturm-Liouville theory from Section 16.1 or 
directly from the identity 


Í r Jo(ar) Jo(br) dr = 5 (aJo(eb) (ca) — bJo(ca) Ji(cb)) (16.15) 
0 G—p- 


If a and b are distinct zeros of Jo(cr), then the right side of (16.15) vanishes, thus establish- 
ing the orthogonality of the eigenfunctions of (16.14). 


ADDITIONAL EIGENVALUES Finally, we seek an efficient algorithm for computing at least 
the first 10 eigenvalues. Realizing that the zeros of Jo(2j) rapidly approach the zeros 
of cos(2u — 7), we compare these two functions in Figure 16.5. Almost immediately, 


x ix M. A= us the zeros of cos(2u — 7), the dotted curve, are good 
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approximations of the zeros of Jo (244), the solid curve. With this insight and an appropriate 


ft, = 1.202412779 computer program, the first 10 eigenvalues, listed in Table 16.1, are easily computed. 
H2 = 2.760039055 
[3 = 4.326863956 A FOURIER-BESSEL SERIES Sturm—Liouville theory tells us that the eigenfunctions of this 
[4 = 5.895767220 eigenvalue problem form a complete set, orthogonal with respect to the weight function 
us = 7.465458854 w(r) =r. Thus, the eigenfunctions are a basis and can be used to represent functions in a 
He = 9.035531984 Fourier—Bessel series, much like the Fourier-Legendre series of Section 10.7. So, a function 
H7 = 10.60581831 f(r) has the series representation f(r) = $ g; cxJo(pr), where the coefficients c; are 
us = 12.17623577 given by 
= 13.74673957 
bay 7 lice - i FF) Jo(uar) dr _ i rf (r) Jo(uer) dr (16.16) 
Jo rJe (Her) dr $ Jiu) 
TABLE 16.1 First ten zeros of Jy(211) The integral in the denominator on the left in (16.16) is evaluated to the closed form shown 


on the right using the identity 


2 


Í rJj(ar) dr = 5 Ud (ac) + J? (ac)) (16.17) 
0 


where a and c are any constants. In particular, if a = x, is a zero of Jo(cjz), then the first 
term on the right in (16.17) is zero, by definition. 

Taking c = 2 and f(r) = r(2 — r) and then numerically evaluating the integrals 
in the numerator of (16.16), the coefficients cg, k = 1,...,10, listed in Table 16.2, are 
readily obtained. Hence, a 10-term partial sum of the series expansion of f(r) is given by 
Fio = T Ck Jo(ugr). Figure 16.6 shows both f(r) and the partial sum Fjo. Except near 
r = 0 (because Jo(0) = 1), the agreement between the two curves is substantial. 


cı = 1.294011356 

c2 = —0.8338654470 
c3 = —0.03055067335 
c4 = —0.1534142976 
cs = —0.02137816209 TAIS 
ce = —0.06015106815 
€; = —0.01339750016 
cg = —0.03146792599 
co = —0.00902993004 


Cio = —0.01918084051 A mu TO 


> 


"sni S 
-N 


0 1 2 
TABLE 16.2  Fourier-Bessel FIGURE 16.6 The function 
coefficients for f(r) = rQ — r) (solid) and Fio, the 
F(r) =r2—r) partial sum of the Fourier-Bessel 


approximation (dotted) 


EXERCISES 16.2—Part A 


A1. Carry out the change of variables x = ur by which (16.14) A4. Obtain Jo(x) as the nonlogarithmic solution of (16.13), Bessel’s 
becomes (16.13). equation of order zero. 
A2. Show that x = 0 is a regular singular point of (16.12), Bessel’s AS. Evaluate the Pochhammer symbols (5), (3)4, and ( +), ; 


equation of order v. 


A3. Obtain the indicial equation and its roots for (16.12), Bessel's 
equation of order v. (See Section 14.1.) 


EXERCISES 16.2—Part B 
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B1. If p, is the kth zero of Jo(x), give empirical evidence that each of 
the following may indeed be correct. 


1 1] = 1 l 
(a) a ee (b) E Fae 

2, p 4 > pn 32 
Exercises B2-21 specify the BVP r R"(r) + R'(r) + ri R(r) = 0, 
R(c) = 0, R(0) < oo, by giving f(r) and c. For each: 

(a) Transform the differential equation into the standard form of 
Bessel’s equation x y" (x) + y'(x) + xy(x) = 0 by the change 
of variables r = £, R(r) = R( 2) = yx), thereby obtaining 
y(x) = Jo(x) so that R(r) = Jo(ur). 

(b) Obtain the first ten eigenvalues 4g, k = 1,..., 10. 

(c) Obtain and graph the first three eigenfunctions R,(r) = 
Jolugr), k = 1, 2, 3. 

(d) Verify that on 0 < r < c these three eigenfunctions are 
mutually orthogonal with respect to the weighting function 
wir) =r. 

(e) Obtain he | Ax Jour), the tenth partial sum of the 
Fourier-Bessel series of f(r), and graph it along with f(r). 
What is the effect on the approximation if f(0) Æ 1 or 
fe) #0? 


B2. f(r)=1-—,c=3 B3. f(r)=/F,c=4 


B4. f(r) = = BS. f(f)ee',c2-2 


1+r? 
B6. f(r) =re",c=3 B7. f(r) =cosr,c = 2x 


o 


3 Pi 
pee B9. f(r) 2 cos^r,c = 2x 


B8. f(r) = iam 


B10. f(r) = arctanr,c = 1 B11. f(r) =1—V2r.c = i 
1 Qril 
2 


0 Il<r< 


B12. f(r) 2rsinr,c— zx B13. f(r) = 


B14. f(r) = 


1 
; T 
sins Caray 
B17. f(r) = m ^ =x 
3 STE 
F O0zrc«l 
B18. f(r) = l ler s3.346£2:8 
39—r 2<r <3 


B19. f(r) 2|(r—D(3-r).c-4 B20. f(r) = |r—-1],c=2 
B21. f(r) = |sinr|,c = 2x 


In Exercises B22-27, make the indicated change of variables to bring the 
given equation into the form (16.12), from which a solution for w(z) can 
be given in terms of Bessel functions. 


5 v? — x 
B22. w"(z) + G = 4 | w(z) = 0; x = Az, w(z) = fo 


2 "ES 1 x 
B23. w"(z) + (5 zT ) w(z) =0;x =A./z, w(z) = y) 


WES 24 5 px Ur 

"(z Az” wz) = 0: x = = |z z) = | — (xX 

B24. w" (z) J- 34z??^w(z) = 0; x ( : ): , w(z) (5) y) 
2v -1 : EN 

B25. w"(z) — : - w'(z) + A*w(z) = 0; x = àz, w(z) = (z) y(x) 


B26. w"(z) + Q2e* — v?)w(z) 20; x = àe, w(z) = y(x) 

B27. zw'(z) + (1 — 2p)zw'(z) + Q2q?z* + p? — V? q?)w(z) = 0; 
x =dz!, w(z) = fe" y(x) In particular, consider the case 
p—2,q >4. 

B28. By evaluating at x = 1, 2, 3 and performing the appropriate 
numerical integration, give empirical evidence that the following 
formulas may indeed be correct. 


1 T 
(a) Jo(x) = JI cos(x sin 0) dé 
T 


0 


] n 
(b) Jo(x) = zf cos(x cos 0) d0 
- 


0 


(©) Jo(x) 2 d COS $X , 
c x)= — ds 
: m Jo V1—s? 


1 n 
(d) J,(x) — f cos(x sin 0 — n0) d0, for n = 1,2, and 3 
Lm 


0 
B29. By differentiating under the integral sign, show formally that the 
integral in 


(a) Exercise B28(a) is a solution of Bessel's equation of order 
Zero. 

(b) Exercise B28(b) is a solution of Bessel's equation of order 
Zero. 

(c) Exercise B28(c) is a solution of Bessel’s equation of order 
zero. 

B30. Show that if the integrands of the integrals in Exercise B28(a)-(c) 
are expanded in Maclaurin series at x = 0 and the results 
integrated termwise, the series for Jo(x) is obtained in each case. 

B31. For n = 2, show that if the integrand of the integral in Exercise 
B28(d) is expanded in a Maclaurin series at x = 0 and the result 
integrated termwise, the series for J, (x) is obtained. 

B32. Evaluating numerically at x — 1,3, 5, give empirical evidence 
that each of the following formulas may indeed be correct. 


oo 
(a) Jo(x) + 2 `, J(x) =l 


k=1 


(b) Jo(x) - 2 CD Jal) = cos x 


k=1 


B33. 


B34. 


B35. 


B36. 
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oo 
(c) 2 YOD Jun) = sinx 

k=0 
For v = 1, 3, 5 and x = 1.5, 3, 5.5, give empirical evidence that 
each of the following recurrence relations may indeed by correct. 


2v 
(a) naa) + Ju = FEL 
(b) Jy) — Joi (x) = 2) (x) 
(©) KO = 440) — 74) 


(d) J,(x) = au) + — =i, (x) 


It is asserted in [1, p. 369] - on the interval —3 <x <3, the 
polynomial f(x) = 1 — eec d y T 1. 2656208 (4 i= 
0.3163866 (2)° + 0.0444479 (3)* — 0.0039444 (1) ^ + 

0.0002100 6) d approximates Jo(x) with an error no worse than 
5 x 1075. Give empirical evidence of a numeric and graphical 
nature that this claim may indeed be correct. For example, plot the 
difference between f (x) and Jo (x) and determine the maximum 
value of this difference. 

It is asserted in [1, p. 369] that if i= = 0.79788456 — 

0.00000077 (2) — 0.00552740 (3 y — 0.00009512 (2 y + 
0.00137237 (3)* — 0.00072805 (3)* + 0.00014476 (2)°, and 

Oo = x — 0.78539816 — 0.04166397(2) — 0.00003954 Cy + 


0.00262573 (2)? — 0.00054125 (2)* — 0.00029333 (2)° + 


B37. 


B38. 


B39. 


(b) f xJ? (ux) dg = ToP, where u2 is the second 
0 - 
zero of J, (uc) (excluding u = 0). 


The differential equation E + cy? + ty + i = 0 is a Riccati 
equation. 


(a) Show that the change of variables y(x) = cm oe 


the equation into Bessel’s equation of order zero. 


transforms 


(b) Set c = 3 in the Ricatti equation, and obtain a numeric 
solution to the initial value problem consisting of this 
equation and the initial condition y(1) = 1. 

(c) In terms of Bessel functions, obtain an exact solution to the 
initial value problem stated in part (b), and show graphically 
that it agrees with the numeric solution found in part (b). 


The differential equation Py + i e * + o?y = 0 is a disguised 


form of Bessel’s equation of order Zero. 


(a) Make the change of variables x = pz and transform the 
equation into a Bessel equation. 


(b) Set p = 2 and obtain a numeric solution of the initial value 
problem consisting of the given differential equation and the 
initial conditions y(1) = 1, y'(1) 2 —2. 

(c) In terms of Bessel functions, obtain an exact solution to the 
initial value problem stated in part (b), and show graphically 
that it agrees with the numeric solution found in part (b). 


Let y (x) satisfy Bessel's equation of order v = 1. 


2 
0.00013558 (2 ip then on the interval 3 € x « oo, (a) Make the change of variables y(x) — , obtaining 
d(x) = fo coso m is an approximation of Jo(x) with errors no worse u” +u = 0, and thus, y(x) = ci nk Ns C2 ne . 

than 1.6 x “o= in fo and 7 x 107 in 6o. Examine empirically 


just how well $ (x) approximates Jo(x) in 3 < x < 10. 


For n = 1, 2, 3, and c = 3, 3, 5, test empirically 


w f x* J, (x) dx e e" Jue) 
0 


(b) Using the series for J, (x), show that Jj)2(x) = ,/ ES sin x and 


Jinx) = V à coss. 


Legendre's Equation 


A Singular Sturm—Liouville Eigenvalue Problem 


Legendre’s equation 


(1 — x?)y”(x) 


— 2xy'(x) + Ay(x) 20 (16.18) 


on the interval —1 < x < 1 typically arises in physical problems being solved in spher- 
ical coordinates. With p(x) = 1 — x?, it's clear the equation is in the self-adjoint form 

(py)! + (q +Aw)y = 0, where q = 0 and v = 1. Although the values for q and the 
weighting function w — 1 are as simple as they could be, solving this equation presents 
unique challenges. In fact, we now realize that both x — —1 and x — 1 are regular singular 
points of the differential equation and the problem is singular because p(x) is not positive 
on the interval [—1, 1]. Hence, there are no boundary conditions at the endpoints! Instead, 
the solution y(x) must be bounded throughout the interval, especially at each endpoint. 
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Our boundary value problem then is the differential equation (16.18) along with the 
“boundary” conditions y(—1) finite and y(1) finite. 


Solving the Differential Equation 


The eigenvalue problem based on the equation y" — Ay presented some new challenges, but 
since the solutions were the familiar trig and exponential functions we ultimately determined 
both the eigenvalues and eigenfunctions. The Bessel equation presented some additional 
challenges since the functions that satisfy the equation, the Bessel functions, are not part 
of the suite of elementary functions studied in calculus. Legendre's equation poses further 
challenges because, unlike the Bessel equation, there are no “Legendre functions" with 
which we can ultimately construct the solution. Each of these three classic BVPs differ in 
key ways, making it seem to the beginning student that there is no coherence in the subject 
at all. 

We avoided grinding out the power series solution of Bessel's equation because we 
ultimately relied on a computer algebra system such as Maple to generate the functions for 
us. We cannot do that with the solutions of Legendre's equation and now must revert to a 
series solution at a fundamental level. 


PowER SERIES SOLUTION About x = 0, seek a Taylor series solution of the form y(x) = 
yo aex®. A seventh-order finite approximating sum satisfying the initial conditions 
y(0) = A and y'(0) = B is 


XQ. — 6)(A — 20 X0. — 6 hs 
( A ) 6 v ) 4 DE 
720 24 2 
(-5-135—439. d-20-135 2-4, 
x! 4 x x -x|B 
+( 5040 i 120 iir wu odds 


The solution appears to split into a series of even powers of x (multiplying A — y(0)) anda 
series of odd powers of x (multiplying B = y'(0)). Also, if A is an integer such as 2, 6, 12, 
or 30, coefficients will be zero and the possibility exists that instead of an infinite series, the 
solution is just a polynomial. However, verification of these suspicions requires knowing 
more about the general form of the general coefficient a;. 


RECURSION RELATION To obtain a general recursion formula for the coefficients, seek a 
solution of the form 


oo oo 

2 1 

y= y(0)) üt” +y'(0)5 oft 
n=0 n=0 


As seen in Section 14.1, the sum 4^7 a„x” suffices and substitution into the differential 
equation gives 
1 


k+2 k42 k+2 
G= (Y s) — 2x p 22 TA » a =0 


n=k n=k n=k 


/ 


Differentiating termwise leads to 
a, (E -pa + auk + k?) xk} + (arya (k -3k42)— a(k +k- Xyx* 
fu — 3k — k? —223. +g (à — 6 — k? 50s"? = 0 


where the coefficient of each power of x must separately vanish. Setting the coefficient of 
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à» = g(0)ao 

a4 = g(0)g2)ao 

as = g(0)g(2)2(4)ao 

dg = g(0)g(2)g(4)g(6)ao 

aio = g(0)g(2)g(4)g(6)g(8)ao 


TABLE 16.3 The recurrence relation for 
Legendre's equation 


FIGURE 16.7 Solid curve is y(x) and 
dotted curve is y'(x) for Legendre's 
equation 


x* to zero yields 
Apso (8 + 3k +2) — a(k? +k — 3) 20 
and solving for a,42 gives the desired recursion relationship 


e+ a " 
ar33 = —— 4; = Oar 
HECEIISNKID ^ 4$ 


Applying the Boundary Conditions 


The recurrence relation suggests that ao determines all other even-indexed coefficients and 
a, determines all other odd-indexed coefficients. Moreover, if A is the integer k(k + 1), then 
dj42 = 0 = aj 44 = ase, etc., so the series starting with ao (if k is even) or with a, (if k is 
odd) becomes a simple polynomial, called a Legendre polynomial. 

To determine the large-k behavior of the coefficients in either infinite series, express 
a in terms of ao, then a4 in terms of az and hence ao, etc., obtaining the results in Table 
16.3. Thus, with ao = 1, azm is the product Ies DL. A similar result holds when 
aķ+2 is based on a. Evaluating the expression for azm gives the closed-form expression 


4"T (m+ i i/1-4X)T(m-i- iv +4) 
T (2m - DT (1 - 4412-44) T (1 - $1 4X) 
from which we can obtain 


lim Re ce BE j >0 


SRI C TE Wear G+ Wise 

Thus, the coefficients grow at the same rate as the coefficients in the harmonic series 
at b a series known to diverge. (See Section 7.2.) Hence, if this limit is true, solutions 
of Legendre's equation that are infinite series will diverge at x — —1 and 1. The only 
solutions that could then be bounded at the endpoints would be the polynomial solutions, 
those arising by choice of 4 as one of the integers k(k + 1). 


am = 


Numeric Solutions 


Figure 16.7 shows a numeric solution of Legendre's equation with A = 3 (which is not an 
eigenvalue) and the initial conditions y(0) = 0, y'(0) = 1 as a solid curve, and the derivative 
y'(x) as the dotted curve. The solid curve suggests the values of y (—1) and y(1) are finite and 
not unbounded. However, the graph of the derivative shows that the slope at the endpoints 
is becoming large, and hence, there well may be vertical asymptotes at the endpoints. 
Evaluating y(x) near an endpoint reveals the computational difficulty. 
y (0.99) = 0.4209825881239523 
y (0.999) = 0.1148798427442815 
y (0.9999) = —0.1934045835681208 
y (0.99999) = —0.5015322459675798 
y (0.999999) = —0.8096067971765240 
y(0.9999999) = —1.117672295649649 
y(0.99999999) = —1.425736522635797 
y(0.999999999) = —1.425736522635797 


The graph does not capture the actual endpoint behavior. Moreover, computing the numeric 
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solution of the differential equation near an endpoint becomes increasingly difficult. This 
Observation is consistent with the slow convergence of the harmonic series, the series that 
models the behavior of y (x) at the endpoint. The computational tools are just inadequate for 
convincingly demonstrating the unbounded behavior at the endpoint. Here is an example, 
therefore, where symbolic analysis and theoretical argument cannot be displaced by brute- 


force computation. 


Legendre Polynomials 


In Section 10.7 we showed that a function f (x) can be represented on the interval [—1, 1] 
by a Fourier-Legendre series built of the Legendre polynomials p; (x), where p; (x), the so- 
lution of Legendre's equation corresponding to the eigenvalue A = k(k + 1), is normalized 
so that p, (1) = 1. The first six such polynomials are 


po=1 


pi =x 


3,2. i 35. 4 15,2 1 3 
p-é-$ Pas Bx — BX HG 
5.5 8 63.5 35,3 , 15 (16.19) 
dj as 3. 22 32:3 E 
pa— 5X" — 5x ps = gx — Gx + gx 


The orthogonality of the Legendre polynomials has already been discussed in an ear- 
lier lesson, so we conclude this study of Legendre’s equation and the resulting eigenvalue 
problem. Legendre polynomials and the Fourier-Legendre series will appear again in Sec- 
tions 29.4 and 29.5 in the context of boundary value problems involving partial differential 


equations. 


EXERCISES 16.3 


1. Starting with Po(x) = 1 and P, (x) = x, use the recursion 


Pear) = GEH )x P.(x) Gh ) Py. 1 (x) to obtain 


P(x) TEET P(x). 


The eigenvalues of (1 — x?)y” — 2xy' + Ay = 0, Legendre’s equation, 
are A = k(k + 1). For à not an eigenvalue, a solution y(x) will be un- 
bounded at x = +1, an outcome difficult to establish numerically. For 
the initial conditions and value of 4 given in each of Exercises 2—6, obtain 
numeric solutions and plot both y and y'. The graphs should be consistent 
with the claim about endpoint behavior. 


2. »(0) = 1, y'(0) 22:1 27 
4. y) =Ly(G)=-1LA=17 


6. ($92 Ly ($) 2-124 =41 


3. (0) 20, y (0o = 1;A=11 
5. (3) 30, y (È) 22:1 229 


The eigenfunctions of Legendre's equation are P; (x), the Legendre poly- 
nomials, for which f P2(x) dx = zà4. Let pa) = y 25 P, (x) be 
an orthonormal version of these polynomials for which the Fourier— 
Legendre series of f(x) would be given by 377 9 cx@x, where ck = 
Ie f o6) dx = ,/ rae f (x) P, (x) dx. For each of the functions 
f (x) given in Exercises 7—16, obtain the coefficients c, and demonstrate 
empirically that * 7^ 9 cx@ converges to f(x) and Parseval's equality, 
EX, c? = f}, £2(x) dx, holds. 


7. f(x) =sinx 8 f(x)=e* 9 f(x) =e 


10. f(x) 2coszx 11. f(x) = tanx 


12. f(x) = 1 -l<x<0O 
te lise Osez 
L+x —]1zx«0 
13. f(x) = 7 
fe) (x — 1) 0<x<1 
x* -1zx«0 
M. fo)-21 ^ E 
sin zx qaysi 
15. f(x) = |sinzx| 
x(x+1) -1zx«0 
16. f(x) = 
fe) x 0<x <1 
The transformation z(x) = €^ + (2*)x maps the interval — ysi 


< 
toa <z < b. If F(z) is defined on a <z < b, then f(x) = F(z(x)) 
1 


is defined and has a Fourier-Legendre series, ® (x), on -1 < x < 
Then, ®(x(z)) is a Fourier-Legendre series for F(z) ona < z < b. In 


Exercises 17-21: 
(a) Obtain a Fourier-Legendre series on the indicated interval. 


(b) Plot at least one partial sum of @(x(z)) and F(z) on the same 
set of axes. 


17. F(z) =4z-3-—27,1<z<3 


18. F(z) = z? — 7z? + 142 — 8,1 <z < 4 
wro gagas 
i dmi" — be 18" addc 


20. 


21. 


22. 


23. 


24. 
25. 


26. 
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i DS un ue 
r-1*-5 ?545*52,24 
z-4 4<z<5 
1 9 980 
E US 34.2 S 
FZ={ 4 2 4 © 32227 
E + UR E 45 5.< zg 7 
4 2 4 m 
Use Rodrigues' formula, 
Riga | = asso 
2kk! dx* 
to obtain Po(x),..., Pal): 
Fork =0,..., 10, ^ that 
[k/2] D" (2k — 2n)! ! 
in im 2k jun ni(k — 2n)Nk — n) pu 


where [5], the greatest hice in £ 
when k is odd. 
Show P? (x) = ( 


Using the binomial expansion, write 
k 
al 


k! 
Ae E. n .2k—2n 
aii à Hn 


n=0 
and differentiate it k times to obtain 


dk [k/2] (—1)"k!(2k — 2n)! 
G2 1 " _ £ xiu d x? 
Jk X ) 2 nik = m 27 


from which, upon comparison to the formula in Exercise 23, 
Rodrigues’ formula follows. 


Obtain f", P2(x) dx = 325 


(a) In 
1 1 k 
P? -) dx l d EU Lem 
La | (x) dx = E POO re act — D dx 


igrate by parts with u = Bi x), obtaining 


1 i ae ; 
f. P? ko dx == fe P (x JG x? — D dx 


(b) Continue integrating by parts A a total of k — 1 times, 


obtaining 
=D P oae d x 
Pj a) 
[ k dx 


( 
J P?(x)dx = —— 
Si 


2kk! 


„is £ when k is even and £1 


= 5d» 


2k)!/2* (k!) by using the formula in Exercise 23. 


28. 


29. 


(c) Obtain f, P2(x) dx = (-D*/2*kt f} 
an erar; integration by parts. 

(d) Establish n (x? — 1)* dx = (-1)*22* (kN)? / Qk + 
applications » the reduction formula 


MEN l M 
fe — 1) dx = d E jj^ 2k fo = hy dx] 


(e) Use the results in parts (c) and (d) and the result in Exercise 24 
to deduce I P2(x)dx = 


PP (x) (x? — 1) dx via 


1)! by k 


ae 


. Fork < 5, verify empirically 
(a) Bj, —xP; 2 (k- DP, (b) xPL, — PL, —KP, 
1 
(c) Pa~ P,., = Qk + DR « f «rico )dx =0 
-1 


1 
1 
Pi(x) dx = —— (P; (x) — Pry (x 
e | (x) dx KFI, 28169) ka QX)) 


(f) P,(1) = 1 and P,(—1) = (-1)* 


: kj 

, 1—(-1)*" k>j 
of P(x) P; (x) dx = | 0 kej 
When 4 = k(k + 1), Legendre's equation (1 — x?) y" — 2xy' + 
k(k + 1) y = 0 has one solution y(x) = P(x), the Legendre 
polynomial. A second RE independent solution is Q(x) = 
P(x) f dx/(1 — x* 2), PP ), the Legendre function of the second 
kind. 
(a) Calculate and graph Qo. ..., Q3. 
(b) Show that Q; (x) satisfies Legendre's equation. 


(c) Use reduction of order to obtain this second solution. Thus, set 
y(x) = u(x) P, (x) and obtain, from oie ria equation, 
2w(x) P,(x) + w'(x) P(x) = 0, where w(x) = (1 — x* 2yy! (x). 
The equation for w(x) is variable- eremi and u(x) follows 
by an integration after finding w(x). 

Verify each of the following alternate representations of Q;(x), 

both taken from [1, pp. 334-5]. 


j | f" By) 
(a) Qi(x) = sf poe 
l 
(b) Q(x) = ; iG) In (5 j- yt P, a(x) Pen Qx) 


Solution by Finite Differences 


The Finite-Difference Scheme 


Section 15.2 implements a finite-difference solution of the boundary value problem 


y'(x)o f 3 


^4 y) and y(a) =a, y(b) = B 


Recall that the interval [a, b] is uniformly partitioned into N subintervals of length h = 2=4, 


N 


resulting in the partition points x, = a + kh, k = 0, 1,..., N. The derivatives at x; are 


À 


EXAMPLE 16.4 


1 Ez? 


389.2578571 
360.9923492 
316.9677883 
261.4936055 
200.0000000 
138.5063945 
83.03221165 
39.00765084 
10.74214286 


800.4379567 
632.6546819 
484.6106158 
356.3057585 
247.7401101 
158.9136705 
89.82643964 
40.47841762 
10.86960440 


TABLE 16.4 Eigenvalues of A and exact 
eigenvalues of BVP In Example 16.4 


16.4 Solution by Finite Differences 413 


replaced with the O(h?) centered approximations 


MIS ZYY ad yop = 2e 
h? 2h 
Substitution of these approximations into a differential equation yields a set of algebraic 
equations for y(x), k = 0, 1,..., N. 
In extending these ideas to the eigenvalue problem 


ya) = (16.20) 


x 
ay Hoa T (cQ) +Aw(x))y(x) =0 y(a)-»y(8)-0 
dx? dx 
we again use (16.20). Instead of a set of linear algebraic equations to solve for the values 
of the yg, an eigenvalue problem of the form Ay = —Ay must be solved for both A and y, a 
vector whose components are the yg. Since there are many eigenvalues and corresponding 
eigenfunctions, the approximation scheme must likewise generate these multiple solutions. 
The following example illustrates these ideas. 


Consider the eigenvalue problem defined, on the interval [0, 1], 
y"(x) + 2y'(x) - Ay(x) 20 and y(0) = y()20 


The methods of Section 16.1 lead to the exact solution y,(x) = a,e~* sinnzx and the 


The finite-difference solution discretizes the interval [0, 1] with a partition of N subin- 
tervals of length h = 1, giving the nodes x, = 0 + kh. If, for example, N is taken as 10, 
we then have h = is and x, = kh. The boundary conditions fix the values at the endpoints. 
Hence, make the assignments uo = 0 and u10 = 0, where y(x,) = ux. At each “interior” 
node xg, k = 1,2,..., N — 1 = 9, the discretization yields a single equation, so we have 


the nine interior equations 
110u5 — 200u, + Au; = 0 110u7 — 200ug + 90us + Aug = 0 
110u3 — 200u2 + 90u; + Xu? = 0 110ug — 200u7 + 90ug + Au; = 0 
110u4 — 200u3 + 90u2 + Au3 = 0 110uo — 200ug + 90u7 + Aug = 0 


110us — 200u4 + 90u3 + Aug = 0 —200u9 + 90ug + Aug = 0 
110ug — 200us + 90u4 + Aus = 0 
The matrix form for these equations is Au = —Au, where 
—200 110 0 0 0 0 0 0 0 
90 —200 110 0 0 0 0 0 0 
0 90 —200 110 0 0 0 0 0 
0 0 90 —200 110 0 0 0 0 
A= 0 0 0 90 —200 110 0 0 0 
0 0 0 0 90 —200 110 0 0 
0 0 0 0 0 90 —200 110 0 
0 0 0 0 0 0 90 —200 110 
0 0 0 0 0 0 0 90 —200 


Table 16.4 lists åz, the negatives of the eigenvalues of A, along with the exact values 
1 + &?z?. The smallest eigenvalue is the most accurate. In fact, the relative error in the 
smallest eigenvalue is —0.01172641941. 


APPROXIMATING THE EIGENFUNCTION The eigenvector y corresponding to the eigenvalue 
A, obtained from the matrix eigenvalue problem Ay = —Ay, is a discrete approximation of 
the eigenfunction y (x). For the case N = 20, the eigenvector corresponding to the smallest 
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eigenvalue A = 10.8376345 is the vector y, whose 19 components are 


y yı = 0.0751 ys = 0.278 yə = 0.318 yis = 0.235 yı7 = 0.0979 

i "— y2 = 0.141 ye = 0.303 Yio = 0.306 yj4 = 0.203 yis = 0.0634 
0.67 FS S y; 20.197 y; 20317 yı 20288  yıs =0.169 y = 0.0305 
ost *. yu 20.243. — y4—0.322 yp —0263 — yi = 0.133 
044 4 V (Remember, yo = y», = 0.) The dashed curve in Figure 16.8 is the exact solution y; (x) = 

f p e™ sin(zx), the solid curve is the piecewise-linear curve connection of the points (xk, yx) 
o3«r jJ P em. wc determined by y, and the dotted curve is i y1(x). Since eigenfunctions are determined only 
0. 34. h £ BN i up to an arbitrary multiple, y agrees with 1y; (x). 
7 d k E 2 

“Y ld Error Analysis 

ol 1 m The relative error in the computed value of the smallest eigenvalue, for N — 10, was 
FIGURE 16.8 Example 16.4: Exact —0.01172641941. With N = 20, the error, now that h has been halved, is —0.002941220197. 
solution y; (x) (dashed), finite-difference The ratio of errors is 3.986923326, which is close to 4, the square of the ratio of stepsizes. 
solution (solid), and 3 y; (x) (dotted) Since derivatives were replaced with O(h?) approximations, it is not unreasonable to find 


the same order persisting in subsequent computations. 
Additional results, such as recipes for the matrix A in terms of the coefficients of the 


differential equation, can be found in [60]. b 
EXERCISES 16.4 
1. For the BVP y" + 3y' + Ay = 0, y(0) = y(1) = 0: 8. Consider the eigenvalue problem y" + Ay = 0, y'(0) = y'(1) = 0. 
(a) Obtain analytic solutions for the eigenvalues and (a) Obtain the exact solution. 
eigenfunctions via the techniques of Section 16.1. (b) Using N — 10, discretize by central differences, obtaining 
(b) Obtain numeric estimates of the eigenvalues and eigenfunctions nodal equations for the 11 nodes xx, k = 0, ..., 10. The first 
via the finite-difference technique of this present section using and last equations will contain y. ; and y;;, respectively. Use 
N — 10. the boundary conditions to eliminate these two unknowns, 
(c) Compare graphically the first eigenfunctions computed in parts leaving an eigenvalue problem for an 11 x 11 matrix. 
(a) and (b). (c) Compare the first two eigenvalues and eigenfunctions 
2. For the BVP 3y” + 2y’ + Ay = 0, y(0) = y(1) = 0: computed numerically with their exact counterparts, graphing 


; : ' " " : the eigenfunctions as part of the comparison. 
(a) Obtain analytic solutions for the eigenvalues and 


P aoe n if S asus 
eigenfunctions via the techniques of Section 16.1. 9. Consider the eigenvalue problem y" + 2y' + Ay = 0, 


y0) = y'(1) = 0. 


(b) Obtain numeric estimates of the eigenvalues and eigenfunctions . . 
(a) Obtain the exact solution. 


via the finite-difference technique of this present section using 
N = 10. (b) Using N — 10, discretize by central differences and obtain 
(c) Compare graphically the first eigenfunctions computed in parts numeric solutions for the first two eigenvalues and 
(a) and (b). eigenfunctions. 
(c) Compare numerically and graphically the approximate and 


In Exercises 3-7, the given differential equation and the boundary con- : 
exact solutions. 


ditions y(0) = y(1) = 0 determine a BVP. For each: 


(a) Obtain numeric estimates of the eigenvalues and eigenfunctions For the given BVP in Exercises 10—17: 


via the finite-difference technique of this present section using 
N = 10. The nodal equations will now contain terms that arise 
from evaluating the coefficient of y’ at the nodes. 


(a) Use N = 10 and obtain a solution by finite differences. 

(b) Compare the finite-difference solution with the analytic 
solution obtained earlier. 

10. Exercise B2, Section 16.1 — 11. Exercise B3, Section 16.1 

12. Exercise B4, Section 16.1 — 13. Exercise B5, Section 16.1 

14. Exercise B6, Section 16.1 15. Exercise B7, Section 16.1 


(b) Graph the first two eigenfunctions. 


3. y" -2xy'--Ay 20 4 y"+e™y +Ary=0 
5. y” +sin(ax)y +y =0 6. y" - x?y' c Ay 20 
7. y" E x(x — Ly’ - Ay 20 


16. Exercise B8, Section 16.1 17. Exercise B9, Section 16.1 


For the given BVP in Exercises 18—27: 


(a) Use N — 10 and obtain a solution by finite differences. 
(b) Compare the finite-difference solution with the solution 
obtained earlier. 
. Exercise B12, Section 16.1 
. Exercise B14, Section 16.1 
. Exercise B17, Section 16.1 
. Exercise B19, Section 16.1 
. Exercise B21, Section 16.1 


19. Exercise B13, Section 16.1 
21. Exercise B16, Section 16.1 
23. Exercise B18, Section 16.1 
25. Exercise B20, Section 16.1 
27. Exercise B22, Section 16.1 
. Consider the eigenvalue problem y" — Ay = 0, y(—1) = y(1) = 0. 


MOERS & » 
on N — o6 


(a) Obtain the exact solution for the eigenvalues A; and the 
eigenfunctions y, (x). 

(b) Approximate the solution with $ (x) = bm Cr fi (x), where 
fo) = (x? = Dx*, obtaining R, the residual that arises from 
substituting this approximation into the differential equation. 


Chapter Review 


1. What is a regular Sturm-Liouville eigenvalue problem? Give an 
example. 

2. Reproduce the solution process for the eigenvalue problem 
y" — Ay = 0, y(0) = y(L) = 0. Clearly state the resulting 
eigenvalues and the companion eigenfunctions. 

3. Explain why, in answering Question 2, the cases A = 0 and A Æ 0 
are treated separately. 

4. Reproduce the solution process for the eigenvalue problem 
y" — ày = 0, y'(0) = y'(L) = 0. Clearly state the resulting 
eigenvalues and the companion eigenfunctions. 


5. Reproduce the solution process for the eigenvalue problem 
y" — Ay = 0, y(0) = y 27), y'(0) = y'Qz). Clearly state the 
resulting eigenvalues and the companion eigenfunctions. 
6. Reproduce the solution process for the eigenvalue problem 
y" — ày = 0, y(0) = y'(L) = 0. Clearly state the resulting 
eigenvalues and the companion eigenfunctions. 


7. Why is the eigenvalue problem posed with 
x2 y" + xy! + x?y — 0,0 < x < c, Bessel's equation of order zero, 
and the conditions that y(x) be bounded and satisfy y(c) = 0, 
called a singular Sturm-Liouville eigenvalue problem? 


8. Describe the process by which the eigenvalues and eigenfunctions 
for the problem in Question 7 are determined. 


9, Show that Bessel's equation is formally self-adjoint. 


10. In what sense are the eigenfunctions determined by the problem in 
Question 7 orthogonal? Illustrate with the appropriate mathematical 
statements. 


T. 


13. 


14. 


16. 


17. 
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16.4 Solution by Finite Differences 


The residual will be a function of the three coefficients 
Co, C1, C? and A as well as x. 

(c) Using a collocation technique, force the residual to be zero at 
the four equally spaced points xo = —1,..., 1 = x3, resulting 
in four equations in the four unknowns co, c;, c; and A. These 
equations are linear and homogeneous in co, c1, c5. 

(d) Write the equations from part (c) in the matrix form 
A(A)C = 0, where A is a 4 x 3 matrix. For most values of À, 
the solution for C is the trivial solution, 0. 

(e) To obtain nontrivial solutions for C, choose À = À so the rank 
of A is just 2. 

(f) Set A = Â in the matrix A, forming the homogeneous system 
AC = 0, and obtain C, the general solution. 

(g) Write the function 9 = ped Cx fi (x), where €; is the kth entry 
in C. There will be a free parameter in this approximate 
solution. 

(h) Normalize the solution found in part (g): determine the free 
parameter so that $(0) = 1. 

(i) Normalize the exact eigenfunction correspondingly, and plot 
both on one set of axes. 


Reproduce the process by which the differential equation 
R'(r) + iR'(r) + u?R(r) = 0 is cast into the form of Bessel's 
equation of order zero. Show how R(r) is determined from the 
solution of Bessel's equation. 


. Detail how to obtain Nn Ck Jo(uxr), the Fourier-Bessel series for 


the function f(r),0 <r < c, given the eigenvalues jz; and the 
eigenfunctions Jo(jur). 

Why is the eigenvalue problem posed with (1 — x?) y” (x) — 
2xy'(x) + Ay(x) = 0, —1 < x < 1, Legendre's equation, and the 
condition that y (x) be bounded called a singular Sturm-Liouville 
eigenvalue problem? 

Describe the process by which the eigenvalues and eigenfunctions 
for the problem in Question 13 are determined. Include a discussion 
of the series solution and the recursion relation that determines its 
coefficients. 


. Detail how to obtain 5 ^ , c, P. (x), the Fourier-Legendre series 


for the function f(x), —1 < x < 1, given that the problem in 
Question 13 determines the eigenvalues à = k(k + 1) and the 
corresponding eigenfunctions P; (x), the kth Legendre polynomial. 
Solving Laplace's equation in which coordinate system typically 
leads to Bessel's equation and solution by Fourier-Bessel series? 
Solving Laplace's equation in which coordinate system typically 
leads to Legendre's equation and solution by Fourier-Legendre 
series? 


<> UNIT Four 


Vector Calculus 


Space Curves 


Chapter 17 


Chapter 18 The Gradient Vector 

Chapter 19 Line Integrals in the Plane 

Chapter 20 Additional Vector Differential Operators 
Chapter 21 Integration 

Chapter 22 NonCartesian Coordinates 

Chapter 23 Miscellaneous Results 


The seven chapters of Unit Four can be summarized in the phrase "div, grad, 
curl, Green's, Stokes', and Divergence." The three differential operators of di- 
vergence, gradient, and curl provide information about vector fields and are 
related through three integration theorems attributed to Green, Stokes, and 
Gauss. In addition, the differential operator called the laplacian, expressible 
in terms of the divergence and gradient, is treated. 

Vector fields describing fluid flows, electromagnetism, and heat trans- 
fer exist in space and can be tangent to curves or orthogonal to surfaces. The 
geometry of curves and surfaces is therefore background against which our 
study of vector calculus takes place. 

The gradient vector arises in our attempt to define a rate of change for 
a scalar-valued function of several variables. This vector is orthogonal to the 
level sets of the scalar function and is tangent to the lines of flow of the gra- 
dient field. Gravitational and electrostatic potentials are examples of scalar 
fields for which the gradient field is physically significant. The electric field 
vector is obtained from the gradient ofthe electrostatic potential function and 
is therefore an example of a conservative force. 

Properties of scalar and vector fields are distributed in space, so at- 
tempts at averaging or accumulating their values leads to line integrals and 
surface integrals. The line integral is a process of accumulation taking place 


along a space curve. Mechanical work, mathematically equivalent to circula- 
tion, is the line integral of the tangential component of a vector field, and flux 
is the line or surface integral of the normal component of a vector field. The 
divergence (or spread) of a vector field at a point is related to its flux per unit 
area, while its curl is related to its circulation per unit area. 

The divergence theorem relates the volume integral of the divergence 
to the flux of the field through the enclosing surface. Stokes' theorem relates 
a curl's flux through a surface and the circulation around the curve bounding 
the surface. Green's theorem gives the planar version of these two theorems. 
Using these theorems, the differential operators div, grad, and curl can be 
expressed as surface integrals. 

Although initially defined in Cartesian coordinates, the operators div, 
grad, curl, and laplacian are transformed to polar, cylindrical, and spherical 
coordinates. This makes it possible to solve problems of wave motions, heat 
transfer, and electrostatics in domains that have either circular or spherical 
symmetry. 

The unit concludes with a brief look at the equation of continuity 
obeyed by continuous fields and Green's identities, the generalization to 
higher dimension of Green's formula from Section 16.1. 
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Chapter 17 


Space Curves 


INTRODUCTION A curve in space can be described either parametrically or in 
radius-vector form. For the radius-vector form of the curve, differentiation with respect to 
the curve's parameter yields a vector tangent to the curve. If the curve describes the motion 
of an object in time, then the tangent vector is a velocity vector. If the curve is a coordinate 
curve, then the normalized tangent vector is a unit basis vector. 

The curvature of a plane curve is the rate at which the slope of the tangent line changes 
as arc length along the curve varies. If at a point the curve is approximated by a circle making 
second-order contact (the first and second derivatives for the curve and circle agree), the 
circle is the circle of curvature and its center is the center of curvature. In fact, the curvature 
of the curve is the reciprocal of the radius of curvature of the circle. 

Curvature is generalized to space curves by defining a unit tangent vector T along the 
curve. Then, the rate at which T changes as arc length changes along the curve must be 
ascribed to the change in orientation of T, since its length remains constant. The magnitude 
of the vector describing this change is called the curvature. 

Along a general curve, we also define the principal normal vector N, a unique normal 
along the curve. The vectors T and N then determine a unique plane, called the osculating 
plane. In this plane, a circle making second-order contact with the curve is called the circle 
of curvature, and the center of this circle is the center of curvature. The principal normal 
points toward the center of curvature. 

The binormal vector B, defined as the cross-product T x N, is then the third vector of 
a moving orthonormal basis defined along a space curve. Thus, for a fighter pilot putting an 
aircraft through strenuous maneuvers, the cockpit contains the moving frame consisting of 
tangent, normal, and binormal vectors. To the pilot, the frame is fixed, but to the observer 
on the ground, the frame twists and turns along the path of the aircraft. 

The osculating plane also contains the vector R” that satisfies the decomposition rule 


R" = p'T 4- «p?N 


where p = ||R'||. If the parameter along the curve is time, then R” is the acceleration vector 
and R” = wy + «v°N. For this case where the parameter along the curve is time, p = v, 
the speed. The decomposition then says the acceleration vector always lies in the plane 
formed by the tangent and normal vectors. Indeed, it says more than that since it links the 
dynamics on the left side of the equation and the geometry on the right. The acceleration 
vector is a dynamic quantity, but the tangent vector T, the principal normal N, the curvature 
k, and v, the length of the tangent vector, are all geometric quantities. There is a link between 
the geometry of a space curve and the dynamics that can take place along it. 


Line Helix 


x(p)=1+3p 
y(p) =2-—5p 
z(p) =3 + 2p 


x(p) = 6cos p 
y(p) = 6sin p 
z(p) =p 


TABLE 17.1 Examples of space curves 


hà 
f oO 4d» tA 
t 

w < 
AR 
tA 
a 


opie 


X 


FIGURE 171 Line given on the left in 
Table 17.1 


FIGURE 17.2 Helix given on the right in 


Table 17.1. Radius vector drawn from 
origin to (x, y, z) on the curve. 


EXAMPLE 17.1 


FIGURE 17.3 Vectors tangent to the helix 


given on the right in Table 17.1 


EXAMPLE 17.2 
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Curves and Their Tangent Vectors 


Space Curves—Parametric Representation 
A curve in space is determined by three equations of the form 


x=x(p) y=y(p) z=2(p) 


where p is a parameter specifying points (x(p), y(p), z(p)) along the curve. The equations 
in Table 17.1 determine two different space curves. The equations on the left determine the 
line shown in Figure 17.1, while the equations on the right determine the helix, or spiral, 
shown in Figure 17.2. In the equations for the spiral, x = x(p) and y = y(p) determine a 
plane circle of radius 6 while z(p) = p causes the rotating system-point to rise at a constant 
rate, thus creating the spiral. Both examples should be familiar from a multivariable calculus 
course. 


Space Curves—Radius- Vector Representation 


A curve can also be represented by a vector drawn from the origin to a moving point on the 
curve. For example, we could write the helix as the column vector on the left in (17.1), or, 
in terms of the unit basis vectors {i, j, k}, as on the right in (17.1). A single representative 
radius vector is shown in Figure 17.2. 


x(p) 6 cos p 
R = | y(p) | = | 6sin p | = 6cos pi + 6sin pj + pk (17.1) 
z(p) p 


Tangent Vectors 
The derivative of the radius-vector form of a curve is defined by 
, . R(p4 dp) — R(p) 
R(p) = lim e ALN AM 
dp—0 dp 
and yields a vector tangent to the curve. Thus, if the radius-vector form of a curve, either 
in space or in the plane, is differentiated with respect to its parameter, the result is a vector 


tangent to the curve. We call R' the natural tangent vector for the curve R. The following 
examples illustrate this result. The first is in space and the second in the plane. 


If R(p) for the helix given on the right in Table 17.1 is differentiated with respect to its 
parameter p, we get the vector 
—6sin p 
R'— | 6cosp 
l 


= —6sin pi + 6 cos pj + k 


At each point on the curve represented by R, the vector R’ is a vector tangent to R, as 
illustrated in Figure 17.3. s 


In (17.2) we have on the left, the parametric representation of a plane curve, in the center, 
R(p), its radius-vector form, and on the right, R'(p), the natural tangent vector along the 
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y curve. Figure 17.4 shows the curve, an outward spiral, and some of its tangent vectors. 


x(p) = COS p « pin p "T cos p. pam R= posp (17.2) 
y(p) = sin p — p cos p sin p — pcos p psin p 


9$. 
hod 


Unit Tangent Vectors 


A unit tangent vector T is obtained from the natural tangent vector R’ (p) by normalization, 
that is, by dividing R' by its length. Thus, R = R(p) > m — R' is tangent, but not, in 
general, of unit length (i.e., |R'|| 4 1). The varying length of R’ is p = |R'|, so T = = 
is now a unit tangent vector. For the curve R(p) from Example 17.2, the tangent vector R’ 
on the right in (17.2) has magnitude p = y p?(cos? p + sin? p) = p, assuming p > 0. 
Dividing R' by p yields the unit tangent vector 


FIGURE 17.4 Curve and tangent vectors 
for Example 17.2 R’ 1 ? cos r] ins p 


T= — . 
psinp 


| = cos pi + sin pj 
p p 


sin p 


EXERCISES 17.1—Part A 


A1. If Py, k = 1, 2, are the points (3, —2) and (7, 4), respectively, and 
P}, k = 1, 2, are vectors from the origin to these respective points, A 
show that R(p) = P; + p(P2 — P;), 0 < p < 1, determines the 
line segment from P; to P5. 

A2. Let P}, k = 1,2, be the points (3, —1, 2) and (5, 7, —4), and 
generalize the results in Exercise A1 to three dimensions. 


Sg 


A3. Eliminate the parameter p from the representation of the line in P 
Exercise Al, and show the result agrees with the point-slope form 
of the line in the plane. 

A4. Derive x(0) = a(0 — sin0), y(@) = a(1 — cos 0), the parametric 0 að ——>| 
equations of a cycloid, the curve traced by a point on the FIGURE 17.5 Hint for Exercise A4 
circumference of a circle of radius a as it rolls along the x-axis 
from an initial position in which its center was at (0, a). Hint: See 
Figure 17.5, where 0 is the angle between the vertical and the 
radius to the point P, which was initially at the origin. 


x 


AS. The plane curve y = f(x) can be parametrized as x(p) = p, 
y(p) = f (p). Verify this is so for f(x) = x(1 — x). 


EXERCISES 17.1—Part B 


B1. The parametric equations x(0) = 7cos0 — cos 70, y(0) = In Exercises B3-12, a plane curve y = y(x) and three values x = xz, 
7 sin0 — sin 70, 0 < 0 < 2x, describe an epicycloid, the curve k = 1, 2, 3, are given. In each case: 
traced by a point on the circumference of a circle rolling around 
the outside of a second fixed circle. The angle 0 is the angle from 
the horizontal to the line connecting the centers of the circles. 
Sketch this epicycloid. 


B2. Let A =a +b and B = 1 + o» and show that x(0) = A cos0 — 
b cos B0, y(0) = A sin — b sin B9, are the general equations for 
an epicycloid generated by a circle of radius b rolling on the (d) Obtain o(p) = ||R’(p;)||, the length of each tangent vector 
outside of a fixed circle of radius a. What are the values of a and found in part (b). 

b for the epicycloid in Exercise B1? 


(a) Obtain R(p), the radius vector form of the curve, by the 
parametrization x — p, y — y(p). 


(b) Find R'(p), the natural tangent vector at an arbitrary point 
along the curve. 


(c) Obtain R’(p;), the natural tangent vector at each p, = xp. 


(e) Obtain T(p;), a unit tangent vector, for each p, = x. 


(f) Plot the curve, and on it draw the unit tangent vectors found in 
part (d). 

(g) Find p(p), the magnitude of R'(p). 

(h) Plot p(p). 

(i) Determine p,, and py, the parameter values for which p(p) 
attains, respectively, its absolute minimum and absolute 
maximum on the interval [xo, x2]. What are the coordinates of 
the corresponding points along the curve? 


B3. y = 2x? — 3x + 1, xx 20, 1,2 
B4. y = 5x? — 7x? + 2x +3, 3x, = —1,0, 1 


x 
B5. y = ——,x,20,L2 B6. y= ——,x, = —2,0,1 
PUlIgGU = Toe 
as Be 
Ih pesa ete 9. bs B8. y = xe”, x, = —1, 0, 1 


B9. y = x?e*, x, = —1, 0, 1 B10. y=e" 


B11. y = arctan x, x, = 0, 1,2 


BiZ. p= i peo x, = 0, —, — 


$3 
In Exercises B13-17, a curve is given parametrically, along with several 
values p, for the parameter p. In each case: 


Xp —1,0,2 


(a) Find R'(p), the natural tangent vector at an arbitrary point 
along the curve. 

(b) Obtain R'(p;), the natural tangent vector at each p. 

(c) Obtain o(p) = ||R’(p,)||, the length of each tangent vector 
found in part (b). 

(d) Obtain T(p;), a unit tangent vector, for each pz. 

(e) Plot the curve, and on it draw the unit tangent vectors found in 
part (d). 

(f) Find p(p), the magnitude of R'(p). 

(g) Plot p(p). 

(h) Determine p,, and py, the parameter values for which p(p) 


attains, respectively, its absolute minimum and absolute 
maximum on the smallest closed interval containing all the 
given p. What are the coordinates of the corresponding 
points along the curve? 


B13. x(p) = VIF p.y(p = J1 + 5, p =1, pz —3 


B14. x(p) = pcos p, y(p) = p° sin p, pk = 2, 5,9, k = 1, 2, 3, 
respectively 
B15. x(p) = 1 — p°, 1 + p?, p, = 1,2, k = 1, 2, respectively 


B16. x(p) = (1 + p°)e™, y(p) = (1 — p’)e™”, p, = 0, 1,2, 


k = 1,2, 3, respectively 
B17. x(p) =2 + 3p — 5p?, y(p) = cos p, p, = 0, 1,k = 1,2, 


respectively 


In Exercises B18—24, a curve is given parametrically, along with several 
values px for the parameter p. In each case: 


(a) Find R'(p), the natural tangent vector at an arbitrary point 
along the curve. 
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Curves and Their Tangent Vectors 


(b) Obtain R'(p;), the natural tangent vector at each p;. 

(c) Obtain o(p) = ||R’(p;)||, the length of each tangent vector 
found in part (b). 

(d) Obtain T(p,). a unit tangent vector, for each pz. 

(e) Find p(p). the magnitude of R'(p). 

(f) Plot p(p). 


(g) Determine p,, and py, the parameter values for which p(p) 
attains, respectively, its absolute minimum and absolute 
maximum on the smallest closed interval containing all the 
given p,. What are the coordinates of the corresponding 
points along the curve? 


0, 1, k — 1,2, 


B18. x(p) = 3p”, y(p) 22p + 1. 2(p) = p pi 
respectively 

B19. x(p) = p’ cos p, y(p) = p?sin p, z(p) = p(1— p), 
py = 0, 1,2,k = 1, 2, 3, respectively 


B20. x Y = i 
+p 2+p 3+p 
2 , 2, 3, respectively 


B21. x(p) = 1 — p, y(p) = 1 + plz(p) = T a Pe= 0,1 
1+ p? 
k = 1, 2, respectively 
B22. x(p) = cos 2p, y(p) = sin 3p, z(p) = cos p, pk = 0, 1, 
k = 1, 2, respectively 


B23. x(p) = (1+ p. y(p) = (1— p}. z(p) = p, p =0,1,k = 1,2, 
respectively 

B24. x(p) = p, y(p) = p’, z(p) = p’, pe = 0, 1,2, k = 1, 2, 3, 
respectively 


In Exercises B25—29, two plane curves y = f (x) and y = g(x) are given, 

along with a value for x = xo. In each case: 

(a) At x = xo, obtain the equation of the line tangent to 
q esf) 

(b) Find the coordinates of the intersection of y — g(x) and the 
tangent line found in part (a). 

(c) Construct a vector from (xo, f (xo)) to the point found in 
part (b). 

(d) Along f(x), obtain R'(xo), the natural tangent vector at 
(Xo, f (xo)). 

(e) Show that the vectors in parts (c) and (d) are parallel. (Hint: 
Show their components are proportional.) 

(f) Draw both curves and the tangent vector found in part (d). 

; ' 7 
f(x) =sinx, g(x) 23, xo = F1 


2 xA? 
f(x) =x", g(x) =8- (2) ,x>0,x% = 1 


B25. 


B26. 


B27. f(x) = x? + 3x7 +2x —5, g(x) = 8 — x°, x >0,x = 1 
1 
B28. f(x) = EQ) — X 4 2, HH SZ 
f(x Dx x) = x + 2, Xo 
B29. f(x) =~ Agios 2 
LfGy , g(x) =2—x, xo = —2 
faa " 
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| ! Arc Length 


Arc Length Formulas 


Table 17.2 lists formulas for the arc length of a curve given in different formats. A plane 
curve can be given explicitly as y = f(x) or parametrically as x = x(p), y = y(p). The 
radius-vector form R for each of these is shown in the table. In three dimensions, the curve 
is given parametrically and has the obvious radius-vector form R. 


Curve R R’ Arc Length 
f(x) j [ 1+ (£) 1 
= x sS = A eh, ax 
du f(x) af ^ dx 
dx 
dx 
aes aq) x(p) dp $ [ Wat + ^y ap 
y= y(p) y(p) dy P Y dp dp 
dp 
dx 
dp 
dimid id SLM dy a > . (ary N [E ? 
= gem s = = —— ap 
: : ur oe dp j dp dp dp i 
dz 
dp 
TABLE 17.2 Arc length formulas 


In each case, R', the derivative of R, is listed; and Table 17.2 thereby shows that the 
integrand of the arc length integral is ||R’||, the length of the natural tangent vector. We state 


this observation as 
b b 
se f I R'l| ap= | p(p) dp 


For R, the helix of Example 17.1, p = |R'|| = 4/37, so the arc length along one turn of 
the helix is 


S | V37 dp = 21.371 s% 
0 


The arc length function From the starting point where p = 0, to the arbitrary terminal 


point p, compute the length of R, the curve given on the left in 


2 2 
«-[1-»- 
p 3p* 


For the natural tangent vector R’, given on the right in (17.3), we have ||R'|| = «4/4 + 972, 


(17.3) 


>< 


(a) 


(b) 


FIGURE 17.6 Example 17.4: The curve 
(a) and its arc length function (5) 
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N- 
Uo 


FIGURE 177 The curve and natural 
tangent vectors in Example 17.5 
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where x is a dummy variable of integration. The desired arc length is then 
p l 
s(p) = f ty4+9r? dt = 4 (4+ 9p?y^ -$ 
A 2 
The curve R is shown in Figure 17.6(a), and s(p), the arc length function, is shown in 
Figure 17.6(b). The vertical axis in Figure 17.6(b) exhibits the readings on an odometer in 


a car driven along the path R(p). $ 


Arc Length as Parameter 


THEOREM 17.1 


If the parameter for a curve is s, the curve's arc length, the natural tangent vector 
R'(s) is automatically the unit vector T. 


The proof follows from an application of the chain rule by which we obtain 
dR _ dRdp dR1 (Zi dy. dz 


= i+ TE 
ds Mp dp’ dp ) N alayan fas 
(4) + (2) zx (&) 


Then, computing the length of S$ R , we have 


ds  dpds dp $ 


dR dR 


dp | 2 2 2 2 
(4 j (2) dz dx dy dz 
(+) (2) E (4) (+) + (2) + (4) 


Table 17.3 contains the parametric and radius-vector forms of a plane curve and its natural 
tangent vector R'(p). Figure 17.7, a graph of R'(p) at several points along R(p), shows 
how the lengths of the natural tangent vector vary with p. 


Parametric Form R(p) R'(p) 
x(p 233p -ip4l ip —ip+l 3p—3 
y(p) =2p +1 2p? +1 3/p 


TABLE 173 Plane curves for Example 17.5 


For the curve in Table 17.3, the following steps will show (a) how to parametrize the 
curve in terms of s, the arc length, and (b) that R'(s) is T, the unit tangent vector. 


1. Gets(p), arc length as a function of p, the stopping point on the curve, by computing 
s(p) = fy IR'COll ar. 
2. Invert the function s — s(p) to obtain p — p(s). 


3. By writing the expressions x = x(s) = x(p(s)), y = y(s) = y(p(s)), obtain R(s), 
the curve expressed with parameter s. 
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FIGURE 17.8 The curve and unit tangent 
vectors in Example 17.5 


R dR(s) 


4. Compute == to get a tangent vector along R (s). 


5. Show that IR’ (s)|| = 1. Hence, R'(s) = 


StEP1 Obtain the function s(p) by the following calculation. 


p p p 
"p aT IR'COI dr =Í V GC + OE) dt =| (3: - 3)dct 2 ip? ip 
0 0 0 


SrEP2 Obtain the function p — p(s) by solving the equation 
$$ = 3p? + åp for p= -i + v9 + 96s 
Select the positive root because at p = 0, s must also be 0. Consequently, we have p(s) = 


—t+3V9+ 96s. 


STEP 3 Substitution yields 


= x(s) = x(p(s)) = ¥ — 149 + 96s +s 


y= y(s) = y(p(s)) =2(-} + 5 /9+96s) 41 
SrEP4 Form R(s) and compute R'(s) = RO, obtaining 
—6 + 4/9 + 96s 
R(s) = *-i dita and R'(s)— TIC 
2(-14 d 9396s)" +1 —9 + 3/0 + 96s 
4/9 + 96s 
SrEP5 A straightforward but tedious computation now shows ||R'(s)|| = 1, verifying the 


claim that R'(s) — T, the unit tangent vector along R(s). 


A graph of the curve R(s) with (unit) tangent vectors T — SEG 


appears in Figure 17.8. 


D 


Generalization 


1. GivenR(p),the radius-vector form of a curve, R'(p) = op is the natural tangent vector. 


2 2 2 
2. The length of the tangent vector is p(p) = ||R'(p)|| = p + (2) + (&) . 


The arc length function is s(p) = f? p(t) dt = fy |R'(t) || dt. 
4. By the fundamental theorem of calculus, the derivative of the arc length function is 


ds tp) = al 2j. (2) + £3] 
X = at 2e 
4p | O =p) = d ap 


5. In principle, the arc e function n an inverse p = p(s). 


6. By elementary calculus, í E = am m» , that is, the derivative of an inverse function 


is the reciprocal of the derivative of the function. (See Exercises 29—34 for a refresher 
on this result from calculus.) 


dR/dp _ 
ldR/dpl ^. 


7. "Theunittangent vector T can be computed by normalizing R’ = T R via T = 
dR/dp _ dR | 


p) dp p 
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8. By the chain rule for differentiation, we can compute T = R from R(p) as 


dR  dRdp dR1ı1  dRI 


T= = = 4 
ds dp ds dp ir dp p 


There really aren't two different ways for computing T. Given R(p), there is only one 
way to compute T and that is to compute R'(p) and divide by p = ||R'(p)|| to normalize 
R'. Although the computation can be conceptualized in two different ways, the results are 


exactly the same. 


EXERCISES 17.2 


In Exercises 1—10, obtain the arc length for the given plane curve 

y = y(x) between the given endpoints x, and x3. 

2. Exercise B4, Section 17.1 

4. Exercise B6, Section 17.1 

6. Exercise B8, Section 17.1 

8. Exercise B10, Section 17.1 
10. Exercise B12, Section 17.1 


. Exercise B3, Section 17.1 
. Exercise B5, Section 17.1 
. Exercise B7, Section 17.1 


. Exercise B9, Section 17.1 


Senn w= 


. Exercise B11, Section 17.1 
In Exercises 11—22: 


(a) If 0 < p < 3, find the length of the arc for the parametrically 
given curve. 

(b) Obtain a graph of s(p), the arc length function, if 0 < p <5. 
Use numeric integration as needed. The arc length can be 
evaluated numerically for 10 values of p and the resulting 
points plotted. 

(c) Obtain a graph of p = p(s), the inverse function. If s(p) was 
obtained as a discrete collection of points (px, Sk), simply plot 
the points (sx, px) or reflect the graph of p(s) about the line 
ps. 


. Exercise B13, Section 17.1 
. Exercise B15, Section 17.1 
. Exercise B17, Section 17.1 
. Exercise B19, Section 17.1 
. Exercise B21, Section 17.1 
. Exercise B23, Section 17.1 


. Exercise B14, Section 17.1 
. Exercise B16, Section 17.1 
. Exercise B18, Section 17.1 
. Exercise B20, Section 17.1 
. Exercise B22, Section 17.1 
. Exercise B24, Section 17.1 


In Exercises 23-28, a curve is defined parametrically for 0 < p < oo. 
For each: 

(a) Obtain a graph for 0 « p <5. 

(b) Obtain, in closed form, s — s(p), the arc length function. 


(c) Compute e and = and show that these derivatives are actually 
reciprocals. 


(d) Express the curve R(p) = x(p)i+ y(p)j as R(s) by finding 
x(p(s)) and y(p(s)). 
(e) Compute R'(s) and show it is a unit vector. 
23. x(p) = 1-9p — ip) y(p) 2 1 - Ap?? 
24. x(p) = 8p? + 16p +5, y(p) = Ap? + 8p —3 
25. x(p) = Ap? + 3p 9, y(p) 2 5p? + 7p 
26. x(p) = 9p? + Bp +4, (p) = 5p? c 2p — 5 
27. x(p) = Tp? — 2p +4, y(p =5+7p — 9p? 
28. x(p) = 4p? + 2p —8,y(p) 5p? +3p —9 


Two functions f(x) and g(x) are inverses if their compositions are 
related by f(g(x) = g(f(x)) =x. Hence, the chain rule yields 
f'(gx)g'x) = Lsog'(x) = P For example, if f(x) = sin x and 


i but the sec- 


g(x) = arcsin x, we know f'(x) = cos x and g'(x) = 


NU 
ond does not appear to be the reciprocal of the first. That is because f’ has 
not been evaluated at the proper argument, namely, at x — g(x). Doing 


that yields g'(x) = —1__ = _1 which is the expected derivative 


cos(arcsin x) 1-32" 


of g(x) = arcsin x. 
In Exercises 29-34: 


(a) For x in an appropriate domain, show that f(x) and g(x) are 
functional inverses by showing f(g(x)) = x for x in the 
domain of g and g( f (x)) = x for x in the domain of f. 

(b) Obtain the derivatives f’(x) and g'(x). 

(c) Show that f' and g' are actually reciprocals of each other. 
(Hint: Show, for example, g'(x) = vod 

29. f(x) = sinh x, g(x) = arcsinh x 

30. f(x) = tan x, g(x) = arctan x 


31. f(x) =e*, g(x) =Inx 32. f(x) 2 x?, g(x) = x 


2—x 2—3x 
T fede. ru n Es 
E Pj -——. au 9 
14+ x2’ x 
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FIGURE 17.9 Curvature as the derivative 
of the angle 0 


FIGURE 17.10 
Example 17.6 


Expanding helix of 
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Curvature 


Curvature of a Plane Curve 


Given the curve whose equation is y = f (x), we define x, the curvature of this curve, mea- 
suring how “bent” the curve is at each point, to be the derivative, with respect to arc length, 
of the angle between the tangent line and the horizontal. This results in the formula 


Iy"] 
t7 0 00332 
whose derivation is based on Figure 17.9, which shows a curve, a tangent line, and the angle 
0 formed by the tangent line and the horizontal. 
By the definition of the derivative, y'(x) = tan 0, so we have 0 = arctan y’. The cur- 
vature « is defined as the rate of change, with respect to arc length s, of the angle 0. Thus, 


o dd d | i. _ f" (xG))x'(s) 
K so arctan( f'(x(s))) = 1L((PGGWEÉ (GG) 


ds s 
From Section 17.2, recall (a) the reciprocal rule for derivatives of inverse functions, namely, 


e E UTD and (b), the definition of s(x), namely, s(x) = i J1+(f'(t))? dt. Hence, we 
» n 


ave 4 = TE UG and £& = al DEE CÁC TEE: ; 
have = = /1+(f’(x))° and F = Ju so substitution for 7* gives K = tics: 


(17.4) 


The important insight, here, is that the curvature formula follows from measuring the rate 
at which the tangent line rotates as the arc length increases. 


Curvature of a Space Curve 


The curvature of a space curve is defined as the magnitude of the rate of change (with 
respect to arc length) in the unit tangent vector T. Since T always has length 1, any change 
in it must be caused by a change in its orientation. This again captures the idea of curvature 
as a measure of the turning of the tangent. 

The formula x = || wt || captures the definition but is best avoided in practice. It requires 


parametrization by arc length, which, as Example 17.5 showed, is a complication best 
avoided when possible. To be derived shortly, a more practical formula is 


IR x R"||  |R' x R^ 

dm 3 = TE! 

p | R']I: 
which works with whatever parameter is given for the curve. The derivatives R’ and R" are 
simply the first and second derivatives of the curve's components and are taken with respect 


to the given parameter on the curve. The numerator is the length of the cross-product of 
these two vectors and the denominator is the length of R’, a scalar, cubed. 


(17.5) 


In (17.6), we have R(p), the radius-vector form of the expanding helix shown in Figure 
17.10. Also given in (17.6), we have R'(p) and R"(p), the first and second derivatives, 
respectively, along this curve. 


p cos p cos p — p sin p —2 sin p — p cos p 


R= | psinp R’ = | sin p + pcos p R” = | 2cosp — psinp (17.6) 


p l 0 


17.3 Curvature 427 


The cross-product is given by 


i j k —2cos p + psinp 
R’ x R” =| cosp — psinp sinp+pcosp 1|—|-2sinp— p cos p 
—2 sin p —pcosp 2cosp— psinp 0 p +2 


and its length by |R' x R"|| = y8 + p* + 5p?. The denominator contains p = |[R'|| = 
vet +P" Figure 17.11 


y p? + 2, so the curvature along this space curve is given by x = aT 
shows how x (p) varies along the curve. As the radius of the helix increases, the curvature 


| decreases. The curvature is greatest when the helix is just beginning to unwind. $ 
DERIVATION i ad = x(p)i + y(p)j + z(p)k, wecan verify that « = | 4t L| = IRR l 
0 E— 3— 3 —1 —1 —F* P as follows. Write T = Èz, and use the chain rule to obtain £T. = Z2 = dT 1. = 
2 4 6 8 10 12 dT 1 IR" I ds dp ds dp ds/dp 
. dp IRT Then, 
FIGURE 17.11 Curvature as a function of e 
p along the expanding helix of Example dT d ( R’ ) R" R d ( 1 ) (17.7) 
17.6 = m jue 7 : 
i dp dp \IRI/ IR dp VIRI 
Now, |IR'|| = /(x’)? + (y)? + 2, so 
d l ) l 2 n2 I2 —3/2 b. Ed 1 R’ R” 
—12-z(Q) ^ 0» +Y Qx'x" + 2y'y" 4 22'2") = ————— 
dp ie Il 2 l ) IRP 
(17.8) 
Thus, using (17.7) and (17.8), a becomes 
dT R" „R'e R” 1 " „R'e R” | 
MEE 
ds IIR” IRP 7 IR IRF 7 R'E 
Now, RU d is the component of R" along R' (see Exercise A5 and Figure 17.12), so 
R"l sin 9 R” — RE is therefore the component of R” perpendicular to R’ (see Exercise A6 and 


Figure 17.12) and is given by ||R"|| sin, where @ is the angle from R’ to R”. Thus, 
dT — |R'||R"| sine 


om ds — || R^|[? 
FIGURE 17.12 Components of R" along : ; . . . 
and perpendicular to R' and since |R/ x R"|| = ||R’||||R” || sin 0, the desired result follows. 
EXERCISES 17.3-Part A 
Al. At x = 1, compute the curvature of y = x°. to A, denoted B | 4, is given by B — B4. If A = i — 2j. B = 2i + 5j. 
A2. Let R = i + pj + p^k define a space curve. Obtain its curvature at obtain the vector components of B along A, and perpendicular to A. 
the point corresponding to p — 2. AS. Use Figure 17.12 to show that the component of R" along R' is 
A3. A plane curve is given parametrically by x = x(p), y = y(p). R' RoR = E . R”) TE 
Write the curve as R = x(p)i + y(p)j + 0k, mna ne (Dhar ts A6. Use Figure 17.12 to show that the component of R” perpendicular 
show that the curvature is given by K = 773. to R' is R’ — R’ RR = = |[R"| sind. 


A4. The vector component of the vector B along the vector A, denoted 


Ba, is given by E^ 


BAA, and the vector component of B perpendicular 
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EXERCISES 17.3-Part B 


B1. For each of the following pairs of vectors A and B, obtain the 
vector component of B along, and perpendicular to, A. 


(a) A = 6i — 7j + 8k, B = 2i + 3j — 5k 
(b) A = 2i — 3j + 5k, B = —7i + j + 4k 


In Exercises B2—6: 


(a) Use (17.4) to obtain, as a function of x, the curvature of the 
given curve. 


(b) Plot the curvature as a function of x. 
(c) Obtain «x (xo). 
(d) Write 6 = arctan y' and compute the curvature as « = 4? 


ds" 
(e) Parametrize the curve with x — p, y — y(p), and write the 
curve in radius-vector form R(p). 


(f) Obtain T(p), a unit tangerit vector, and p(p) = |[R'(p)||. 


dT dT 1 
ds dp p 


(g) Obtain x (xo) by evaluating | at p = xo. 


B2. y(x) = e?, xy =0 


B4. y(x) = yx, xo = 1 


B3. y(x) = x? — 4x? + 5x — 3, xo = 2 
1 


B5. y(x) = rx 


Xo —1 
3 


fe 
B6. y(x) = = -, Xo = 0 


In Exercises B7-16: 


(a) Use (17.4) to obtain, as a function of x, the curvature of the 
given curve. 


(b) Plot the curvature as a function of x. 
(c) Obtain « (x1). 


(d) Determine where « has its absolute maximum and minimum 
on the interval [x;, x3]. 


(e) Write 0 = arctan y’ and compute the curvature as x = “4 


ds ' 
(f) Parametrize the curve with x = p, y = y(p), and write the 
curve in radius-vector form R(p). 
(g) Obtain T(p), a unit tangent vector, and p(p) = ||R’(p)||. 


dT 
ds 


(h) Obtain « (x1) by evaluating 


4) at p=. 
B8. Exercise B4, Section 17.1 
B10. Exercise B6, Section 17.1 
B12. Exercise B8, Section 17.1 
B14. Exercise B10, Section 17.1 


B16. Exercise B12, Section 17.1 


B7. Exercise B3, Section 17.1 

B9. Exercise B5, Section 17.1 
B11. Exercise B7, Section 17.1 
B13. Exercise B9, Section 17.1 
B15. Exercise B11, Section 17.1 


In Exercises B17—28: 


(a) Use (17.5) or the formula in Exercise A3, as appropriate, to 
obtain « (pı). 


(b) Obtain T(p), a unit tangent vector, and p(p) = ||R'(p)||. 
dT | 
dp p 


(c) Obtain x (pi) by evaluating | ex | = | | at p = pi. 


B17. Exercise B13, Section 17.1 B18. Exercise B14, Section 17.1 
B19. Exercise B15, Section 17.1 B20. Exercise B16, Section 17.1 
B21. Exercise B17, Section 17.1 B22. Exercise B18, Section 17.1 
B23. Exercise B19, Section 17.1 B24. Exercise B20, Section 17.1 
B25. Exercise B21, Section 17.1 B26. Exercise B22, Section 17.1 
B27. Exercise B23, Section 17.1 B28. Exercise B24, Section 17.1 
In Exercises B29—34, it is possible to obtain R = R(s), where s is the 
arc length. For each: 

(a) Obtain T(s) = R'(s). | (b) Obtain x = || T'(s)||. 

(c) Use the formula in Exercise A3 to obtain «x (p). 


(d) Show that the two expressions for curvature computed in 
parts (b) and (c) agree, provided the change of variables 
s = s(p) is made in the first expression for x. 


B29. Exercise 23, Section 17.2 B30. Exercise 24, Section 17.2 
B31. Exercise 25, Section 17.2 B32. Exercise 26, Section 17.2 
B33. Exercise 27, Section 17.2 B34. Exercise 28, Section 17.2 


The circle of curvature, given by (x — hy. + (y — ky = R?, where h = 
FOUA 1 1+ f'(a)? 1 2 +f a? p 
ma k= SA + Wo o R g = a is the 
unique circle that, at x = a, makes “second-order” contact with the 
curve y = f(x). The point (h, k) is called the center of curvature at 
x = a. For the curve specified in each of Exercises B35-39: 


a 


(a) Obtain the center of curvature at a = xo. 
(b) Graph the circle of curvature along with the given curve. 


(c) Plot the locus of the centers of curvature. The resulting curve 
is called the evolute of the given curve. 


(d) Taking a = xo, show that the circle of curvature touches the 
given curve at (xo, f (xo)): that is, show (xo, f(xo)) is a point 
whose coordinates satisfy the equation of the circle of 
curvature. 


(e) Show that at (xo, f (xo)) the slopes of the circle of curvature 
and of the curve y = f(x) agree. 


(f) Show that at (xo, f (xo)) the second derivatives of the circle of 
curvature and the curve y = f (x) agree. 


(g) Show that at (xo, f (xo)) the third derivatives of the circle of 
curvature and the curve y = f(x) do not agree. 


B35. Exercise B2 B36. Exercise B3 B37. Exercise B4 

B38. Exercise B5 B39. Exercise B6 

B40. Exercise B3, Section 17.1, with a — x; 

B41. Exercise B10, Section 17.1, with a = x, 

B42. Derive the formulas for the circle of curvature. Begin with 
(x — hy) + (y — k = R? and 


(a) write the equation that corresponds to having the point 
(a, f (a)) satisfy the equation of the circle. 


(b) use implicit differentiation on the equation of the circle to 
obtain y'(a) and then form the equation y'(a) = f'(a). 

(c) use implicit differentiation again to obtain y"(a) and then 
form the equation y"(a) = f" (a). 


(d) solve, for A, k, and R?, the three equations from parts (a)-(c). 


The lines y = +1 are envelopes of the family of circles described by 
f(x, y, a) = (x — ay + y? — 1 = 0. One member of the family is tan- 
gent to the envelope at each point on the envelope. In general, an envelope, 
ifitexists, can be found by eliminating the parameter a from the two equa- 
üons f(x, y, a) — 0 and — 0. Sometimes, these two equations lead 
to y = y(x), but more often, the envelope must be given parametrically 
by x = x(a), y = y(a). For the families in Exercises B43-47: 


(a) Obtain any envelope that might exist. 
(b) Graph the envelope, along with some representative members 
of the family. 
B43. x? — a(y —a) =0 B44. 2a(x — a) - a? — y=0 


B45.3a?(x —a) +a? — y «0 B46. y 4-2a(x 1=0 


a)-a? 
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B47. x cosa + ysina — 1 = 0 
The evolute of the curve C is the envelope of the family of normals along 
C. For the curves given in Exercises B48—52: 
(a) Obtain the equation of the evolute, the locus of the centers of 
curvature. 
(b) Obtain the equation for the family of normals along C. 


(c) Obtain the envelope of the family of normals, and show that 
this envelope is the evolute found in part (a). 


(d) Plot the curve C, the evolute, and several representative 


normals along C. 


B48. y=x? B49. y - 3? B50. y — x 


1 
B51. y=e* B52. y=-,x>0 
Xx 


B53. Show, in general, that for any smooth curve y = f(x), the 
envelope of the family of normals is the evolute, defined as the 
locus of the centers of curvature. 


l Principal Normal and Binormal Vectors 


Normal Vectors and the Principal Normal 


FIGURE 17.13 Two possible normals for 


a plane curve 


A vector n is said to be normal to a curve if n is perpendicular to the natural tangent vector 
R’ or to any of its multiples such as T, the unit tangent vector. In the plane, there are two 


possible directions for the vector n, as shown in Figure 17.13. In any event, the recipe 
1dT ld 1 
N= = T(p) (17.9) 
k ds k dp p 


singles out N, a unique unit normal vector called the principal normal vector. 


NORMAL VECTORS IN THE PLANE Evaluating (17.9) at p = 2 for the plane curve given on 
the left in (17.10) results in the principal normal given on the right. (See Exercise A1.) 


r-e] "mI 


In the plane a specific principal normal can be constructed as follows. From T, the 
unit tangent vector, form two candidates for N by switching the two components of T and 
negating, in turn, each of the components in the new vectors. These three vectors are given 
in (17.11) and are the vectors graphed in Figure 17.13. 


(17.10) 


ce) BL] TES 


The two vectors n; and n» point in opposite directions since they differ by a minus sign. 
By construction, they are both perpendicular to T since 


d .| T Late o 
b * = =a DA = 
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FIGURE 1714  T(2) and N(2) for 
R — pi 4- pj 


FIGURE 17.15 T($). NG), and several 
of the infinite normals at a point along a 
helix 


EXAMPLE 17.7 


In this example, the vector n» is the principal normal N. In general, the principal normal 
points inward toward the center of curvature (defined in Exercise B34, Section 17.3). It is 
helpful to observe that after switching the components in T, negating the first component 
(as in n2) yields a vector “to the left" of T whereas negating the second component (as 
in nj) yields a vector “to the right" of T. Thus, facing in the direction of T, the right arm 
extended out to the side would point in the direction of a vector that is to the right of T. 
Figure 17.14 shows the curve R and the vectors T(2) and N(2). 


NorMat VecTors IN SPACE In space, there are an infinite number of vectors perpendicular 
to the tangent vector R’. These normal vectors form a plane to which the tangent vector is 
perpendicular. For example, evaluating (17.9) at p = 7 for the helix given on the left in 
(17.12) results in the principal normal given on the right. The unit tangent vector T is given 
in the center. (See Exercise A2.) 


cos p (: 1 —1 E) 0 
R=] si T(-~)=—] 0 N(—)2|-1 (17.12) 
P z) Z| | 2 s 


The point on R corresponding to p — 7 is (0, 1, 7). In Figure 17.15 the thickest arrow 
represents T(4), while the thinner arrows are six of the infinite number of possible vectors 
normal to R. The figure also shows a portion of the plane which is perpendicular to T(X) 
and contains the six normal vectors. The principal normal, also lying in this plane, is the 
unique vector N shown in the figure. 


Principal Normal Vector—Theory 


Amongst all the possible normal vectors at a point on a space curve, the principal normal 


is the normalized version of the vector a Since the curvature « is defined as the length 


of this vector, that is, since x = || l the principal normal, a unit vector, must then be 
N = 141, Computing the derivative 4 Fn 1 by the chain rule leads to 


xa 
N a; dp 1 dT 1 1dT1_ 1 aT 
- dp ds «dp % kdpp xp dp 


as a practical formula for computing N. 
Since T is a unit vector, T and N must be perpendicular. The proof is essentially 
computational, starting with the identity T - T = 1. Differentiating this dot product gives 


dT dT 
-T+T- =0 
ds ds 
or 2T - 4 = 0, from which T- 4 = 0 and T - 4% = 0 clearly follow. But this last 


equation is just T - N = 0, which shows T and N are Tate 


Table 17.4 lists a space curve R and vectors arising in the computation of T(1) and N(1). 
First, R'(p) is computed, and from this, 


ds ; > 7 
p=— = |R (p) =v1+4p* +9p 


dp 
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p 1 1 , 1 
R=| p? R' =| 2p T=VA,| 2p Td) = 7 2 
p 3p? 3p p 3 
0 6p? —pQ +9p°) —11 
R’ =| 2 R’ x R” = | -6p ES es 22 1 —9p* N(1) = x= 8 
dp 2 4/266 
6p 2 3p(1 2p’) 9 
E 1 
~ 1+44p?+9p4 


TABLE 17.4 Vectors for Example 17.7 


and T(p) = TR'(p). Evaluating at p = 1, we get T(1). Next, R"(p) is computed, and 


from this, |R' x R"|| = 2,/9p* + 9p? + 1 and 
" |R'xR"| |, V9p*+9p? +1 


—2 17.13 
p? (1+ 4p? + 9p4)3/2 ( ) 


Evaluating at p = 1, we have «(1) = x266. Then, us is computed, and from this, the 
principal normal 


—2p(2+ 9p?) 


A ! 2 —9p*) (17.14) 
= So SS RE 5 = P 3 
FIGURE 17.16 TandNat p = å and 1 kp dp 2/1+4p? + 9p+,/1 + 9p? + 9p* 6p(1 + 2p?) 
for the space curve in Example 17.7 
is obtained. Evaluating at p = 1 gives N(1). 
Figure 17.16 shows the curve R, along with T and N at p — i and 1. 


EXAMPLE 17.8 Table 17.5 contains the parametric equations of the plane curve shown in Figure 17.17. The 
table includes the radius vector R and the derivative R’. Since 


- P 
p-|RI-——- pcr 


dp 


the unit tangent vector T is readily obtained. The curvature, computed by the formula in 


x(p) = pcos p R= cos p — psin p dT — 2+ p? sin p + pcos p 
y(p) = psinp ~ | sinp + pcos p dp | (1+ p2)?? | psinp — cos p 


pcos p T= 1 cos p — psin p N= 1 — sin p — p cos p 
~ | psin p B /p? + 1 |sinp + pcos p i /p? +1 | cosp— psinp 


TABLE 17.5 Vectors for Example 17.8 


>< 


FIGURE 17.17 Example 17.8: The curve, 
and several sets of vectors T and N 


EXAMPLE 17.9 
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Exercise A3, Section 17.3, is 


2+ p? 
"E ~ a + p?)3/2 
A straightforward but tedious computation gives 47 


dp’ 
obtained as N = = = At each point on the curve R, there is a unit tangent vector T and a 


-— : a * 
principal normal vector N, also a unit vector, as shown in Figure 17.17. Md 


Ix'y" — y'x 


hast? / | 


K = 


(17.15) 


from which the principal normal is 


The Binormal Vector 


Given the unit vectors T and N along a space curve R, we define the binormal vector 
B = T x N, which is a unit vector perpendicular to both T and N. (Students who remember 
the word BuTtoN will be “right on the button” when computing the binormal vector.) 


Tangent, normal, binormal vectors 
R” are given. Since 


In Table 17.6, R defines a helix for which R’ and 


ds 1 
p = |R'| = — = -7145 (17.16) 
z dp 4 
we immediately have both T and en The curvature is given by 
R’ x R” 48 
? K l i = (17.17) 
p? 145 
FIGURE 17.18 Example 17.9: The curve 
R and the vectors B, T, and N soN = oe readily follows. Finally, the binormal is computed as B = T x N. Figure 
17.18 shows the helix, with a radius vector to a point on it at which the vectors B, T, and 
N are drawn. ^ 
r ira p " B sinp 1 " — sin p T "Er 
= | 3sinp ‘= 3 cos p = cos p — = ——— | sinp 
i i V145 i dp V145| p 
4P A i2 
—3cos p " sin p — cos p j sin p 
R” = | —3 sin p R’ x R” = — | — cos p N = | -sin p B = —— | —cos p 
4 / 
0 12 0 hs 12 
TABLE 17.6 Vectors for Example 17.9 
EXERCISES 17.4—Part A 
A1. Compute N for the plane curve R in (17.10). A6. Verify the computation of R’, T, and in Table 17.5. 
A2. Compute T and N for the curve R in (17.12). A7. Verify the computation of « in (17.15). 
A3. Verify the computation of T, oe and N(1) in Table 17.4. AS. Verify the computation of N in Table 17.5. 


AA. Verify « in (17.13). 
AS. Verify N in (17.14). 


A9. Verify (17.16) and (17.17) in Example 17.9. 
. Verify B = T x N in Example 17.9. 


EXERCISES 17.4-Part B 
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B1. Given R(p), an alternative recipe for computing T, N, and B 
begins with p = ||R'(p)|| and T = ZR’. Then, B = T and 
N = B x T follow. This recipe avoids differentiation by the chain 
rule. 
" R'xR" |. EN: a 
(a) Show that RaR = T x N and, hence, B. 


(b) Show that B = T x N implies B x T = N since (T x N) x T 
can be simplified with the vector identity (a x b) x c = 
(a » c)b — (b+ c)a. 


For the functions y = y(x) specified in Exercises B2-11: 


(a) Graph the curve corresponding to the function. 


(b) Using the parametrization x = p, y = y(p), represent the 
curve in radius-vector form. 


(c) Obtain T(1) from T(p) — Rp). 


(d) Obtain N(1) from T(1) by interchanging the components of T 
and inserting a minus sign to make N(1) point inward toward 
the center of curvature. 


(e) Sketch T(1) and N(1) on the graph drawn in part (a). 

(f) Obtain « (1) from a 

(g) Obtain T'(p). 

(h) Show that N(1) agrees with -T’(p) when p = 1. 
B2. Exercise B3, Section 17.1 B3. Exercise B4, Section 17.1 
B4. Exercise B5, Section 17.1 B5. Exercise B6, Section 17.1 
B6. Exercise B7, Section 17.1 B7. Exercise B8, Section 17.1 
B8. Exercise B9, Section 17.1 B9. Exercise B10, Section 17.1 


B10. Exercise B11, Section 17.1 B11. Exercise B12, Section 17.1 


For the plane curves specified in Exercises B 12-22: 

(a) Graph the curve determined by the given parametric 
equations. 

(b) Obtain T(1) from T(p) = 5R(p). 

(c) Obtain N(1) from T(1) by interchanging the components of T 
and inserting a minus sign to make N(1) point inward toward 
the center of curvature. 

(d) Sketch T(1) and N(1) on the graph drawn in part (a). 

(e) Obtain «(1) from T'(p) and the chain rule. 

(f) Show that N(1) agrees with c T (p) when p = 1. 

B12. Exercise B13, Section 17.1 — B13. Exercise B14, Section 17.1 
B14. x(p) 21— p’; (p =14+ p? 

B15. Exercise B16, Section 17.1 
B16. Exercise B17, Section 17.1 
B18. x(p) = arctan p; (p) = p? 


B17. Exercise B23, Section 17.2 
B19. x(p) = p°; y(p) = sin p 

B20. x(p) = cos p; y(p) = e? 

B21. x(p) = n(1 + p; y(p) =1+2p 


B22. x(p) = In(1 + p); y(p) = p? 
For the space curves specified in each of Exercises B23-29: 


(a) Obtain R’, R”, and p = ||R'|. 


(c) Obtain x (1) from IERI, 


(b) Obtain T(p) and T(1). 

(d) Obtain T'(p) and T'(1). 

(e) From part (d) and the chain rule, obtain N(1) from ST. 

(f) Obtain B(1) = T(1) x N(1). 

(g) Obtain T, N, and B by the recipe in Exercise B1 and test your 

results by evaluating at p = 1. 

B23. 
B25. 
B27. 
B29. 


B24. Exercise B19, Section 17.1 
B26. Exercise B21, Section 17.1 
B28. Exercise B23, Section 17.1 


Exercise B18, Section 17.1 
Exercise B20, Section 17.1 
Exercise B22, Section 17.1 


Exercise B24, Section 17.1 


As a result of the work of Frenet and Serret (1852 and 1851, respec- 
tively) it is known that the moving basis vectors T, N, and B, and the 
two scalars «, the curvature, and the torsion t, completely determine 
a curve R = xi + yj + zk. The torsion is given by t = —B'(s)- N = 
N'(s)-B-— ERU and measures the twist of the curve R out of the 
osculating plane, the plane determined by T and N. For each space curve 
specified in Exercises B30—36: 


(a) Calculate the torsion via rt = —B'(s) - N, where B'(s) = i 
by the chain rule. 
(b) Calculate the torsion via x = N'(s) - B, where N'(s) = b 


by the chain rule. 


(R'xR^)-R" 


(c) Calculate the torsion via tT = IRR" 


(d) Graph t (p). 
B30. Exercise B18, Section 17.1 
B32. Exercise B21, Section 17.1 B33. Exercise B22, Section 17.1 
B34. B35. Exercise B24, Section 17.1 
B36. x(p) = In(1 + p°); y(p) = p; z(p) = p? 


B31. Exercise B20, Section 17.1 


Exercise B23, Section 17.1 


The differential equations T'(s) = «N, N'(s) = —«T + tB, B'(s) = 
—tN are known as the Frenet-Serret formulas for a space curve R. For 
each space curve specified in Exercises B37—43, show that these dif- 
ferential equations are valid. Compute the derivatives on the left by the 
chain rule so that the variable of differentiation is p. Thus, T'(s) — I = 
for example. 


B37. Exercise B30 
B40. 
B41. 
B44. 


B38. Exercise B31 B39. Exercise B32 
x(p) = cos2p; y(p) = sin2p; z(p) = cos2p 

Exercise B34 B42. Exercise B35 B43. Exercise B36 

The Frenet-Serret formulas are nine differential equations for 
nine unknowns, three components each in the three vectors T, N, 
and B. Take x = s and t = s?, T(0) =i, N(0) = j, and 

B(0) — k. Solving the nine Frenet-Serret equations will give the 
moving basis vectors but not yet give the curve R = x(s)i + 
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y(s)j + z(s)k. The connection between the curve and T is differential equations can be integrated numerically to give the 
R’ = T. Hence, T' = R” = x"(s)i + y"(s)j + z"(s)k, and the moving basis vectors and the curve R. Obtain this solution and 
first three equations are second order, requiring such additional plot the graph of R as a space curve. 

initial conditions as x (0) = y(0) = z(0) = 0. Now, the nine 


Resolution of R" into Tangential and Normal Components 


Resolution of R” along T and N 


The vector R"(p) has components only along the moving basis vectors T and N, a result 
expressed by the equation 


R" = p'T +p N (17.18) 


where o! = 2e Thus, R"(p) always remains in the osculating plane, the plane determined 
by the vectors T and N, as we shall prove at the end of this section. 

In the special case where the parameter p is the time f, the derivative R'(r) is V, the 
velocity vector; R” (t) is a, the acceleration vector; and v = ||R‘(t)|| is the speed, the 
magnitude of the velocity vector. In this event, the decomposition of the acceleration vector 
into components along the tangent and normal vectors is written as 


a = 0T 4- kv?N (17.19) 


where the raised dot on v denotes the derivative w, Thus, the formula for the accelera- 


tion vector reads aloud with a memorable “vee-dot tee,” by which the author recalls the 
component that goes with the vector T. 


The term 2» called the rate of change of the speed, is not the “scalar acceleration a,” 


nor is it the magnitude of the acceleration vector. In fact, there is no scalar associated with 
acceleration. The length of the velocity vector V is the scalar speed v, but the length of the 


acceleration vector a is not a scalar of any dynamic significance. It is an egregious error 
to believe — is a, the length of the acceleration vector. In fact, using raised dots to denote 


differentiation with respect to t, the acceleration vector is a = Xi + yj + Zk and the speed 
v is given by v = yX? + y? + 22. The length of the acceleration vector, ||a||, and the rate 


of change of the speed, 2, are given respectively by 


Bo oe dv XX +yV+2722 
X? + y? +Z? and = = 
dt 


lal = 


It should be clear that 2 and ||a]| are completely unrelated. 


EXAMPLE 17.10 To demonstrate the validity of the decomposition (17.18) for the parabola curve R, given 
in Table 17.7 and graphed in Figure 17.19, compute R' and R" as shown in Table 17.7. 


TABLE 177 Vectors for Example 17.10 


17.5 Resolution of R" into Tangential and Normal Components 435 


Then, |R'|| = p = i oe T p? and the curvature, given by the formula in Exercise A3, 
Section 17.3, iş K — i TP yz. On the right in Um 18) there are four terms, namely, T, 
N, p', and xp”. The unit tangent vector is T = x and N, the principal normal vector, is 
obtained from T by interchanging the components and negating the first (new) component, 
causing N to lie to the left of T. (Of course, this ww only exists for a planar curve.) 
The tangential "eae of R” is the derivative @ 2 P and its normal component 


+p? 
The sum p’T + xp?N is then 


is the product xo? 


T — P 
FIGURE 17.19 The parabola in Example 2p 1 B * 2 1 L4] H =R” & 
17.10 Ara dira lt JATIEAYE 2 


EXAMPLE 17.11 The plane curve R, given in Table 17.8, is a circle with radius 3 and center at the origin. 
Interpreting the parameter f as the time, R' is the velocity vector V, the speed is v = ||V|| = 
3, and R” is the acceleration vector a. The unit tangent vector is given by T = Y, and N, the 
principal normal vector, is most easily obtained from T by interchanging components and 
negating the second component. The curve R represents uniform motion around a circle, so 
ù = 0 and a = R” has no tangential component. The curvature of a circle is the reciprocal 
of the radius, so x = i and the normal component of a is kv? = 33? = 3,soa = 3N, 
verifying the decomposition a = ÙT + xv?N. Hence, the acceleration vector is directed 
completely along N, the principal normal. % 


3 t —3 sin ź —3 cost — sint — t 
_ in y= sin "T en T= sin N= eds 
3sint 3cost —3sint cos f — sint 
TABLE 17.8 Vectors for Example 17.11 


EXAMPLE 17.12 Table 17.9 contains Hs radius vector R(p) defining a space curve, along with the vectors 
R'(p), R'(p, T = E, and T' — = These vectors are computed as functions of the 
parameter p, even though we want to verify (17.18) at p = 0. In addition, we must compute 


1 P 
1+ p* (1+ p^) á 3p? —1 
= R' = 1 = —___. 0 
R p I (1 + p? A 
p ] — p* pp” —3) 
1+ p* (Ll 4p) 
—2p 
1+ p? 3p° + 5p*+2p*-2 
i 1 dT 2 (14. po! 
molta = 3/2 2 d du di 
442p +2 5 dp 4. 2p2 4-2 1+ p? 
vp*+2p =p (pt +2p +2)" (1+) angi pt -5p -5) 
1+ p? 


TABLE 17.9  Parameter-dependent vectors for Example 17.12 
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EXERCISES 17.5—Part A 


the scalar quantities 


4.1999 1.9 2 

j=j RTT a au E. (17.20) 

Lp p? (1 + p p* + 2p? +2 
At p = 0, the curve passes through (1, 0, 0), at which point the six vectors 

R'(0)=j+k R'(0)—--2i TO)= E +k) T'(0-2 -42i (17.21a) 
1 ] 

N(0) = ————T'(0 -—-i  B(0)—T(0) xN(0) = —(k-j 17.21b) 

1 — xp Ub a? ( 
are computed, provided the scalars p(0) = V2, p'(0) = 0, and «(0) = IOS =i 


are also obtained. Thus, (17.18) is verified by noting that R” (0) = OT + (/2)? N(0). More- 
over, B is orthogonal to the plane determined by T and N. But that plane contains R", so B 


must be orthogonal to R". At p — 0 we see that, indeed, B - R" — 0. kx 


This example demonstrates just which quantities need to be computed as functions of 
the parameter p and which quantities can be evaluated at the specific argument p = 0. 


Derivation 


A general proof that R" lies in the plane of T and N follows immediately upon verifying 
the decomposition (17.18) because this formula plainly says that R" consists of compo- 
nents along just T and N. Now, this formula can be derived from the two familiar results 
T = È and N = z is if they are written as R' — oT and E = KN. Differentiating, with 
respect to p, the first of these, gives R" = E 5 LoT]. which, by the product rule for differenti- 
ation, becomes R" — PT +p pe By the chain rule, the second term on the right becomes 
E = aus = 4t p, Hence, R" becomes R" = “2T + pop, which, upon replacing 4* 


dp ds 
with «N and ae with o', becomes (17.18). 


A1. Show that E —T.a. 
A2. Obtain « for Example 17.10. 


A4. Verify the computations in (17.20). 
AS. Verify the calculations in (17.21a) and (17.21b). 


A3. Verify that the curvature of a circle is the reciprocal of its radius. 


EXERCISES 17.5-Part B 


B1. Verify the computations in Table 17.9. 
For the curves specified in Exercises B2-11: 


(a) Obtain a graph of the curve. 


(b) Using the parametrization x = p, y = y(p), obtain R’(p). (g) Show that = = SW") and Kp? = 


of R” along T and along N. Show that these are p’T and 
xp°N, respectively. 

(f) On the graph of the curve, and at the specified point, draw the 
vectors p'T, o?kN, and R”. 


If” (p) 
J MEC (Q? 1+(f"(p))2 


(c) Obtain T(p), N(p). o(p), p'(p). and «(p). 


(d) Show that (17.18) is valid. 


(e) Using the projection operator BA — 


of B along A and working at p = x), obtain the components 


B-A A for the c 
AAA A for the component 


B2. Exercise B3, Section 17.1 B3. y = 7x? -2x +3, xı = —1 
B4. Exercise B5, Section 17.1 B5. Exercise B6, Section 17.1 
B6. Exercise B7, Section 17.1 B7. Exercise B8, Section 17.1 


B8. Exercise B9, Section 17.1 
B10. Exercise B11, Section 17.1 


B12. Show that, in general, for the plane curve y = f(x), p'(x) = 


B13. Exercise B13, Section 17.1 
B15. Exercise B14, Section 17.4 
B17. Exercise B22, Section 17.4 


B9. Exercise B10, Section 17.1 
B11. y = In(1 +. x7), x; =0 


f'( f" (x) 


J+ F/O)? 


MESI 


SIF)?” 


and Kp? = 


For the curves specified in Exercises B13-17: 


(a) Obtain a graph of the curve. 

(b) Obtain R"(p). 

(c) Obtain T(p), N(p). o(p), p'(p), and k(p). 

(d) Show that (17.18) is valid. 

(e) Using the projection operator By = BAA for the component 
of B along A, and working at p = 1, obtain the components 
of R" along T and along N. Show that these are p’T and 
kp?^N, respectively. 

(f) On the graph of the curve, at the point corresponding to 
p = 1, draw the vectors p'T, o?kN, and R”. 

B14. Exercise B18, Section 17.4 


B16. Exercise B16, Section 17.1 


For the curves specified in Exercises B18—24: 


(a) Obtain R"(p). 
(b) Obtain T(p), N(p), o(p), p'(p), and «(p). 


17.6 Applications to Dynamics 


(c) Show that (17.18) is valid. 


(d) Using the projection operator B, = =ê 


A-A 


of R” along T and along N. Show that these are p’T and 

kp^N, respectively. 
B18. Exercise B18, Section 17.1 
B20. Exercise B20, Section 17.1 
B22. Exercise B22, Section 17.1 
B24. Exercise B24, Section 17.1 


In Exercises B25-29, V (tọ) and a(to) are given, for the same curve, at 


time t = fy. 
(a) Obtain v(fto). (b) Obtain T(t). 
(c) Obtain v'(9). (d) Obtain x (to). 
(e) Obtain B(to). (Hint: See Exercise B1, Section 17.4.) 
(f) Obtain N (to). 
B25. V(t) = 3i — 4j + 2k, a(to) = 13i + 2j + 5k 
B26. V(t) = —5i + 7j — 8k, a(f) = 4i + 17j — 8k 
B27. V(t) = 2i — 5j — 12k, a(t) = 5i — 6k 
B28. V(t) = 6i + j — 2k, a(to) = —9i + 11j + 15k 
B29. V(to) = —i — 7j + 9k, a(t) = ŝi + $j — k 


Applications to Dynamics 


Geometry and Dynamics 


If the parameter for a curve R(p) is actually the time, ¢, then, from Section 17.5, the de- 


composition formula (17.18) becomes 


where a is the acceleration vector for a particle moving along the curve described by 
R(t). This is a remarkable result. It says that motion (as described on the left side by the 
acceleration vector a) is determined by the geometry on the right side (as described by the 
geometric quantities T, the unit tangent vector, N, the principal normal, «, the curvature, 
and v, the length of R’). 

Hence, this decomposition equation for the acceleration vector can be used to solve 
problems in dynamics where, primarily, the geometry of the path of motion is known. When 
(17.22) is combined with Newton’s second law, F = ma, several interesting applications 


become accessible. 


EXAMPLE 17.13 


without skidding? 


a = (T 4- kv?N 


Together, all four tires of a car in uniform motion around a circular track can exert toward 
the center of the track, a total frictional force of no more than 450 Ib. The radius of the track 
is 200 ft and the car weighs 3200 Ib. What is the fastest constant speed the car can sustain 


A for the component 
of B along A, and working at p — 1, obtain the components 


B19. Exercise B36, Section 17.4 
B21. Exercise B21, Section 17.1 
B23. Exercise B23, Section 17.1 


(17.22) 
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EXAMPLE 17.14 


Taking the gravitational constant to be 32 ft/s”, the mass of the car is m = z = ee = 


100 slugs. The curvature of the track is the reciprocal of its radius (Exercise A3, Section 
17.5), so k = i = x5 The speed v is constant, so ù = 0. Hence, the acceleration becomes 
a=0T+ 3 "^N. The acceleration is directed along N, which itself points toward the cen- 
ter of the circular track. The force of friction also points toward the center of the track, and 
so must be along N. Hence, F = 450N. But F = ma and a = ZN, so 450N = 100(45)N 
or 450 = iv?. Solving this for the speed yields v = +30, with the positive answer, 30 
ft/s, as the appropriate answer. Note that the units in the problem were fixed as soon as the 
gravitational constant g was taken as 32 ft/s?. To obtain an answer in miles per hour, convert 


to 20.45 mph afterward. o 


An object weighing 8 Ib is moving from left to right along the curve y = —x?. When it is 
at the origin, the total force on it is F = i — 2j Ib. What is its speed, and at what rate is it 
speeding up or slowing down at that point? 

The unknowns in the problem are v and ù. From the geometry, the vectors T(0) and 
N(0) can be found. From the force F, Newton’s second law (F = ma), and from (17.22), 
the equation 


F= L5 = m[vT(0) + xv? N(0)] (17.23) 


is obtained. From the weight w = 8 Ib, the mass m = A = 1 slug can be determined, but 
the curvature x at x = 0 must be computed from the equation of the curve. (The problem 
is predicated on the curvature being defined as a positive quantity.) 

To write the curve y = y(x) parametrically with parameter p take x = x(p) = p and 


y = y(p) = — p°. Then, we have 


Ri) =| A 10) =(4| No =| d 
=p” 0 =] 


The curvature at the origin is x (0) = 2, so (17.23) becomes 


La] ll ara 


2 
y- 


or the pair of equations 1 = - and —2 = —+, obtained by equating corresponding com- 
ponents in (17.24). Since v = ||R'(r)|| is a positive quantity, v = 2, and ù = 4, the object 
is speeding up at the rate of 4 ft/s, the units being determined by the choice of g — 32 ft/s?. 

S. 


c d 


Note that R was parametrized with p to avoid the absolutely crushing error of writing 
the letter t and then believing it must therefore be the time. Nothing could be further from the 
truth. There is no indication in this problem as to how the object moves in time. The curve 
is given geometrically and cannot be parametrized in terms of the time. Consequently, com- 
puting from R(p) the magnitude 
the error this problem is designed to detect. 


dt 


4; RG)]| and thinking it is v(f) — | ZR()| is precisely 


EXERCISES 17.6 


439 


17.6 Applications to Dynamics 


1. Find the force of friction required to keep a car on a circular track 
of radius 300 ft if the car weighs 3200 Ib and travels at the constant 
speed of 200 ft/s. 


2. A satellite is traveling at a constant speed in a circular orbit 400 mi 
above the surface of Earth where the acceleration of gravity is 30 
ft/s?. If the radius of Earth is taken as 4000 mi, what is the speed (in 
miles per hour) of the satellite? 


3. A coin weighing A Ib remains on a turning phonograph record if the 
force on it is not more than E Ib. How far (in inches) from the center 
of a revolving 45-rpm disk can this coin sit without sliding off? 


4. What is the maximum magnitude of the force needed to cause an 
object weighing 2 Ib to move at the constant speed of 3 ft/s along 
the parabola y — x?? 

5. An object of mass 3 kg is traveling counterclockwise around the 
ellipse 4x? + 9y? = 36. When it reaches the point (0, —2) the force 
on it is 3i + 5j. At this point, what is its speed? 

6. To create artificial gravity, a cylindrical satellite with radius 100 ft 
is given a constant rotation about its axis. How fast (in revolutions 
per minute) should it rotate if an astronaut whose feet are against 
the outer wall (head pointing toward the axis of rotation) is to 
experience, at foot-level, an acceleration of 32 ft/s?? What would be 
the value of the acceleration experienced at head-level for an 
astronaut 6-ft tall? 


7. What rotational speed (in revolutions per minute) imparted to a 
space station will cause the center of the crew's quarters, 8 m from 
the axis of rotation, to experience the same gravitational field as the 
Earth's surface? 


8. A car moves with constant speed 20 ft/s along the curve y — x?, in 
such a way that x > 0, y > 0, and y increases as x increases. At 
(1, 1), find the acceleration vector. 


Chapter Review 


1. Let R = p?i + p?j + pk, 0 < p < 2, define a space curve. 
(a) Obtain R'(p) and R"(p). 
(b) Obtain v(p) — 7 = |R'(p)Il- 
(c) Find the length of the curve. 


(d) Obtain T(p) = ŁR’, the unit tangent vector. 

(e) Obtain x = IRRI, the curvature. 

(f) Obtain N(p) = + = the principal normal. 

(g) Obtain B(1) = T(1) x N(1), the binormal vector at p = 1. 
(h) Evaluate v/T + «v?N at p = 1, and compare to R” (1). 


(i) Show that R” (1) lies in the plane determined by the unit tangent 
and principal normal vectors by verifying R" - B = 0 at p = 1. 


9. 


10. 


11. 


12. 


13. 


14. 


15. 


Jogger X weighs 160 Ib and runs clockwise around the circle 

x? + y? = 25. At the point (3, 4) Jogger X is running 5 ft/s and is 
speeding up at the rate of 10 ft/s?. Find X's acceleration vector at 
the moment X is at the point (3, 4). 


In a horizontal plane, a 1500-kg sports car enters a section of 
circular track and slows down to a constant speed of 100 m/s. The 
radius of curvature of the track in this curve is 80 m. Determine the 
horizontal force exerted on the tires by the road. 


A 4-kg mass is in uniform motion around the inside of a plane 
vertical track whose radius of curvature is everywhere 1.8 m. 
Determine the minimum speed that the mass can have and still 
remain in contact with the track when it is at the top of the loop. 


A 12-Ib object traverses the curve y — e* from left to right. At 

x = 0, the force that is keeping the object moving is —2i + 3j. Find 
the speed, and determine if the object is speeding up or slowing 
down at this point by first finding T(0), N(0), x (0) from the curve 
and, from these, a(0). Now use F = ma, Newton's Second Law, to 
set up and solve two equations in the two unknowns ù and v?. 


A 4-lb object traverses the curve y = nz from left to right. At 
x = 1, the force that is keeping the object moving is —5i + 7j. Find 
the speed, and determine if the object is speeding up or slowing 


down at this point. 


Find the force F that will cause a particle of mass 3 to travel at 
constant speed v — 7 around the ellipse x(p) — 5cos p, 

y(p) = 12sin p. 

An object of mass 2 kg is traveling from left to right along the curve 
y = 4x3 — 7x? + 2x — 1. When it reaches the point (1, —2) the 
force on it is 5i + 2j. At this point, what is its speed? 


. Show that x = A becomes k = Xd for the plane curve 


R = x(p)i  y(p)j + Ok. 


. Let R = pi — p?j, 0 < p < 2, define a plane curve. 


(a) Sketch the curve. 
(b) Obtain R'(1), v(1), and T(1). 


(c) Obtain N(1) from T(1), being sure to have the principal normal 
point towards the center of curvature. 


(d) Using Question 2, obtain «(1), the curvature at p = 1. 
(e) Verify R” = v/T + «v°N, at least at p = 1. 
(f) Obtain the length of the curve. 


. State and illustrate the reciprocal rule for the derivative of an 


inverse function. 
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5. For the curvature of a plane curve y(x), derive the formula 


K = IA. Explain what the curvature measures. 
6. Explain the formula « = || ur || for the curvature of a space curve. 


7. Show that if u is a unit vector, it is necessarily orthogonal to u’, its 
derivative. 


8. Determine the force exerted on a particle of mass m if the particle 
undergoes uniform motion on a circle of radius r. 


9. A particle of mass m = 1 traverses the curve R = 3ri + 9t?j, where 


the parameter f is time. 


(a) Show that the particle describes the parabola y — x?. 


(b) By differentiation, obtain the acceleration vector a = R. 


(c) Using R = xi + x?j as the trajectory, obtain R” = v'T + kv?N. 
Explain why this is not the acceleration vector a. Hint: The 
chain rule for differentiation should enter the discussion. 


10. A particle of mass m = 1 traverses the curve R = t7i + ttj, where 
the parameter ¢ is time. 


(a) Show that the particle describes the parabola y — x?. 

(b) By differentiation, obtain the acceleration vector a — R. 

(c) Using R = xi + x?j as the trajectory, obtain R” = v/T + kv?N. 
Again as in Question 9, R" # a, and unlike the outcome of 
Question 9, R" is not even proportional to a. 


(d) Deduce a condition under which R" would be proportional to a. 


Chapter 18 


The Gradient Vector 


INTRODUCTION If f (x, y, z) is a scalar-valued function describing, for 
example, temperatures in a room, then Dy f, the rate of change of f along a fixed line 
whose direction is given by the unit vector U, is called the directional derivative of f in 
the direction U. This derivative is a spatial rate of change, not a temporal one. It gives the 
temperature gradient, the change of temperature per unit length in a given direction. 

It turns out that the directional derivative can be expressed as the dot product of 
grad(f ) = fri+ fyj + fk, the gradient vector, and the vector U. This gradient vector 
turns out to be orthogonal to the isotherms of f, the surfaces along which the tempera- 
tures described by f are constant. The gradient vector points in the direction of increasing 
temperatures, and the greatest rate of change in f is the length of grad( f). 

By defining the del or nabla operator V — iĉ + ji + kå, the gradient vector can be 
expressed as V f. The operator V will continue to appear throughout the rest of the unit. 

The flow lines for f are curves whose tangent vectors are the gradient vector field 
grad( f). They can be found as the solution of the system of differential equations em = Vi; 
where p is a parameter along the flow line. 

The Lagrange multiplier method is a technique for solving constrained optimization 
problems. The extrema are at points of tangency of the constraint and the level curves of the 
objective function. These points of tangency are obtained by locating points where, along 
the constraint and the level curves, the gradient vectors become parallel. 

A force F is called conservative if F = —Vu, the negative of the gradient of some scalar 
function u(x, y, z) is called the potential. Several other characterizations of the conservative 
force are detailed in Section 21.5. 


_ Visualizing Vector Fields and Their Flows 


Vector Fields 


Mathematically, a vector field is a function that assigns a vector to each point in its domain, 
which can be a plane or space curve or a region in two or three dimensions. 

As an example of a vector field defined along a curve, recall the field of tangent vectors 
R'(p) defined along the curve R(p) in Example 17.2. This curve and its tangent vectors are 
shown in Figure 17.4. Such a field along a curve is, in general, represented formally by 


iid 


F — 
en Es 


a vector-valued function of the scalar p. 
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FIGURE 18.1 The planar vector field of 
Example 18.1 


EXAMPLE 18.1 


FIGURE 18.2 Flow lines of the planar 


A vector-valued function of a vector-valued argument would define a vector at each 
point of a domain in two or three dimensions. Thus, the notation F(x), where F is a vector 
of functions and x is a vector of coordinates, represents the vector-valued function of a 
vector-valued argument. For example, a function of the form 


ro) = [| (18.1) 
g(x, y) 


is a vector field defining an arrow at each point in the xy-plane. An example of such a field 
is seen in Figure 18.1 appearing in Example 18.1. 


Flow Lines 


Given a vector field F(x), the flow lines are curves along which the arrows of the field are 
tangent. Thus, the flow lines are curves defined by the vector R(p). The given field F(x) 
is precisely the field of tangents to the curves R(p), so the flow lines are defined by the 
equations R'(p) = F(x) along x = R(p). Thus, given the field (18.1), write the equations 
of the flow lines in radius-vector form so that R(p) and R'(p) are given by 


R(p) = pul > R'(p)- E 
y(p) y (p) 


The differential equations R'(p) = F(x) then become x'(p) = f(x, y). y'(p) = g(x, y). 
Integrating these equations, that is, solving the system of differential equations R'(p) — 
F(x), produces the flow of the field. On occasion, the flow lines can be found explicitly and 
exactly. Typically, however, the differential equations defining the flow of the field must be 
solved numerically. 


The vector field 


1 x 
F(x) = F(x, y) = ————5 | | (18.2) 

(x + yy? y 
represents the force of a positive charge placed at the origin of the xy-plane. A plot of some 
of the arrows in this field appears in Figure 18.1. The flow lines, which we anticipate to be 
radial lines emanating from the origin, can be found analytically by solving the differential 

equations R'(p) = F(x(p), y(p)). Thus, the equations 
: 3i 

— um and y'(p) = 
(x24723) (24y) 


can be solved by writing de = em = +, from which we obtain y = wx, radial lines through 


the origin. Figure 18.2 shows some of these radial lines and is, in fact, a phase portrait for 


x'(p) = (18.3) 


field in Example 18.1 the differential equations R'(p) = F(x(p), y(p)). Ed 

EXERCISES 18.1—Part A 

Al. Verify that the solution of (18.3) is y = ax. A4. For the field F = yi + 2xj, find and sketch the flow line through 

A2. For the field F = xi + y?j, find and sketch the flow line through the point (1, 1). Include the direction of the flow along this curve. 
the point (1, 1). Include the direction of the flow along this curve. AS. At the grid points (x;, yj) = (i, j), i =0,..., 2. J = 2,92 


A3. At the grid points (xi, y;) = (i, j),i —0,...,3, j =0,..., 4. sketch the arrows determined by the field in Exercise A4. 


sketch the arrows determined by the field in Exercise A2. 


18.2 The Directional Derivative and Gradient Vector 


EXERCISES 18.1—Part B 
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B1. 


The force due to a positive charge is supposedly inversely 
proportional to the square of the distance from the charge. Show 
that the field in (18.2) is indeed such a field. Hint: Define a unit 
vector from the charge to the point (x, y). 


In Exercises B2—9: 


B2. 
B5. 


B7. 


B9. 


(a) Find all critical points where F = 0. Hint: If F = f(x, y)i + 
g(x, y)j, then f (x, y) = 0 implicitly defines y = yi (x), 
whereas g(x, y) = 0 implicitly defines y = y»(x). Any 
intersections of the curves y; (x) and y2(x) are critical points. 

(b) Obtain a field plot. 


(c) Obtain a graph of the flow lines of F, indicating the direction 
of increasing t along the flow lines. Such a graph is actually a 
phase portrait for the autonomous system R'(p) = F(x(p)) = 
F(x(p), y (p)), where R = x(p)i+ y(p)j. The critical points 
for the field are the equilibrium points for the autonomous 
system of differential equations defining the flow. 


(d) Linearize at each equilibrium point (see Section 12.22) to 
determine, where possible, whether the point is ustable, 
orbitally stable, or asymptotically stable. 


(e) Where possible, categorize each equilibrium point as a node, 
saddle, center, or spiral. 


(f) Let C be the unit circle in the xy-plane; and let p; — 
(cos E, sin E), E 0,1, «s 9, be 10 equally spaced points 
around C. For this circle, let T; be the unit tangent vector at 
Px, and let n, be the outward unit normal at p. For each px, 
obtain and graph the vector F( p,), and its tangential and 
normal components, Fy = (F - T})T; and Fp = (F + njn;, 


respectively. 


F=x7i-yj B3.F=yi+xj B4. F=yi-xj 
l 1 
F = xyi +cosyj B6. F= -i+ -j 
] 4- y^ ] 4-x* 
J Ny - 2 y , X X 

F=——i+—j Ba. F=— i+ = GI 

1+ y? 1 +x? xe y^ x^ + y“ 
F=xi+yj 


In Exercises B10—20, repeat the steps used for Exercises B2-9. However, 
in part (a) find only those critical points in the square —2 < x, y < 2. In 


part (£f), draw the vectors just at the point Ch 


1 Se: 
p T on the unit circle. 


B10. 


B19. 


B20. 


. F = (—3x — 5x? — 3y? —2x?y + xy? — 4x?)i + (-3x — By 
4y? + 6y? — 8x? y + 3xy)j 
. F = (4 — 6y + 2y? — 8x3 — 6xy? — 9x7)i + (26 — 9x + 9y + 


F = (—5 — 3y — A? + 8y? + 8x?y + 6x? + (7 — 6x? +7x?y + 
xy + 7xy*)j 


6y? — 4y? + 2xy?)j 


. F = (9x + 8y — 7y? c A? + 5x?y — 9x? + (4y + Oy? — 5x? + 


Ty? — Ix? y — 9xy)j 


. F = (9 + 6x? + 2y? + 8x?y — 7xy + 6xy?)i + (4x — 4y — 6x? — 


9x?y + 2xy + 5x?)j 


. F = (—8x — 2y + 2y? + 2x? y — 9xy? — Ix? + (8x + 9y — 


3x3 - 6y? T3xy?- 3x7)j 


. F = (—2 + 4x 4+ 3x3 + 9y? — 7x?y — 3xy?)i + (—8 — 9x + 


6y? — 4x3 = 7y°)j 


. F = (—8 + 5x —5y? — 9y? — 3xy?ji - (—6 —9y? +5x?y — 1xy?)j 
. F = (—8 — 3x — 6y? — 5x? — 3y? — 6x?y)i + (2 — 6x +6y + 


8x?y + 5xy? — 9x?)j 

F = (—3x — 5x? — 3y? — 2x?y + xy? — 4x?)i + (3x — 8y + 
4y? + 6y? — 8x? y + 3xy)j 

F = (—2x + y -4y? — 7x3 + xy? + 5x?)i+ (-8 — y? — 6x? — 
6x?y + 7xy + 7xy?)j 


In Exercises B21—30, obtain and plot as a space curve, the flow line ema- 
nating from (1, 1, 1) forthe autonomous system of differential equations 


R’ = 


F(x(p), y(p), z(p)) determined by the given field F(x). Along the 


solution curve, indicate the direction of increasing p. 


B21. 
B22. 
B23. 
B24. 
B25. 
B26. 
B27. 
B28. 
B29. 
B30. 


F = (—5 — 9x — 2xz)i + (9yz — 5x — 5xz)j + (9x + 2yz — 4z?)k 
F = (2 + 4yz + 2z)i + (x? — 5y? + 3xy)j + (8xz — 3y + z)k 

F = (8y + 7xz + 822)i + (9 — 3x — 5y2)j + (6yz — 8x? — 9z)k 

F = (1 — 3y? — 6z)i + (7yz — 92 + 9z)j + (8yz — 3x? — z?)k 

F = (2y? — 8xz — 4z)i + (1 (5x? — 4yz + 4z)k 

F Sy? — 7x?)i + (9 + 8xz + 6xy)j + (4 — 9yz + 3x?)k 
F = (4xz — 4xy 7yz + 222)j + (Sx + 2y — 9xy)k 
F 

F 

F 


3x —y)j4 


= (227 


9x?)i 4 


(2xy 
= (6y — 4 — 2y*)i + (Ty + 9xz — 8yz2)j + (—y — 2y? — x?)k 
= (yz — 2xz + 5y”)i + (2y + 6xz — 2x?)j + (—4x — 9y?)k 
= (8xz + 3z? — 8z)i + (7xz — 3 — y)j + (9xz — 2xy — 4z)k 


The Directional Derivative and Gradient Vector 


The Directional Derivative 


Let U = ai + bj + ck be a unit vector, and let w = 


f(x, y, z) bea scalar-valued function 


defined at each point in a three-dimensional region. At the point Pp = (xo, Yọ, zo) in the 
region, the rate of change of w in the direction of the vector U is called the directional 
derivative of f (x, y, z) in the direction U. 
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EXAMPLE 18.2 


For example, w could give the temperature at each point in a room. The directional 
derivative of w would be the rate of change of temperature, computed at Po, and in the 
direction of the vector U. Although the word “rate” is used, the directional derivative is 
not a measurement of change in time. It is not a velocity. For a temperature, it would be a 
temperature gradient, measured in degrees per unit length, and would indicate the tendency 
for the temperature to change in a given direction. 

In general, the equation of the line passing through point Po and having the direction 
of the vector U is 


Xo + pa 
R(p) =P) + pU = | yo + pb (18.4) 

Zo + pe 
The values of w along this line are a function of the parameter p used to mark progress 
along the line, so w becomes w(p) = f(x(p), y (p). z(p)) along this line. To determine the 


rate at which w(p) is changing along this line, differentiate with respect to the parameter 
p, obtaining, by the chain rule, 


dw 
ds fx Go-F pa, yo pb, zo pc)a + fy (xo pa, yo pb, zo pc)b 
+ f.Go-- pa, yot- pb, zg4- pc)c 
Since the rate of change at Po is the objective, evaluate this derivative at p = 0, which 
corresponds to the point Po on the line through Po. This gives 
dw 


— = fx(Xo. yo. zo)a + fy (Xo. yo. zo)P + fz(x0, yo. zo)c 

dp p=0 

The point (xo, Yo, zo) is arbitrary, so it can be replaced with just (x, y, z). If we also introduce 
dw 


the notation Dy f for the derivative d m we obtain 
Dyf = f(x, y, z)a + fy, y. 2b + £x, y, ze (18.5) 
Careful inspection of (18.5) suggests it is a dot product between the vector U and a vector 
Ic, y. z) 
. ,9 ., 0 a ix ; 
grad(f) = Vf =(i—+j—+k—)f=fAit+ f Kk | fE, yz) 
ax dy Oz f 
far y, 2) 


called the gradient vector. Notations for this vector include grad( f) and V f. In Cartesian 
coordinates, the nabla symbol V stands for the del operator 
ð 9 ð 
V=i—+j—4k 18.6 
Ox J dy Oz ( ) 
As an operator, (18.6) is applied to a scalar-valued function from the left. It is common to 
read V f as “del f." 

When the derivative of f(x, y, z) in the direction U exists, it can be computed as the 
dot product Dy f = V f - U. The gradient V f is computed first, yielding a vector, which is 
then dotted with the unit vector U. We illustrate this with two examples in three dimensions, 
leaving to the exercises the obvious modification to two dimensions. 


3 


Given the function f(x, y, z) = x? — xy? — z, we find, at the point Py = (1, 1, 0), the 


directional derivative in the direction u = 2i — 3j + 6k. The direction vector U must be 
a unit vector. Given the direction u, not a unit vector, we begin by normalizing u to form 
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U- 1Qi — 3j + 6k). Next, we get 
3x?—y? 
Vf =| —2xy | = Gx? - yi - 2xyj - k 
-1 
the gradient of the function f(x, y, z), and evaluate the gradient at the point Po, obtain- 


ing V f (Py) = 2i — 2j — k. Finally, the desired directional derivative is the dot product 
V f (P) -U = 4. E 

Again, although the directional derivative is described as the rate of change in the 
direction U, there is no time in this derivative. The directional derivative is a spatial rate 
of change that measures the change in function value per unit length in the direction of the 
vector U. The gradient (or pitch) of a lawn, measured as a change in height per unit length, 
is a relevant image. 


EXAMPLE 18.3 At the point Py = (2,0, 0) and in the direction of the point P; = (4, 1, —2), find the 
directional derivative of the function f (x, y, z) = xe? + yz. First, the vector from the point 
Po to the point P, is found by the difference P, — Pp = 2i + j — 2k. Then, the direction 
vector U must be a unit vector, so normalize to obtain U — 5 (2i + j — 2k). Compute 

e 

Vf = |x +z} =eit (xe +2z)j + yk 
y 
the gradient of f(x, y, z), and then evaluate at the point P; to obtain V f (P5) = i + 2j. 


Finally, obtain the dot product V f (P5) - U = $. $ 


EXERCISES 18.2—Part A 


A1. Show that the directional derivative of f(x, y) in the direction ofi — A4. At (3, —2, 1), and in the direction u = 4i — 7j + 2k, obtain the 


is just f, and in the direction of j is just fy. directional derivative of f(x, y, z) = x?y — 3yz + 2xz. 
A2. At (1, 1), and in the direction u = 2i + 3j, obtain the directional AS. At (5, —1, 1), and in the direction of the point (2, —3, 1), obtain 
derivative of f(x, y) = xy’. the directional derivative of f(x, y, z) = xyz’. 


A3. At (2, —1), and in the direction of the point (—3, 5), obtain the 
directional derivative of f(x, y) = x?y?. 


EXERCISES 18.2—Part B 


B1. If F(x, y, z) = f(x, y, Dit g(x, y, 2j + h(x, y, zk, define In Exercises B2-11, a function f (x, y) and a pair of points P and Q are 
F(p) as the value of F(x, y, z) along (18.4). By computing given. For each: 
dF 


dp ipei show that the directional derivative of a vector field can 


Obtai aph of the surface defined by z = f(x, y). 
formally be represented by the product AU, where S iain: Bapt theisurface refined. by fo y) 


££ & o£ (b) Obtain a contour plot of f (x, y). 
A-g g " (c) Obtain V f, the gradient vector field. 
hy hy, hi (d) Obtain a field plot of the arrows of the gradient vector field. 


is the Jacobian matrix for F. In Cartesian coordinates, A is the 
covariant derivative of F, the natural generalization of the notion 
of a directional derivative. 
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B2. 
B3. 
B4. 


B5. 
B6. 
B7. 
B8. 
B9. 
B10. 
B11. 
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(e) Obtain a phase portrait for the autonomous system R’ = V f 
and obtain for the gradient field a graph of the flow lines 
superimposed on the contour plot of the level curves of 
f (x, y). The flow lines should be orthogonal to the level 
curves. 


(f) Obtain the coordinates of the tail and head of V f (P), the 
gradient vector constructed at point P. 

(g) At the point P, obtain for f (x, y), the directional derivative in 
the direction of the point Q. 


f(x, y) = —Ix?y — 6xy? — 9x?, P = (—2, 2), Q = (—10, —5) 
f(x, y) = Ixy? + Ay? + y? + 5xy, P = (8,4), Q = (11, —2) 
f(x, y) = 3x? — 5x — 8y + 3x?y, P = (—3, —3), 

Q = (-7, —12) 

f(x, y) = 8x — 9y + 6y? — 2y3, P = (—4, 8), Q = (0, —12) 
f(x,y) =7— x +9x?y —2xy, P = (4,2, Q = (8, —9) 

f(x, y) = y? — x? — 9x3, P = (10, 2), Q = (8, 10) 

f(x, y) = Ty? — 8 — 9x?y - 9xy?, P = (-6, 5), Q = (—8,1) 


f(x, y) = 9y + 4xy? — Ax? + 8y?, P = (—8, —4), Q = (1, 10) 
f(x, — 4x?, P = (—4, —6), Q = (3, 6) 
f(x,y) 25643y -2x!y + xy?, P = (—6, 3), Q = (9,7) 


y) = xy — 5y — 5xy? 


In Exercises B12-21, at the given point P, find the directional derivative 


of f( 
B12. 


B13. 


B14. 


B15. 


B16. 


B17. 


B18. 


B19. 


B20. 


B21. 


x, y) in the direction of Vg evaluated at point Q. 


f(x, y) = Ty — 6x? — 9x?y, g(x, y) = —3x + 9x? — Axy, 
P=(8,7), Q = (-2,1) 


f(x, y) = 8x — 2y? + 6x”, g(x, y) = 3y + 6x’y, P = (-7, 8), 
Q = (5, —7) 

f(x, y) = 6x — 5x* — 6y?, g(x, y) = 8 +3y? — 7xy, 

P = (5,8), Q = (5, 11) 

f(x, y) = 2x — 6y — Oxy, g(x, y) =x -8—2y? 

P = (—8, —9), Q = (—3, —5) 

f(x, y) = 2y? — 8x — 2x3, g(x, y) = Axy? — 8xy + y), 


P-(3,6,0—(1,2) 


fœ, y) = 5x? — 2, g(x, y) = Axy — 9x?y, P = (—4, 0), 
Q — (—10, 10) 
f(x, y) = 9x3 — 8x? Ay), g(x, y) = x? — 1x?y, P = (1, —3), 
Q = (4, —6) 
f(x, y) = 2x? + 3xy, g(x, y) = 8x? — 6p), P = (3,7), 
Q = (-12, -1) 
f(x, y) = 9x3 — 6x — Txy, g(x, y) = 7 — 5xy? — 8x3, 
P = (—5, —3), Q = (10, 11) 
f(x, y) =3 + By’, g(x, y) = 5 — 4xy? — 3x?y, 
= (3,0), Q = (7, 2) 


In Exercises B22—31, at the given point P, find the directional derivative 


of f( 
B22. 


X, y, z) in the direction of the point Q. 


+4z?, P = (—6, 12, —5), 


f(x, y, z) = 9xyz + 8x3 
Q = (—5, —10, 9) 


B23. 
B24. 


B25. 
B26. 


B27. 
B28. 
B29. 
B30. 
B31. 


f y.2) == 2yz, P = (-9, —10, 12), 0 = (—7,9,.—6) 
f(x,y,z) = 3yz + 5xz + 9yz?, P = (—7, —5, -12), 

Q —(2,5,2) 

f (x, y, Z) = 6y — 5x? + Az?, P = (—5,0, —6), Q = (10, 7, 1) 


f(x, y, z) = 3y? — 8xz? — 3y), P = (—1, —2, 10), 

Q = (6, —12, —2) 

f(x,y,z) = —7x2 +2x?y — 7z, P = (2, —5, 3), Q = (0, —2, 0) 
f(x,y,z) = 4x — yz —723, P = (4,1, —4), Q = (-1,9, 7) 

f (x, y, z) 2 4x?y — 5x — 5z, P = (2,8, —12), Q = (11, —4, 1) 
f(x,y,z) 2 2y + 2xy +723, P = (0,8, 6), Q = (4, 12, —2) 
f(x, y, z) = 4x? — 2z — 52, P = (0, 8,4), Q = (1, 11, —4) 


In Exercises B32—41, at the given point P, find the directional derivative 
of f(x, y, z) in the direction of Vg evaluated at point Q. 


B32. 


B33. 


B34. 


B35. 


B36. 


B37. 


B38. 


B39. 


B40. 


B41. 


B42. 


B43. 


f = —6y — Txyz — 6x?z, g = 3xy — 9yz?, 
P = (—12, 11, —10), Q = (9, 12, —3) 

f = 4y 47x22 — 6z, g = 4xy — 8z? — 6x27, 
P = (12, —11, —8), Q = (3,10, —7) 

f =2y + 522 —7xz’, M 3y? + 5y?z + 2z, 
P = (3, —11,7), Q = (5,3, —8) 

f = 6x?y — 8xz pois 728 —Tx*, 
P = (8,0, —9), Q = (12, 7, 0) 

f =2y2? -9x^z nt ; a = 2x + 9x?z — xy, 
P = (6, —9, —5), Q = 3, 12) 

f =xz—7Tx?z— 8y?, celu PN 
P = (2,3, —7), Q = (1, 12, —10) 

f = 4xz — 8xyz — 6y), Jr rl 
P = (10, —12, —4), Q = (8, 2, 9) 

f =5y +72 — Txyz, oe = Day = Ty, 
P = (2,4, 1), Q = (-11, 9, —9) 

f =—2yz + 8y + 823, g = 3y — Ay'z - y? 
P = (—2, —3, 2), Q = (11, —3, —11) 

f = 4xy? — 82 — Ixz?, g = 3y — Axz — xy’, 
P = (12, 1,3), Q = (—6, —4, 12) 


At (1, 2) the directional derivative of f(x, y) in the direction of 
the point (5, 6) is 8 and in the direction of the point (—4, 3) is 13. 
At (1, 2), find the directional derivative in the direction of the 
point (7, —5). (Hint: Use the two given directional derivatives to 
set up two equations in the two unknowns f; (1, 2) and f,(1, 2). 
Once these have been determined, the directional derivative in any 
direction can be calculated.) 

At (1, 2, —3) the directional derivative of f (x, y, z) in the 
direction of the point (5, 6, —7) is 8, in the direction of the point 
(—4, 3, —2) is 13, and in the direction of point (8, 0, —12) it is 
—3. At (1, 2, —3), find the directional derivative in the direction 
of the point (7, —5, 9). 
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B44. For 0 < 0 < 2x, the unit vector U = cos ĝi + sin 0j, with tail at (c) Determine @, the value of 0 for which the directional 
the origin, rotates around the unit circle. If f(x, y) = 2 - derivative is a maximum. 
(a) Obtain, at the point P = (1, 1), the directional derivative of f (d) Determine the vector U(@). 
in the direction U. This directional derivative will be a (e) Normalize V f (P), the gradient evaluated at point P, and 
function of 0. compare to U(@). 
(b) Plot the directional derivative as a function of 0. B45. Repeat Exercise B44 for f (x, y) = ur and P — (2,3). 


FIGURE 18.3 Level curves of 
f(x,y) =x +y 


FIGURE 18.4 Level surfaces for 
Pang = x?4 y? -z 


Properties of the Gradient Vector 


Level Sets 


The level sets for f (x, y) are the curves y = y(x) defined implicitly by an equation of the 
form f(x, y) = c, where c is a real constant. We will refer to these curves as the level curves 
of f(x, y). The level curves for f(x, y) = x? + y are the downward-opening parabolas 
y — c — x?, some of which are shown in Figure 18.3. Note that these curves lie in the 
xy-plane. 

The level sets for g(x, y, z) are the surfaces z = z(x, y) defined implicitly by an 
equation of the form g(x, y, z) = c, where c is a real constant. We will refer to these 
surfaces as the level surfaces of g(x, y, z). 

If the function g(x, y, z) represents the temperature w at every point in a room, then 
it defines a number at each point in space inside the room. If each “air molecule" would sit 
still long enough for someone to paint on it the number representing the temperature at that 
point, a representation of this function of four variables would be obtained. Of course, air 
molecules, even if they existed, can't be recruited to this task, so imagine the room filled 
with ping-pong balls on which the appropriate temperatures have been painted. Again, a 
representation of this function of four variables has been obtained. Unfortunately, it would 
be difficult to extract information about the temperatures in the middle of the room! 

Suppose further, however, that all the ping-pong balls whose temperatures were 68°F 
were painted blue and all those whose temperatures were 78? were painted red. Then, the 
collection of blue ping-pong balls would form a level surface, the surface g(x, y, z) — 68, 
and the collection of red ping-pong balls would form another level surface, the surface 
g(x, y, z) = 78. Thus, it is impossible to graph w = g(x, y, z), a function of four variables, 
but g(x, y, z) = c implicitly defines level surfaces of the form z = z(x, y) and such surfaces 
can be graphed with three axes. 

For example, the level surfaces of the function 


w = g(x, y, z) =x? +y -z (18.7) 


are defined by the equation x? + y? — z = c, from which the surfaces z = z(x, y) can 
be determined by z = x? + y? — c. For each value of the constant c, a level surface is 
determined, as shown in Figure 18.4, where c takes on the values 0, —1, —2. 


Four Properties of the Gradient 


The following four properties of the gradient vector make it important, and useful, in the 
applications. 


1. Vfisorthogonal to the level sets of f. 


2. Vf points in the direction of increasing values of f. 
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3. The maximum rate of change in f is along V f. 
4. The maximum rate of change in f is precisely the number ||V f ||. 


Property 1 


The level sets for the function z = f(x, y) are curves in the xy-plane, whereas the level 
sets for the function w — g(x, y, z) are surfaces embedded in space. The gradient vectors 
in each case have different dimensions, and the geometric representations for each case are 
different. The wise student will pay close attention to the differences between the two cases. 


Two INDEPENDENT VARIABLES z= f(x,y) The gradient vectors for f(x, y) exist in the 
same space as the level curves of f (x, y), namely, the xy-plane, the space of the independent 
variables. Even though the function z = f (x, y) canbe represented as a surface, the gradient 
vectors are found in the xy-plane. 

For f(x, y) = x? + y, the gradient vector V f = 2xi + j has only two components and 
is defined only in the xy-plane. In fact, Figure 18.5 shows the two level curves y = 1 — x? 
and y — 4 — x? and some of the gradient vectors along them. 

If the level curve y = c — x? is written as R(p) = pi+ (c — p?)j, the tangent vector 
R'(p) = i — 2pj follows by differentiation with respect to the parameter on the curve. The 
induced parametrization of the gradient field along this level curve is V f = 2pi + j and 
R’-V f = 0, showing that the gradient vector along a level curve is orthogonal to the tangent 
vector. Thus, the gradient is perpendicular to the level curve since it is perpendicular to a 
tangent to the level curve. 

A general proof that the gradient of the function f(x, y) is necessarily orthogonal 
to the level curves defined by f(x, y) — c is easily given once it is recognized that this 
equation implicitly defines the level curve y = y(x). Then, f(x, y(x)) = c is an identity, 
and differentiation with respect to x (by the chain rule) leads to fy + f, y' = 0, from which 
we get the derivative y'(x) = — f,/f,. The level curve y = y(x) is written in vector form as 
R = xi + y(x)j by taking the parameter along the curve to be x. The tangent vector is then 
R’ =i+ y'(x)j =i — Cf. /f,)j and the gradient vector is V f = fyi + f,j. Consequently, 
R’- V f — 0, so the gradient vector is orthogonal to the tangent vector, proving that, in 
general, gradients are orthogonal to the level curves. 


t = t >x 
-6 4 2 0 2 4 6 
FIGURE 18.5 Gradient vectors on two level FIGURE 18.6 Three gradient vectors on the 
curves of f(x, y) =x? +y level surface x? + y? — z = 0 


THREE INDEPENDENT VARIABLES w= g (x, yz) For g(x, y, z) given in (18.7), the gradient 
is Vg = 2xi + 2yj — k. It has three components and is attached to a level surface. Figure 
18.6 shows three such gradient vectors emanating from the level surface w — 0. 


FIGURE 18.7 Example 18.4: Level 
curves and gradient vectors for 
z= 1-—x?- y? 


EXAMPLE 18.4 
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The following construction demonstrates that the gradient vector is always perpen- 
dicular to the level surface. In fact, the construction shows more than that. It shows how 
to construct a normal to a surface, whether the surface is given implicitly in the form 
g(x, y, z) = 0 or explicitly in the form z = f(x, y). In the implicit case, the normal vector 
will turn out to be the gradient vector, and in the explicit case, the normal vector will be a 
new formula. 

Let the function g(x, y, z) = Oimplicitly define z = f(x, y), and compute, by implicit 
differentiation based on the identity g(x, y, f(x, y)) = 0, the derivatives 

gx. y, Z) gy, y, z) 

fe 2E Bum 

gi. y. z 82(%, y. z) 
Next, on the surface z = f(x, y) consider the two plane sections y = constant and x = 
constant, respectively, projecting to grid lines y — constant and x — constant. Along the 
grid line where y is constant, x varies and is the parameter on that space curve. Along the 
grid line where x is constant, y varies and is the parameter on the corresponding space curve. 

Both space curves lying in the surface can be described in radius-vector notation by 


R — xi t yj + f(x, y)k 


where x is fixed on one curve and y on the other. Differentiating with respect to the parameter 
on each curve produces 


and f,-— 


R, =i+ fik and R, =j+ fk 
vectors tangent to the respective curve. The cross-product 
R,xR,--—fi- fj+k 
is a vector normal to the surface. Thus, the normal to the surface given explicitly by z — 
f(x, y) is 
N=—-f,i- fj+k 


Making the substitutions f, = —g,/g, and f, = —8y/8z in N gives N = (g,/g-)i+ 
(gy/g8z)j +k, and scaling this vector by the factor g; yields gxi + g,j + gk, which is pre- 
cisely the gradient vector, V g. Thus, the gradient of w = g(x, y, z) is normal to the level sur- 
face g(x, y, z) = c. If this result is taken as fundamental, then the expression for the normal 
to the surface given explicitly by z = f(x, y) follows from the rearrangement g(x, y, z) = 
z — f(x, y) = 0. Since Vg is normal to the surface defined by g(x, y, z) = 0, a normal to 
the original surface is then — fyi — f,j + K, which recovers the result obtained earlier. 


Property 2 


The previous discussion detailed why the gradient is perpendicular to the level curves of 
z = f(x, y) or to the level surfaces of w = g(x, y, z). To show that the gradient points 
in the direction of increasing function values, compute the directional derivative along 
the direction defined by the gradient vector. The appropriate unit vector U, obtained by 


normalizing V f, is U = Wi: Then the directional derivative in this direction is Dy f = 
f. nor = an ^ > 0. Since the directional derivative of f in the direction of the gradient 


is positive, f must be increasing in the direction of the gradient vector. Of course, this 
demonstration is valid for f(x, y) or f(x, y, z). 


The function z = f(x, y) = 1 — x? — y? defines the surface in Figure 18.7 where the level 
curves (circles) are projected to the xy-plane on which gradient vectors are also drawn. 
Function values increase as the radii of the level curves decrease. The gradient vectors point 
"inward" since that is the direction of increasing function values. $ 


EXAMPLE 18.5 


FIGURE 18.8 Example 18.5: Level 
curves and gradient vectors for z = x? + y? 


EXAMPLE 18.6 
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The function g(x, y) = x? + y? has the same contour plot as f (x, y) from Example 18.4 
but gradient vectors pointing in the opposite direction. Again, the gradient vectors point 
in the direction of increasing function values, but here, that direction is “outward.” A plot 
showing the surface, the contours, and the outward-pointing gradient arrows is shown in 
Figure 18.8. e 


Properties 3 and 4 


The rate of change of the function f (x, y, z), computed in the direction U, is the directional 
derivative Dy f = V f - U. Expressing the dot product as 


Vf -U= |V fU cos = ||V fl1cos8 = ||V f || cose 


shows the directional derivative is greatest when 0 = 0 so that cos@ = 1. But this means 
the directional derivative of f is greatest when it is taken exactly along the gradient vector. 
Hence, the maximal rate of change of f is along the gradient. 

When 6 = 0 so that the directional derivative is being taken precisely along the gradient 
vector, the value of the maximal directional derivative is then V f - U = ||V f ||. 


Consider the function f(x, y) = 2x? + Sy? whose level curves are ellipses and whose 
gradient vectors point “outward” in the direction of increasing values of f, as shown in 
Figure 18.9. 

Now, pick a point on the level curve f(x, y) = 2.If x = 5, the corresponding y coordi- 
nates are found by solving FG, y) — 2 for y. This yields the two possibilities y — i2. 
Pick Ġ, 2), and at this point compute the directional derivative of f, using an arbitrary 
unit vector U for the direction. First, compute V f = 4xi + 10yj, and evaluate it at the fixed 
point on the level curve f = 2, obtaining Vi, 4 = + (8i + 104/2j). Then, define the 
unit vector U = icost + jsint. As t varies through the interval [0, 277], U points in every 
direction around the compass. The directional derivative in any of these arbitrary directions 
is therefore Dy f = $ cost + 2/2 sint. 

Figure 18.10, a graph of the directional derivative as a function of t, shows the depen- 
dence of the directional derivative on the direction of U. Moreover, the directional deriva- 
tive clearly has a maximum value that can be found by differentiation. Thus, the value of 
t at which this maximal value occurs is fmax = arctan + /2 = 1.056. The direction vector 


FIGURE 18.9 Example 18.6: Level FIGURE 18.10 Example 18.6: 
curves and gradient vectors for At (2, a ), the directional derivative 


yp. eme sa 32 d 
z—2x + 5y as a function of the angle t 
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U = 4(2V2i + 5j) corresponding to this maximizing direction is supposed to be the di- 


J/33 


rection of the gradient vector. However, Umax is a unit vector while the gradient vector is not. 


Vi 


Therefore, normalize the gradient, obtaining iva = 750i + 5j) = U, as expected. 


EXERCISES 18.3—Part A 


:$. 
“se 


Al. Let P be the point (x, y) = (1, 2) and define f(x, y) = 33? + 
2xy + 5y?. 
(a) Obtain a formula for, and a sketch of, the level curve of f (x, y) 
that passes through the point P. 
(b) At P, obtain a vector tangent to the level curve found in part (a). 


(c) At P, obtain the gradient vector, and show it is perpendicular to 
the tangent vector found in part (b). 


(d) Find the coordinates of the tip of the gradient vector. 

(e) By comparing the values of f at both the tail and tip of the 
gradient vector obtained in part (c), show that this vector points 
in the direction of increasing values of f. 

(f) At P, obtain the value of the directional derivative in the 
direction of the gradient. 


EXERCISES 18.3-Part B 


A2. 


(g) At the point corresponding to P, find a vector normal to the 
surface z = f(x, y). 

Let P be the point (2, 1, —1) and define g(x, y, z) = 

2x? + 3y? + 427. 

(a) Obtain a formula for, and a sketch of, the level surface of 
g(x, y, z) that passes through the point P. 

(b) At P, obtain the gradient vector. Find the coordinates of the tip 
of this vector. 

(c) Show that the gradient in part (b) points in the direction of 
increasing values of g. 

(d) At P, obtain the value of the directional derivative in the 
direction of the gradient. 


Bl. If R = xi + y(x)j is an implicitly defined level curve of f(x, y), 
show that a tangent vector along R is given by R' = i — (f/f). 
Hint: Differentiate f(x, y(x)) = c implicitly to get y’. 


n Exercises B2-11, a function f(x, y) and a point P are given. For each: 


(a) Obtain a contour plot of f(x, y), —2 < x, y € 2. 

(b) On the contour plot found in part (a), superimpose a field plot 
of V f, the gradient field. 

(c) Obtain the coordinates of the tail and head of V f (P). 

(d) Obtain the vector R'( P), tangent to the level curve through P. 
(See Exercise B1.) 

(e) Show that V f ( P) is perpendicular to R'( P). 

(f) Obtain, at point P, and in the direction of U(0) = cos 6i + 
sin6j, 0 < 0 x 2z,6(0) = Du(f)(P)(0), the directional 
derivative of f. 

(g) Plot as a function of 0, the directional derivative, ó(0). 

(h) Calculate Ô, the value of 6 for which 5(6), the directional 
derivative, is a maximum. 

(i) Obtain U(0), the unit vector in the direction of maximum 
value for the directional derivative. 

(D Normalize V f (P) and compare to U(Ó). 

(k) Compute 5(6), the maximum value of the directional 
derivative 5(@), and compare to || V f£ (P) ||. 


B2. f(x, y) 2 4x — Ax?y + 2x3, P = (8, —10) 
B3. f(x, y) = 6y — y? — 60, P = (0, 1) 
B4. f(x, y) = 3x + y?, P = (—9, —9) 
B5. f(x, y) =9+2x? - Ty, P = (8, 10) 
B6. f(x, y) = 2x?y — 2 — 8y, P = (11, —5) 
Tx? — 9y? + xy 
B7. f(x,3) = i—593y-Lxy P = (4, —1) 
-— E 
TCR fois us Pet. 
B9. f(x,y) = L ms. d "EET. 
i ' 6xy^ —9y^ + 3x7 
B10. f(x, y) = 2 c y —A pat 1,7) 
` f 9x?—x?2y — y? 
B11. f(x,y) = 250-20) gites) 
` . 5(y — x?—-y?) 
B12. Let g(x, y, z) = 0 implicitly define a surface z = z(x, y). On this 


surface, the plane section x = o is the curve R, = oi + yj + 

z(a, y)k, while the plane section y = P is the plane section 

R, = xi + 8j + z(x, B)k. Show that T, = i — (g,/g_)k and 

T, = j — (g,/8g:)k are vectors tangent to R, and R,, respectively. 
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B13. Show that U(0, $) = cos0 sin $i + sin 8 sin dj + cos ók, B14. g(x, y, z) = 6y?z + 8xy? + Axz, P = (—11, —2, 3) 
0 <6 <2x,0 < ¢ < zx, isa unit vector with tail at the origin and — ps. g(x, y, z) = 9x? + Byz + 9yz?, P = (6, —9, —9) 


head on the unit sphere. B16. ar, 9.2) = Sar Ax? +3xy?, P = (3,1,2) 


In Exercises B14—25: B17. g(x, y, z) = 4y — 2z + A2, P = (11, —6, 3) 
(a) Obtain Vg(P). B18. g(x, y, z) = y + 6x? + 5x?z, P = (7,8, —5) 
(b) Obtain the coordinates of the tail and head of V g( P). B19. g(x, y, z) = 3y? + 7yz? + 9xz^, P = (0,3, —8) 
(c) Using the result of Exercise B12, obtain T, ( P) and T, (P), B20. g(x, y, z) = x?y ni 3x PHS oes] es 
independent vectors tangent to the surface at point P. 4z + 6z^ — Tyz 
(d) Show that V g(P) is orthogonal to both T, (P) and T, (P). B21. g(x, y, z) 2xy? + 8yz? Petira 


= 6y2z — 7y? — 9x2z’ 


(e) With U(6, p) as defined in Exercise B13, obtain, at point P, 
Ay 2xy? + 3xy 


the directional derivative 8(0, 6) = Dy(g)(P)(6, $). 


B22. g(x, y, 2) = 7— = ~ P —(4,8,—3) 
(f) Plot, as a surface over 0 < 0 < 27,0 < $ < zt, the directional 3y* + 4z^ — 8yz* 
" š 1 8 2 xy + 2 iz 
derivative (0, $) . B23. g(x, y, z) = CE N P = (9,2,10) 
(g) Calculate, using the techniques of multivariable calculus, 0 2y* — 4z 
h imi 4 + 4xy + xz 
and $, theryalues of 0 and $ that maximize |ô (0, $)|. B24. g(x, y, z) = ET 2, +x P =(—5,2,9) 
(h) Obtain U(6, $), the unit vector in the direction of maximum 22° — 62° + 6x27 
irecti ivati 7x — 9x? + 2x2? 
absolute value for the directional Ma B25. g(x, y, z) = X - X X EE Pe (3,11, —6) 
(i) Normalize Vg( P) and compare to U(6, $). 6x^z — y? + yz 


(j) Compute EXCH 9)l, the maximum absolute value of the 
directional derivative 8 (0, 9), and compare to || V g (P) ||. 


1 Lagrange Multipliers 


Constrained Optimization 
Elementary calculus considers constrained optimization problems of the form 
find the rectangular box of maximum area if the perimeter is fixed at 100. 


Initially, these problems are solved by eliminating one of the variables. For example, with 
the area of the box written as A = xy and the perimeter constraint as 2x + 2y = 100, the 
constraint can be solved for y — 50 — x so that A — A(x) — x(50 — x). The ordinary 
techniques of differentiation (or plotting) now lead to the maximum of 625 at x — y — 25. 


The Lagrange Multiplier Method 


: The Lagrange multiplier technique is an alternate method for solving constrained optimiza- 

FIGURE 18.11 Objective function and tion problems. By making an elegant application of the gradient vector, it avoids the algebra 

constraint in Example 18.7 of using the constraint to eliminate one of the variables. The method of Lagrange multipliers 
is illustrated through the following five examples. 


EXAMPLE 18.7 In this first example, we show how the Lagrange multiplier method selects points at which 
the level curves of the objective function f(x, y) are tangent to the constraint curve. To 
do this, we will find the extreme value of f(x, y) — xy along the constraining ellipse 
g(x,y) =x? +4y?-8=0. 

Figure 18.11 shows the constraint ellipse in the xy-plane, along with the surface z = 
f(x, y). By way of interpretation, imagine being restricted to walking on this ellipse in the 
xy-plane. Overhead, the function f (x, y) determines the shape of the ceiling. You want to 


FIGURE 18.12 Example 18.7: Constraint 
ellipse and curve of intersection of the 
surface z = f(x, y) and the cylinder 
whose cross-section is the constraint 


FIGURE 18.13 Example 18.7: Constraint 
ellipse and level curves of f(x, y) 


-6-4-2 0 2 4 6 
X 


FIGURE 18.14 Example 18.7: Gradients 
(in color) along constraint ellipse, and 
gradients (in black) along level curves of 
f (x, y) that are tangent to the constraint 


EXAMPLE 18.8 
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know where, on the elliptic path being walked, you will find the highest and lowest points 
of the ceiling. 

The intersection of the cylinder g(x, y) = 0 and the surface z = f(x, y) is the space 
curve (thin black) shown in Figure 18.12. Included is a rendition of the ellipse (thick black) 
in the xy-plane. Clearly, there are two maxima and two minima. 

The contour map in Figure 18.13 is yet another way of looking at this problem. The 
level curves of f(x, y) and the constraint ellipse are all drawn in the xy-plane. Where a 
level curve of f (x, y) cuts through the graph of g = 0, there can't be a stationary value. 
Where the level curve of f(x, y) is tangent to the graph of g = 0, the value of f(x, y) 
becomes stationary because it pauses" momentarily. 

The method of Lagrange multipliers seeks points where the level curves of f are tangent 
to the constraint curve g = 0. It does this by looking for points where the gradient vectors 
of f and g are colinear. This happens where the gradient V f = yi 4- xj is a multiple of the 
gradient Vg = 2xi + 8yj. Figure 18.14 shows the gradient vectors at the four points where 
they are colinear. The companion Maple worksheet contains a complete animation of the 
gradient vectors as the constraint ellipse is traversed. The animation shows two things. First, 
V f (in black) never equals Vg (in color), which is considerably longer than V f. Second, 
at two points of tangency, V f points in the same direction as V g, but at the other two points 
of tangency, the two gradients point in exactly opposite directions. 

The analytic condition that expresses the colinearity of the gradients is V f = AVg, 
which stands for the pair of component equations 


fx-—2gy and fy =Agy (18.8) 


The factor of proportionality, À, is called the Lagrange multiplier. There are three unknowns, 
namely, the coordinates x and y and the Lagrange multiplier A. These are determined by 
the two equations in (18.8) and the constraint equation g(x, y) = 0. Table 18.1 lists the 
equations, the solutions, and the value of f(x, y) at each extreme point. Hence, there are 
two places on the constraint curve g(x, y) = 0 where f(x, y) attains a maximum and two 


places on the constraint curve where f (x, y) attains a minimum. $ 
Equations A (x, y) f(x, y) 
x = BÀy i (2, 1) 2 
y =2dx i (—2, -1) 2 
x? +4y =8 -i (2, —1) -2 
1 
-i (-8, 1) 2 


TABLE 18.1 Example 18.7: Equations V f = ÀV g and 
g = 0, critical points, and value of f at the critical points 


The solutions in Table 18.1 can be obtained by dividing the left and right sides of the 
first two equations on the left in Table 18.1. This eliminates 4 and gives x? = 4y?. If this 
equation is now used to eliminate x in the constraint equation, we obtain y? = 1, so y = +1 
and, hence, x = +2. 


In this second example, we will find the Lagrange multiplier is zero, so an extreme point 
occurs where the constraint is not operative. The extreme point is on the constraint, but it is 
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FIGURE 18.16 Example 18.8: 
Intersection of plane x + y = 3 and 
z = f(x, y) drawn in the plane x + y — 3 


-14 + + + i 
-2 -l 0 


N 
[ 
Ttt 


x 


FIGURE 18.17 Example 18.8: Constraint 
line and level curves of f(x, y) 


EXAMPLE 18.9 


also a critical point for the unconstrained objective function. To illustrate this, we find the 
extreme values of f(x, y) = x?y subject to the constraint g(x, y) =x +y—-3=0. 

Figure 18.15 shows the surface z = f(x, y), the xy-plane, constraint (line) g(x, y) = 0, 
and the intersection of the plane x + y = 3 with the surface z = f(x, y). The space curve 
in which the plane x + y = 3 intersects the surface z = f(x, y) is shown in Figure 18.16. 
It suggests f(x, y) has extreme values at x = 0 and x = 2 along the constraint line. Figure 
18.17 shows a contour plot of the surface z = f(x, y) and a graph of the constraint line 
g(x, y) = 0. This view is significant since it shows but a single point of tangency at about 
(2, 1). 


FIGURE 18.15 Example 18.8: Constraint line, 
surface z = f(x, y), and intersection of plane 
x + y = 3 with this surface 


Table 18.2 lists the equations V f = AV g and g(x, y) = 0, the solutions for A, x, and 
y, and the values of f(x, y) at the extreme points. When A = 0, the constraint does not 
apply. The corresponding extreme point is a critical point for the unconstrained optimization 
problem and would have been found without the constraint. That is why Figure 18.17 shows 
but one point of tangency between the constraint line and the level curves of the objective 
function f (x, y). e 


Equations À (x, y) f (x, y) 


2xy =À 4 (2, 1) 4 
x? =i 0 (0,3) 0 
xty=3 


TABLE 18.2 Example 18.8: Equations V f = AVg 
and g = 0, critical points, and value of f at the critical 
points 


In this third example, the objective function must be constructed from a verbal description 
provided by the problem statement, namely, the requirement to find the (shortest) distance 
from the origin to the plane 2x + y — z = 

Thus, the quantity to be minimized is the distance from the origin to a point (x, y, z) on 
the plane. It's generally easier, however, to minimize the square of the distance. We therefore 
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have f (x, y, z) = x? + y? + z2, with g(x, y, z) = 2x + y — z — 5 = 0, the equation of the 
plane, as the constraint. There are three equations in V f = AV g and four unknowns, namely, 
X, y, z, and A. The fourth equation is the constraint equation itself. Table 18.3 lists the four 
equations and their single solution. o 


Equations A (x, y, z) Vf, yz) 
2x = 2a 3 ($$) a 
2y=A 
2z = —À 
2x -y—-z-5 


TABLE 18.3 Example 18.9: Equations V f = AV g and g = 0, 
critical point, and value of ./f at the critical point 


EXAMPLE 18.10 A pentagon is formed from a rectangle surmounted by an isosceles triangle. What dimen- 
sions give the pentagon least perimeter if the area is fixed at the value a? (See Figure 18.18.) 
In this fourth example, the constraint contains a symbolic parameter and the algebra be- 
comes significantly more complicated. The point of the example is to show how to navigate 
through such complexity. 

From Figure 18.18 the area of the rectangle is 2xy, the area of the triangle is 2(1xy), 
the total areais g(x, y, z) = 2xy + xz = a, and the perimeter is f (x, y, z) = 2 x? + z? + 
2x + 2y. The objective function is the perimeter. The constraint is the fixed area. Table 18.4 
lists the four equations arising from V f = AVg and the constraint g = a. There are four 
possible solutions for x, y, z, and A; computed exactly in Maple, they are listed in floating- 
point form in Table 18.4. Only one solution gives all three dimensions as positive. 


2x Equations À (x, y, Z) f(x,y,z) 
"GURE 18.18 Example 18.10: Pentagon "m 0.52 
vhose perimeter is to be minimized while —MÀ— + 2 = Ay +z) pede 1.9 a, 0.82./a, —1.1Ja 
ts area remains fixed at a Ax? + 2? Ja ( ) 
0.52 
2z 1.9 
——— E — 0.52 /a, 0.82 Va, 0.30 V/a 3.86 /a 
Vx? + 2? Ja ( 
1.9 
2xy -xz—a -=a (-0.52Va, —0.82./a, —0.30./a) 
a 


TABLE 18.4 Example 18.10: Equations V f = AVg and g = 0, critical points, and value of f at 
the one feasible critical point 


The third solution, given exactly as (6, (1 + 5P. Ja), with B = Va(2— J3), is 
the physically meaningful one. The minimum value of the perimeter can also be given 
exactly as (1 + 4/3) 4/2a. It is surprising how much the presence of the symbolic parameter 
a complicates the algebra. But the reader should not let the additional complexity in the 


algebra obscure the underlying simplicity of the basic technique of Lagrange multipliers. 
4 
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EXAMPLE 18.11 


51 
Vg 
z OF = Vf 
- "Lc 
-2 gX. 
uu. AG? 
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FIGURE 18.19 Example 18.11: Sphere 
x? +y? +z? = BB, R(t) (the line of 
intersection of the constraints g; = 0 and 


&2 = 0), and the vectors V f, Vg), and Vg; 
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In this fifth example we extend the method to the case of two constraints by finding the 
shortest distance from the origin to the intersection of the two planes 


8j — 2x —3y -5z 29 and g2=6x+y-—7z=12 


We give two solutions, the first with the use of Lagrange multipliers, and the second, 
without. For both solutions, the objective function is f (x, y, z) = x? + y? + z?, the square 
of the distance from the origin to the point (x, y, z). As we will explain, the Lagrange 
multiplier method generalizes to V f = A1V | + A2V go, so now, there are five equations 
in the five unknowns x, y, z, 41, and Az. Alternatively, the function F = f — ae Ak gk 
could be defined and the same set of equations obtained from V F — 0. The equations and 
their single solution are listed in Table 18.5. The point closest to the origin is denoted by P. 


Equations (X1, A2) (x, y, z) J| f(x, y, z) 
. 5 263 28 (1003 
2x = 2A, + 6Ay (3, 32) (3,-7.3) S 
2y = —3A, za Àz 
2z = SA} = Tho 
2x —3y+5z=9 


6x 4-y—7z 212 


TABLE 18.5 Example 18.11: Equations V f = A; Vg; + A3 V5. g1 = 0 and 
g2 = 0, the critical point, and value of 4/ f at the critical point 


A second solution to this problem can be framed within the confines of simple multivari- 
able calculus operations. First, a vector along the line of intersection of the two constraint 
planes is given by the cross-product of normals to the two planes. Thus, we compute the 
vector V = Vg; x Vg» = 16i + 44j + 20k, which lies along the line of intersection of the 
constraint planes. This vector is perpendicular to V f at the point P. 

Hence, the line of intersection of the constraint planes is tangent to the level surface 
determined by the objective function, f(x, y, z). This is the analog of the geometry that 
applies in the case of the objective function f (x, y) constrained by a single constraint curve 
g(x, y) 2 0. 

To find a point on the line of intersection of the two constraint planes, set z = 0 in both 
planes to find where the line passes through the xy-plane. The solution of the equations 


2x —3y 29 O6x+y=12 
is found to be x — :. y= —3, so the line of intersection can be given parametrically by 
the vector 
R(t) = (3 + 16t) i + (44t — 3) j + 201k 
If we evaluate f(x, y, z) along this line, we obtain f(t) = D — 60t + 259277, and the 


techniques of elementary differential calculus, setting the derivative to zero and solving, 
gives the critical value of t as i5 and RGS) = P, 
s "a 2 _ 1003 


Figure 18.19 shows a sketch of the sphere x? + y? + z? = 100? 


ij, a segment of the line 


R(t), and the vectors V f, Vgi, and Vg», all drawn at point P. (The segment of the line 
R(t) is drawn in color.) The line of intersection of the two constraining planes is tangent to 
the level surface determined by the objective function f (x, y, z). The plane spanned by the 
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gradients Vg; and Vg% is orthogonal to this line. The vector V f lies in the plane spanned 
by the gradients Vg; and V5. The Lagrange multiplier condition V f = A, Vg; + A2Vg2 
finds points at which the gradient of f lies in the plane spanned by the gradients of g; and 
£2. At such points, the curve of intersection of the constraints is tangent to a level surface 
of the objective function f. 


EXERCISES 18.4—Part A 


i$. 
b d 


A1. Use the Lagrange multiplier technique to find the shortest distance 
from the point (2, —1, 3) to the plane 3x — 5y + 7z = 15. 


EXERCISES 18.4—Part B 


A2. 


Use the Lagrange multiplier technique to find the shortest distance 
from the point (5, 2, —4) to the intersection of the planes x — 2y + 
5z = 12 and 5x + 8y — 2z = 9. 


B1. Using the Lagrange multiplier technique, find the minimum 
distance from the point (1, —2, 3) to the plane 3x — Sy + 7z = 4 
and find the point on the plane where this minimum distance 
occurs. Show that the vector from (1, —2, 3) to the distance- 
minimizing point on the plane is perpendicular to the plane. 


B2. Find the minimum distance from the point (—3, 1, 5) to the line 
x(t) = 3 — 4t, y(t) = —2 + 5t, z(t) = 6 + 11r, and find the 
coordinates of the point on the given line at which this minimum 
distance occurs. Show that the vector from (—3, 1, 5) to the 
distance-minimizing point on the line is perpendicular to the line. 


B3. Find the minimum distance between the two skew lines 
x(t) =7 + 4t, y(t) = —3 + 2t, z(t) = —1 — 5t, and 
x(t) = —1(5 + 32), y(t) = 17 + 8t), z(t) = —3 + 5t; find the 
points on the lines where this minimum distance occurs. Show 
that the vector connecting the distance-minimizing points on the 
two lines is simultaneously perpendicular to each line. 


B4. Using the Lagrange multiplier technique, find the point on the 
curve x?y = 2 that is closest to the origin. Find the minimum 
distance. Obtain a graph of the level curves of the objective 
function f (x, y) that is to be minimized, and on this graph 
superimpose the graph of the constraint curve. 

B5. Using the Lagrange multiplier technique, find the points on the 
curve x? + xy + y? = 1 closest to and farthest from the origin. 


B6. 


B7. 


B8. 


B9. 


B10. 


Obtain a graph of the level curves of the objective function 

f (x, y) that is to be minimized, and on this graph superimpose 
the graph of the constraint curve. 

Using the Lagrange multiplier technique, find the point on the 
surface xy + 1 — z = 0 that is closest to the origin. 

Find the extrema of f(x, y) = 4x + y on the constraint 

g(x, y) = 2x? + 3y? — 1 = 0. Sketch the level curves of f (x, y) 
and superimpose the graph of g(x, y) = 0. 

Find the distance from the point (1, 2, —3) to the plane 

3x +2y —3z=5. 

Find the extrema of f(x, y, z) = 2x + y + 2z subject to the 
constraints g(x, y, z) =x? + y? — 4 = 0 and g(x, y, z) = 
x+z-2=0. 

Find the extrema of f(x, y, z) = 2x + y? + 5z subject to the 
constraint g(x, y, z) = 9x? + 4y? — 252? — 16 = 0. 


. Find the point(s) on 3x? + 2y? + 2xy + x + y = 16 closest to the 


origin. 


. Find the points on the intersection of 2x — y = 1 and 


2x? + y? + 22? = 1 that are closest to and farthest from the origin. 


. Find the distance from (—1, 2, 3) to the line of intersection of the 


planes x + 2y — 3z = 4 and 2x — y + 2z = 5. 


| Conservative Forces and the Scalar Potential 


The Conservative Force 


A force F is called conservative if F — —Vu for a scalar function u called the scalar 


potential. 


Inclusion of the minus sign makes the scalar potential u agree with the potential energy 


function in physics. 


Section 21.5 presents several other definitions of the conservative force and shows the 
properties that characterize them to be equivalent. 
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EXAMPLE 18.12 


EXAMPLE 18.13 


FIGURE 18.21  Equipotentials for 
Example 18.13. The values on the contours 
are U = 0.4, 0.6, 0.7, 0.8, 0.9, 1, 2, 3, 
with the smallest value occurring on the 
outermost contour. 


Let the force field F — Si, A > 0, be generated by a unit positive charge at the origin on 
an x-axis. The potential energy function is defined as the work it takes to move another unit 
positive charge from infinity to the point x > 0 and is given by 


ate) = f _||F\| dc = [ (-3) fae (18.9) 
oo oo L^ x 


The force generated by the charge at the origin is directed radially outward. Along the 
axis, the force that the fixed charge exerts on the moving charge is directed to the right, so 
the force needed to push the moving charge toward the origin points to the left. That is the 


reason for the minus sign in the integral in (18.9). Thus, the field F arises not as Vu = — - i, 
but rather, as —Vu = $i. % 


Often, it is mathematically convenient to characterize the conservative field F as one 
that is “the gradient of a scalar potential,” without explicit mention of the physicist's minus 
sign. The resolution is that the physicist’s potential u could easily be the mathematician's 
potential U = —u. Then, the physicist’s F = —Vu is the same as the mathematician's 
F = VU. 


In addition to the positive charge at the origin in Example 18.12, assume a similar charge, 
placed at the point (5, 5) in the xy-plane. In two dimensions, the charges at the origin and 
at (5, 5) have the respective potentials 


1 
u(x, y) = ——M———z 
/x2 + y? 


The potential for the system is then the sum 


1 
Vx — 5 4 (y — 55 


and v(x,y)-— 


1 


1 
+ 
vty f@-5)?+ 0-5)? 


The potential surface for this system is seen in Figure 18.20; and the equipotentials, the 
level curves of this surface, appear in Figure 18.21. The contours show that at a sufficient 
distance away from the two charges, they begin to resemble one charge. 


U(x, y) 2u(x, y) + v(x, y) = 


FIGURE 18.20 Potential function for 
Example 18.13 


The force field generated by the two charges is then 


X - x5 
paya 597  (e-59-0-59)^ 
a a ) y-5 


+ ; 
(2X3 (e -524o-52)^ 


MN SQ 
FARR 


FIGURE 18.22 Flow lines for the field in 
Example 18.13 
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and if R = x(p)i+ y(p)j, solving the system of equations R'(p) = F(x(p), y(p)) gives 
the phase portrait seen in Figure 18.22. The points (0, 0) and (5, 5), where the charges 
are located, are singular points of the differential equations. The derivatives x’ and y’ are 
infinite at those two points, making the system of differential equations very difficult to 
solve numerically. 

There is an equilibrium point at G, 3) since F(3, 2) = 0. The linearization technique 
of Section 12.22 can be applied here to verify that (3, 3) is a saddle point. At (3, 3), the 
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Jacobian matrix for the system is =% È A; with eigenvalues -$ v2, E V2. Since the 


eigenvalues are of different signs, the equilibrium point is indeed a saddle. $ 


Recovering the Potential 


It is sometimes possible to construct the scalar potential from a given vector field. In two 
dimensions, the test for the existence of a scalar potential is essentially the straightfor- 
ward test for the exactness of a first-order differential equation. (See Section 3.3.) In three 
dimensions, the full characterization of conservative fields is given in Section 21.5. 

If F = f(x, y)i + g(x, y)j = VU, then, by the equality of the mixed second partial 
derivatives of U, that is, since U,,— Uy, must hold, then so too must f,— g, also hold. 
Applying that test to the scalar potential of Example 18.13 gives 


3 xy 23 (x —5)(y — 5) 
(2+) ((@ — 5)? + (y —5)?) 


5/2 


for both f, and g,, so a potential function exists. 
To find the scalar potential U(x, y), start with the equations 


U, = f(x, y) and U, = g(x,y) 


Then, determine U (x, y) by integrating with respect to x, the left-hand equation, holding 
y fixed, thereby making the constant of integration a function of y. This yields 
" 1 1 

v+ Vx —5)?+(y—5)) 


If this candidate for U (x, y) is differentiated with respect to y, g(x, y) should result. Hence, 


+ C(y) 


x y y-5 
2 2343/2 + 2 ? 
(x? + y?) (œ -57+ 0-5?) 


y= wm tC) 
Matching that with the known result for g(x, y) gives C'(y) = 0, so C(y) is at most a 
constant. The scalar potential is, at best, determined up to an additive constant, and with 
C(y) =0,U =U. 
Not every vector field comes from a scalar potential. For example, form the vector field 

y " j—8 
(23^ («x—5284(o-52)^ 

x X—3 


(x+y) («-5?4 60-5») 


everywhere orthogonal to the vector field F, by interchanging the components of F and 
introducing one minus sign. This new field G will have its vectors perpendicular to the flow 
lines of F, so if a scalar potential exists for this new field, the equipotentials of U (x, y) will 
be its flow lines. That sometimes does happen, but not here, since the “‘cross-partials” test 


G= 


3/2 
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shows 


fy Bx — 


3/2 


(x22? + (x — 5)? + — 5) 


j : * 
(x2--y2y "^ (& — 5)? + (y — y^" 


so no scalar potential exists for the field G. 


A Convention 


Usually, the electric force field in physics is normalized so that it gives the force on a unit 
positive test charge. In physics, the convention for gravitational fields seems to be that each 
field is defined in terms of the force exerted on the specific mass in question. However, for 
the sake of uniformity, we will normalize all fields in this text so that a field always gives 
the force on a unit particle or unit mass. 


EXERCISES 18.5—Part A 


Al. Use the technique in (18.9) to obtain the potential energy function 


for the force F = x~4i. 


A2. Determine which, if any, of the following forces are conservative. 
Find a scalar potential for each conservative force. 


(b) F = (1 + xy)e? (yi + xj) 
(c) F = y? cos xyi + (sin xy + xy cos xy)j 


A3. If r = f/x? + y? andr = 1 (xi + yj), show that F = f(r)r is 
conservative for any differentiable function f(r). 


(a) F = x?yi — xy?j 


EXERCISES 18.5-Part B 


A4. The force exerted by a spring on an attached object is F = —kxi, 
where x is the displacement of the object from the equilibrium 
position of the spring. Find w(x), the work done in stretching the 
spring x units from its equilibrium length. Show that w(x) is the 
potential function for F. 

AS. A unit positive charge is placed at the origin in an xy-plane. If at 
(x, y) the charge exerts a force F inversely proportional to r?, find 
F and its scalar potential. 


B1. An object weighing 4 lb is raised x ft. Find the work done, and 
show this gives the scalar potential for the gravitational force 
acting on the object. 


For the scalar potentials given in each of Exercises B2-11, let R be the 
region —1 <x,y<1.InR: 
(a) Obtain a plot of the potential surface z — u(x, y). 
(b) Obtain a contour plot of the equipotentials (level curves) of 
u(x, y). 
(c) Obtain the conservative field F 2 —Vu. 
(d) Find all critical points where F — 0. Hint: Since F — 
—ux(x, y) — uy(x, y)j. u(x, y) = 0 implicitly defines 
y = yı (x), whereas u, (x, y) = 0 implicitly defines 
y = yz (x). Any intersections of the curves y; (x) and y» (x) are 
critical points. 


(e) Obtain a field plot for F. 

(f) Obtain a graph of the flow lines of F, indicating the direction 
of increasing t along the flow lines. Such a graph is actually a 
phase portrait for the autonomous system R'(p) — F(x(p)) — 


F(x(p). y(p)), where R = x(p)i+ y (p)j. The critical points 
for the field are the equilibrium points for the autonomous 
system of differential equations defining the flow. 


(g) By linearizing at each equilibrium point, determine whether 
the point is asymptotically stable or unstable. 


(h) Where possible, categorize each equilibrium point as a node, 
saddle, center, or spiral. 


(i) Superimpose the flow lines on the contour plot found in 
part (b). 


(j) By appropriately integrating F, reconstruct the potential 
function u(x, y). Compare your result with what your favorite 
computer algebra system gives if it has a built-in facility for 
finding the scalar potential. 

B2. u(x, y) = 2y? + 11x?y — 12xy? 
B3. u(x, y) = 10y + 12xy? — 7x3 
B4. u(x, y) 2 6y + 6x? — 8xy? 

B5. u(x, y) = 12y? + 11x2y — 2x3 


B6. u(x, y) = 6x? + 8? — 3xy 


10x? + 8xy + 4xy? 
B7. u(x, y) — Jp P ORY E AEN 


7 + 6xy? 
12x — 5x? + Ay? 2x = 11y? + 6y? 
B8. u(x, y) = : B9. u(x, y) = : : 
iurc =e ta eat u(t, y) = 19 ay? — 4x 
Axy + 6y? — 5xy? 6+ 12y 
B10. u(x, y) = — : - B11. u(x, y) = ———— 
uen y) 4+ 1lxy + 10x? vus n 1 +x?y? 


B12. Let u(x, y) be the potential of a unit positive charge placed at 

(0, 0) in the xy-plane. Let v(x, y) be the potential of a unit 

positive charge placed at (2, 0), and let w(x, y) be the potential of 

a unit negative charge placed at (1, 1). Then, the potential for the 

system of three charges is U(x, y) = u + v + w. 

(a) Write the potential function U (x, y). 

(b) Obtain a graph of the surface U (x, y). 

(c) Obtain a contour plot of the equipotentials (level curves) of 
U(x, y). 

(d) Obtain a field plot of F = —VU, the associated force field. 

(e) Obtain a graph of the two flow lines that start at (—0.1, 0.1) 
and (0.1, 0). 

(f) Find the critical point where F = 0. 

(g) The critical point found in part (f) is an equilibrium point for 
the differential equation R’ = F(x (t), y(t)). By linearization, 
categorize this equilibrium point as a node, saddle, center, or 
spiral. 


In Exercises B13—27, the vector field F = M(x, y)i + N(x, y)j is con- 
servative and has a potential function u(x, y) if the condition M, = N, 
is satisfied. For each, determine if a potential function exists. If it does, 
find a scalar function u(x, y) for which F = —Vu. 

B13. 
B14. 
B15. 
B16. 


M = lly? +24xy, N = 3 -22xy + 12x? 
M = —18x — 18xy, N = 9x? 

M = —22x — 6xy, N = —9 — 3x? 

M = 4y? — 4xy, N = 8xy — 24y? — 2x? 


B17. M = 10x — 6y, N = 6x + 2y 
B18. M = 6xy + 3y?, N = 3X? + 6xy 
y xy? y Ky 
B19. M = y arctan — + ———~, N = x arctan — + ——, 
x x*-Ly* x X^ py 
in. M x? — 2xy -Ay = 2x? + 2xy E y? 
=y) G@—y)r 
B21. M = a Ly) ya T eii = ct 
(x? — y*ye (x? — yt 
x 2010 942 4 1242 
B2. M = 622 D y=3? (10 — 9x EE. ) 
4+ 3y3 (4 + 3y3)? 
= 17x? - 6+ 12y we 34 7xy 
2 x3 x? 


1] 4x? Ty 71 
a yon = 
5 x 
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~— 11 11 — 10xy 2 +. 4x? 
B25. M = y 3 1O0xy + 5y* + 4x 
(x — yy (x — 
x? 1 2 y x? — 4 
a6. eo wy Ae 
(y? — 1x? x(y* — 1)* 
2+ 6x + 9x? 6x? —3 — 5x 
Wea uoa eoe 
y(1 + 3x)? y*(1 + 3x) 


For the potential functions u(x, y, z) given in each of Exercises B28 —39: 


(a) Obtain the corresponding conservative force field F = —Vu. 
(b) Graph solutions of the differential equation 
R’ = F(x(p), y(p), z(p)) to obtain, as space curves, the flow 
lines for the field F. 


B28. u(x, y, z) = 5x — lly*z — 8xz? + 8yz 
B29. u(x, y, z) = 9xy — 11y? — 9x? — 11yz? 
B30. u(x, y, z) = 10xy +223 + 3y?z + Ixy? 
B31. u(x, y, z) = 3yz — Tez + 8xz? — 12xz 
B32. u(x, y, z) = 2y — xz + 3xz 
B33. u(x, y, z) = 10 + 12xz? — 12y? + 8yz 
B34. u(x, y, z) = 2yz) — 8x?z + 2y? 
Oxyz — 3xy — 6y? 
B35. u(x, y, z) = — i 3 
u(x, y 1-2y42 
9y?z + 12yz? — 7xz 
B36. u(x, y, z) = ? 2 : 
11x — 10yz 
5xy 4-52 
B37. u(x, y, z) = as 
! 5y?z — 5xz? +x 
8x?z + xz? + 11y? 
B38. u(x, y,z) = : = a. 
11y? — 623 
5y? — 5xz— 2? 
B39. u(x, y, 2) = v ae. a 
llyz — 7x 
The vector field F = f(x, y, z)i + g(x, y, 2j + h(x, y, z)K is con- 


servative and has a potential function u(x, y, z) if the conditions 
hy = 8z, f. = hx, and g, = f, are satisfied. In Section 21.5, u(x, y, z) = 
— f? f(t,b, c) dt — f; gx. t, c) dt — pr h(x, y, t) dt is then shown to 
be a potential for F. The potential so constructed is determined up to an 
arbitrary constant via the arbitrary point (a, b, c). For each of Exercises 
B40-—51, determine if a potential function exists, using the given recipe 
to find it, should it exist. 

B40. 
B41. 
B42. 
B43. 
B44. 
B45. 
B46. 


F = (8xz + 3z°)i — 7z°j + (4x? — 14yz + 6xz)k 
F = (7 — 21x? — z)i — xk 

F = (2xz + 2y)i + (2x — 22)j + (x? — 2y)k 

F = 10y?i + (42? + 20xy)j + 8yzk 

F = (12y + z)i + (12x — 14y)j + xk 

F = (3x? — 7y? + 4z)i — 14xyj + 4xk 

F = 3yzi — 3xzj + xy — 12z’)k 
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x . 54y -D2xy 45x). 


y. 1 Mx = 22) | 1 »Qz + Lx), 


B47. F=5 B50. F = —- 
yore X pyys z iz? i z 
y y? (8z? — 3) dehy £42 .., Q@+yO'—2z) 
A B51. F = -i : t Uk 
dm u —9) TM 22(8z2 — 9)? z(y—-z)? —xz(y—zy xz2(y — zy 


J a 5 2xy?--l6xz--llyz, y(lly + 32x) 
i-2 
y^ — 8 Or-s&y GP 8 


Chapter Review 


1. Describe the calculation by which the flow lines for a vector field 10. 
are obtained. Give an example. 

2. Describe the gradient vector and state its most interesting 11. 
properties. 

3. Give an example of a gradient vector field in two dimensions. To 
what are the gradient vectors orthogonal? 12. 

4. Give an example of a gradient vector field in three dimensions. To 13. 
what are the gradient vectors orthogonal? 


5. Define the concept of the directional derivative. Show how to 
obtain the expression V f - u for the directional derivative of the 
scalar f(x, y, z). 


6. Describe what is meant by the level curves of the function 
z = f(x, y). Give an example. 

7. Describe what is meant by the level surfaces of the function 
w = f (x, y, z). Give an example. 

8. Give an example that demonstrates that the gradient vector V f 
points in the direction of increasing values of f. 


9. Give an example that demonstrates that the directional derivative, 
taken in the direction of the gradient vector, has the value ||V f ||. 


Use the Lagrange multiplier technique to find the minimum 
distance from the point (3, 7, —2) to the plane 6x — 4y 4- z — 12. 


Use the Lagrange multiplier technique to find the minimum 
distance from the point (4, —5, 2) to the intersection of the planes 
2x —3y+7z = 9 and 3x + 5y — 9z = 16. 

Define a conservative force. Give an example. 


A unit positive charge at the origin of the real line exerts its 
influence along that line as a field. A second unit positive charge is 
at x = +00 on the line. The potential energy u(x) = | m F(r) dr is 
defined as the mechanical work required to move the particle from 
+00 to a new location x along the line. Since the two charges repel 
each other, the rightmost charge moves toward the origin only if it 
experiences a force pointed to the left. For electrostatic charges, 
this force is inversely proportional to the square of the distance 
between the charges. Hence, the force on the rightmost charge is 

= 4, where k is a constant of proportionality. 


(a) Show that the work done in moving the rightmost charge from 
infinity to x is u(x) = E, 


(b) Show that F = —Vu = — di is the force exerted by the field 


(from the charge at the origin) on the particle to its right. 


Chapter 19 


Line Integrals in the Plane 


INTRODUCTION Students of general physics know that work is defined as the 
product of a force and the distance through which it acts. If the force is not directed along 
the line of motion, its component along the path is used. If the force varies along the path, or 
if the path is curved, the component of the force on the tangent to the path is summed along 
the path. This results in a /ine integral, which happens to be the same, mathematically, as 
the circulation integral for a moving fluid. For work, the tangential component of a force 
is integrated along a path. For circulation, the tangential component of the velocity vector 
is integrated along a closed path such as a circle. 

If a fluid flows across a curve, there is a net transport of mass across that curve. The 
flux, or transport across the curve, is determined by a line integral of the normal component 
of the velocity vector along the curve. Thus, flow through a boundary is related to the flux, 
a line integral of the normal component of the field crossing the boundary. 

These two concepts of work and flux are fundamental in understanding the vector 
calculus in the following two chapters. Although initially defined for plane curves, both 
work and flux exist in three dimensions. The work integral generalizes to a line integral 
in three dimensions, but the flux integral generalizes to a surface integral in Section 21.2, 
where flow through a surface is defined. 


Work and Circulation 


Integration as Accumulation 


Integrating to find area under a curve is a summation process. Rectangular bits of area are 
accumulated, and as the rectangles become thinner and more numerous, the approximate 
area becomes the total area sought. For the function f(x) = x? + 1, Figure 19.1 suggests 
how 10 rectangles begin to approximate the area under f (x) on the interval [0, 1]. 

Of course, this intuition was well established in the integral calculus course, as was the 
following analysis of the summation process that resulted in the definition of the integral. 
The sum of n equally spaced rectangles, each having its height determined by the function 
value at the left endpoint of the subinterval over which the rectangle sits is 


n-i 


1 Y i? 4 J j| E l p 1 ) 
B 5r dq porn RN PR 
n4 n? n A3 2 6n 
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(b) 
FIGURE 19.3 Areas under the 


projections of the curve in Figure 19.2 to 
(a) the xz-plane and (b) the yz-plane 
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FIGURE 19.1 Integration as accumulation of area FIGURE 19.2 The curve 


y = 1 — 5 “lifted” to the 


which, in the limit as n becomes infinite, is 4, recognized as the value of the definite integral 
al j 
fo (8 + D dx. 


Line Integrals 


INTRODUCTION A similar accumulation process for a quantity f(x, y) defined along 
a curve C lying in the xy-plane results in a line integral, written with one of the notation 
i c JG, y) dx or be f (x, y) dy. The subscript C indicates that the integration is along some 
curve C. 

Suppose f(x, y) = x? + y? and C is the curve x + 2y = 1. A graph of the surface 
z= f(x, y), the curve C, and the “lift” of C onto the surface is shown in Figure 19.2. 
Figure 19.3(a) shows z = f(x, y(x)), the lift projected onto the xz-plane; while Figure 
19.3(b) shows z = f (x(y), y), the lift projected onto the yz-plane. The area under each 
projection is also shown. Hence the line integrals 


x=b y=y7! (b) 
/ F(x, y) dx =f f(x, y(x)) dx = / f(xy), y)x y)dy (19.1a) 
(Oy oi 


a y=y—!(a) 


yzy (b) x=b 
[ to.nav=f feo). dy = | f(x, yG)y'G)dx (19.1) 
Cc 


y=y7! (a) x=a 


compute areas analogous to the shaded regions in Figures 19.3(a) and 19.3(b), respectively. 
The middle integral in (19.1a) is used if C is parametrized by y = y(x), whereas the 
rightmost integral is used if C is parametrized by x = x(y). The middle integral in (19.1b) 
is used if C is parametrized by x = x(y), while the rightmost integral is used if C is 
parametrized by y = y(x). If the curve C is defined parametrically by expressions of the 
form x = x(p) and y = y(p), then the line integrals are evaluated as 


p=pı 
/ f(x, y)dx = Í f (x(p), y(p))x'(p) dp 
G Į 


?— po 


P=P1 
/ f(x, y)dy = / f (xi) y(p))y'(p) dp 
C p 


2= po 


EXAMPLE 19.1 


FIGURE 19.4 Tangential component of F 
along the curve C 
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Let the curve C be the upper semicircle of radius 3, centered at the origin, and parametrized 
by p via the equations x(p) = 3cos p and y(p) = 3 sin p; let the function be f(x, y) = 
x? + y?. The function must inherit the parametrization given the curve C so that f = 
f (x(p), y(p)) = 9cos? p + 27 sin? p. Hence, we have the two line integrals 


f f(x, y)dx = f (9 cos? p +27 sin? p)(—3 sin p) dp = —18 — Ha (19.2a) 
c 0 


/ f(x, y)dy = / (9 cos? p + 27 sin? p)(3 cos p) dp = 0 (19.2b) 
C 0 


e. 
“~~ 


CLOSED LINE INTEGRALS Ifthe line integral is taken around a curve C forming a closed 
loop, it is called a closed line integral and is often denoted by an integral sign decorated 
with a closed loop: $ . Since the direction in which the curve C is traversed matters, some 
texts also decorate the little loop with an arrow to indicate whether a simple (non-self- 
intersecting) loop is traversed in the clockwise or in the counterclockwise sense. Moreover, 
the applications most often contain closed line integrals of the form 


f fo ydx + se ndo d fæ oae d ono 
C C € 
which arise as work, circulation, and flux calculations. 


WORK As A LiNE INTEGRAL Mechanical work done by a force acting on a particle is 
defined in physics as the product of the component of the force in the direction of motion 
times the distance through which that component acts. If the force varies along the path, or 
the path is curved, then this definition is generalized as the line integral of the component 
of the force tangent to the path. This definition gives the work done on the particle by the 
force. 

In particular, let F be the force acting on the particle, and C be the curve along which 
the particle moves under the action of the force F, and ds be the element of arc length along 
C. Further, let T be a unit tangent vector along the curve C. Then define 


Work = | F-Tas= [Fear 
e C 


Figure 19.4 shows why, along the curve C, F - T represents the tangential component 
of the force F. Mathematically, the projection of F onto the unit vector T is determined by 
simple right triangle trigonometry and the standard formula for interpreting the dot product, 
namely, F - T = ||F||||T|| cos@ = ||Fl|1 cos0 = ||F|| cos 8. 

Next, examine why F - T ds = F - dr, or equivalently, why T ds = dr. The radius vec- 
tor r = x(p)i+ y(p)j describes the curve C. Along C, the unit tangent vector is T = “ = 


ds 
di + 2, Thus, Tds — & ds = dr = dxi + dy j. Finally, if F = f(x, y)i + g(x, y)j. 
then F - T ds = F - dr = f dx + g dy is the tangential component of F along C. 

Hence, the line integral for work is precisely the line integral of the tangential com- 
ponent of the field. Circulation is also defined as the closed line integral (around the curve 
C) of the tangential component of the velocity field of a fluid flow. Therefore, the same 
structure expressing mechanical work also expresses the notion of circulation, which plays 


an important role in Sections 36.9 and 36.10 where problems in planar fluid flow are solved. 
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EXAMPLE 19.2 


EXAMPLE 19.3 


(1, 1) 


b 


Find the work done by the force field F = (3x — 4y)i+ (4x + 2y)j on a particle of mass 
m = 3 as the particle is moved around the ellipse C defined by x = 4cos p, y = 3sin p. 
According to the convention stated at the end of Section 18.5, the field F is defined as the 
force exerted on a particle of unit mass. 

The work done by the field F on the particle as it moves along the closed curve C is 
the closed line integral of the tangential component of F, namely, F - dr. If the curve C is 
expressed in radius-vector form, we have 


r=4cos pi + 3sin pj and dr = —4sin p dpi + 3cos pdpj 


Expressing x and y as functions of p then gives 


2a 
Ji fdx+gdy= Ji [—4(12 cos p — 12 sin p) sin p 
c t=0 

>, 


-- 3(16cos p + 6sin p) cos p] dp = 2887 St 


When the curve C is parametrized by one explicitly given set of equations, computing a 
line integral whose integrand is of the form f(x, y) dx + g(x, y) dy is straightforward. If, 
however, the curve C is defined in segments, with different sets of formulas for different 
segments, the line integral becomes more of a challenge. In fact, if no parametrization for 
C is given at all, then the user must supply that all-important parametrization before any 
line integration can take place. Consider, then, the following example. 

Let C be the triangle with vertices (1,0), (1, 1), and (0,0). Let f(x, y) = y? and 
g(x, y) = x?. Find the value of the line integral of f dx + g dy taken in the counterclock- 
wise sense around the triangle C. Note that traversing the triangle in the counterclockwise 
sense means that a person walking the path would have the interior of the triangle to the 
left as the boundary was traversed. (See Figure 19.5.) 

Parametrize segment (a) with x = p, y = 0, segment (b) with x = 1, y = p, and 
segment (c) with x = p, y = p, giving 


(0, 0) ^ (1,0) 
à : 1 1 0 
FIGURE 19.5 The triangular path for : a a7. 2. 1 
Example 19.3 s fdx+ gdy = M di i I dp + 2p dp=0+1-5=3 
Note that segment (c) must be traversed from (1, 1) to (0, 0). * 

EXERCISES 19.1—Part A 
A1. Evaluate the line integrals Ja f (x, y) dx and Js f(x, y) dy if A4. Compute the work done in Exercise A3 if the path is the straight 

f (x, y) = 2x? — 3xy + 5y? and C is the curve y = 2x — 3, line connecting the two given points. Is F a conservative field? 

0zxzl. AS. Let F = f (x, y)i + g(x, y)j be a force field. Show that 
A2. Evaluate the line integrals f, f (x, y) dx and fj. f (x, y) dy if fc F -dr = fe fe y) dx + fog, y) dy. 


f (x, y) = 3x? + 2y? and C is a circle with radius 1 and center at 


the origin. 


A3. Compute the work done when an object of mass 2 is moved from 
(0, 0) to (2, 4) along the curve y — x? if it is subjected to the field 
F = x?yi + xy?j. 


EXERCISES 19.1—Part B 


19.1 


467 


Work and Circulation 


B1. Graph the integrand in (19.2b), Example 19.1, and argue from 
symmetry that the value given is correct. Graph the integrand in 
(19.2a) and explain why the graph does not contradict the given 
value of the integral. 


In Exercises B2-11, evaluate the line integrals fa f(x, y)dx and 
E f(x, y) dy, where C is the curve given by y = y(x) for x in the 
indicated interval. 


B2. f(x, y) = —6 + 7y — 1y?, y = —Ix* — Ax? — 14x? — 4x + 9, 


[-3. 6] 
B3. f(x, y) = 8— 6x?y — Oxy?, y = 14x4 + 8x? + 1, [-9, 7] 
B4. f(x, y) = —3 + Ax?y -9y?, y = 8x* — x? + 8x? + 6x, [—6, 6] 


B5. f(x, y) = —8x — 4y + xy, y = 9x4 — 6x? + 5x? — 6x +1, 
[77,9] 

f(x, y) = 84-8x?y + x?, y = —7x3 + Ax? + 14x + 3, [-6, 1] 
f(x, y) = xy? — 9xy + 8x2, y = 6x? — 18x, [-2, 6] 

f (x, y) = 3x + Oxy? 2x — 8, [-2. 6] 
f(x, y) = —4x + Sxy? + 2xy, y = 12x* — x? — 5x? +6, [—5, 7] 


f(x, y) = 9y + 7x?y — 3y5, y = —Ax* + 7x? — 3x? — 3x + 1, 
[—3,5] 
B11. f(x, y) =8—7y -3y?, y = —2x? + 12x — 8, [—4, 8] 


B6. 
B7. 
B8. 
B9. 
B10. 


3xy, y = xt — 3x3 


In Exercises B12-21, evaluate the line integrals fe f(x, y)dx and 
Ja f (x, y) dy, where C is the curve given by x = x(t), y = y(t) fort 
in the indicated interval. 


B12. f(x, y) = 6x — Axy? —3x?, x = —9t? — 5, y = —? + 3t? + 3t, 


[-8, 8] 

B13. f(x, y) = 7x -3y? - 2y, x = 8? + 8t, y = 21^ + 9 — 3, 
[—2, 0] 

B14. f(x, y) =3+6y? —x?, x = 13? — 4, y = —6t* + 12t — 2, 


[-1, 1] 

f(x, y) 26—8x?y +xy?, x = -t — 1, y = —2t^ 4 8 + 
2t? + 3t, [1, 2] 

f (x, y) = Ixy? + 8xy + 6x3, x = —88 + 6t —2, y = —5r* 
5t? — 327, [0, 1] 

f(x,y) =x +8y —7y?, x 2 9 — 20 + 8t +2, y = —6t* + 
t — 182, [-2, 1] 

fo, y) = y — Tx’ y 4+ 9y3, x = 38 46? — Bt, y = 705 — 

3r? — 4, [0, 1] 

f(x, y) =3y - Ay! + 5xy, x = 3D — 4t +5, y  —00 — 7, 
[-31, 1] 

f(x, y) = 6x + 9y3,x = 
9r + 2, [0, $ 
f(x, y) = 6 — 5x?y + 5xy, x = —50 —2t + 12, y = —8t* + 
t? +3, [-1, 2] 


B15. 


B16. 


B17. 
B18. 
B19. 
=P 


B20. = 7 — 5t, y = 6t +307 + 


B21. 


In Exercises B22-31: 


B22. 
B23. 


B24. 


B25. 


B26. 


B27. 


B28. 


B29. 
B30. 


B31. 


(a) Graph the path C, the curve given by y = y(x), —2 < x < 3. 


(b) Add to the graph of C a direction field for G = F/||E||. 
Calculate both F and Fr, the tangential component of F, at 
x= l: 

(c) Find the work done by the field F, acting on a particle of mass 
m, as the particle moves from left to right along the curve C. 

F = (1 —7y —4y?ji + Oy? - 732 — 6xy*)j, m 27, y = 12x? +9 

F = (3 + 5x? + 9xy)i + (Sy — 9x? — 2x?)j, m = 1, y = 6x^— 

3x3 —9x +5 


F = (2y? + 7x3 + 2xy?)it (8 + xy? — 5x?y)j,m = 8, 
y = 5x3 +3x7 43x41 


F = (5y — 6y? + 3x7)i+ (5 — y + 4x? y)j, m = 3, y = —5x^— 
3x35 +7 
F = (7 — 4y — 5xy”)it+ (6 — 4x? + 3xy?)j,m = 1, y = 7x? + 
15x +9 
F = (4x? — 3xy*)it+ (6+ y? — xy)j, m = 9, y = —3x* + 
Ix? —7T 
F = (8y + 7xy — Txy*)i + (3 + 2x?y)j, m = 4, y = 2x4 + x? — 
3x? — 5x 

—3xyli4- (2y? — 6x?)j,m 24, y = 3x3 — 11x — 11 


y =—7x* + 3x3 — 4x? 


F 

F = (4xy — 2y? — 5x?ji + (4+ 3x — Ty?)j, m = 8, 

y 

F = (7 + Ax?y)i + (2 + 2xy’)j, m = 4, y = 11x* + 8x? 


In Exercises B32-43: 


B32. 


B33. 


B34. 


B35. 


B36. 


(a) Graph the given closed path C formed by y; and y». 

(b) Add to the graph of C a direction field for G = F/||F||. 
Calculate both F and Fy, the tangential component of F, at 
Po = (Xo, Yo), the lowest point on yı. 

(c) Find the work done by the field F, acting on a particle of mass 
m, as the particle moves once counter- 
clockwise around the curve C. 


F = (8y? — 6x*y — 7x9)i + (2 — 2xy?)j, m = 6, yı = 2x? — 8x, 
y2 = —2x + 56 

F = (12x — 6x?y)i + (7x + 8y — 7xy?)j, m = 1, yı = 7x? — 
Tx —3, y = Ix + = 

F = (6xy — 7x?y — 4)i4 
2x +2, y = 2x +27 

F = (2x + 8y + 4x?y)i + (x + 9y? — 5x3)j, m = 8, 
yı = 5x? — 7, y2 = 5x +93 


F = (5y + 4xy — 2x?)i + (3x — 2y + 4x?)j, m = 3, 
yı = 2x? — 4x — 4, y; = 10x — 4 


(8x +3y + 5xy)j, m = 1, yı = x? + 
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B37. F = (8xy — 9x?y —6)i+ (1 — 5xy) m = 8, yı = Dye = B44. F = (4 — 5x -2z22 y)i + (1 2x?y --7xy)j, ((10, 1), (—11, 4), 
8x — 2, y2 = 2x + 26 (—10, —3)} 
B38. F = (9y + 8y? — 3x3)i+ (x —3y)j,m = 6, yı = 4x? — 4x — 9, B45. F = (3x + 6y? + 9x2ji + (9x? — 9y3)j, {(9, 6), (—11, 9), 
yo = 16x +2 (—1, —10)} 
B39. F = (2y + 3xy + 8x>)i+ (5x — 6xy — y*)j,m = 6, B46. F = (4y + x? + 3xy)i + 3x2y + 4xy? — 3)j, (4, 2), 
yi = 9x? + 8, y; = 9x + 26 (—7, 11), (—4, —3)} 
B40. F = (6x + 4y°)i + (5 + 8y? + 3x°)j, m = 8, yi = x? + 8x + 5, B47. F = (3x?y — 6x)i+ (7 — 3xy7)j, {(12, 9), (—2, 3), 
y) =x+13 (—4, —1)) 
B41. F = (3 — 8x + 9y?)i + (4xy — 4x? + 6y)j, m = 7, yi = Ax? + B48. F = (1 — 3y — x2)i + (2x + 4y + x°)j, (C7, 10), (—7, 10), 
8x — 2, y = Bx? +8x4+8 (—10, —7)} 
B42. F = (4y + Sy? + 9x?)i + (5x?y + 4y? + 8x7)j, m = 7, B49. F = (8y — 6x? + 7xy)i + (5x — 9y + 7x°)j, {(2, 10), (—3, 6), 
yi = 3x? + 6x +1, yo = 3x? — 3x41 (—6, —2)} 
B43. F = (8 — 7xy — 8x?)i + (6x + y — 8y?)j, m = 2, yı = 3x? — B50. F = (7xy? + Hi + (9 — 6x + 3xy)j, {(2, 9), (—2, 9), 
9x — 9, yo = 3x? — 6x — 8 (—10, —8)} 
f cL "E E 
In Exercises B44—55: B51. 5 2 eH 6y* +x°)it (4y + 8xy 3x)j, {(5, 10), (—11, 4), 
(a) Graph the closed polygonal path C determined by the given B52. F = 9xy^i + (7x2y + 5xy? + 3)j. {(5, 5), (—9, 11), (—1, —8), 
vertices. D 
(12, —10)) 
(b) Add to the graph of C a direction field for G = F/||F ||. B53. F = (2 + 8x + 6xy)i + (7x — 2x? — 8y°)j, (15, 9), (—5, 7), 
Calculate both F and Fr, the tangential component of F, each (—1, —10), (12, —11)} 


computed at x = 0. (The path C is closed, with two points on 


e 5 Su um : —12 
‘aed B54. F = (y + 9x3 + 6y?)i + (4x — x2y + 5)j, {(2, 4), (—12, 10), 


(—3, —8), (5, —9)} 
B55. F = (xy? + x — y)i + (2y — 8x?y + 6x)j, {(7, 6), (—4, 9), 
(—1, —9), (11, —2)} 


(c) Find the work done by the field F, acting on a particle of mass 
m = 1, as the particle moves once counterclockwise around 
the curve C. 


— Flux Through a Plane Curve 


DEFINITION 19.1 


The flux of the vector field F = fi + gj through a plane curve C is defined as the 
line integral, along the curve C, of the normal component of F on the curve, that is, 
by Je F-Nds. 


If at a point on C the two normals are denoted by N and —N, then the flux in the direction 
of —N is the negative of the flux in the direction of N. Shortly, we will describe a standard 
convention for specifying which unit normal vector is usually chosen when computing flux 
through a plane curve. 

The flux of F through C is a measure of how much of F flows along the normal to C. 
This is most easily seen by examining the units of the field F = pv, where p is the planar 
density (mass per unit area) and v is the velocity field of a planar fluid flow. The units for F 
are then 7 E = ak a indicating that F is the mass flow-rate per unit length along 
the curve C. The flux of this field through C is then a measure of the mass of fluid flowing 
per unit time through (across, not along) the curve. 

If C is given in vector form by the radius vector r and T and N are unit tangent and 


normal vectors, respectively, along C, with N to the right of T, then the following comparison 


FIGURE 19.6 The normal component of 
F along the curve C 


FIGURE 19.7 The field and path in 
Example 19.4 


EXAMPLE 19.4 
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of the work and flux integrals is useful. 


Work — Í F. Tds = / Frds = Í fdx+gdx= / F-dr (193a) 
E C c [ok 


Flux — / F-Nds = Í Fy ds = / f dy — gdx (19.3b) 
G E C 


It is not an oversight that flux has no counterpart for the rightmost expression in (19.3). 
The closest we come to filling that gap is (23.17) in Section 23.2. 


The Unit Normal Vector N 


A standard convention for specifying the normal vector N is to pick it “to the right of the unit 
tangent vector T." This means that when walking along the curve C facing the direction in 
which the tangent vector T points, the normal vector points to the right. Hence, this choice 
of N implies T x N = —k. 

Put N to the right of T as follows. Let T — cos pi 4- sin pj. making T a unit vector 
and N — sin pi — cos pj. Compute T x N and notice it will necessarily be —k. Thus, by 
interchanging the components of T and negating the second component, the normal vector 
N is to the right of the tangent vector T. If N is to the right of T, then turning T toward N 
advances a right-handed thread into the page, so T x N — —k. 

If the curve C is closed, it is usual to select the outward normal. Hence, the closed 
curve must be traversed in a counterclockwise sense for the normal to be both outward and 
to the right of T. If C is not closed, the choice of parametrization determines the direction 
of T, so that the direction of N will depend on the parametrization of C. 


Normal Component of F 


Figure 19.6 helps show why F - N is the component of F along the unit normal N. From the 
definition of the dot product we have, for the normal component of F along the curve C, 


F-N = [FINI cos 8 = ||F||1 cos6 = ||F|| cos 8 


Consequently, F - N is the component of F along the unit normal N. 
To obtain 


F-Nds = f dy —gdx 


recall that the radius vector r = xi + yj gives T = € = d + 2j. the unit tangent vector. 


ds ds 
Then N — o — dj is formed from T by interchanging components and negating the 
second, so that Nds = dy i — dx j, and finally, F - Nds = f dy — g dx. 
It might prove useful for the reader to notice that the word flux begins with the letter f 


and ends with the letter x, just like the flux expression f dy — g dx. 


Using Figure 19.7, compute the flux of the field F through C if F = 3i is a constant field of 
strength 3 pointing horizontally left to right and C is that portion of the y-axis where y is 
in [0, 5]. This makes T = j and N = i. Parametrize C as x(p) = 0, y(p) = p, p in [0, 5]. 
The flux of F through the curve C is computed by evaluating the line integral 


p=5 p=5 
Fux= | F-Nas= | fdy-gax= f 3ap- | 0=15 
C C p=0 p=0 


The flux is positive. Note that the flow of the field F is in the same direction as N. Positive 
flux indicates flow along the direction of the normal N. ku 
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ÉXAMPLE 19.5 


aoe 


FIGURE 19.8 The field and path in 
Example 19.5 


EXAMPLE 19.6 


FIGURE 19.9 The field and path in 
Example 19.6 


EXERCISES 19.2—Part A 


Repeat the calculation in Example 19.4, but parametrize the curve C as x(p) — 0, y(p) — 
5 — p so that the direction of travel is downward from (0, 5) to the origin. This reverses the 
direction of T, making T — —j, and N, to the right of T, must be taken as N — —i. The 
field F now opposes the normal N, as seen in Figure 19.8. 

The flux through the curve C is then calculated by evaluating the line integral 


p=5 p=5 
Fux e f F-Nas= | fay-gdx= | 3(—ap) - | 0 2 —15 
€ C p=0 p=0 


The negative value of the flux indicates that the flow is opposed to the direction of the 
normal N. Depending on the parametrization of the curve C, the flux can be computed as 
+15, even though the normal vector N was chosen to the right of T. What this means is that 
there is no way for selecting a unique normal along a segment of the curve C. Hence, when 
computing the value of the flux through such a curve, it is essential that the normal N be 
reported along with the value computed for the flux of F through C. Positive flux indicates 
a net flow along the chosen normal, and negative flux indicates a net flow against the chosen 
normal. $ 


Find the flux of the field F — (3x — lyji + (ix + iy) through the ellipse C given para- 
metrically by x(p) = 5cos p, y(p) = 3 sin p. A graph of the field F superimposed on a 
plot of the ellipse appears in Figure 19.9. The field F seems to be spreading, passing out 
through the curve C, so there should be some net flux of F passing through this curve C. 
Figure 19.9 also shows, at the point ( 2. 24/3), a representative tangent and normal vector. 
Along C, 


F = F(x(p), y(p)) = (2 cos p — 3 sin p)it (3 cos p + 3 sin p)j 


so the flux is given by the integral 
2n 
Í fdy—gdx= f [3 (2 cos p — 3 sin p) cos p 
--5 (3 cos p + sin p) sin p] dp = 2x 


Since the ellipse C is traced in the counterclockwise sense by the parametrization used, 
the normal vector N is both “to the right of T" and “outward” with respect to the closed 
curve C. Hence, the positive value of the flux confirms that there is a net outward flow, 
through the boundary of C, for the vector field F. E 


A1. Compute the flux of F = x?yi + xy?j through the curve A4. Predict, then compute, the flux of F — 3i through the triangle 


y=x?,0<x <1. 


whose vertices are (0, 0), (1,0), (1, 1). 


A2. Compute the flux of F = xy?i + x*yj through the triangle whose AS. Find the flux of F = (3x + 4y)i + (5x — 7y)j through a circle with 


vertices are (0, 0), (1, 0), (0, 2). 


radius 1 and center at the origin. 


A3. Predict, then compute, the flux of F — 3i through the square whose 
vertices are (0, 0), (1, 0), (1, 1), (0, 1). 


EXERCISES 19.2—Part B 
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19.2 Flux Through a Plane Curve 


B1. Let u(x, y) = —xy so that F = —Vu is conservative. If C isa 
circle with radius c > 0 and center at (a, b), 


(a) obtain a field plot for F. 

(b) obtain a contour plot for u(x, y). 

(c) find, and categorize as node, saddle, center, or spiral, all 
equilibrium points for the differential equation R' = F(x, y). 
For nodes and spirals, determine if stable or unstable. 

(d) obtain the flow lines for the field F and superimpose them on 
the contour plot found in part (b). 


(e) show that the flux through C is zero for all such circles. Hint: 
x —a-ccos0, y = b + csin 0, and integrate counter- 
clockwise around C so that the normal, to the right of the 
tangent vector T, is outward along C. 


B2. Repeat Exercise B1 for u(x, y) = — i (x?4- y?). In part (e), show 
that the flux is 2zrc? for all circles C. Thus, vanishing of the flux 
must be attributed to a property of the field other than being 


conservative. See Section 20.1. 
In Exercises B3-12: 


(a) Obtain a field plot for F. 

(b) Find, and categorize as node, saddle, center, or spiral, all 
equilibrium points for the differential equation R’ = F(x, y). 

(c) Obtain the flow lines for the field F. 

(d) Let C be the circle with center at (a, b) and with radius c, as 
given. At (a, b + c), the point at the “top” of the circle, plot 


F, and also Fy, the component of F along N, the outward unit 
normal. 


(e) Compute the flux of F through C. 


B3. F = (4x — 4y°)i + (8? — 5x — 6y)j, (-8, 3.02 7 

B4. F = (9? + 3xy? — 4x)i + (10 — 105? + 4y)j, (—8, 8), c = 4 

B5. F = (12x? — 5y + 11x?y)i + (2xy + 10x — 7)j, (—1, 2),¢ =5 

B6. F = (9x — 2xy? + 9y)i + (4x? y — 10xy — 8x2)j. (C1, 3), c =9 

B7. F = (xy? — 8y + 3x? + (11xy? + 4x — 8y)j, 9,4),c = 1 

B8. F = (7x? — 4y — Si + (9x — Ty? + 3x7)j, (6, 3),c =6 

B9. F = (9y? + 8x + 5x)i + (11xy + 8y? — 4x3)j, (C1, -5),c = 6 
B10. F = (45? — 10x + y)i + (6xy? — 12y? + 10x*)j, (2, 8), c = 4 
B11. F = (12x? — 3xy? — 5y?)i + (92y — 7x? — 95, (8, 9), = 2 
B12. F = (xy + 5y — x2)i + (x? —3x + 4y)j, (5, —5),c =5 


In Exercises B13-22: 


(a) Obtain a field plot for F. 

(b) Find, and categorize as node, saddle, center, or spiral, all 
equilibrium points for the differential equation R’ = F(x, y). 
For nodes and spirals, determine if stable or unstable. 

(c) Obtain the flow lines for the field F. 


B22. 


(d) Let C be the given ellipse that has been parametrized with 
p.O < p < 2z. At the highest point on the ellipse, plot F, 
and also Fy, the component of F along N, the outward unit 
normal. 


(e) Compute the flux of F through C. 


. F = (2x — x? + y)i + (10 — 2y —2x?)j, x = 3cos p, y = sin p 
. F = (8x — xy + Ax? y)i + (xy + 6y + x?)j, x = 3 + 6 cos p, 


y=6+2sinp 


. F = (11x?y + 11x + 3)i + (8xy + 5x? + 9)j, x = —5 + 8cos p, 
y 


= —6 + 6sin p 


. F = (3x — y? - 12)i + (x? — 3y?)j, x = 1 + 4cos p, 
y 


( 
y=2+7sinp 


= (12y? — 1 — 5x°)i + 10yj, x = 4 + 3 cos p, y = 2 sin p 
= (9x?y + 5)i + (12x? — 10xy)j, x = 8 + 6cos p, 
y=4+2sinp 
. F = (10xy? — 2 — 2y)i + (6x? y — Ty? — 2)j, x = 4 + cos p, 


y=6+3sinp 


. F = (7y? — 5y — 8x?)i + (Sy? + 10 — 5x?)j, x = 54 9cos p, 


y=6+4sin p 


. F = (33? — 5)i + (4x? y + 4y? — 10y)j, x = 3 + 9 cos p, 


y = —9 + 3sin p 
F = (10xy — 9)i + (2x + 4y?)j, x = 9 + 8 cos p, y = 4 + 3 sin p 


In Exercises B23-32: 


B23. 
B24. 
B25. 
B26. 
B27. 
B28. 
B29. 


B30. 


(a) Obtain a field plot for F. 
(b) Graph C, the closed curve formed by y; and yp. 


(c) At the lowest point on y;, plot F, and also Fy, the component 
of F along N, the outward unit normal. 


(d) Compute the flux of F through C. 
F = (5x? +2 — 6y?)i+ 2x? + 5x 4-6y2)j, yı = 2x? + 8x +7, 


2 = 19 — 2x 

F = (Sy? + 5x + 5y?)i+ (5x? — 2y? — 4y)j, yı = x? +3x +4, 
y2 = 3x + x 

F = (x + y-4(5x—8y—9)j yi = 6x? - 4x — 7, 

y = 2 = 6x 

F = (4x? — 4 — 2y)i + (14+ y —2x)j, yı = 3x? — 3x — 9, 

yo = ix? + 47-3 


y= 7x? xx 2x + 2 

F = (7x? — 5x? + 9y?)i+ (6x? y + 8y? — x)j, yi = 2x? — 4x — 4, 
2x? + £y —4 

F = (4x? +5 + x)i + (5x — y)j, yı = 2x? — 6x — 9, 


3.2 S. ST 
i 8 
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B31. F = (2— 8y? + 9x)i + (2y — y — 8xy)j, yi = x? -9x +5, 


B32. F = (732 — 8 


p= oe Bat? 
7y?j (4x3 
4x +8, y; = Ax? + fx p 


8xy? — 2xy)j, yı = 6x? — 


In Exercises B33-42: 


(a) Obtain a field plot for F. 
(b) Graph C, the triangle whose vertices (A, B, C} are given. 


(c) At the midpoint of segment AB, plot F, and also Fy, the 
component of F along N, the outward unit normal. 


(d) Compute the flux of F through C. 


B33. F = (332 +7y? + Ay)i + Gx? + 7)j, (4, 4), (—9, 4), (—10, —4)) 
B34. F = (6x — 5x? — y)i + 6j, {(6, 3), (—9, 5), (-5, —1)] 
B35. F = (9x? — 3xy?)i + (2 + 5? — 4x)j, (3, 12), (—10, 8), 
(5; —LDy 
B36. F = (5y — 2xy — x? y)i + (2x3 — 7x?y + 4y7)j, (8, 1), (—4, 4), 


B37. 


B38. 


B39. 


B40. 


B41. 


B42. 


(9; —7)) 

F = (x? — 7xy --9xy?)i + Guy + 2 + 4x)j, {(5, 4), (—11, 5), 
(S=) 

F = (6x? — 4y? — 6y*)i + Guy — 4x? + 9x?)j, {(9, 1), (—11, 8), 
(^25, —2)) 

F = (5x? — 4y)i+ (xy? — y + 3j, ((1, 8), (—10, 6), 

(-5, —11)} 

F = (4x? + 3x?y — 8x)i + (5xy + 2x? + 2xy?)j, (1, 9), 
(—12, 7), (-1, —8)] 

F = (3? — 2xy — y)i + 2y? — 6xy — 2y?)j, {(2, 11), (—5, 5), 
(—8, —6)} 

F = (5xy + 7y? + 9x)i + (5 + 6x + y)j. (C, 11), (—9, 7), 
(-3, —8)} 


Chapter Review 


1. 


The line integral of f(x, y) is to be evaluated along a curve C 
parametrized by x = x(t), y = y(t). How are the line integrals 
Je f(x. y) dx and f. f(x, y) dy evaluated? Give an example of 
each. 


. The line integral of f (x, y) is to be evaluated along a curve C given 


by y = y(x). How are the line integrals fs f(x, y) dx and 
i. f(x, y) dy evaluated? Give an example of each. 


. The line integral of f (x, y) is to be evaluated along a curve C given 


by x = x(y). How are the line integrals Ie f (x, y) dx and 
Je f(x, y)dy evaluated? Give an example of each. 


. Evaluate the line integrals Ja f (x. y) dx and Je f(x, y) dy, where 


f(x, y) = x?y? and C is the counterclockwise path formed by the 
edges of the triangle whose vertices are (1, 1), (4, 5), and (9, 8). 


. A particle is moved from point A to point B along the curve C ina 
field F. The work done is computed by the line integral 


In Exercises B43-52: 


B43. 


B44. 


B45. 


B46. 


B47. 


B48. 


B49. 


B50. 


B51. 


B52. 


(a) Obtain a field plot for F. 

(b) Graph C, the quadrilateral whose vertices {A, B, C, D} are 
given. 

(c) At the midpoint of segment AB, plot F, and also Fy, the 
component of F along N, the outward unit normal. 

(d) Compute the flux of F through C. 

F = (—5x?y + 9y? 2 8)i T (-6? = y? > 3x)j, {(7, 6), (-1, 6), 

(—12, —11), (6, —11)} 

F = (1x? — 2y? — 3xy°)i + (x? + Ty — 6xy?)j, (011, 1), (—3, 4), 

(—12, —6), (6, —4)} 

F = (7 - 7y?i + (—3x? — 7x?y + 3y?jj, (102, 12), (-11, 4), 

(—1, —6), (3, —8)] 

F = (9x?y + 6 — 6y?i + (6? — 8x + 3xy?)j, {(7, 6), (—5, 5), 

(—7; —D (4.—9)] 

F = (x? — 6x? + 8xy)i + (x + y)j. ((1, 7), (712, 2), (74, 3), 

(5, -2)) 

F = (Sxy + x? — 4y)i + (8? + Ty” + 3y)j, {(11, 2), (77, 6), 

(—10, —10), (2, —8)} 

F = (2x7 + 8 — 5y°)i + (x?y — 5x — 8y)j, {(5, 7), (712, 2), 

(—2, —2), (1, —8)} 

F = (7x3 — 5y? + 6y)i + (5x?y — 9x + 2y)j, {(9, 6), (—6, 10), 

(—1, —5), (5, -11)] 

F = (3? — 8x? + 6x)i + (8x? — 5y)j, {(3, 5), (—10, 10), 

(-11, -3), (3, -5)} 

F = (8x3 + 3y? — 2y)i + (2 — 7x? — 8xy)j, {(7, 7), (—10, 1), 

(-1, -12), (0, —9)] 


W= Se F - dr. If W > 0, did the field move the particle or did an 
outside agent have to push the particle against the field? What if 
W <0? 


6. If F = x sin yi + y cos xj is a field and C is the line segment from 
(2, 3) to (—3, 2): 


(a) Find the work done when a unit particle is moved through the 


field F and along C. 


(b) Find the flux of F through C. Clearly state the normal direction, 


and interpret the value obtained for the flux. 


7. Obtain the circulation of the field F from Question 6 if C is the unit 
circle centered at the origin. 


8. Sketch representative arrows for the field F in Question 6. 


9. Sketch representative flow lines for the field F in Question 6. 


Chapter 20 


Additional Vector 
Differential Operators 


INTRODUCTION The divergence and curl of a vector field are introduced as 
two additional vector differential operators. The divergence of a vector field is defined for 
a vector with any number of components, but the curl is defined only for a vector in three 
dimensions. 

The divergence is interpreted physically as the limiting value of the ratio of the flux 
through the boundary of a curve that shrinks to a point and the area enclosed by that curve. 
As such, the divergence is a measure of the pointwise dispersion of a vector field. 

The curl is interpreted physically as the limiting ratio of the circulation around a closed 
plane curve that shrinks to a point and the area enclosed by that curve. As such, the curl is 
a measure of the pointwise rotation in a vector field. This interpretation is generalized in 
Section 21.6. 

There are now three vector operators, the divergence, the gradient, and the curl. A 
fourth operator, the laplacian, can be expressed in terms of the divergence and the gradient. 
We compute the divergence and curl of a vector field and the gradient of a scalar field. The 
divergence yields a scalar, but the curl yields another vector. The laplacian of a scalar field 
is again a scalar field. 

We present 11 formulas or identities relating these vector operators to one another. Six 
contain a single del operator that acts on a product of two operands. The other 5 contain 
two del operators, del acting on the result of another del applied to a single operand. 


Divergence and Its Meaning 


DEFINITION 20.1 DIVERGENCE 


Given the vector field F = u(x, y, z)i + v(x, y, z)j + w(x, y. zk, the divergence of 
F at the point (x, y, z) is the scalar 


V. F —div(F) =u,(x, y, z) + vy, y, z) + wz(x, y, z) 
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EXAMPLE 20.1 


FIGURE 20.1 The vector field, flow 
lines, and equipotentials for Example 20.1 


The divergence of the field F measures the "spread" ofthe field at each point. Notational 
clarifications, as well as examples and calculations designed to illuminate this claim about 
divergence measuring "spread" of the field at a point, follow. 


The field F = xi + yj, graphed in Figure 20.1, appears to be "flowing" radially outward, 
with flow lines y = ox, the solution of the set differential equations x'(p) = x. y'(p) = y. 
contained in R'(p) — F. The parameter p is eliminated from these equations by writ- 
ing uz ES Eh = *, and the solution is immediate. The field arises from the scalar potential 
u(x, y) = 4(x? + y?), where the minus sign has been ignored. The level curves of u(x, y) 
are concentric circles orthogonal to the flow lines of the field F, as seen in Figure 20.1. 
The divergence is V - F = 2. The constant and positive value of the divergence signals 
the uniform spread of the field, evidenced by the flow pointing radially outward from 


mu 7 
the origin. ka 


Divergence as Limiting Value of Flux per Unit Area 


We next give a physical interpretation of the divergence based on the notion of flux through 
a closed curve C. It demonstrates that in the limit as the curve C shrinks to a point P, the 
ratio of the flux of the field F through C divided by the area enclosed in C becomes the 
divergence of the field F evaluated at P. 

To compute the flux of the arbitrary plane vector F = f(x, y)i + g(x, y)j through 
C, a circle of radius a, centered at the point P whose coordinates are (xo, yo), write the 
parametric representation of the circle as x (p) = xo +a cos p, y(p) = yo + a sin p, so that 
on C we have F = F(xo +a cos p, yo +a sin p). As the circle C shrinks to the point P, the 
radius a goes to zero. Hence, expand F in a Taylor series about a — 0, obtaining 


Fe Ff (Xo. yo) + (fx (xo. yo) cos p + fy (xo. yo) sin p)a + O(a’) 
(Xo. Yo) + (8x (xo. Yo) cos p + g, (xo. Yo) sin p)a + O(a?) 


The flux integral f. f dy — g dx is then 


Í a[Cfo + (fx cos p + fy sin p)a) cos p 
0 
+ (go + (gx cos p + gy sin p)a) sin p] dp + O(a?) 


so dividing by za’, the area enclosed by the circle C, gives f, + gy + O(a). Thus, in the 
limit as a goes to zero, the limiting ratio of flux to area becomes f; + gy, the divergence 
of F. 


Solenoidal Fields 


Because the magnetic field set up by a solenoid (coil of wire) has zero divergence in the 
space surrounded by the coil, physicists use the term solenoidal for fields whose divergence 
is everywhere zero. For example, the field F = xi — yj is solenoidal since its divergence is 
1 — 1 = 0. On the other hand, the field F = xi + yj is not solenoidal, since the divergence of 
F is 1 + 1 = 2, as seen previously. Connections between conservative fields and solenoidal 
fields are detailed in Section 21.5. 

If F is the field of velocity vectors for a steady fluid flow with constant density, then 
its divergence must be zero, as we discuss in Section 23.3. But a steady flow with constant 
density is incompressible, so the analog of the solenoidal field is the incompressible flow. 
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The Laplacian 


The laplacian of the scalar u(x, y, z) is the scalar field V - (Vu) = V?u, the divergence of 
the gradient field of u. 

In Cartesian coordinates, the del operator (Section 18.2) is V — i +j + +k; 2. and 
the gradient of the scalar u(x, y, z) is the vector Vu = uxi + u,j + u;k. The Ahe h of 
F is 


0 a ð 
verhig d ek Cfi gj +hk) = fid gy h; 
ax dy Oz f 


so the laplacian of u(x, y, z) is 
QU g0 a Q9 1498 a 
V-(Vu) = |i—+j—+k -(i—+j—+k u 
Ox dy Z X y 
u 
2 


9? " 9? " a? au u " 9? 
= ü= t 
ox? ay? Az? y? a 


2 
= ügy +H lyy +A, = VU 


Thus, the laptaeiun Kar ii is generally called *del-squared" and in Cartesian coordinates 
is written V? — H+Hh+H. 


Generalizations of the Directional Derivative 


First GENERALIZATION ‘Texts on fluid dynamics or electromagnetic theory generalize 
Duf = Vf -U, the directional derivative of the scalar f(x, y, z), by introducing the 
operator 
. . a a a 
V-V=(ui+vj+wk)- (i Hg; ks. (20.1a) 
a dy Oz 
: : : 20.1b 
mu ap 7 VH 
The directional derivative of Section 18.2 requires that the vector U be a unit vector. In 
this first generalization of the directional derivative, the vector V need not be a unit vector. 
When applied to a scalar f(x, y, z), this operator is just the gradient dotted with V, giving 
for f a derivative in the direction V. 


SECOND GENERALIZATION Between two neighboring points P; and P», a change in the 
vector field 


F = f(x, y, zji + g(x, y, z)j + h(x, y, Zk (20.2) 


is again a vector. If V is proportional to P? — P4, then at P; the directional derivative of F 
in the direction V is given by 


V. Vf u fx F vf, T wf. fx dy f u 
(V-V)F=|V-Vg |= | ug, vgy + wg | —|8&x 8y & v (20.3) 
V. Vh uhy + vhy + wh; hz hy hz w 


where the matrix on the right in (20.3) is the Jacobian matrix for F and the operator V - V 
is given by (20.1a) and (20.1b). The formalism in (20.3) is established in Exercise B1 of 
Section 18.2. The idea behind the formalism is a generalization of the directional derivative. 
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Think of F as a force field in which R(p) = P, + pV is a line through P; with direction 


V. Evaluating F along the line gives F(p), and 2E 


is the directional derivative of the 
dp |p—0 


field measured at P, in the direction of V. 

When this process was carried out in Section 18.2 for Dy f = V f - U, the directional 
derivative of the scalar field f, the gradient vector V f appeared as a new object dotted with 
the direction vector U. The matrix that appears in (20.3) is a new object, one “rank” higher 
than the vector field F, called the covariant derivative. Multiplication of the direction vector 
V by this object gives the desired rate of change. 


EXERCISES 20.1—Part A 


A1. Compute the divergence of 
(a) F = xyi +x°yj (b) F = xyi + yz2j + x?zk 

A2. Let F = xi + yj and let C be a circle with radius a and center at the 
origin. Obtain the flux of F through C, and compute the limit, as a 


goes to zero, of the ratio of the flux to the area enclosed by C. 
Show that this limit is the divergence of F evaluated at the origin. 


EXERCISES 20.1—Part B 


A3. Show that F = yzi + xzj + xyk is solenoidal. 


A4. Let F be as in (20.2), where f, g, h, all have continuous second 
partial derivatives. Show that the field (h, — g.)i + (f; — hx)j + 
(gx — f,)k is solenoidal. 


AS. Obtain the laplacian of u(x, y, z) = x? yzi. 


B1. For each of the vector fields F; = xi + yj and F; = 5—1i-4- 


^y 


(a) Obtain a field plot. 
(b) Obtain the flow lines for the field F;, k — 1,2. 


(c) Obtain the divergence of F}, k = 1, 2. Both fields “appear” to 
be diverging, but one actually has positive divergence and the 
other has zero divergence. Divergence is a “local” or “point” 
property of a vector field, whereas the field plot and the flow 
lines exhibit more “global” behavior of the field. Caution, 
therefore, should be exercised when interpreting graphs of 
vector fields and their flows. 

B2. If f(x, y) = arctan x and g(x, y) = x? — y?, show that the vector 
field F — V f x Vg is solenoidal. 
B3. Show that, in general, for scalar-valued functions f(x, y, z) and 

g(x, y, z) with continuous second partial derivatives, the vector 

field F = V f x Vg is solenoidal. 


In Exercises B4—13, a pair of scalar-valued functions f(x,y,z) and 
g(x,y, z) and a point P are given. For each, compute (at P) the di- 
vergence of the field F = ||V f || Vg. 


B4. f(x, y, z) = —8xy? — 6xyz — 9), g(x, y, z) = 4x? y +23 2x, 


P — (0, —5,4) 

B5. f(x, y, z) = 33? — 7x + yz’, g(x, y, 2) = —z + 7x2z + 2y), 
P = (4, —7, -2) 

BO. f(x, y, z) 2 z2 + 8y°z + 9z, g(x, y, z) = —3xz? — 2xyz + 6y), 


P = (9; —3,8) 


B7. f(x,y,z) = —yz2? — 7, g(x, y, z) = y — 8y°z + 8xyz, 
P = (—1, —4, —6) 


B8. f(x, y, z) 232 — 33 — yz, g(x, y, z) = —4xy? + 7x? + 3yz, 


P = (5,0,9) 
B9. f(x, y, z) = 2y?z — 7 -2y, g(x, y, z) = 8x? + 9x2? + 4y, 
P —(—5,9,1) 


B10. f(x, y, z) = 332 + Ax?y, g(x, y, z) = 5x? — By’, 

P = (—9, —7, —1) 

fŒ, y, Z) =2— 8xz? — 5x3, g(x, y, Z) = 8x?z + 3x + 3xz, 
P = (3, —9, 4) 


fx,y,2 255-723 —3y, g(x,y,z2)-— 4x?y — 8xy? — 4y?z, 
P = (—6, —6, —2) 

f(x,y,z) = 5z — Ixy? + 5xyz, g(x, y, z) = 7 — 9x + 3z, 

P = (—8, —4, —7) 


B11. 
B12. 


B13. 


For the vector field F given in each of Exercises B14—25: 


(a) Obtain a field plot. 

(b) Obtain a graph of the flow lines. 

(c) Compute V - F, the divergence of F. Is F solenoidal? 
B14. F = (4xy? + 5)i + (8x3 — 3x°)j | BIS. F = —18y?i — 6x?j 
B16. F = (y — 2x)i — (9 + 7y)j 


B17. F = —9x?i + (5xy — 9y25j 
B19. F = ( 3y? 5xy)i+ (1 2x)j 


B20. F = (7x — 8x*)i + (2y — Dj 

B21. F = (4y — 7x2)i + (4x? — 7y)j 

B22. F = (xy—6y5)i—3xj B23. F = —12xy*it (4y? — 16x)j 
B24. F = (2y + Axy)i + (8 + 5y)j 

B25. F = (65? — 8)i + (7x + 5y)j 


For each vector field F and point P = (a, b) given in Exercises B26—35: 


(a) Compute V - F at P. 
(b) Obtain a field plot of F. 
(c) Obtain a graph of the flow lines of F. 


(d) Obtain F, the flux of F through a circle with radius p and 
center at P. 


(e) Obtain limpo Z a that is, compute, as the circle shrinks to a 
point, the limit of the ratio of the flux to the enclosed area. It 
should agree with the divergence computed in part (a). 

(f) Compute F, the flux of F through a square with side 2p and 
center at P. 

(g) Obtain limpo e» that is, compute, as the square shrinks to a 
point, the limit of the ratio of the flux to the enclosed area. It 
should agree with the divergence computed in part (a). 


B26. F = (7x? + 4x — y*)it+ (-9x — Ay? — Txy)j, P = (2, 2) 
B27. F = (9x? — 3x3 — 9y)i + (Ty — 8 — 8j; P = (7, 4) 
B28. F = (3x — 3x? — 2xy)i + (2x? — 2 7x1y)j P = (—3, 9) 
B29. F = (7y + 2? y — Di + (4xy? + 9x)j. P = (8, —4) 

B30. F = (2x2 + 7x3 + 3)i + (x?y — 2x + 6y°)j, P = (—3, 2) 
B31. F = Qx?y + 7xy — 4ji + (5 — 2x + 6x’y)j, P = (3, —7) 
B32. F = (xy? + 9x + 3y)i + (2x? + 9y? — 6xy)j, P = (73,5) 
B33. F = (9x 4-2? — 9x2y)i + (9x? + 2xy? — x)j, P = (—5, 3) 
B34. F = (y — 6x? y — 6y?)i + O? + Oxy — 3)j, P = (75,2) 


B35. 


B36. 
B37. 


F = Qxy? — 5x yi + (3 + 7y? — 8x’y)j, P = (75, -8) 
Show that the area enclosed by the ellipse 5 + = 1 is zab. 
Show that the area enclosed by the ellipse x = a + p cost, 
y=b+x«psint,0 € t < 27, is kzp?. Hint: Arrange the 
parametric equations for the ellipse so that the identity 

cos? 0 + sin? 0 = 1 can be used. 


For the vector field F and point P = (a, b) given in each of Exercises 
B38-47: 

(a) Compute V - F at point P. 

(b) Obtain a field plot of F. 

(c) Obtain a graph of the flow lines of F. 


(d) Compute F, the flux of F through the ellipse x = a + p cost, 
y—b--kpsint, O x t < 27, where x is as given in each 
case. 

(e) Obtain lim,..o m that is, compute, as the ellipse shrinks to 
a point, the limit of the ratio of the flux to the enclosed area. It 
should agree with the divergence computed in part (a). 
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B38. F = (8x? + 8 — y)i + (4x? + 4y)j, P = (6, 6), k —4 
B39. F = (6 — RI — 5x)j, P = (1, -2),« =6 


B40. F = (7x? + 9y? + 2y)i+ x? — 5y’)j, P = (7, —5),k =3 
B41. F = (8x — 5? — 4y?ji 4 oe 6x?y — 8xy)j, P= (1, 1), 
ke 
B42. F = (8xy — 2x? — 8y°)i + (5xy? — Ty? — x?y)j, P = (72, —6), 
ka= 
B43. F = (8 — 6? — 7xy?)i + (8y — &? — 5y)j P = (5, -6),« =6 
B44, F = (5x2y — 4xy? — 3y? yi + (2x? + 8y)j, P = (-3, -1), « 23 
B45. F = (9x3 — 8y + Ty?” 2 + (7x? + 6x? — 5y? )) P = (-2, —2), 
E 7 
B46. F = (2 —2x? + xy)i + (Sxy — 8y)j, P = (7-5, 5) x —5 
B47. F — (9x?y — 9x — 4xy)i + (5x3 — 8x?y + Axy)j, P = (—1, —8), 
Kk zx] 


For the vector field V, scalar-valued function f (x, y), and point P given 
in each of Exercises B48—57, compute (V - V) f at P. 


= 5 " 
B48. V = (65? — 33i + By — 2x2 y + 8xy)j, f(x. y) = rg 
8--5xy 
= (4, —7) 
Bi sd 
B49. V = (x — 3xy? — 7x’ y)it (5x —4j, fy) = Eau m 
2x9 —2x?y 
= (5, —3) 
B50. V = (6x — 3x? + 2x’y)i + Oy? — 7x — 9x’ y)j, 
ox 
FQ VS A = (9, —7) 
5 . 3 m a7 = 8x" 
B51. V = (7x° + 9y)i + Gy? +2x+ y°)j, f(x, y) = By 9° 
ys — 
P = (1,7) 
B52. V = (5 — 4x — 9i + (2x3 — 6x — 9x? y)j, 
f 3xy? + Txy P =(-4,1) 
x,y) = ——— —-, P = (-4, 
` t 3—7xy 
B53. V = (7x? — 9x? y + 7xy)i + (8 — 4x? — 3y°)j, 
9y + Oxy 
fo, y» = 3x3 42y’ P = (1,6) 
B54. V = (7x? — 6xy? — 5y°)i + (6xy — y? — 3xy°)j, 
"o 7 —2x?y Bos, ey 
x,y Se Tee = (4, —-4 
` i 8xy? + Ty’ 
B55. V = (8? y — 6? — 6xy)i + (6x? y — 3x? — xy)j, 


fü) PHD 
y 


B56. V = (1 — 8y? + 5x’y)i+ Gy? — 6x — 2y°)j, 
9x? +6 
(x, y) = ——~——, P = (-9,5 
foy) 8x? + 3xy ( ) 
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B57. V = (9x? — 4y + xy)i + (x? — 5x + 2y)j, B61. F = (6x? + y*)it+ (6 — 3xy)j, V = Oy? + Ax)i + (4y? + 9x)j, 
6x? —3 P-I(1-7 
füngbe———ÀSP-6Ó58 d. 7D 
4x* — 6y° B62. F = 4xy^i + (x + 4x7y)j, V = (xy? — 2y)i + (3x? — 4xy?)j, 
In Exercises B58—67, given the vector fields F and V, compute, at point P = (-2, 5) 
P, the generalized directional derivative, (V - V)F. B63. F = (5x? — 2y?)i + (7x3 + 4?)j, V = —3y7i + (6y? + xy)j, 
2 2 «s P= —4, 2 
B58. F = (7xy? — 8)i + (8? + 3xy)j, V = (x? -2)i + 2? — 8x7y)j, ( ) on " , . 4 cs 
P = (5,3) B64. F = (y? + 8xy?)i + (6x? + 3y)j, V = —9xyi + (2x3 — x?y)j, 
i : P — (6,8 
B59. F = (6xy? + 5)i + (7x? + 3xy)j, V = (2 + 9xy)i + (Sy? — 9x)j, dide . m g 
P = (8, —3) B65. F = (9x + 9x?y)i + (333 — 8y?)j, V = (2x + 3xy)i + 
. j : A " j : (9x? — 2x?y)j, P = (7, 2) 
B60. F = 2yi + (6x — 7y)j, V = (C7x^ + 9y^)i + (xy^ + 8y)j, 
P (9,5) 
Curl and Its Meaning 
DEFINITION 20.2 CURL 
A third operator of vector calculus is the curl, taking a vector field F into another vector 
field V x F, which measures “local rotation" in the vector field F. As suggested by the 
notation, the formalism for computing the curl looks like the cross-product of the del 
operator V — i2- +j2+k2 and the vector field F = u(x, y, z)i + v(x, y, z)j + 
w(x, y, z)k. i 
i j k 
Wy — Ww Wy — vz 
curl(F) = V x F = 9 EA 3h = | —(w, — uz) | = | uz — Wy 
ax dy dz 
u v w ug Hg Mer 
The determinant on the left is a mnemonic, a memory device, whereas the vector on the 
right is the definition of the curl in Cartesian coordinates. 
EXAMPLE 20.2 The velocity field V = —yi + xj + Ok arises from a flow in uniform rotation about the 
z-axis, and Figure 20.2 shows flow lines and field vectors for one representative z-plane. 
A computation shows this field has curl V x V = 2k. The following argument shows the 
H angular velocity vector for the field is Q = k, and we conclude that for the uniformly 


FIGURE 20.2 Example 20.2: The 
velocity field for uniform rotation about the 
Z-axis 


rotating field, the curl is twice the angular velocity vector. 

The angular velocity vector lies along the z-axis, the axis of rotation, and points upward 
by the right-hand rule. Its magnitude is 2o where 0 is the angle that measures the rotation 
in radians. For V, the magnitude of x is 1 because 


ds d0 
VI = yx? + y? =r = — =r — 
IIVII ) di di 
where s = r0 measures arc length around a circle of radius r. Hence, Q = k. $ 


Curl as Limiting Value of Circulation per Unit Area 


Another classic demonstration of the curl as a measure of rotation is the computation for 
the closed curve C and the planar field F = f(x, y)i+ g(x, y)j of the limiting value of 
the ratio of circulation to area enclosed. Circulation of F about C is the line integral of the 


EXAMPLE 20.3 


EXERCISES 20.2—Part A 


20.2 Curl and Its Meaning 479 


tangential component of the field F. The expression for circulation is therefore the same as 
that for mechanical work. This circulation is divided by the area enclosed by the curve C, 
and in the limit as C shrinks to a point P, the ratio becomes the z-component of V x F at 
P. Thus, taking C as a circle of radius a, we will show 


1 
(V x F)-k= lim TIE: 
C 


a—0 mat 


Let the circle C, with radius a and center (xo, yo), be given by x(p) = xo + a cos p, 
y(p) = yo + asin p. On C, F = F(xo + a cos p, yo + a sin p). As the circle C shrinks to 
the point P, the radius a goes to zero. Hence, expand F in a Taylor series about a = 0, 
obtaining 


b yo) + (fx (Xo. yo) cos p + f, (xo. yo) sin p)a + e 
& (Xo. Yo) + (8x (xo. Yo) cos p + g, (xo, Yo) sin p)a + O(a?) 
The circulation integral fo f dx + g dy becomes 


a al—(fo + (fx cos p + fy sin p)a) sin p 
0 


+ (go + (gz cos p + gy sin t)a) cos p] dp + O(a?) 


so dividing by za’, the area enclosed by the circle C, gives gx — fy + O(a). Thus, in the 
limit as a goes to zero, the ratio of circulation to area becomes gy — fy, the z-component 
of the curl of F. 


Irrotational Fields 


Fields for which the curl vanishes at all points are called irrotational. Section 21.5 explores 
the important connections between irrotational fields and conservative fields. 


The field V = (4xy — z?)i + 2x?j — 3xz?k is irrotational since V x V = 0. (Once again, 
notice how we distinguish between 0, the zero vector, and 0, the zero scalar.) e 


A]. Obtain the curl of 


(a F—xe'i--ysinxj (b) F=xzi+ yzj + xyk 


the limiting ratio of the circulation of F around C and the area 
enclosed by C. 


A2. Verify V x V — 2k for V given in Example 20.2. A4. Determine whether the following fields are irrotational. 


A3. If F = y?i + x?j and C is the circle with radius a and center at 


(a F = 3x?y i +2x°yj (b) F = y?z’i + 2xyz’j + 3xy?z'k 


P = (2,3), obtain the curl of F at P. Then, compute, as a — 0, AS. Let F = Vu, where u(x, y, z) has continuous second partial 


EXERCISES 20.2—Part B 


derivatives. Show F is irrotational, that is, show V x F = 0. 


B1. For each of the vector fields F; = yi — xj and F; = = Li -— property of a vector field, whereas the field plot and the flow 
zb]: lines exhibit more “global” behavior of the field. Caution, 


(a) Obtain a field plot. 


therefore, should be exercised when interpreting graphs of 
vector fields and their flows. 


(b) Obtain the flow lines for the field F}, k = 1,2. 


(c) Obtain the curl of F;, k = 1, 2. Both fields seem to have 
rotation about the origin, but one actually has nonzero curl 
and the other has zero curl. Curl is a “local” or “point” 
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B2. 


B3. 


B4. 


B5. 


B6. 
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Give an example that shows F and V x F are not necessarily 
orthogonal. 

If F = f Vg for scalar-valued functions f and g, show that F and 
V x F are orthogonal. 


If A and B are irrotational, show that the cross-product A x B is 

solenoidal. 

Find solenoidal fields A and B for which the cross-product A x B 

is not irrotational. 

This exercise is designed to determine if the concepts of 

solenoidal and irrotational are mutually exclusive. 

(a) Find a vector field that is solenoidal but not irrotational. 
Verify your claims. 

(b) Find a vector field that is irrotational but not solenoidal. 
Verify your claims. 

(c) Find a vector field that is both solenoidal and irrotational. 
Verify your claims. 


(d) Show that for every solution u(x, y, z) of Laplace's equation 
Vu = 0, the gradient vector Vu is both solenoidal and 
irrotational. 


In Exercises B7-16: 


B7. 
B8. 
B9. 
B10. 
B11. 
B12. 
B13. 
B14. 
B15. 


(a) Categorize the given field F as neither solenoidal nor 
irrotational, just solenoidal, just irrotational, or both 
solenoidal and irrotational. 


(b) Obtain a field plot of F. 
(c) Obtain a graph of the flow lines of F. 
(d) Evaluate V x F, the curl of F, at the given point P. 


(e) Compute Aj, the circulation around C}, a circle with radius p 
and center at point P. 


(f) Compute limpo AL, the limiting value of the ratio of 
circulation to enclosed area. It should agree with the value of 
curl(F) at point P, as obtained in part (d). 


(g) Compute A», the circulation around C5, a square with side 2p 
and center at point P. 


(h) Compute limpo zh the limiting value of the ratio of 
circulation to enclosed area. It should again agree with the 
value of curl(F) at point P, as obtained in part (d). 

F = (5xy — yi — (x + 4x?y)j, P = (—8, —2) 

F = (24y? + 6x?)i — 12xyj, P = (6, —8) 

F = (32x? + 14xy)i+ 7x? — 1)j, P = (-8, —4) 

F = (5x? — 5xy)i+ (3 — 4y*)j, P = (-1, 2) 

F = (3y — 6xy?)i + (Sy + 9xy)j, P = (—8,6) 

F = (6y? — 12xy)i + (18xy? — 18y? — 6x?)j, P = (—4, 2) 


F = (15x? — 3x)i+ (3y — 5y°)j, P = (—3, 3) 
F = (14xy — 3x”)i+ (6xy — 72)j, P = (—1, -1) 
F = (10x — 27x? y)i — (16y? + 9x?)j, P = (—1, 2) 


B16. 


F = (8xy? — 4x?)i+ (8? — 7x2y)j, P = (—9, —3) 


In Exercises B17—26: 


B17. 


B18. 
B19. 


(a) Categorize the given field F as neither solenoidal nor 
irrotational, just solenoidal, just irrotational, or both 
solenoidal and irrotational. 

(b) Obtain a field plot of F. 

(c) Obtain a graph of the flow lines of F. 

(d) Evaluate V x F, the curl of F, at the given point P = (a, b). 

(e) Compute A, the circulation around C, the ellipse given 
parametrically by x = a + p cost, y = b + kp sint, 

Q «12m. 

(f) Compute limpo enm the limiting value of the ratio of 
circulation to enclosed area. It should agree with the value of 
curl(F) at point P, as obtained in part (d). 


27x? 


= (54+ 12x + 5y 4 27y?ji + (8 + 5x 
AE AE 
= (16x?y — 8x?)i + (24x?y — 16xy?)j, P = (-2, —1),k = 4 


= (2y? + 10xy2)i + (12y? + 4xy + 10x?y)j, P = (0, —1), 


12y — 54xy)j. 


= (20x? + 3y)i + (12y + 3x)j, P = (—1, 1),k 26 


= (3 — 6x + 6y + 12xy)i + (6x + 6y — 6y? + 6x? — 4)j, 
P = (3,6),k =6 


. F = (9x?y — 2y)i + (8 — 5x*y)j, P = (4, -4),« =5 
. F = (8xy + 12x*y)it (4x? — 6? + Ax?)j, P = (1,2), « =3 
. F = (xy? — 6x7 y)it (8 — 5x)j, P = (2,0),« 29 


In each of Exercises B27—36, compute, at point P, and in the direction 
of V, the directional derivative of the divergence of F. 


B27. 


B29. 


B30. 


B31. 


B32. 


F = (333 + 8x2)i + Oxy? — xy)j, V = (8 + 7y)i + (4 — 9x)j, 
P = (9, —4) 


.F = (8y + 5x?y)i + (6: — 332)j, V = (y — 3xy)i + 


(9? + &2y)j, P = (7, —6) 

F = (8y? — 5x? y)i+ (7x + 733)j, V = (6y — 8xy?)i+ 
(9y + 5y5)j, P = (8, 2) 

F = 8xi+ (xy? — 7x?y)j, V = (2 — 5x?)i + (7x + 3yj, 
P = (-8,—3) 
F = (64+ 2xy)i+ (6? — 3x? y)j, V = (2 — 8xy)i + (5x? + 6y?)j, 
P = (—9, —4) 


F = (y + 4x7)it+ (9x + 6xy?)j, V = 8y?i + (65? + 3xy)j, 
P = (6, 1) 


B33. F = (6y — 4y?)i + (4x? +7y°)j, V = (9? + 332 y)i + (x — 3x°)j, 
P = (17, —3) 

B34. F = (7xy? — 5y?)i + (6x? — 9xy?)j, V = (9x? — 3y°?)i + 
(2x — 4y?)j, P = (3,4) 


Basic Tableau 


20.3 Products—One V and Two Operands 


B35. F = (2x? + 8x? y)i + (5xy? + 7y?)j, V = (5x — 8y)i + 
(3x + 5xy*)j, P = (-7, 3) 

B36. F = (9x + 8xy?)i — 8x?yj, V = (4x? + y)i + (5 — 6y°)j, 
P = (4,8) 


Products—One V and Two Operands 
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Let f(x, y, z) and g(x, y, z) be scalar functions, and let u and v be vector fields. Table 
20.1 lists all possible combinations of one del operator acting on a product of two factors 


as shown in 


fg 
* ^ 
un "hi 
V acting via on 
uxv 
x 
u-v 


(20.4) 


where here, x represents ordinary operator application. Of the 1 x 3 x 4 = 12 possible 
combinations of these symbols, only the six numbered expressions are defined. 


Ordinary VU) Y) 
V Operator VOY) 
Application V(u x v) 
V(u-v) (2) 
V + (fg) 
Ve(f 3 
y Cfv) (3) 
V -(u x v) (4) 
V. (u-v) 
V x (f8) 
Vx(f 5 
v » fv) (5) 
V x (u x v) (6) 
V x (u-v) 
TABLE 20.1 All possible combinations of V acting on products 


The six numbered entries in Table 20.1 are listed as identities in Table 20.2. 


(1) 
(2) 
(3) 
(4) 
(5) 
(6) 


TABLE 20.2 


V(fg)— fVgact8gVf 

V(u-v) 2 (u. Vv-F(v- Ou-c-ux(Vxv)-vx(Vxu) 
V-(fvy)=fV-vtv- Vf 
V.(uxv)—-v:Vxu—u:Vxv 
Vx(fv)=fVxvt+(Vf)xv 

V x (ux v) =(v- V)u—(u- V)v+uV-v—vV-u 


Six vector identities where V acts on products 
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Notation 


In addition to the scalars f(x, y, z) and g(x, y, z), we will use the vectors u = ai + bj + 
ck and v = ai+ fj + yk while exploring the six identities in Table 20.2. 


Identity (1) 


Identity (1) in Table 20.2 says the gradient operator is well-behaved with respect to the 
product rule. The gradient of the product fg is “the first times the gradient of the second 
plus the second times the gradient of the first.” 

The vector on each side of the first identity is 


Ig F £8: 
V(fg)-— fyg T ft 


Identity (2) 


Identity (2) in Table 20.2 is complex, indeed. It says that the gradient of a dot product does 
not behave like the derivative of a product. In addition to the first two terms that seem to 
follow a product-like rule (differentiate each factor and multiply by the partner), there are 
two other terms involving curls and cross-products. The terms involving the dot products 
are generalized directional derivatives. Where multiplication by the undifferentiated factor 
enters, it is a dot product. Where differentiation occurs, it is by the gradient operator. In the 
other two terms, where multiplication occurs, it is a cross-product. Where differentiation 
Occurs, it is a curl. 
The vector on each side is 


ad, + aa, + bf, + Bb, + Cyx + YCx 
V(u-v) = | aa, + aay + bby + Bb, -- cy, + ycy 
aa, + aa, + bp; + Bb, + cy; + yc; 


Identity (3) 


Identity (3) in Table 20.2 again nearly behaves according to the product rule. The divergence 
of this product sees the del operator applied, once to the scalar and once to the vector. When 
applied to the vector, a divergence is computed, and that is multiplied by the scalar factor. 
When applied to the scalar, a gradient is computed, and that is multiplied by the vector via 
a dot product. 

The scalar on each side of this identity is 


Ve (fv) = frat fox + f, B fBy + hy + fx 


Identity (4) 


Identity (4) in Table 20.2 is again close to behaving like a product rule. The divergence 
of the cross-product expands to two terms, each containing one of the factors multiplying 
a derivative of the other. The differentiations are curls, and the multiplications are dot 
products. The only quirk is the minus sign appearing in the second term. 
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The scalar on each side of this identity is 


V-(ux v) yb, + by, — Bc, — cf, + ac, + coy — yay — ayy 
+ Ba; + aß: — ab, — ba, 
= (by)x — (cB)x + (ca), — (ay), + (aß): — (ba); 


Identity (5) 


Identity (5) in Table 20.2 expands the curl of a product and behaves much like a product rule. 
There are two terms, each containing one factor multiplying a derivative of the other. The 
derivative of the vector is a curl, while the derivative of the scalar is a gradient. Multiplication 
of the curl is ordinary scalar multiplication, whereas multiplication of the gradient is a cross- 
product. Note the order in which that cross-product is formed in the second term. 

The vector on each side of this identity is 


fy + fry — fb — f B. (Gy), — GBA 
Vx(fv) 2| frat fa; — fry — fys | = | (fa), - Cy 
EB + fB > fya — fay Cf B) — Cf), 


Identity (6) 


Identity (6) in Table 20.2 gives a complicated expression for the curl of a cross-product. 
Since there are four terms, it is not akin to a product rule. The first two terms on the right 
are generalized directional derivatives, whereas the second two are simply the product of 
a vector by a divergence. The first two terms have the reciprocity of a product rule, and so 
too, the last two. 

The vector on each side of this identity is 


Bay + apy — aby — bay — ac, — co; + ya; + ay; 


V x (u x y) = | yb; + by, — Bc; — cB; — Ba; — af, + ab, + ba, 
aC, + ca, = Yay — ay, = yby — by, + Bey + cBy 
(aB)y — (bo), — (ca); + (ay): 
= (by): e (cB); = (aB)x + (ba), 
(ca), — lay); — (by)y F (cB) 
EXERCISES 20.3 
1. Explain why each unnumbered entry in Table 20.1 is undefined. 2y? — xyz 423 + Axy? 
: . : . . 3. f 24yz—4xz u= | 62-3 v=| 9-32 
In Exercises 2-11, using the given pairs of vectors and scalars, verify - a DNE REN 2yz 
each of the six vector identities in Table 20.2. = 7xz + 9y'z D Ts = 
, , : 9x?2z + 2y? 
ee Ixy = 2y 6yz? — x? 3x — 2yz 
2. f = —6xz? — 9x?z,u = | 9x?—3xz |,v= | Axyz — 8x faf- um hee $4 | ee | Sx? — 2ylz 
"m - T m uL M gent gs ms iiis : pum = E 
B 8xz ced 2x3 4xz + Axyz 8z 3xz Axy? _ yz Ty a9 3xz he 9y? 


s= 6-32 ETURSY EU 


484 Chapter 20 Additional Vector Differential Operators 


2yz? + 8x? 2-—Ty? x? 32 — 8xy 
5. f Z2yz— x!y, u = | 5xy - 62 |,v = | 7yz + Axyz 10. f = yz? — 7x7, u = | 8xz? —9y2z | , v = | 3y? — 7x? 
7z4+3 x? + 6y?z 5xy + 2z 8y? + 5x 8y? — 6x?z x?y — 6z 
^5 5y4 7x2z E = 9g — 6xy 
5xz — 8y? TXY 2 — 3y? 3z — Ay?x 
6. f = 3yz — 6x), u= Axy? Tg l yE 9z—x 11. f = 2 + Oxy, u=| 7z- 2xy v= 8z? — 9y? 
523 — 4x 6xz?—5y 62? + 4xy 6xy? — 72 4xz 4-9y? Tyz2 + Ax 
s= 5xy? — 3xyz a yz 
yz — 5x3 22 — Oxy 12. A particle of mass m moving under the governance of Newton’s 
J 7 p & 
7. f =xz—71y, u= |8x?y 52 |, v= | 8xz—3y Second Law, F = ma, follows a path x(t) that is constrained to lie 
923 + 4x? Oyz — 7x 5xy +2yz in an equipotential surface of the conservative force F. Show that 
g-—-———À f : : the particle moves with constant speed. Hint: See Section 17.5. 
423 — 3xy? P p 
i 5 5 3 5 13. If, in R?, the vectors u(t), v(t), and w(t) are differentiable, with 
xy” — 3àx* 3x" = 32° ! du yr Vv and w!-— @ sh 
8. f = y? —9x22,u = | 9x2y +72 |v = | 223 -— Ty? "Ry ae MAW = aps SOW 
9xy? — y? 8y — 6z? 4x?y — y (a) (u- v) =u-W4+v-eu 
dei "rr (b) ux v 2u x vu x v 
xyz—7 8x22 — 8y? (c) [(u- (v x )] 2u'-(vx w) -u-(v x w) -u-(v x w) 
9. f =22? +6y, u = | 7x?y — 62 | v = z 
223 _ 6y x? — 7y? 8x? + 7y?z 
$7 9g +2y 


Products—Two V’s and One Operand 


Basic Tableau 


Of the 18 possible ways two del operators, the three operations of multiply, dot, and cross, 
and a single operand can be arranged, only 5 are valid. These 5 valid expressions are 
numbered in Table 20.3, and studied later in this section. We assume throughout that the 
operands f and v have continuous second partial derivatives. 


V(V f) Q) V- (Vf) (4) V x (Vf) 
V(Vv) V.(Vv) V x (Vv) 
VV: f) V:(V: f) Vx(V-f) 
(1) V(V-.v) V-(V-y) Vx(V-v) 
V(V x f) V-(Vx f) V x(V x f) 
V(V x v) (3) V-(V x v) (5 V x(Vxv) 


TABLE 20.3 All possible combinations of V, acting on another V 
that acts on a single operand 


The 13 expressions that are not numbered are operationally undefined. For example, at 
the top of the leftmost column, one cannot compute a gradient of a gradient since a gradient 
can be computed only for a scalar-valued function. Immediately following is the attempt 
to compute the gradient of the vector v, again undefined. In like manner, the remaining 11 
unnumbered entries should be examined and the reason why they are undefined determined. 

For the 5 numbered entries, capsule comments appear in Table 20.4. Detailed discus- 
sions constitute the essence of this section. 
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V(V v) 


grad(div v) Appears in formula (5) 


©) avga PPlacian Ml rota 

à firmi PNEU ed fd ce eed 

e iiie always a Pd 
(5) VxVxv VIE - v) — V?y laplacian applied to 


curl(curl v) each component of v 


TABLE 20.4 Five meaningful cases of two V's and a single operand 


Expressions (3) and (4) are the most important of all the results. Each states that some 
combination of vector differential operators is zero, in one case the scalar zero and in the 
other the zero vector. The implications of each are so significant that a mnemonic phrase 
has been provided. 


Expression (1) 


The first expression, namely, grad(div v), is defined but will not play a significant role in 
our work. If v = ui + vj + wk, then 


Uxx + Uxy Tow 
V(V* v) = | uy + vyy + Wyz 
Uzx + Uzy + WU; 


Expression (2) 


VERIFICATION The second expression, namely, div(grad f) = laplacian( f), was dis- 
cussed formally in Section 20.1 where the notation V - (V f) = V? f was first met. The 
laplacian operator is of particular importance in the applications since each of the three 
partial differential equations of mathematical physics, equations governing wave motion, 
heat transfer, and electric potential all contain this operator. 


Ficx’s Law As just noted, many of the laws of engineering and the physical sciences are 
expressed in partial differential equations. In almost all cases, the partial differential equation 
contains the laplacian. Unit Five is devoted to a study of special cases of the following three 
partial differential equations of mathematical physics, each of which contains the laplacian 


Wave equation Ut = C? (Uxx + Uyy + Uzz) 
Heat equation Uy = K (Uxx + Uyy + Uzz) 
Potential equation 0 = lys Fly Fuz 


Here’s a glimpse why. Fick’s Law states that flux is proportional to the gradient, that 
is, the amount of flow down a hill is proportional to the steepness of the hill. For example, 
when discussing heat flow, it is assumed that heat flows the instant a temperature gradient 
is established and, as in Newton’s law of cooling, with a rate proportional to the difference 
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in temperatures. This difference in temperature between an object and its surroundings is 
precisely the temperature gradient. For temperature distributions at equilibrium, we would 
have F = —kV f, where F is the flux (or flow) of heat and f is the temperature. Computing 
the divergence of the flux vector F (to determine whether heat flows into or out of the region) 
immediately yields the laplacian V  F = —k V? f. 


AVERAGING PROPERTY OF THE LAPLACIAN Another glimpse of the importance of the 
laplacian operator is reflected in its averaging property. For example, suppose the values of 
a function f (x, y) and its derivatives are known at (a, b), the center of a square of side 2h. 
Using a Taylor expansion computed at (a, b), the values of f (x, y) can be approximated at 
the four corners of the square, yielding 


f(a -- h, b — h) « f(a, b)+ f(a, b)h — fy(a, b)h 

+4 fala, b)? — fey (a, b)? + 1f, (a, bh? 
flath,b+h)= f (a, b) + f (a, b)h + fy(a, b)h 

+4 fex(a, b)? + fas (a, b)? + 1 fyy (a, b)? 
f(a — h, b +h) = f(a, b) — f. (a, b)h + f,(a, b)h 

+ 5 fa (a, b)? — fia, b)h? + 5 fy (a, b)h? 
f(a — h, b — h) « f(a, b) — f(a, b)h — f,(a, b)h 

+5 fax (a, b)? + foy (a, b)? + 1 fyy (a, b)? 


The average of the four corner-values is then 
fav = f (a, b) + 5 f. (a, b)? + 5 fy (a, b)? 


and one interpretation of this result is that the laplacian is proportional to the difference 
between f (a, b) and the average value at the corners. 


Expression (3) 


The third expression is the vector identity div(curl v) = 0, which says that the divergence 
of the curl is always zero. Since the divergence measures spread, the phrase “curls don't 
spread" is provided in Table 20.4. (Visualize an elegant hair-do of long, softly wound curls, 
bouncing, but not coming undone. The curls don't spread.) 

That V - (V x v) is zero follows from the equality of the mixed second partial deriva- 
tives. Let v = ui + vj + wk, and compute 


V «(V x v) = (Wy — vz)x + (Uz — wy), + (Vx — us); 
= Wyx — Uz; + uz, — Wyy + V; — uy; = 0 


This actually characterizes fields with zero divergence. Any field that arises as the curl 
of some other field is necessarily solenoidal. In Section 21.5 a proof of the converse is given 
whereby it is shown that a field whose divergence vanishes must necessarily be the curl 
of another field called the vector potential. Thus, any curl field is necessarily a solenoidal 
field, a characterization of solenoidal fields. A field is solenoidal if and only if it is a curl 
field (that is, the solenoidal field arises as the curl of some other field). This is discussed 
further in Section 21.5. 
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20.4 Products—Two V’s and One Operand 


Expression (4) 


The fourth expression is the vector identity curl(grad f) = 0, which says the curl of the 
gradient is always the zero vector. Since the curl measures rotation (or twist), the phrase 
"gradients don't twist" is provided in Table 20.4. (It looks like this section is a frightening 
lesson, so your hair is standing straight out from your head. Each hair is a gradient vector 
on the surface of your scalp. Now, grab a handful and try to twist it. You'll tear your scalp 
off, so don't twist the gradients, and gradients don't twist.) 

That V x (V f) is the zero vector follows from the equality of the mixed second partial 
derivatives of f(x, y, z), since 


i j k 


ag fy 
Vx vf) pL ~ ~|= £s fs | =0 
x y z 
Íx ^ y fa Í; yx — Tey 


This actually characterizes irrotational fields. Any gradient field is irrotational. In Sec- 
tion 21.5 a proof of the converse is given whereby it is shown that an irrotational field 
is the gradient of some scalar, called the scalar potential. Thus, gradient fields are always 
irrotational, and a field is irrotational if and only if it is the gradient of some scalar potential. 
Consequently, a vector field has a scalar potential if and only if its curl vanishes. That means 
the irrotational fields are those arising as gradients of scalar potentials, so the conservative 
fields are precisely the irrotational fields. 

The existence of a scalar potential for a vector field is established by the vanishing of 
the curl of the vector field. If the curl of the field vanishes, then the field is irrotational, 
is therefore conservative, and hence arises as the gradient of some scalar potential. This is 
examined in detail in Section 21.5. 


Expression (5) 


The fifth expression, namely, curl(curl v) = grad(div v) — laplacian(v), is an identity of 
use in working with Maxwell’s equations in electromagnetic theory. The first term on the 
right, namely grad(div v), is the quantity in expression (1). 


EXERCISES 20.4-Part A 


A1. Explain why each of the 13 unnumbered entries in Table 20.3 is 
undefined. 


A2. For what value of the constant o is the vector field V = (x +4y)i+ 
(y — 3z)j + azk the curl of some other vector field? 


EXERCISES 20.4—Part B 


A3. Compute grad(div v) = V(V + v) for v = xy’i + x? yj. 

A4. Verify div(curl v) = V-(V x v) = 0 for v = y?°z’i + xyzj + xy?k. 
AS. Verify curl(grad f) = V x (V f) = 0 for f(x, y, z) = xyz. 

A6. Verify V x V x v= V(V - v) — V?v for v given in Exercise A4. 


B1. Given the vectors u = a(x, y, z)i + b(x, y, z)j + c(x, y, z)k and 
v= f(x, y, z)U + g(x, y, z)j + h(x, y, Dk, define the operator 

" ; bè = c2 

J k az Cay 


1 ay 
= D ng 
(ux V)=]|4 b c|= cz, — 45, | and show that 
3 3 9 a a 
Ox dy az ay = bz. 


(ux V)-v=u-(V x v). 


In Exercises B2-11, a scalar f (x, y, z) anda point P are given. For each: 
(a) Evaluate both the divergence of the gradient of f and the 
laplacian of f. Show that the two numbers are the same. 


(b) Verify that the curl of the gradient is the zero vector. 
x+yz 


(c) For each scalar function f (x, y, z) and g(x, y, z) = "5, 
verify that, at P, (V f) x (Vg) = V x (fVg) —-V x (V f). 


1 
B2. f(x, y, z) = — >  P = (1,2, 3) 
Reb ye zt 
yz + 9y3 
B3. 2) P =(—3,1,5 
f(x, y 3244 ( ) 
5y? — 4z? 
BÀ. Fe y dies — — Paia) 
x?y 
x+3y° 
B5. f(x,y,z de = (—2, 2,3) 
FR eel = sy Baye 
xz 
B6. f(x,y,z) = —, (—3, —5, 2 
FC, y2) 6xy + 8y? ) 
2y? +y 
B7. z) = —— ——,P = (3,2,1 
fœ, y, z) TA Fy ( ) 
9—2xz 
B8. f(x, y,z) = Pi (3. 1,7) 
T0539 = S yl and Syd i 
a 
B9. f(x,y,z) = Pm 2, 
fs») bud S ( 5) 
6y?z — 3x 
B10. f(x, y,z) = = ,P=(1,1,-1 
FO, yz) 9x? — 4x?y — 6yz? ( ! 
923 —4 
B11. f(x, y, z) = = (2,5,1) 


3xy — 9y?z — 8xz?' 


For the vectors F given in Exercises B12-16, verify that the divergence 


of the curl is zero. 
B12. F = x?yzi + xy?zj + xyz)k 
B13. F = xyzi+ zj + yk 


B14. F = (1 - zi + — 
X 


jt+2’k 
iy! 


Chapter Review 


1. If F = ui + vj + wk: 

(a) Write the formula for the divergence, V - F. 

(b) Write the formula for the curl, V x F. 
2. Give a verbal description of what the divergence measures. 
3. Give a verbal description of what the curl measures. 


4. Give an example that illustrates the meaning of the statement “the 
divergence is the limiting value of flux per unit area enclosed.” 


5. Give an example that illustrates the meaning of the statement “the 


curl is the limiting value of the circulation per unit area enclosed.” 


6. If F = xy? — yz? + zx: 
(a) Compute the divergence. (b) Compute the curl. 
7. What is a solenoidal field? Give an example. 
8. What is the divergence of the gradient field? Give an example. 
9. Is the laplacian of a scalar field necessarily zero? 


10. Write the formula for computing the laplacian of the scalar 
u(x, y, z) in Cartesian coordinates. 


B15. F = 2x? 
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yzi + ye*j + sin(xy)k 


B16. F = z cos yi + x sin zj + yz tan(xz)k 


For the vector fields F given in each of Exercises B17—23, determine a 
function u(x, y, z) that makes F the curl of some other vector field. 


B17. F = u(x, y, zit (6y + 3)j + (—3x + 5xz)k 
B18. F = u(x, y, z)i + Oxy — z°)j + (3z —3)k 

B19. F = u(x, y, 2i + (2y — 5x°)j + (8y? — 4x)k 
B20. F = u(x, y, z)i + (8xy — 6y)j + (8z — 7x)k 


B21. 
B22. 
B23. 


F = u(x, y, zi + (9xz — 3x?)j — 7xzk 
F = u(x, y, zit (7y — 5)j + (9x — 4y?)k 
F = u(x, y, z)i + (4xz — z)j + Cxz — 7)k 


In Exercises B24—33, determine a value of the constant o for which the 
given vector field is a gradient field. 


B24. 
B25. 
B26. 
B27. 
B28. 
B29. 
B30. 
B31. 
B32. 
B33. 


11. 


12. 


13. 


14. 


15. 


16. 
17. 
18. 
19. 


F = (9x? — 5)i + ayzj — 5y°k 

F = 14xzi+ (az? — 16yz)j + (7x? — 16yz — 8y?)k 

F = (8xz + 2y?)i + (7z + Axy)j + (ay + 4x?)k 

F = axyi — 9x?j + (14z — 21z2)k 

F= (ay? — 9z)i — 10xyj + (8 — 9x)k 

F = (axy — 4yz + 8y?)i + (16xy — 2x? — 4xz)j — 4xyk 
F = (4yz + 8? + 227)i + (Axz + axy)j + (4xy + Axz)k 
F = (ayz + 827)i — 8xzj + (16xz — 8xy)k 

F = (ayz + 3x?)i + 3xzj + (3xy — 927)k 

F = 5yzi+ (6z + 5xz)j+ (6y taxy +7)k 


Compute the laplacian of u(x, y) = —= : 


What is an irrotational field? Give an example. 


weet? state 


u.v 


fg 
* E. 
Of the 12 possible expressions of the form V | . | ga 
x 


which 6 are valid. For those that are not valid, explain why. 
Of the 18 possible expressions of the form V | ; | V | . | H ; 
x x 


state which 5 are valid. For those that are not valid, explain why. For 
those that are valid, state the significance of any associated identity. 


What is a harmonic function. Give an example, and demonstrate 
that it is indeed harmonic. 


Characterize conservative fields. 
Characterize solenoidal fields. 
Characterize irrotational fields. 


What is a field called if it is the curl of some other field? 


Chapter 2] 


Integration 


INTRODUCTION A procedure for computing surface area of a surface of 
revolution is available in elementary integral calculus. We generalize this to the computation 
of surface area of a general surface. We then define the surface integral that accumulates 
the values of a scalar on a surface. For example, the scalar can be a surface density giving 
either charge or mass per unit area. The surface integral would then yield the total charge 
or mass for the surface. 

If the component of a vector field normal to a surface is integrated over that surface, 
the resulting number is called the surface flux of the field and is a measure of how much of 
the field "passes through" the surface. 

If the divergence of a vector field is integrated over the interior of a region R, the result 
must match the surface flux of the field through the boundary of R. This law of balance is 
the divergence theorem of Gauss and simply says that a net change in the content inside 
the region must be balanced by an appropriate flow through the boundary. 

If a field passes through an open surface such as a hemisphere, the surface integral 
of the normal component of the curl must balance the circulation of the field around the 
curve that bounds the open surface. For the hemisphere, the bounding curve would be the 
“equator.” This law of balance is Stokes’ Theorem. 

There are two forms of Green's Theorem, one that looks like the planar version of the 
divergence theorem, and one that looks like the planar version of Stokes' Theorem. 

Section 21.5 collects and connects alternate definitions of a conservative force. In 
fact, the equivalence of the various definitions is rigorously established. The solenoidal 
(divergence-free) field is characterized in terms of conservative fields for which the potential 
function is harmonic. It is also characterized in terms of a field that is itself the curl of 
another field called the vector potential. The irrotational (curl-free) field is characterized 
as a conservative field, and vice-versa. 

Finally, we see the integral equivalents for the vector differential operators of diver- 
gence, gradient, and curl. On the basis of the formulas relating the differential operators to 
integrals, richer interpretations of divergence and curl are possible. 


Surface Area 


Surface Area—Surfaces of Revolution 


Surface area for surfaces of revolution is a staple of the integral calculus course. After a 
brief review, the question of finding the surface area of a surface that does not necessarily 
have rotational symmetry becomes the chief focus. 
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EXAMPLE 21.1 


Radius of rotation 
p-fQ) 


! 
! 
I 
1 
i} 
1 
l 
| 
[j 
! 
1 
1 
I 
I 


- > X 


0 


FIGURE 21.1 Surface area for a surface 
of revolution 


IU x VII = IIUI IVI since) 


U Il VII sinc) 


FIGURE 21.2 Area of a parallelogram 


f(a, B) 
FIGURE 21.3 Element of surface area 
approximated by parallelogram 


EXAMPLE 21.2 


Solution 


If a curve given by y = f(x) is rotated about the x-axis to form a solid of revolution. 
then an integral that expresses the surface area of the solid is Jf : 2ztp ds, where p is the 
radius of rotation and ds is the element of arc length. Corresponding to Figure 21.1, this 
integral becomes 


b 
/ Qn f (x) 1 + Cf)? dx 


a 


Sphere of radiusa Rotate, about the x-axis, a semi-circle of radius a, thereby forming 
a sphere of radius a. Thus, the curve being rotated is f(x) = va? — x?, so the element of 
arc length is ds — Wm The surface area sought is therefore A = 27 fat adx = 4na’, 
the well-known value for the surface area of a sphere of radius a. e 


Surface Area—General Case 


The element of surface area in the general case is approximated by a parallelogram, one 
corner of which is attached to the surface in question. The area of a parallelogram whose 
edges are the vectors U and V is ||U x V||. A brief reminder of this result from multivariable 
calculus is based on Figure 21.2. The dotted line forms a right triangle where the hypotenuse 
has length ||V|| and the leg opposite angle t has length ||V|| sin t. The height of the paral- 
lelogram is therefore || V || sin? and its area is ||U||||V]| sin t, which is precisely the length 
of the vertical segment, the cross-product of U and V. Thus, the area of a parallelogram of 
sides U and V is ||U x V ||. 

On the surface z = f(x, y) the surface area element is the parallelogram formed by 
two vectors tangent to plane sections x = a and y = £, as shown in Figure 21.3. The plane 
sections are 


R, =ai+yj+ f(o, y)k and R, = xi + 8j + f(x, B)k 
respectively. Infinitesimal tangents to these curves are then 
T, = (i+ fk) dx and T, = (j+ fk) dy 


so the area of the parallelogram they form is 


IT; x Ty = /1+ f2 + f2dxdy 


Hence, the element of surface area for the surface z = f(x, y) that projects to the xy-plane 


is 
do =,/1+ f? + f?dxdy 


Of course, if the surface were projected to a different coordinate plane, the expression for 
do would change accordingly. 


Find the surface area of the “North Polar Cap” cut off the sphere x? + y? + z? = a? by the 


plane z = y, 
As shown in Figure 21.4, the required surface area is given by an integral of the form 
Jo do, where Q is the disk in the xy-plane above which sits the North Polar Cap. To find 
the radius of the disk Q, intersect the sphere with the cutting plane by solving 

" 2a 


xe yt +2=a and z= — 
3 


simultaneously. Thus, solve 


for r, calling the positive value r; = 
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Surface Area 


> ? yj 
r+ sa? =a" 


Ba, Then write the upper hemisphere as 


z= FRY 


the positive square root being used when finding the area of the North Polar Cap. Hence, 


FIGURE 21.4 Example 21.2: “North 


do — 1-4 f? + f?dxdy = €—— dx dy 
i Ja? — x? — y? 


The surface-area integral will be a double integral over a disk of radius rı. Set this up in 


Polar Cap” 


Cartesian coordinates, but evaluate it in polar coordinates, obtaining 


ra 


V5a/3 e A/5a2—9x2 /3 
_ | guia 


EXERCISES 21.1—Part A 


2x pV5a/3 
= dy dx 2 dr d9 = $na? % 
0 J0 7 


Va? — r? 


Al. 


A2. 


A3. 


A4. 


Find the surface area of the solid of revolution formed when 
y =x*,0 <x < 1, is rotated about the x-axis. 


Find the area of the parallelogram that has u = 3i — 5j + 7k and 
v = 2i + j — 4k as adjacent sides. 


Write do for the surface: 
(a) x =g(y,z) (b)y-h(.z) 
The first-octant triangle T is cut from the plane 5x + 7y + 9z = 


315 by the coordinate planes. Obtain the area of T by 


(a) using the formula 2 ||u x v||, where u and v are vectors that 
form the triangle. 


EXERCISES 21.1—Part B 


AS. 


(b) projecting T to the xy-plane and using integration. 

(c) projecting T to the xz-plane and using integration. 

(d) projecting T to the yz-plane and using integration. 
Calculate the surface area of the sphere x? + y? + z? = a? by 
(a) projecting to the xy-plane and integrating. 

(b) projecting to the yz-plane and integrating. 


(c) projecting to the xz-plane and integrating. 


B1. Find the surface area of the surface of revolution formed when 


y =sinx,0 < x < £, is rotated about the x-axis. 


B2. Find the surface area of that portion of the plane in Exercise A4 


that lies inside the cylinder 
(a) (x 3? -c(y - ? =4 


(b) whose footprint, in the xy-plane, is the triangle with vertices 
(1, 3), (8, 5), (13, 22). 

(c) whose walls are the curves y = x? — 8x + 21 and y = x + 13. 

(d) whose walls are the curves y = x? — 8x + 21 and y = 
i; (100 + 75x — 7x?). 

(e) 6x? + 15y? 290  (f(x—6?-(z—7?29 

(g) (y — 8? + (z — 10)? = 25 


(h) whose footprint, in the xz-plane, is the triangle with vertices 
(3, 4). (9, 12), (6, 17). 


B3. 


B4. 


B5. 


B6. 


B7. 


(i) whose footprint, in the yz-plane, is the triangle with vertices 
(6, 1), (1, 7), (12, 13). 

Find the surface area of that portion of the surface z — 36 — 

4x? — 9y? that is inside the cylinder 2x? + 3y? = 12. 

Find the surface area of that portion of the surface z = 1+ 

2x? + 3y? that lies below the plane z = 5. 

Find the surface area of that portion of the surface z = yx? + y? 

that lies in the first octant and below the plane z = 1. 

Find the surface area of that portion of the surface z = 

x? + y? — 1 that lies in the first octant and below the plane 

z= 3. 

Find the surface area of that portion of the cylinder x? + y? = 1 

cut out by the cylinder x? + z? = 1. 
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B8. Find the surface area of that portion of the surface z = ,/x2 + y? B15. When the curve y = f(x), a < x < b, is rotated about the x-axis, 
that lies within the cylinder x? + y? — y — 0. the surface of revolution so formed is given implicitly by 
z? + y? = f?(x). To substantiate this claim, obtain graphs of the 
implicit surfaces corresponding to the surfaces in Exercises B13 
and 14. 
B16. Writing the implicit surface in Exercise B15 as z(x, y) — 
Vv f?(x) — y?: 


(a) Obtain do, the element of surface area. 


B9. Find the surface area of that portion of the cylinder x — y? cut off 
by the planes z = 0, y = z, and x = 2 and for which y > 0. 


B10. Find the surface area of that portion of the cylinder x? + 2z? = 2 
that lies within the cylinder x? + y? = 1. 

B11. Find the area of that portion of the plane 3x -- 4y — 12 that lies 
within the ellipsoid $ + 25 + = — I. 

B12. Find the area of that portion of the plane 6x + 4y + 3z = 12 that 
lies within the ellipsoid $ + Ż + £ = I. 


(b) Set up a double integral for the surface area for this surface of 
revolution. 
(c) Show that evaluation of the inner integral in part (b) leads to 


B13. Obtain the surface area of the surface of revolution formed when m f. fGD VT FF dx. 


the curve y = f(x) = x?,0 < x < 1, is rotated about the x-axis. 

B14. Obtain the surface area of the surface of revolution formed when 
the curve y = f(x) = tanx, 0 < x < 1, is rotated about the 
X-axis. 


Surface Integrals and Surface Flux 


Surface Integrals 


The surface integral Sh f (x. y. z) de. accumulates the values of the function f(x, y, z) 
on a surface S just the way the line integrals Ja f (x, y) dx and Je f(x, y)dy accumulate 
values of the function f (x, y) along a curve C. For the line integral, the parametrization of 
the path C is passed to the integrand to guarantee that f (x, y) assumes values just on C. 
Similarly, for a surface integral, the integrand must be restricted to assume values just on 
the surface S. But there are two ways to express the surface S. 

The surface S can be given either explicitly as z = z(x, y) or parametrically via formu- 
las of the form x = x(u, v), y = y(u, v), z = z(u, v). When the surface S is given explicitly 


as z = z(x, y), the surface area element is do = V1 +z? + z? dx dy. Section 23.2 con- 
siders the more complicated expression for the surface integral when the surface is given 
parametrically. 


EXAMPLE 21.3 Surface integral Suppose the functions fŒ, y,z) =x and g(x, y, z) = xz give the 
charge per unit area on the surface S, defined by z = x? + y, with x in [0, 1] and y in 
[-1, 1]. The element of surface area is do = 4/2 + Ax? dx dy. The double integral that 
accumulates the total charge due to f(x, y, z) = x on the surface S is 


1 pl 
I f xy 2 + 4x? dx dy = V6 — 1/2 
-1J0 


whereas the double integral that accumulates the total charge due to g(x, y, z) = xz on the 
surface S is 


Log 
/ f x(x? + y)/2 + Ax? dx dy = 2/6 4- iv2 
-1J0 : ` 


The explicit z in g(x, y, z) = xz is replaced by z = x? + y, the value of z on the surface S. 
4 


EXAMPLE 21.4 
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Surface Flux 


Concept In analogy to the notion of flux through a curve C, the surface flux of the vector 
field 


F = f(x, y, 2i + g(x, y, 2j + h(x, y, z)k 


through a surface S is given by the surface integral of the normal component of F over the 
surface. The normal component of F is F - N, where N is aunit normal vector on the surface 
S. Once this normal component has been obtained, the surface flux integral becomes a 
surface integral, that is, it becomes the integral of some scalar-valued function over a 
surface S. Thus, the surface flux integral is 


[[¥ Nao 


Choosing the “right” normal takes more than a few words. For the flux through a 
curve C there were two possible normals to consider and the convention adopted was to 
take the normal to the “right” of the tangent vector T. On a closed curve, this normal is 
outward for traverse counterclockwise. There is also a choice of two normals on a surface, 
but unfortunately, for a surface there is no recipe by which every user will end up with the 
same normal. Hence, the choice of normal on a surface is arbitrary, and that choice will 
have to be stated clearly in every case. 

There is one case where the choice of surface normal permits a convention that removes 
the ambiguity. The closed surface (like a sphere or an ellipsoid) permits the convention 
“outward normal.” That’s the easy case. Look at the surface, determine the inside and 
outside of the closed surface, and select the outward-pointing normal. 


Closed surface We will find the flux of the field F = xi + 2yj + 3zk through the unit 
sphere given implicitly by 


f, y, =x*+y+4+2-1=0 (21.1) 


Since the divergence V - F = 6, the net flow should be outward and positive. 

Determining the outward normal belongs in the arena of the sphere. It has nothing to 
do with the field F. The sphere is given implicitly by (21.1). For a surface defined implicitly 
by a formula of the form f(x, y, z) = 0, the gradient operator produces a normal vector. 
Whether or not this normal vector is inward or outward for the closed surface cannot be 
determined a priori. We must examine the gradient so calculated to see which way it points. 

From (21.1) wehave V f = 2(xi + yj + zk), which points in the direction € 
f. For w = f(x, y, z), that makes V f outward but not unit. A unit normal is ws 
and a unit normal field on the surface of the sphere is N = xi + yj + zk, since there, 
x+y +z =l. 

Next, obtain F - N = x? + 2y? + 3z?, which for either branch of z = +,/1 — x? — y? 
becomes 3 — 2x? — y?. The surface area element is do = Ju for both the upper and 
lower hemispheres, each of which project to R,,, the unit disk in the xy-plane. The desired 
flux integral is then 


T — r*(1 
: fff 3- m D drdy=2 f" r FB ren Ws osa (21.2) 
my (tay Lc 


where the integral on the left is evaluated by changing to polar coordinates. The flux is 
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FIGURE 21.5 Moebius band with its 


discontinuous normal field 


EXAMPLE 21.5 


positive, indicating the net flow of the field F is along the (outward) normal N, and hence, 
is itself outward, consistent with the divergence of F being 6. $ 


NONCLOSED SURFACES A nonclosed surface such as a plane or a hemisphere does not have 
an "inside" or “outside,” so a new convention for selecting a unique normal is needed. Note 
that the word “upward” is also ambiguous because it depends on perspective. For example, 
consider the plane x — y + z = 1. Write the plane as z = 1 — x + y, and the normal —z,i — 
zyj + k = i — j + k will point upward for an observer who thinks z is inherently upward. 
Write the plane as y = y(x, z) = x + z — 1 and N = —y,i+j-—y-k = —i + j — k, a vec- 
tor that is “upward” to an observer whose north is the positive y-direction but is “downward” 
to observers who think the z-direction is upward. So, the recipe for finding a normal for an 
explicitly given surface is not fool-proof. It works only for surfaces described explicitly by 
a formula of the form z = z(x, y). Then, the recipe yields an “upward” normal, provided 
everyone is in agreement that the z-direction is “upward.” 


ORIENTING SURFACES Some texts describe for a surface, the process of orientation 
(sketched below), but leave the impression that giving a surface a right-handed orienta- 
tion solves the problem of picking a unique normal. This is not true. Orienting a surface 
insures that a continuous normal field has been selected over all the surface, not that a unique 
normal has been selected. 

The orientation process starts with the arbitrary choice of a normal, then covers the 
whole surface with a field of normals continuous with respect to the original arbitrary choice. 
It thus guarantees that when constructing surfaces, even closed surfaces, from nonclosed 
parts, the complete surface ends up with a consistent (continuous) normal field. 

Right-handed orientation is accomplished by walking along the bounding edge of a 
nonclosed surface in such a way that the surface is to the left, the head pointing in the 
direction of the normal field. Advance along the bounding edge, walking on the surface 
itself, with the surface to the left. The body is the normal vector. 

Unfortunately, a right-handed orientation can be given to the same surface with the 
opposite normal being selected. For example, consider the upper hemisphere. Walk around 
the equator while standing on the outside of the hemisphere, left hand toward the surface, 
and head pointing “outward.” Having walked west-to-east, the body is the “outward” nor- 
mal. Alternatively, stand inside the surface, walk along the equator on the inside of the 
hemisphere, left hand pointing into the surface. The journey around the equator is now 
east-to-west, and the body is now the “inward” normal. Thus, orienting a surface merely 
assures continuity in the normal field, it does not select one of the two possible normal 
fields. 

There are surfaces, however, that cannot be oriented. The classic example is the Moebius 
band formed by gluing together the ends of a strip of paper after the strip has been given a 
one-half turn, or twist. The Moebius band, shown in Figure 21.5, is not orientable because 
a continuous normal field cannot be prescribed on it. The half-twist in the strip rotates the 
normal field as the field is followed around the band. The initial and terminal points of the 
circuit around the band should be identified since the surface has no thickness. Therefore, 
the normals at the initial and terminal points should be the same, but instead, they are 180° 
out of phase. Hence, the normal field is inherently discontinuous on the band, and the band 
is not orientable. 


Nonclosed surface We will find the flux of the field F = 18zi — 12j + 3yk through the 
surface S, which is the first-octant portion of the plane 2x + 3y + 6z = 12. 


EXAMPLE 21.6 


EXAMPLE 21.7 
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A unit normal field on this plane is N — ENERO as per the sketch in Figure 21.6. The 


normal component of F is F- N — B(2z + y — 2), and writing the plane in the explicit 
form z = 2 — E — 3 we get the element of surface area do = Z, Evaluating F - N do on the 
surface by substituting z = z(x, y), we get the integrand 6 — 2x. The domain of integration 
is a triangle in the xy-plane, the first-quadrant shadow of the plane onto the xy-plane. The 
bounding curves are x = 0, y = 0, and the line y = -ix + 4. Hence, the required flux is 


hin y — 2x) dy dx = 24. e 


UJ 


7// 


y, 


" 


Ll? 


V 
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FIGURE 21.6 Example 21.5: The surface and a 
representative normal vector 


Nonclosed surface We will find the flux of the field F = zi + xj — 3y?zk through the 
surface $, which is the first-octant part of the curved wall of the cylinder x? + y? = 16, 
between z = 0 and z = 5. 

The surface S is given implicitly by f (x, y, z) = x? + y? — 16 = 0, so a normal vector 


is V f = 2(xi + yj), a unit normal field is =. and a unit normal field on the surface 
x“+y* 


where x? + y? = 16 is N = 24. The surface S is a cylinder with axis parallel to the z-axis 
and, hence, has no projection to the xy-plane. The surface cannot be expressed in the form 
z = z(x, y). Instead, project the cylinder onto the xz-plane, and solve f(x, y, z) = 0 for 
y = y(x, z) = V16 — x?, where the positive root has been chosen because S lies in the 


first octant. Next, compute 


do = J1 + y2 + y2 dx dz = = dx dz (21.3) 

then form the integrand 
F-Ndo = A dx dz = (FS +x) dx dz (21.4) 
where y has been replaced with y(x, z). The projection of the surface y = y(x, z) onto the 
xz-plane is the rectangle 0 € x < 4,0 < z <5. Hence, f h + x)dx dz = 90 is 
the flux through S. l $ 


Closed surface Find the flux of the field F = k passing through the surface S, which is 
just the unit sphere centered at the origin. Note that the field F is constant and upward, so 
that whatever passes into S on the bottom leaves again through the top. We would therefore 
expect that the flux through S is 0. 
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As in Example 21.4, represent the unit sphere implicitly by (21.1) so that on the whole 


a. the unit normal field is N = xi + yj + zk and do = v adr oo 


. dxdy | _ dxdy _ dxdy 


zl * 


If vz? is erroneously simplified to z instead of |z|, the net flux will be the counterintuitive 


2x. Since F -Ndo = € 


and the upper and lower hemispheres both project to Rxy, the unit 


disk in the xy-plane, the total flux is given by 


On the upper hemisphere, 4 


^ lal 


Jl axdy+ ff —dx dy = 0 
Ry Ry 


= 1, but on the lower hemisphere, + E —1; so the two double 


integrals differ in sign. Incorrectly simplifying |z| to z gives two denied integrals, each 


giving zr, the area of the unit disk. v 


EXERCISES 21.2-Part A 


e. 


A1. Show how the unit disk with center at the origin can have a 
right-handed orientation with the normal field pointed upward or 
downward. 


A2. Evaluate Sf, f(x, y. z) do if f (x, y, z) = x? y? and S is the 


5 
surface z = 1 — x? — y?, z > 0. 


EXERCISES 21.2—Part B 


A3. Evaluate ff. f (x, y, z) do if f (x, y, z) = x?z and S is the surface 
z—-1—-x?—y^zz0. 

A4. Compute the flux of F = x?i + 2y?j + 3zk through S, the surface 
z=1—x*-y?,z>0. 

AS. Compute the flux of F = 3x?i + 5y?j + z?k through S, the surface 


z=1—x?-y’,z>0. 


B1. For Example 21.4, verify the integration in (21.2). 
B2. For Example 21.6, verify do given in (21.3). 
B3. For Example 21.6, verify the integrand in (21.4). 


B4. For Example 21.6, verify the integral 
hhg = +x) dx dz = 90. 


In Exercises B5-14, compute ff. f (x, y, z) do for the given f(x, y, z) 
and surface S. 
B5. f(x, y, z) = (2x? — 3y”)z?; S is that part of the cylinder 
x? + y? -o umb ene 
B6. f(x, y, z) = x?yz^; S is that part of the cylinder 2x? + 3z? = 5 
between y = 0 and y = 2. 
B7. f(x, y, z) = 5x? — Ay^; S is that part of the sphere x? + y? + 
z? = 49 lying between z = 2 and z = 6. 
B8. f(x, y, z) = 5x?y — 3z +4; S is the first-octant portion of the 
plane 2x + 5y + 9z = 45. 
B9. f(x, y, z) = 3x + 4y — 5z7; S is the first-octant portion of the 
cylinder y = x? lying below z = 5 and bounded by the plane 
x eb. 


B10. f(x, y, z) = 4x? + 8y? + 8x?z; S is that part of the plane 

7x — 3y + 5z = 21 interior to the cylinder 4x? + 3y? — 2y = 1. 
B11. f(x, y, z) = 4xz — 4xy — 9x?; S = {z = 10 — x?  4y?, z > 0) 
B12. f(x, y,z) =7y + 9xz — 8yz; S is that part of z = yx? + y? 


interior to the cylinder x? + 2x + y? = 2. 


B13. f(x, y, z) = 9xz — 2xy? — Az; S is that part of z = 4 — y? inside 
—-(0xyz4-x)j 
B14. f(x, y, z) = 6yz — 8x? — 925; S is that part of z = xy defined on 
R={0<y<3,0<x <y} 


In Exercises B15-24, compute ff; F - N dc, the flux of F through the 
given surface S, where N is the upward unit normal on S. 


B15. F = 5xyi — 3yzj + 13xzk; S is the first-octant portion of the 
plane 3x + 5y + 7z = 105. 

B16. F = yi + z?j + xk; S is that part of z = 125 — 2x? — 3y? lying 
above the triangle whose vertices are (1, 1, 0), (2, 5, 0), 
(—3, 4, 0). 

B17. F = yzi — 2x?j + 3xzk; S is that part of z = xy defined on 
O0<y<1-—x?. 


B18. F = 3zi + 2xj — 5yk; S is that part of z = 1 + xy? defined on 
R={0<x<2,0<y<sinx}. 

B19. F = y*i — z2j + x?k; S is that part of z = x? + y? satisfying 
0x. 

B20. F = (x — y)i + (y + z)j + xzk; S = {z = y1 — x? — y?) 

B21. F = (yz — x)i + (xz — y)j + (xy — z))k; S is that part of 


x? + y? — z? = 9 satisfying —4 < z < 4. (Use an outward 
normal.) 

B22. F = xi + y?j — z°k; S is the first-octant portion of x? + z? = 1 
satisfying 0 € x < y. 
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B23. F = V f, f = 9xz — 9xy? + 5z; S is that part of the cylinder B29. F = xi - yzj + y’k; S = {x? + y? =1,z=0,z=1} 

z = sin y satisfying 0 < y < 3,0 < x < 1. B30. F = V f, f = x?yz; S is the rectangular box whose faces are 
B24. F = V f, f = 8yz — 8x? + 725; S is that part of the cylinder valy 2,263. 

z = x° satisfying 0 < x < 1,0 < y < x. B31. F = V f, f = yz? — 3xy?; S is the boundary of the region 
In Exercises B25-34, compute ff; F - N do, the flux of F through the enclosed by (x^ + y“ = 1,z = 0,z =2 — x}. 
given closed surface $, where N is the outward unit normal on S. B32. F = V f, f = 2xz --5y?; S is the boundary of the region 


enclosed by z = /2x? + 5y? and z = 1. 


B33. F = xzi — y?j + yzk; S = (2x2 + 3y? + 4z? = 24] 


B25. F = x!i + yj — zk; S = {z = y1 = x? — y?, z = 0} 


B26. F = yzi — xzj + xyk; S = {z = x? + y?,z = 1 , , . " ; 
ý : b» i í . = 3 á B34. F = (y + z)i + (x — z)j + 2xyk; S is the triangular cylinder with 

B27. F = zi — 2xj + yk; S = {z = 1 — x“ — y“, z = 0} vertices (1, 3), (—4, 5), (3, —9) in the xy-plane, bounded above 

B28. F = y?i + zj - xk; S = {2x + 3y + 5z = 30,0 < x, y, z} by the plane 5x + 7y + 9z = 315 and below by z = 0. 


The Divergence Theorem and the Theorems of Green 
and Stokes 


Statement of the Theorems 


There are connections between the vector operators div, grad, and curl and the integrals 
defining flux and circulation. Three classic theorems attributed to Green, Stokes, and Gauss 
connect these notions and are an essential part of vector calculus. 

The three theorems are stated first so that they may be compared and contrasted. The 
divergence theorem of Gauss is the most intuitive and is stated before Stokes’ Theorem. 
Green's Theorem has two forms, one resembling the divergence theorem and one resembling 
Stokes’ Theorem, each form being the planar counterpart of its analog. In fact, some texts 
confuse the issue by calling Green's Theorem “the divergence theorem in the plane." 

For simple regions, both the divergence theorem and Green's Theorem are proven by 
straightforward integration ideas. The proof of Stokes’ Theorem generally invokes Green's 
Theorem. All three theorems are extended to more complicated regions by arguments based 
on subdivision to the simpler cases. Details of such proofs are found in texts such as [84], 
[92], [91], [35], [97], and [65]. 


THE DIVERGENCE THEOREM OF Gauss Alternatively called the “divergence theorem,” 
the divergence theorem of Gauss should not be confused with “Gauss’ Theorem,” which 
appears in Section 23.1. Gauss' Theorem is a consequence of the divergence theorem, but 
not conversely. 

The essence of the divergence theorem is the integration formula 


[J| v 54 ff 9: Nao (21.5) 


and appropriate hypotheses for making (21.5) valid. Conditions on the vector field F are just 
that its components have continuous derivatives inside and on the surface S. The surface S, 
bounding the open connected set V, must be piecewise smooth, closed, and oriented. The 
vector N is the unit outward normal on S. The volume represented by V is connected, but not 
necessarily simply connected. Thus, V can be the interior of a sphere (simply connected) 
or of a torus (donut; not simply connected). It can even be the (simply connected) interior 
of a sphere that has had a smaller sphere extracted from its interior. In this case, $ would 
be the union of the inner and outer boundaries. 
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STOKES THEOREM The essence of Stokes’ Theorem is the integration formula 


[[ vx Fi Nao =f Far = d reas (21.6) 
S 6 C 


with sufficient hypotheses for making (21.6) valid. For example, the vector field F should 
have continuously differentiable components. The surface S should be oriented, its unit 
normal field N consistent with the orientation. In addition, S should be described by piece- 
wise smooth functions and bounded by a piecewise smooth, simple closed curve C, itself 
oriented consistently with the orientation of S. 


GREEN’S THEOREM IN THE PLANE Green's Theorem consists of an integration formula that 
is valid in the plane and resembles either the divergence theorem or Stokes’ Theorem. One 
form of the theorem can be transformed into the other by suitably defining the vector field 
F appearing in the theorem. In Table 21.1, each form is given in both vector and component 
forms. Both forms are valid under the general hypotheses [35] that R is a bounded closed 
region whose boundary consists of a finite number of simple, closed, rectifiable curves and 
that the components of F have continuous partial derivatives. A rectifiable curve is one that 
has finite arc length. 


Form Green's Theorem Integral Formula 


II V-Fdxdy = $ F-Nds 

R g 

If (fr +8y)dx dy = r) f dy — gdx 
R C 


f| v x i-kaxdy =p F-ar= d ras 
C C 


R 
ike - fodxdy = $ fdx+gdy 
t 


" ) 


Divergence 


Stokes’ 


TABLE 21.1 Alternative forms of Green’s Theorem 


If the divergence form of the theorem is applied to the vector field F = gi — fj, the 
resulting component form will read precisely as the Stokes’ form. If the Stokes’ form of 
the theorem is applied to the field F = —gi + fj, the resulting component form will read 
precisely as the divergence form. A more complete discussion of Green's Theorem is the 
subject of Section 21.4. 


Discussion of the Divergence Theorem 


In the integration formula fff, V-F dv = ff, F-Ndo that is the essence of the divergence 
theorem, V is a three-dimensional region in space, representing a volume, and S is its 
bounding surface, necessarily closed. A vector field F is defined throughout the region V, 
and V - F is its divergence. The volume element in V is dv, which is dx dy dz in Cartesian 
coordinates or r dr d0 dz in cylindrical coordinates. 

The left side of the divergence theorem is the volume integral of the divergence. We 
saw earlier that this yields the net spread of the field F inside the region V. The divergence 
theorem is a law of balance, so whatever enters or leaves the region V must have passed 


EXAMPLE 21.8 


EXAMPLE 21.9 


"IGURE21.7 Example 21.9: Region 
yetween concentric spheres 
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through the boundaries of the region. This boundary is the surface S, and on the right side 
of the formula we find the surface integral of F - N, where N is the outward unit normal on 
S. Thus, the integrand on the right is the surface integral of the normal component of the 
field F, namely, the flux of F through the surface S. 

The divergence theorem is intuitively appealing, simply claiming that the net divergence 
(spread) of the field F inside a volume V must be accounted for by the flux of F through 
the bounding surface § enclosing V. 


For the field F = xi + yj + zk and the region V taken as the interior of the unit sphere, 
verify that the divergence theorem is valid. 

Define S implicitly by (21.1), so a unit normal field on S is N = xi + yj + zk and 
F-N=x?+y?+2? = 1 on S. The divergence of F is V - F = 3, so the volume integral 
on the left in the divergence theorem, fff, 3 dv, is just three times the volume of the unit 
sphere, or 3(471°) = 4z.. The flux integral on the right is ff 1do = 4x because it is just 
the surface area of the unit sphere. $ 


Verify the validity of the divergence theorem for the field of Example 21.8, and V’, the 
region between concentric spheres with radii + and 1. Thus, S has two pieces, the outer 
surface, which is the sphere of radius 1, and the inner surface, which is the sphere of radius 
1. A cut-away sketch of the region V', along with representative outward normal vectors 
on the inner and outer surfaces, are shown in Figure 21.7. 

From Example 21.8, the field is F = xi + yj + zk, with divergence V - F = 3. The 
integral of the divergence over the region V’ can be realized by subtracting from 47 (the 
value over V computed in Example 21.8), the integral of the divergence over V”, the interior 
of the inner sphere. Thus, the left side of the divergence theorem will be 


4r — "i 3dxdydz — 
ya 


using tr ay = € for the volume of the inner sphere of radius L, 

The unit outward normal field on the outer surface is still N = xi + yj + zk, but on 
the inner surface itis n = —2 (xi + yj + zk), the minus sign because the normal field must 
be outward with respect to the region V’, which is therefore inward with respect to s, the 
smaller sphere. The value of F - N is 1 on the outer surface and —4 on the inner sphere. The 
value of the flux through the surface of the larger sphere is 477, as computed in Example 
21.8. The flux through the surface of the smaller sphere is 


l l js 1 
If do = An = 
"E 2 a 2 


so the total flux through V’ is Tm. ke 


T 


NIN 


Discussion of Stokes’ Theorem 


The essential formula in Stokes’ Theorem is (21.6). The surface S, usually not closed, is 
called a capping surface for the bounding curve C. For example, a hemisphere is the capping 
surface for the circle C, which is the equator. Alternatively, a thimble is the capping surface 
for the circle that defines its opening. 

The integrand in the double integral on the left is the flux, through the surface S, of 
the curl field of F. On the right, the tangential component of F is integrated around the 
bounding curve C, yielding the circulation of F around C. 
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FIGURE 21.8 Flux of the curl field 


passing through a surface 


EXAMPLE 21.10 


Stokes’ Theorem balances the field’s net vorticity (circulation) flowing through the 
surface and the average circulation of F around the bounding curve C. Vorticity (or twist, 
rotation) of F on the surface S is measured by the curl of F. Integrating the normal component 
of the curl of F on the surface S allows local swirls that oppose each other to cancel out, 
leaving just the uncanceled parts on the boundary curve C to reckon with. This residual 
vorticity is along the bounding curve C and accumulates along C in the line integral on the 
right side of (21.6). 

Figure 21.8 illustrates how local rotation of the normal.components of V x F “cancel” 
where two such vectors are contiguous, leaving just the points along the boundary to accu- 
mulate circulation. Thus, the net circulation as measured by the flux of the curl field can be 
measured by summing the tangential component of F along the bounding curve C. 


If the surface S is the upper unit hemisphere, verify Stokes’ Theorem for the field F = 
—yi + xj + zk. Let the capping surface S be defined by (21.1), so that the unit normal field 
on Sis N = xi + yj + zk. The curl of Fis V x F = 2k, from which follows [V x F]- N = 
2z. The element of surface area, computed from z = z(x, y) = /1 — x? — y?, is 


dx dy | dxdy  dxdy 


M-2x-y zi z 


valid on the upper hemisphere. The surface integral on the left of (21.6) is f Trey 2dx dy, 
where R,, is the unit disk in the xy-plane. The flux integral, twice the area of the unit disk, 
evaluates to 27r. 

For the line integral on the right side of (21.6), the parametrization of the bounding 
curve C must be consistent with the orientation induced by the choice of normal field 
used in the flux integral on the left. The outward normal was used. Walk the equator with 
the left hand pointing inward, toward the surface S, and the head in the direction of the 
normal. If the hemisphere is set on the xy-plane, the equator is the unit circle centered at the 
origin. The orientation induced by the outward normal means the curve C is traversed in 
the counterclockwise direction. A parametrization that accomplishes this is x (p) = cos p. 
y(p) = sin p. Since dz = 0 in the xy-plane, 


do 


F.Tds—F-.dr— Fi dx + Fody+ F3dz=1 
and the closed line integral on the right reduces to $e 1 do = 27, the circumference of C. 


i$. 
ksd 


STOKES’ THEOREM ON A CLOSED SURFACE If Stokes’ Theorem is applied to a closed 
surface S, the result is always 0. The simplest way to see this is to look at both Stokes’ 
Theorem and the divergence theorem 


[[ iv «mao = $ F -ar [[[ v ^ f| A-Nao 
8 C V $ 


In the divergence theorem take A — V x F, obtaining 


"i V-IV xFldv= [fiv x Fi Nac 
y S 


The divergence of the curl is necessarily zero since curls don't spread. That makes the left 
side of the divergence theorem zero. But with A — V x F, the right side of the divergence 
theorem reads the same as the left side of Stokes" Theorem. Hence, applying the surface 
integral in Stokes’ Theorem to a closed surface S yields zero. 


EXERCISES 21.3-Part A 
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21.4 Green's Theorem 


A1. If F = yi + z?j + x?k, verify the divergence theorem for the region 
bounded by z = y1 — x? — y? and z = 0. 


A2. If F = xyi + yzj + xzk, verify Stokes’ Theorem for the surface 


A3. If C is a simple closed curve and f(x, y, z) and g(x, y, z) are 
scalar-valued functions, apply Stokes’ Theorem to F = V( fg) to 
prove that fo f Vg «dv = — fo gV f - dr. 


EXERCISES 21.3-Part B 


A4. If V is the region internal to the closed surface S, N is the outward 
unit normal field on S, and f (x, y, z) is a scalar-valued function, 
apply the divergence theorem to the vector fF to prove that 

ff, fF-Ndo = fff (fV -E+E Vf)dv. 

AS. For any surface S, the surface area is given by Sf, do. If Sisa 
closed surface with unit outward normal N, prove that f/f, Ndo = 
0. Hint: Let B be a constant vector, consider B - Sh, Ndo = 

Jh B - N do, and apply the divergence theorem. 


B1. If v is the volume internal to the closed surface S, show that 
v = 2 ff, V(r?) - Ndo, where N is the outward unit normal field 
on $, andr = ||xi + yj + zk||. 


In Exercises B2-8, if F = 2y?i + 3z?j + 4xk, verify the divergence 
theorem for the region bounded by the given surfaces. 


B2. z = /1—x? — y! andz =0 

B3. x = +5, y = +3, and z = +1 
B4.c=x?+y2andz=4 BS. z= /x? +y andz=1 
B6. z = x? + y? and z = 3 — 2/x? + y? 

B7. z = 10 — 2x? — 3y? and z = 0 

B8. x? + 4x + y? + 4y = 8, z = 0, and 2x + 3y + 5z = 30 


In Exercises B9-15, if F = 2x?i + 3y?j + 4zk, verify the divergence 
theorem for the region bounded by the given surfaces. 


B9. z = /4— x? — y! andz = 0 
B10. x = £2, y = 3 and z = +4 
B11. z = x? + y? andz = 1 k 
B13. z = x? + y? and z = 3 - 2/2 + y? 

B14. z = 9 — 3x? — 4y? and z = 0 
B15. x? + 6x + y? + 4y = 3, z = 0, and 5x + 3y + 6z = 90 


In Exercises B16—22, if F = 2xyi + 3yzj + 5xzk, verify the divergence 
theorem for the region bounded by the given surfaces. 


B16. z = x? + y? and z = 3 — 2/x? + y? 
3, y = +1. and z 2 45 
B18. z = x? + y? and z = 4 


B19. z = /x? + y? and z = 1 


B21. z = 16 — 4x? — 2y? and z = 0 

B22. x? + y? = 1, y +z = 4, and z = 0. Hint: Project the cylinder 
onto the yz-plane. 

In Exercises B23-29, if F = yzi — x?zj + xy?k, verify the divergence 

theorem for the region bounded by the given surfaces. 

B23. x = +1, y = +2, mdz = +3 

B24. z = x? + y? and z = 3 —2,/x? + y? 

B25. z = x? +y? andz =4 B26. z = 10 — 2x? — 3y? and z = 0 

B27. z = yx? + y? andz = 1 

B28. z = /1—3? — y? and z = 0 

B29. 3x + 5y + 7z = 95 and lying in the first octant. 

In Exercises B30—36, if F = (3x? — 2yz)i + (5yz — 2x)j + 

(7xz + 6y°)k, verify Stokes’ Theorem for the given surface. 


B30. y = V9 — x? — z? B31. x? +z? =9,0<y<l,andy=1 
B32. x? +z? =9,0 < y < 5, andy =5 B33. z= /1—x?— y? 


B34. z =9 — x? — y?,z > 0 

B35. x? + y? =9,0 <z < 1, andz = 1 

B36. x? + y? =9,0 <z < 5, andz =5 

In Exercises B37-41, if F = 3yzi + 5xz?j — 7xy?k, verify Stokes’ 
Theorem for the given surface. 


B37. The surface bounded by the planes x = 0, y = 0, 4x + 5y 4 
6z — 120, and lying in the first octant. 


B38. z=x?+y?,0<72<4 B3%z=/x?+y2,0<z<5 
B40. x + y +z = 4, inside the cylinder x? + y? = 1. 


Green’s Theorem 


Integral Formulas of Green’s Theorem 


Table 21.1 in Section 21.3 lists the integral formulas for the two forms of Green’s Theorem. 
The following two examples illustrate both forms of the theorem. 
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EXAMPLE 21.11 


EXAMPLE 21.12 


Taking the region R as the unit disk in the xy-plane, we verify both forms of Green's Theorem 
for the vector field F = f(x, y)i + g(x, y)j = xi + xyj. The boundary of R is the unit 
circle, parametrized with x(p) = cos p, y(p) = sin p. The curl of F is V x F = yk, and 
the divergence of F is V. F = 1 + x. Except on the line x = —1, V- F # 0. Therefore, the 
question “What is the net divergence within the unit disk?" becomes an interesting question. 


DIVERGENCE FORM OF GREEN’S THEOREM In the divergence form of Green's Theorem, 
V - F is integrated over the region R. Since here R is the unit disk, a change to polar 
coordinates is appropriate, so the double integral on the left becomes 


2z 1 
f f (1 +r cost)rdrdt — x , (21.7) 
o Jo 


The closed line integral on the right, the net flux of F through the boundary of the region 
R, is around a circle. The parametrization of C given previously traces the unit circle in the 
counterclockwise sense, putting the normal N to the right of the tangent vector T. This is 
the positive orientation of the curve C. The line integral around C is then 


27 2x 
f fdy-gdx= | cost rat - f — cost sin? t dt =x (21.8) 
c 0 0 


STOKES’ FORM or GREEN’S THEOREM In Stokes’ form of Green's Theorem, the integrand 
of the double integral on the left is [V x F] -k = y, and in polar coordinates, that integral 


1S 
2x 1 
Í / r?sintdr dt 20 
0 0 


Note that the value of this double integral is not the same as the value of the double integral 
in the divergence form of the theorem. There are two different versions of Green's Theorem. 
One form computes the net divergence of F throughout the region R, and the other computes 
the net curl. There is no reason to believe that these quantities should be the same. What the 
theorem does guarantee, however, is that in each case the corresponding line integral taken 
around the boundary of R will agree with the respective double integral. 

For the Stokes' form, the line integral on the right is the circulation integral, the integral 
of the tangential component of F. Thus, 


2x 2x 
§ fax +edy= f —cost sins dt + | cos? t sint dt = 0 (21.9) 
[e 0 0 


and both sides in Stokes' form of Green's Theorem agree. e 


We verify both forms of Green's Theorem for the field F = f (x, y)i + g(x, y)j = xy^i + 
(x + y)j.and R, the region inside the curves y; = x!/4 and y? = x* but outside the square 
defined by the inequalities $ < x < $ and 4 « y < $. A sketch of the region R appears 
in Figure 21.9. 

A double integral over the region R requires that R be subdivided into four parts, 
Ry, k = 1,..., 4. Each edge of the interior square will require a separate parametrization, 
so each edge is separately labeled. The boundary of R is in two parts. One part consists 
of the curves y; and y», forming the outer boundary. The other part consists of the four 
edges of the square, forming the inner boundary. A positive orientation for the boundary is 
counterclockwise around the outer boundary and clockwise around the inner boundary. All 
these features are shown in Figure 21.9. 


0 02 04 06 O08 1 


FIGURE 21.9 The region for Example 
21.12 
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The curl of F is V x F = (1 — 2xy)k, and the divergence of F is V.F = 1+ y? 
¢ #0. 


«e |l 


DIVERGENCE FORM OF GREEN’S THEOREM 
the double integral on the left is 


3/10 3/5 3/5 p3/10 
Í L ET [. dyes f L, ¢ dydx 
3/10 w 3/10 
. _ 596,901 
+ L LL & dy dx = i999 


the sum of four integrals over the subregions Rz, k = 1,...,4. The line integral around R 
will take six integrals. First, on the outer boundary, the integral 


f fay—gdx = | fdy-gdx+ | fdy—gdx 
yı » 


In the divergence form of Green's Theorem, 


(21.10) 


will be 
1 ] 0 0 
f xax- f ces as | bonas - f (xc-x)dx-3$ (2111) 
0 0 1 1 
Then, on the inner boundary, there are four different line segments Cy, k = 1,...,4, 
parametrized as shown in Table 21.2. The integral $ f dy — g dx is now — E. the 


sum of the four line integrals listed in Table 21.2. The flux through the complete boundary 
pie 348 1089 596,901 ; , i ; 

of R is then 355 — t0000 = 319999; Which agrees with the double integral of the divergence 

of F throughout R. 


C, Parametrization Value 


3/10 3/10 
x 3 3 3. 9 
Ci x =t y = m3 L S Í oar- f (t+ $) dt 40 
3/5 3/5 
3/5 3/5 
1 en WE 3 Bo ae 189 
C5 Xo = 75.92 =t.7 Sts 5 Í at dt Í Odt eT 
3/10 3/10 
3/5 3/5 
PA EEG d 3 - 3 _ 6 
C3 y=, Is = oy Ge SESE f 0 dt f (t+ 2) dt £ 
3/10 3/10 
3/10 3/10 
"UEM QUE: 3. 37 dt — -— d 
C4 Xài— $y—h5itzitXi Í sf dt Í Odt Eon 
3/5 3/5 
TABLE 21.2 Example 21.12: Line integrals in divergence form of Green's Theorem 


STOKES’ FonM or GREEN’S THEOREM For Stokes’ form of Green's Theorem, the double 
integral on the left contains [V x F]-k = 1 — 2xy = p and is 


3/10 3/5 3/5 73/10 
| [ odds f. [. ‘payax+ | L pdydx 
3/10 pn 3/10 
xl 
24. — 4929 
Zu p dy dx = 5595 


the sum of four separate integrals over the subregions Rg, k = 1,..., 4. 


(21.12) 
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The circulation integral around the boundary will contain six separate line integrals. 
Using the parameter x, the line integrals on the separate curves forming the outer boundary 


sum to 
ae 
^ 10 


1 1 0 0 1/4 
Å ? + 
[ vars f 4(x + x*)x? dx | + EL ie 
0 0 1 jp 4x4 


(21.13) 


The four integrals on the inner boundary, listed in Table 21.3, sum to — tan so the net 
: : mE 1071 __ 4929 ; . : 
circulation around the boundary of R is iü — 30000 = 20000: 1 agreement with the value 


of the double integral on the left in Stokes’ form of Green's Theorem. 


y 


A 
N u(x) 
T 
R 
I E 
I A 
MB. =e ah 
| arsi cases RE T | 
| u(x) N ! 
L e 
Ol a b 
FIGURE 21.10 Proof of Green's 


Theorem: simple region, bounding curves 
y= yx) 


-— 
T f R 


0 


FIGURE 21.11 Proof of Green's 
Theorem: simple region, bounding curves 
x — x(y) 


C; $ fdx+gdy Value 

3/10 3/10 
8 

Ci L mare f. Odt -5 
3/5 3/3 
3/5 3/5 

C; Í odi ^ f (t + 3) at i 
3/10 3/10 
3/5 3/5 

C3 f st dt «f Odt ES 
3/0 ^ 3/10 ý 
3/10 3/10 

C4 / odr« f (t + 2) dt - 
3/5 3/5 ` ^ 


TABLE 21.3 Example 21.12: Line integrals in Stokes’ 
form of Green's Theorem 


Proof of Green's Theorem 


An outline of a proof of the divergence form of Green's Theorem for a simple region R 
is given. The region is shown in Figure 21.10 where the boundary curves are written as 
functions of x and Figure 21.11 where the boundary curves are written as functions of y. (A 
nonsimple region would be broken into simple regions where the following analysis would 
be carried out, and the results combined for the larger region.) 

The double integral ff. (fx + gy) dx dy is equivalent to the sum of the iterated integrals 


[^ Li gy dy dx and f* F f, keg f; dx dy. The first iterated integral is guided by Figure 


21.10, where the boundary consists of the two curves y = u;(x) and y = w2(x) and the 
second by Figure 21.11, where the boundary consists of the two curves x = vj(y) and 
X = v2(y). These iterated integrals evaluate, respectively, to 


b b d d 
[ see» - f g(x.uj(x)) dx and [ roya- f fQiQ). y)dy 
j ° i i (21.14) 


Reversing the limits of integration in the integrals containing u(x) and v; (y) gives 


b a d c 
- [ se neas - f g(x,u»(x)dx and | fes ane [rm à 
a b C d 
(21.15) 


which sum to $. f dy — g dx. 
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A1. Use Green's Theorem and an appropriate field F to establish that 
the area inside the simple closed curve C is given by each of the 
integrals f£. x dy = — f, y dx = 1 f, x dy — y dx. 

In Exercises A2—6, let R be the given region. If F = (y? — 3x?)i + 

(x? + 5y?)j: 

(a) Verify the divergence form of Green’s Theorem for the 
region R. 
(b) Verify the Stokes’ form of Green’s Theorem for the region R. 


(c) Use the third integral in Exercise A1 to find the area of R. 


EXERCISES 21.4—Part B 


A2. 
A3. 


A4. 


AS. 
A6. 
AT. 
AS. 


the triangle whose vertices are (0, 0), (5, 3), (1, 4) 
the region bounded by the pu. y = x? and the line y = x +1 


the region inside the ellipse 4 + + Y= 


x 390081, y "—  Ü 27 


= 1, best parametrized as 


the region bounded by the parabolas y = x? and y = 8 — x? 
the region inside x = 2 + sint, y = (2 + sin t) cost, 0 < t < 2x 
Verify the integrals in (21.14). 


Verify the integrals in (21.15). 


B1. 
B2. 
B3. 
B4. 
B5. 
B6. 
B7. 
B8. 
B9. 


Verify the integral in (21.7). 
Verify the line integral in (21.8). 
Verify the line integral in (21.9). 
Verify the results in (21.10). 
Verify the results in (21.11). 
Verify the entries in Table 21.2. 
Verify the results in (21.12). 
Verify the results in (21.13). 
Verify the results in Table 21.3. 


In Exercises B10—21, a region R is given. For each: 


(a) Use the third integral in Exercise A1 to find the area of R. 


(b) Verify both the divergence and Stokes' form of Green's 
Theorem for R and the field F = (x? — 3y?)i + (y? + 5x?)j. 

(c) Verify both the divergence and Stokes' form of Green's 
Theorem for R and the field F = xy?i — (3x? + 2y)j. 


(d) Verify both the divergence and Stokes' form of Green's 
Theorem for R and the field F = (x?y + Di + (xy? 


(e) Verify both the divergence and Stokes' form of Green's 
Theorem for R and the field F = x?y?i — (1 + xy)j. 


(f) Verify both the divergence and Stokes' form of Green's 


Theorem for R and the field F = (x? — 3y)i + (y? + 2x)j. 
B10. the region inside x = cost, y = sin 2t, -5 <t € 5 


B11. the region inside the loop in the curve given by x = t° — 1, 


y=t(t?—-1),-1<t<1 
B12. 
B13. 
B14. 


the region inside the curve defined play by |x| + ly] 2 1 
the region between the two circles x? + y? +y?=4 
= +1, y = +1 and the circle 


2 = 1 and x? 


the region between the square x 
vr+y=4 
B15. the region between the triangle with vertices (1, 1), (—2, 3), 


(4, —5) and the square x = +7, y = +7 


—x+y)j. 


B16. 


B17. 


B18. 


B19. 


B20. 


B21. 


the region between the circle x? + y? = 
g= 135 y = 3 


1 and the square 


the region between the circle x? + y? = 1 and the ellipse 
x —3c0ost, y —Asint, 0 € t < 27 


the region between |x| + |y| = 1 and the ellipse x = 3 cost, 
y = 4sint,0 < t < 27 

the region inside the square x = +5, y = +5 but outside the 
circles (x — 2)? + (y — 2)? = Land (x 4-2) + (y+2)* =1 
the region inside the hypocycloid x = cos? t, y = sin? t, 
0<t<2z 

the region between x = sin t, y = t(1 — t) 
X-axis 


,0 <% < 1, and the 


In Exercises B22-31, use Green's Theorem to evaluate the given line 
integrals. 


B30. 


B31. 


. $.G 
f 


c (3x* — 5y?) dx + x?y? dy; C is the square x = +1, y = +1 


-fel 
pr xy? dx + (2x — 3y) dy; C is the triangle with vertices 
(2, 3), 7, 5), (4, —2) 


x —4y*) dx + x?y dy; C is the circle x? + y? = 1 


x cos(y) dy — y sin(x) dx; C is the triangle with vertices 
. (9, 8) 


C 
(—2, 5), (5, 2) 


. $~ ye’ dy — xe! dx; C is the rectangle x = +1, y = +2 
JC ~ E e E 


. fo xy* dy — x*y dx; C bounds the region enclosed by y = x? and 


yea 


a $. Xy dx + (2y? — x) dx; C is the cardioid r = 1 + cos 
. fe xy? — 


2x?) dx + (x + 5y) dy; C is the first-quadrant loop of 
the rose r — sin 30 

d G2y* + x) dy — (x*y* — y) dx; C is the first-quadrant loop of 
the rose r — sin 20 

f(x? — 4y?) dy — (3xy + x?) dx; C is the outer loop of the 
limaçon r = 1 + 2sin 0 
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B32. Consider the field F = 3L + 35, and recall that one 
hypothesis of Green’s Theorem is that f(x, y) and g(x, y), the 
components of F = fi + gj, have continuous first partial 
derivatives on the region R over which the double integral is 


computed. 
(a) Show graphically that f, is not continuous at (x, y) = (0, 0). 


(b) Show analytically that fy is not continuous at (x, y) = (0, 0) 
by approaching the origin, for example, along the x-axis. 


(c) Show that in any region that does not include the origin, both 
the curl and the divergence of F are zero. 


(d) For this field, verify both Stokes’ and the divergence forms of 
Green's Theorem if C is the circle with radius 1 and with 
center at (2, 2). Thus, the singularity in F is not inside C, 
Green's Theorem applies, and 0 = 0 results for each form of 
the theorem. 


(e) Let C be the unit circle centered at the origin. The singularity 
in the field is now inside the region R and Green's Theorem 
does not apply. Show that for this field, the Stokes’ form of the 
theorem seems to “work,” but the divergence form yields the 
contradictory 0 = 27. 


(f) Let C’ be a small circle with radius a and with center at the 
origin. Let R’ be the region between C and C’. Green’s 
Theorem is valid on R’. The boundary of R’ now consists of C 
and C’ (both oriented in the counterclockwise sense). Hence, 
the following extended forms of Green’s Theorem are 
suggested, namely, f$, F- Tds = f, F -Tds + ffy V -FdA 
and f, F - Nds = f, F- Nds + ff, V x FdA. Verify both 
forms of the extended theorem for this field F. Show that the 
line integral around C' is independent of the value of a. 


Introduction 


In Exercises B33-37, analyze the given field in a manner analogous to the 
discussion in Exercise B32. However, in part (c) the divergence and/or 
the curl may not vanish, and in part (e), the outcomes for the two forms 
of Green's theorem may not be the same as in Exercise 68. 


X 


Ni a 
x2 + y? x? +y? 
B34. F NE T 
a = 1d 
(x2 + y2)3/2 (x2 + ype 
y x 
B35. F = i+ j 
Ga nm t Fy 
y X 
B36. F — : i+ j 
vx? + y? Vx? + y? 
B37. F : d 


/x? + y * J/x? + y 

B38. If F is singular at points P,, k = 1,..., N, inside C, then each 
singularity is surrounded by small circles Ck, k = 1,..., N, 
respectively, so that Green's Theorem extends to either 
f; F-Tds = Y, fo, E -Tds + ff, V -FdAor 
f, F -Nds = Yu. fo, F -Nds + ffy V x FdA. Of course, R' 
is that portion of the interior of C exclusive of the C; and their 
interiors. 


(a) Apply this formalism to the field F = xi + yj, where C is a 
circle with center at the origin and radius 5, whereas C, and 
C are circles of radius 1, centered at (2, 0) and (0, 2), 


respectively. 
(b) Apply this formalism to the same field, but take C to be the 
square x = +4, y = +4, and take C, and C; as squares with 


side 1 and with centers at (2, 0) and (0, 2), respectively. 


Conservative, Solenoidal, and Irrotational Fields 


A conservative force was initially defined as F = —Vu, that is, as a gradient of a scalar 
potential u(x, y, z). Moreover, it was intimated that there are other, equivalent definitions of 
a conservative force. These alternative definitions, and their consequences and connections, 
listed in Table 21.4, are the substance of this section. We will assume the domains for 
the functions in Table 21.4 are simply connected, that is, have no “holes,” and that the 
functions themselves have continuous partial derivatives. Exercise A10 shows the difficulty 
one encounters if the domain is not simply connected. 


Conservative and Irrotational Fields—A Discussion of Theorem 21.1 


Theorem 21.1 is stated in Section 20.4 where we showed that for F conservative, curl(F) — 
— curl(grad u) = 0 and created the mnemonic "gradients don’t twist" to capture this identity. 
To prove the converse, we have to exhibit the scalar potential for the irrotational field F. We 
provide two constructive recipes for this. 


Theorem 21.1 
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F is conservative & F is irrotational 


Theorem 21.2 
Theorem 21.3 
Theorem 21.4 
Theorem 21.5 
Theorem 21.6 


F is conservative & F - dr exact 

F is conservative & £, F - dr = 0 for all closed paths C 

F is conservative = f F - dr independent of path from A to B 

The conservative F is also solenoidal = F has harmonic scalar potential 


F is solenoidal €&» F = V x A for some vector A, the vector potential for F 


TABLE 21.4 Characterizations and properties of conservative forces 


EXAMPLE 21.13 


Recipe1 IfF= f(x,y,z)i 4- gi. y, z2)j - h(x, y, zk, its curl is V x F = (hy — g,)i+ 
(fz — hj + (gx — fy)k. The working hypothesis is that the curl of F is the zero vec- 
tor, so hy = 8z, hx = f., and g, = fy. Next, define the three integrals J > f (t. b. c) dt, 
E g(x.t, c) dt, and [i h(x, y, t) dt along straight lines parallel to the axes. The first in- 
tegral is from (a, b, c) to (x, b, c) along a line parallel to the x-axis. The second integral 
is from (x, b, c) to (x, y, c) along a line parallel to the y-axis. The third integral is from 
(x, y, c) to (x, y, z) along a line parallel to the z-axis. Define U (x, y, z) to be the sum of 
these three integrals and u(x, y, z) = —U (x, y, z). Thus, 


y = 


l g(x,t,c)dt + [ h(x, y, t) dt 
(21.16) 


works because —u, = Uy = f, —uy = Uy = g, —u; = U, = h follow from (21.16) by di- 
rect computation, provided A, = gz, hx = fz, and g, = fy, from V x F = 0, are used. 
Indeed, U; = h(x, y, z) is immediate, and 


—u(x,y,z) —-U(x,yz)-— I f (t. b, c) dt «f 


b 


Uy = g(x, yc) + / . hy(x, y,t) dt = g(x, y, c) + f «e. y,t)dt = g(x,y.z 
follows. Finally, we obtain 


y 


Ur = fO) +f 


gx (x, t, c) dt + 3 hy(x, y, t) dt 
b 


c 


y Z 
= f(x,b,c)+ fos rnodrs [ ERM TYE = F OW Ya Z) 
b c 


The curl of the vector 
F = (12xy + yz)i + (6x? + xz)j + xyk (21.17) 


is zero. Using (21.16), construct 


—u =U =| (12th + bc) dt + l (6x? + xc) dt + f xyar 
a b c (21.18) 
= —6a?b — abc + 6x?y + xyz 
Setting (a, b, c) = (0,0,0) gives u = —(6x?y + xyz), since the terms in a, b, and c 


constitute an additive constant, and the scalar potential is determined up to an additive 
constant by any recipe. Verification that — Vu recovers F is left to Exercise A2. $ 
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EXAMPLE 21.14 


EXAMPLE 21.15 


Recipe 2. The radius-vector form of the line connecting (a, b, c) with (x, y, z) is given 
by r(t), where 


RO = ai + bj + ck (21.192) 
R=vxi+ yj + zk (21.19b) 
r(t) = RO+7(R— R0) = [a + t(x — a)li + [b + t(y — b)]j + [c + t(z — c)]k (21.19c) 


The parameter on the line is /, and the segment is traced as f varies in the interval [0, 1]. In 
fact, r(0) = RO and r(1) = R. Then, the potential function is 


1 
—u(x, y, x) =UG,y,z) = / F(r(t)) -r'dt 
0 


For the field (21.17), with (a, b, c) = (0,0, 0), we have r(t) = tR, r' = R, and F(r(t)) = 
ÜF(x, y, z). Hence, we again find 


] 
—u=U= Í (18x?y + 3xyz) dt = 6x? y + xyz (21.20) 


0 ae 


CONSERVATIVE FIELDS, AND EXACT DIFFERENTIALS—A DISCUSSION OF THEOREM 21.2 
Given the scalar function f(x, y, z), the exact or total differential df is defined by 


df = fedx + fydyt+ f: dz 


where the subscripts denote partial derivatives. The symbols dx, dy, and dz denote “incre- 
ments" and can just as well be expressed as dx = x — xo, dy = y — yo, and dz = z — zo. If 
the partial derivatives are evaluated at a point, then df = a(x — xo) + b(y — yo) - c(z — zo). 
which is just a linearization of the function f. 

But given three expressions A(x, y, z), B(x, y, z), and C (x, y, z), interpreting them as 
the partial derivatives of some function f(x, y, z) isn't necessarily possible. The equations 
fe = A(x, y.z), fy = B(x. y. z), and f; = C(x, y, z) just may not have a solution for 
some function f(x, y, z). Thus, the form df = A dx + B dy + C dz may or may not be 
the total differential of some function f(x, y, z). If it is, df is called an exact (or total) 
differential. This definition generalizes to three dimensions, the notion of exactness first 
seen in Section 3.3. 


Given f (x, y, z) = x sin 2, the total differential is 


y x cos(*) x cos(2)y 
df — sin (z) dx + — dy —— dz 


7 7 E 


4 & & 


Note that the same expression can be constructed from 


- Ed = 
& 4 


fy xcos(*), x cos(*)y 
Vf =sin( i+ - 


& 


dotted with dr = dxi + dyj + dzk. e 


The example shows why an arbitrary declaration of df may not be a total differential. 
There may not be a function whose gradient consists of the three components A, B, C. 
Thus, the problem of determining if a differential is exact is the same as determining if a 
force field comes from a potential by a gradient operation. It's the same problem. So, there 
is clearly a connection between a conservative force field F = Ai + Bj + Ck and finding a 
scalar potential f (x, y, z) for which —grad( f) = F. 


B 


FIGURE 21.12 A closed loop constructed 
from two paths connecting A and B 
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Theorem 21.2 in Table 21.4 characterizes as conservative, fields F = Ai+ Bj + Ck 
for which F - dr is an exact or total) differential df. To see why this is so, assume F is 
conservative so that F = —Vu = VU. Then, 


F-dr=Adx+Bdy+Cdz=U, dx + Uy dy + U,dz 


is the (total) differential dU. On the other hand, if A dx + B dy + C dz is known to be the 
exact differential df, then F = Ai + Bj + Ck is a gradient vector and hence, A = fi, 
B= fy, C = f, so F = grad( f) and is conservative. 


Conservative Fields, and Work on Closed Paths—A Discussion 
of Theorem 21.3 


A field F for which $c F - dr, the work done by the field as a closed path is traversed, 
vanishes for every closed path C is said to have the closed-loop property. Theorem 21.3 
in Table 21.4 characterizes conservative fields as exactly those that have the closed-loop 
property. To see this, suppose F is conservative. Then, F - dr is an exact differential, df, 
and 


F-dr=Adx+Bdy+Cdz= fedx + fydy + f,dz =df 


The work integral then evaluates to f, F - dr = s df = i = f (P) — f (Po) = 0. 


On the other hand, if F has the closed-loop property, let C be any closed curve and let 
S be any open capping surface with C as its boundary. Invoke Stokes’ Theorem to obtain 
[K[V x F] -Ndo = f. F dr = 0 for every possible closed path C. Since the integral 
ff, [IV x F] - N do vanishes for arbitrary closed curves C and their equally arbitrary capping 
surfaces S, the conclusion V x F — 0 follows, thereby making F irrotational and, hence, 
conservative. 


Conservative Fields, and Path Independence—A Discussion 
of Theorem 21.4 


If the work done by a field F is independent of which path connects the starting and ending 
points, then the field is said to be path independent. 

Theorem 21.4 in Table 21.4 characterizes conservative fields as those that are path 
independent. To see this, suppose F is conservative so that F - dr is an exact differential df. 
Thus, the work integral becomes 


P Pi 
Work = if F-dr= / df = f(Pi) — f(Po) 

Po Po 
a number that depends only on the points Pp and P; and not on the path connecting them. 
On the other hand, consider Figure 21.12, which depicts a closed loop composed from 
two paths connecting points A and B. The left path is traversed is from A to B in the 
counterclockwise sense, and the right path is traversed from A to B in the clockwise sense. 
Let the value of the work integral on the left path be u, and the value on the right path, 
v. If the right path is traversed in the counterclockwise sense, the work integral is then 
negated to —v. The assumption of path independence is captured in the equality u = v or 
u — v = 0. The complete counterclockwise loop from A back to A is a closed path along 
which the work integral is the sum of the two values u + (—v) = u — v = 0. Hence, path 
independence is equivalent to the work vanishing on any closed loop, and by Theorem 21.3, 

F is conservative. 
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EXAMPLE 21.16 


Harmonic 


Solenoidal 


Conservative 


Not conservative 


FIGURE 21.13 Venn diagram showing 
relationships between fields for which the 
potential function is harmonic (H) and 
fields that are conservative (C), solenoidal 
(S), and nonconservative (N) 


EXAMPLE 21.17 


EXAMPLE 21.18 


A path-dependentfield The field F = fi+ gj = (x? — y)i + (y? +2x)j is one for which 
the work integral is not path independent. Since V x F = 3k + 0, F is not conservative. 
If F were conservative, the work integral would be path independent, but we will show the 
work integral for F to depend on the curve connecting starting and ending points. This will 
be demonstrated by computing the work integral for at least two different paths connecting 
(0, 0), with (1, 1). First, let the path be the line y — x and compute 


1 1 
, fdx+edy= | (x? — x) dx 4 { (x? +2x)dx = = (21.21) 
B 


along this path. Next, take the path to be the line segments x = t, y = 0, then x = 1, y = t. 
The work along this second path is 


1 1 1 
[Pasa odr+ f (0 +2)dt=% (21.22) 
0 0 0 
These two paths produced different amounts of work. The field F is not irrotational, is not 
conservative, and is not path independent. $ 


Conservative, Solenoidal Fields, and Harmonic Potentials—A 
Discussion of Theorem 21.5 


A function u(x, y, z) with continuous second partial derivatives is said to be harmonic if it 
satisfies Laplace's equation 


vy = Uxxy +Uyy d uz —0 (21.23) 


Some fields F are conservative, some are solenoidal, some are both conservative and 
solenoidal, and the rest are neither conservative nor solenoidal. The relationships are cap- 
tured graphically in the Venn diagram in Figure 21.13. The circle C represents all conser- 
vative forces, whereas the ellipse S represents all solenoidal forces. In the overlap, H, are 
forces that are both conservative and solenoidal. These forces are conservative forces with 
a harmonic scalar potential. The region N represents the remaining forces that are neither 
conservative nor solenoidal. 

These relationships are captured analytically in Theorem 21.5 in Table 21.4. In par- 
ticular, the forces in region H in Figure 21.13 are those conservative forces for which the 
scalar potential u satisfies Laplace's equation (21.23). 

To see why this is so, let F be conservative so that F — — grad(u) for some scalar 
function u(x, y, z). If Fis also solenoidal (divergence free), then div(F) = — diy (grad u) = 
0. But the divergence of the gradient is the laplacian, so the scalar potential u satisfies 
V?u = 0, making it harmonic. On the other hand, if u is harmonic, then div F = — V?u = 0, 
so F is solenoidal. 


The function u — sin x cosh y is harmonic because 
P . . 
V^u = Ux, + uy, = — sin x cosh y + sin x cosh y = 0 


Hence, the field F = —Vu = — cos x cosh yi — sin x sinh yj must be conservative, since it 
arises from a scalar potential as a gradient. This field is also solenoidal since the divergence 


V. F = 0. Thus, fields with a harmonic scalar potential are both conservative and solenoidal. 
D 


There are conservative forces for which the scalar potential function is not harmonic. In 
fact, it is more likely that the scalar potential is not harmonic. Just start with an arbitrary 
scalar function u(x, y, z) and set F = —Vu. It is unlikely that F is divergence-free since it 
is unlikely that the function u(x, y, z) will satisfy Laplace's equation. 


EXAMPLE 21.19 


EXAMPLE 21.20 
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Consider the following scalar function u(x, y, z) = x sin ^, and compute 


F = -Vu = — sin Ži — Č cos Žj + = cos 2k (21.24) 


S E » < 


The field F just created is conservative because it was obtained as a gradient. However, 


V-F=-Vu=z"4 (so? + 2) sin £ — 2xyz cos z) z0 (21.25) 


S < 


so F is not solenoidal and u(x, y, z) is not harmonic. The field F is conservative but not 
solenoidal. The scalar potential u(x, y, z) is not harmonic. E 


Solenoidal Fields and the Vector Potential —A Discussion 
of Theorem 21.6 
If the field F arises from the field A as its curl, that is, if F = V x A, then A is called the 


vector potential for F. Any vector F — V x A is necessarily solenoidal as we saw from the 
vector identity div(curl A) — 0 (curls don't spread) in Section 20.4. 


^ 


The field A = (5 — xy)i — yzj is the vector potential for 
F=VxA= yi+zj+xk (21.26) 


S. 
Sd 


and a computation verifies that V - sF = 0. 


Theorem 21.6 in Table 21.4 characterizes solenoidal fields with continuous partial 
derivatives as those that arise as the curl of a vector potential. To see why this is so, we have 
only to exhibit a recipe for finding the vector potential for a solenoidal field F. (We have 
already verified the vector identity div (curl A) = 0.) 


RecipE3 IfF = u(x, y, z)i+ v(x, y,z)j + w(x, y, z)k is a solenoidal vector, then a vec- 
tor potential for it is 


0 
A= r w(t, y, z) dt — à u(a, y, t) dt (21.27) 
-f v(t, y,z)dt 
Indeed, computing the curl of (21.27) we get 
F — curl(A) = Ea y,z)— f (vy (t, y, z) + w(t, y, z)) ar| i 


+ u(x, y, z)j + w(x, y, 2k 


From V -F = u, + v, + w, = 0, obtain —v,(t, y, z) — wz(t, y, z) = ux(t, y, z), so the 
integral in the first component of curl (A) reduces to u(x, y, z) — u(a, y, z) andcurl(A) = F. 


With (a, b, c) = (0, 0, 0), (21.27) gives the vector potential for (21.26), a solenoidal field, 


as 
re (f rar- f var)i- f zdtk = (+ - yz) j- xzk (21.28) 
0 0 0 2 $, 


v 
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Recipe 4 An alternate recipe for constructing a vector potential of F is A = bs tF x dr, 
where RO, R, and r(t) are given by (21.19a), (21.19b), and (21.19c), respectively, and 
dr is given by (R — RO) dt. The vector field F = u(x, y, z)i + v(x, y, 2j + w(x, y, z)k, 
evaluated along this line segment, becomes F(r(t)). 

Verification of this second recipe in the general case is computationally intensive. The 
reader is referred to the accompanying Maple worksheet or to [22] for the details. 


EXAMPLE 21.21 For the solenoidal field (21.26) and (a, b, c) = (0, 0, 0), 


Wile 


1 
A= Í PI — xy)i + (x? — y2)j + 6? — xoklat = 
0 


However, (21.27) gave (21.28), a different vector potential. The vector potential is not 
unique, but any two differ by the gradient of a scalar. Indeed, 


A, - A = —i(2 — xy)i + (x? — 4yz)j — 10? + 2xz)k (21.29) 
is the gradient of 1(x?y — 2xz? — 2y?z). ES 


EXERCISES 21.5—Part A 


A1. Show that V x F = 0 for F given in (21.17). 
A2. Show that — Vu — F for u given by (21.18) and F in (21.17). 


A9. Show V - F = 0 for F in Example 21.19. 
A10. Let F = — 75i + aii. 


A3. Verify the integration in (21.20). 


. Verify the line integral in (21.21). 

. Verify the results in (21.22). 

. In Example 21.17, show that V - F — 0. 

. For u given in Example 21.18, verify F = —Vu as in (21.24). 
. Verify (21.25) in Example 21.18. 


EXERCISES 21.5—Part B 


(a) Show that for (x, y) # (0, 0), F is conservative. 


(b) Show that f. F - dr = 2x #0 for C, the unit circle centered 
at the origin. 


(c) Explain why this conservative field does not have the 
closed-loop property and therefore, is, not path independent. 


B1. 


Verify that u(x, y, z) = į (x°y — 2xz? — 2y?z) is a scalar 
potential for (21.29). 


Exercises B2-11 give a potential function u(x, y, z) and a point P = 


(a, b, 


c). In each: 


(a) Obtain the conservative field F = —Vu. 

(b) Obtain du, the total differential of u. 

(c) Show that F - dr is exact by showing it is precisely —du. 
(d) Show that V x F — 0. 

(e) Reconstruct the potential u(x, y, z) from F using Recipe 1. 
(f) Reconstruct the potential v(x, y, z) from F using Recipe 2. 
(g) Show that u(x, y, z) and v(x, y, z) differ by a constant. 


(h) Compare u and v to the output of an appropriate command in 
your favorite computer algebra system. 


(i) Show rn F-dr = f. F - dr, where C; is the straight line 
from (0, 0, 0) to P — (a, b, c) and C; is the segmented linear 
path from (0, 0, 0) to (a, 0, 0) to (a, b, 0) to (a, b. c). 


(j) Compute fe F - dr, where C is the closed space curve 
x(t) — cost, y(t) = sint, z(t) = sint, 0 € t x 2x. Of 
course, the value is zero since F is conservative. 


(k) Compute $, F - dr, where C is the closed space curve 
x(t) = cost, y(t) = sint, z(t) = sin2t,0 < t < 27. Again, 
the value is zero since F is conservative. 

(1) Compute $c F - dr, where C is the closed space curve 
consisting of x(t) =P +t — 1, y(t) =P + —1 —3, 
z(t) = ť +2, —1 < t < 1, and the straight line connecting 
the initial and terminal points. Again, the value is zero since 
F is conservative. 


B2. u(x, y, z) = 82 — xy’, P = (—4, 8, —7) 
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B3. u(x, y, z) = A2 — 6xz — 5y°, P = (8, 7, —7) 
B4. u(x, y, z) = 22? + 6y + 5xz, P = (—8,5,6) 
B5. u(x, y, z) = 6x?z — 5xy — 2y), P = (—1, —9, —6) 
B6. u(x, y, z) = 5yz — 622 — 5x, P = (8,7, —6) 
B7. u(x, y, z) = 2x?y — yz + 322, P = (—4, 8, 7) 
B8. u(x, y, z) = 5yz — 62 — 8x, P = (8.4, —6) 
B9. u(x, y, z) = x?z — 9y?z + 3x, P = (—4, 8, —2) 
B10. u(x, y, Z) = 8x?z — 8xyz, P = (—2, —6, 3) 
B11. u(x, y,z) = 3y?z + 5xz — 9x? y, P = (-8, 4, 6) 


For each vector field F given in Exercises B12-21: 


(a) Show F is irrotational, so that F is thereby conservative. 
(b) Use Recipe 1 to find u(x, y. 
(c) Use Recipe 2 to find v(x, y, 
(d) Show that u(x, y, 


(e) Compare u and v to the output of an appropriate command in 
your favorite computer algebra system. 


(f) Show that F is solenoidal. 
(g) Use Recipe 3 to find A, a vector potential for F. 


z), a scalar potential for F. 
z), a scalar potential for F. 


z) and v(x, y, z) differ by a constant. 


(h) Use a computer algebra system to find B, a vector potential 


for F. 

(i) Show that A and B differ by a gradient vector. 
B12. F = (—5y — 9z)i — (8z + 5x)j + (9 — 8y — 9x)k 
B13. F = 2zi + (5z — 9)j+ (Sy + 2x + 2)k 
B14. F = (yz + x)i + xzj + (xy — z)k 
B15. F = (4yz + 3)i + (4xz — 8z — 8)j + (4xy — 8y)k 
B16. F = (8z — y)i + Cz — x)j + Cy + 8x)k 
B17. F = (3y — 7yz)i + (x — 7xz + 9)j — 7xyk 
B18. F = (9y + 5yz — 5)i + (9x + 5xz + 7)j + 5xyk 
B19. F = (Sy + 16xy)i + (8x? — 8z? + 5x)j — 16yzk 
B20. F = —8xyi + (4z? — 4x? + 6z)j + (6y + 4 + 8yz)k 
B21. F = (9yz + x)i + 9xzj + (9xy — z + 8)k 


In Exercises B22-36, determine if the given expression is an exact dif- 
ferential. (Write du as F - dr and examine V x F.) If du is not exact, 
find C, and C5, two paths connecting (0, 0, 0) with (1, 1, 1), for which 
Íe , du x Je du. If du is exact, find u(x, y, z) using a computer algebra 
system by Recipe 1 and by Recipe 2. Show that the resulting functions 
differ by a constant, and verify that (Vu) «dr = du. 


B22. du = —4xz dx + (1djyz 4-722) dy + (Ty? + Myz — 2x? — 62?) dz 
B23. du = (3yz--12xy —2xz) dx-- (3xz4-6x?) dy--(18z —3xy —x?) dz 
B24. du = (3 — l6xy) dx — (16yz + 8x7) dy — (8y? + 8z) dz 
B25. du = (5y? — Ayz + I2xy) dx + (Oxy — 14yz — 4xz + 


6x?) dy — (Ty? + Axy) dz 


B26. du = (1 — 12xy + 10xz) dx — 6x*dy + 5x? dz 
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B27. du = (6x+y? +6yz—12xz)dx+(2xy+6xz \dy+(6xy—6x?) dz 
B28. du = (Az -2y? — 8xz) dx + (2yz +4xy) dy + (y? +4x — 4x?) dz 
B29. du = (72? — Ty) dx — (7x + 24y?) dy + (14xz — 12z) dz 

B30. du = (4z? — 2yz) dx — (18yz + 2xz) dy + (8xz — 9y? — 2xy) dz 
B31. du = (8z — 2y?) dx + (18y? — 4xy) dy + (16z — 8x) dz 

B32. du = (4z + y) dx + (7 — 2z + x) dy + (4x — 2y) dz 

B33. du = (2z — 2xy) dx + (8 — x?) dy + (18z — 2x) dz 

B34. du = (18x? + 10xz) dx — (6 + 125?) dy + 5x? dz 

B35. du = (21x? + 10xy) dx + (5x? — 8 — 5z) dy — 5y dz 

B36. du = 12xy dx + (5z? — 6x? — 3z) dy + (10yz — 3y) dz 


Let u(x, y, z) be harmonic inside and on S, a sphere with radius a and 
center at P = (Xo, yo. Zo). Then it can be shown (see, e.g., [77, p. 593]) 
that u(Xo, Yo, Zo) = ga Jf u(x, y. z) do. In Exercises B37-39: 

(a) Verify that the given function is harmonic. 

(b) At the given point P, verify the mean-value property. 

B37. u(x, y, z) = 3yz — 6? + 9yz? + 9x?y, P = (2, —3, 5) 

B38. u(x, y, z) = —9y? + 9z? + 3xz — 3xy?, P = (1,3, 7) 

B39. u(x, y, z) = 6xz + xyz + y?z — x?z, P = (—5, 8, 2) 

B40. Let u(x, y, z) be harmonic on R, a closed, bounded region with 
piecewise smooth boundary S, oriented by the outward unit 
normal field N. The directional derivative of u, in the direction of 
N, evaluated on S is called the normal derivative and is generally 


denoted by | 94- thus, (Vu) - N = oe . Use the divergence theorem 
to show that Th 2u u do =0. 


In Exercises B41—44, verify the given function is harmonic, and show 
Jf, = do — 0 for S: 


(a) The unit sphere centered at the origin. 


(b) A cube with side 2a and center at the origin. 


(c) The closed cylinder x? + y? = 1, z = +1. 


B41. u(x, y, z) = Ty? — xyz - 21x?y 
B42. u(x, y, z) = —3xz? + 3xy? 

B43. u(x, y, z) = —4xy + 72 — _ 
B44. u(x, y, z) = 4x? — 4y? - 2yz 


Let u(x, y, z) beharmonic on A, aclosed, bounded region with piecewise 
smooth boundary S, oriented by the outward unit normal field N. Then 
fff, Vul? dv = ff u% do, where | Vu| = (Vu) + (Vu), S can be es- 


on 


tablished using Green’s First Identity, to be seen in Section 23.4. In Ex- 
ercises B45—47, verify the given function is harmonic, and then verify 
ST fe | I Vul? dv = Sf, u% do for R: 

(a) The unit sphere centered at the origin. 

(b) A cube with side 2a and center at the origin. 

(c) The closed cylinder x? + y? = 1, z = +1. 
B45. u(x, y, z) = —9xyz + 3xz? — 3xy? 
B46. u(x, y, z) =2xy—6yz—9 B47. u(x, y, z) = 6xy —2xz + Oy 
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FIGURE 21.14 Integral formula for 
gradient: cube with outward normals 


Integral Equivalents of div, grad, and curl 


The Tableau 


Let & represent any of the three operations: “ordinary operator application,” -, and x. Let 
do be the element of surface area on the closed surface $ bounding the three-dimensional 
region AV. Let N be the unit outward normal on this closed surface S. Then the operators 
div, grad, and curl can be expressed as integrals according to the template 


. ffNG v dc 
Vev= im ————— 
AV—O0 AV 
As the operator ® ranges through its three values, the quantity V it acts on changes from 
scalar to vector, but that still gives only three values for the formula. These three values 
correspond to expressions for the divergence, gradient, and curl shown in Table 21.5. 


{N@Fd {N-Fd '(F-Nd 
div V.F lim JI ere = lim JJ T = lim SÍF: Ndo 
AV—O0 AV AV—O0 AV AV—0 AV 
SNS fd [Nf d f[fNd 
grad — Vf LLLI NEL Eu 
AV—0 AV ^V-0 AV Av>=0 AV 
TN@Fd {Nx Fd 'l'F x Nd 
curl VxF lim INO Fdo = lim LN GE de — lim „IEX Nda 
AV>0 AV AV>0 AV AV—0 AV 


TABLE 21.5 Integral equivalents of divergence, gradient, and curl 


DiveRGENCE The integral formula for the divergence is the easiest of the three to explain. 
In Section 20.1 the divergence for a planar vector field was shown to be the limiting value of 
the "flux per unit area" for flux through the boundary of a plane curve. The generalization 
of this result to fields in space is precisely the first formula in Table 21.5. 

Since the integrand of the surface integral is F - N, the integral computes the flux of 
F through the surface S. The divergence of F is then the limiting ratio of the flux through 
S divided by the volume enclosed. The intuition developed in the planar case is simply 
extended by this new formula. 


GRADIENT Surprisingly, the most challenging formula for which to provide insight is the 
gradient formula. However, if the surface § is taken as a cube of side 2h, centered at the 
point (a, b, c), the following computations show why the right side of the middle formula 
in Table 21.5 produces the partial derivatives found in the gradient vector. 

In Figure 21.14, a representative cube is seen, along with the unit normals N on each 
face. These normals are just the unit basis vectors i, j, k, and their negatives. On the face 
to which N = i is attached, (x, y, z) = (a +h, y. z); while on the opposite face where 
N = —i is attached, (x, y, z) = (a — h, y, z). Hence, fN on these two faces contributes 
f(a +h, y, z) — f(a — h, y, z) to the surface integral. This contribution, made in the first 
component of the vector of surface integrals, is 


ch b+h 
/ [f (a -h, y,z) — fla—h, y, z)]dy dz 
o—h b—h 


where the integration in the variables y and z are over the two faces in question. By the 
Mean Value theorem for integrals [91, p. 383], there is a point (y, z) for which the integral 


FIGURE 21.15 The vector N x F is 
orthogonal to N, rotated a quarter-turn to 


the left of Fin 


EXAMPLE 21.22 


21.6 Integral Equivalents of div, grad, and curl 515 


is equal to 
b+h ch 
[f (a -h, y, z) - f(a—h, y. z)] I. dy dz 
b—h 
The double integral is (2A)?, the surface area of one of the faces, so this pair of faces 
contributes 
4[f(a +h, y, z) - fía—h,y, aye? 
Dividing this component by the volume in the cube yields 
f(ath, y,z) —f(a—-h,y,z) 
2h 
recognized as a form of the difference quotient for the derivative f,. Similar calculations 


applied to the other two pairs of faces yield f, and f, for the remaining two components, 
respectively. (See Exercises Al and A2.) 


Curt In Section 20.2, the curl of a planar vector field was extracted from the limiting 
ratio of the field’s circulation around a closed curve to the area enclosed by the curve. The 
circulation around a curve is the net tangential component of the field. 

The surface integral for the curl in the third formula of Table 21.5 is actually the 
generalization of the circulation around a closed curve. The cross-product in the surface 
integral yields a vector in the plane tangent to the surface S, a vector equal in length to 
the component of F orthogonal to N. However, N x F is not simply the projection of the 
component of F normal to N but is rotated a quarter-turn to the left of that projection. 

To illustrate these remarks, consider a surface S aligned so that N = k, and take F = 
ui + vj + wk. From elementary multivariable calculus, the projection of F onto N, since N 
is a unit vector, is given by Fy = (F - N)N = wk, and the component of F orthogonal to N 
is given by the difference F ¿y = F — Fy = ui + vj. The cross-product, N x F = —vi+ uj, 
is in the plane orthogonal to N, here, the xy-plane. However, N x F is not the vector F |y, 
the component of F orthogonal to N, projected to the tangent plane, but is that projection 
rotated a quarter-turn to the left. 

Figure 21.15 shows the relationships between the five vectors N, F, Fy, Fin, and N x F 
when F = i + 2j + 3k. 


Divergence Using F = xi--2yj 4-3zk and S, the surface of a sphere of radius p centered 
at the origin, let's verify the divergence formula in Table 21.5, computing V - F = 6 at the 
origin. 

Describe S by the equation x? + y? = p?, so the enclosed volume is V = imp. 
A unit (outward) normal field on S is N = lod + yj + zk), Aap € is explicitly given 


x?4-2y?--3z? 
F-Ndo = wll iet dxdy = 


& 


(21.30) 


Consequently, the surface integral f f F - Ndo, where R,, is the unit disk in the xy-plane, 
is the sum of two integrals, both the same, so changing to polar coordinates we have 


P 3p? — r2(1 
[^ Í E d M ruit es lag (21.31) 


Vp -=r 


which, divided by V — imp, yields 6. kd 
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EXAMPLE 21.23 


EXAMPLE 21.24 


Gradient T the scalar function f(x, y, z) =x +2y + 3z and the same surface S as 
in Example 21.22, let's use the second formula in Table 21.5 to obtain V f = i+ 2j + 3k 
at the origin. 

The integrand of the surface integral in the formula for the gradient is £N do, with N 
being the unit (outward) normal vector. This is interpreted to mean three surface integrals, 
one for each component of the vector N. The quantities N — ;Gi + yj + zk) and do = 
id dx dy were obtained in Example 21.22. Each component of 

r 91) = 

fNdo = Ert oi + yj + zk) dx dy (21.32) 
will contain two surface integrals, one for the upper hemisphere where z = 
and one for the lower hemisphere where z = —y p? — x? — y?. For |z| in the denominator 
of do the sign will not matter. But where z appears to an odd power in the numerator, the 
sign will indeed matter. On the upper hemisphere, z > 0, so i= = 1, and fN do is the 
vector on the left in (21.33); on the lower hemisphere, z < 0, so a = —l, and fN do is 
the vector on the right in (21.33) 


(x + 2y + 34/ p? — x? — 32)x (x + 2y — 3y p? — x? — y?)x 


(x +2y -3// p? — x? — y2)y | dxdy (x +2y — 3/ p? — x? — y2)y | dxdy 


(21.33) 


The domain of integration in each case is R,,, a disk of radius p in the xy-plane. Hence, 
adding each pair of integrals gives the integrand on the left in (21.34). Conversion to polar 
coordinates gives the vector in the middle in (21.34), and evaluating the integrals gives the 
vector on the right in (21.34) 


p 
362) MEL T 
P- /p? — r? 4p? 
p 
p X *t2y) | dxdy r E „cost sint +2sin*1 Arat 8p? 
0 Vp —r? — 72 
2n 4p? 
[ f 6r / p? — r? dr dt 
o Jo 
(21.34) 


When divided by V — imp, the vector on the right in (21.34) becomes V f = i+ 2j+ 3k. 


$ 
$ 


Curl Using the vector field F = zi + xj + yk and the same surface S as in Examples 21.22 
and 21.23, let's use the third formula in Table 21.5 to compute V x F = i +j + k at the 
origin. 

The integrand needed is N x F do. The quantities N — Ld + yj + zk) and do = f 
have already been obtained. As in Example 21.23, the integrand is a vector, so a surface 
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integral for each component of this vector must be formulated and evaluated. Thus, 


N x Fdo = —[(y” — xzi + (z? — xy)j + (x? — yz)k] dx dy (21.35) 


on the upper hemisphere where z is positive and i = 1, becomes the vector on the left in 
(21.36); while on the lower hemisphere, where z is negative and a = —1, it becomes the 
vector on the right in 


(21.36) 


The upper and lower hemispheres both project to R,,, a disk of radius p in the xy-plane. 
Each component of the integrand in the surface integral consists of two terms, one for the 
upper hemisphere and one for the lower. Adding the integrands yields the vector on the left 
in (21.37). Conversion to polar coordinates leads to the vector in the middle in (21.37), the 
value of which is given by the vector on the right in 


Z r "ü 
0 Jo p-r 4.3 
2 379 
2z p 2 2 1 sf sinf 
dx dy i i a NOE = M dr dt np? 
o Jo Vp? —r? : 
3 
ax [^  cogt 37? 
i Í a r dr dt 
o Jo Vp2?—r? J 
(21.37) 
When divided by volume, V = imp), the vector on the right in (21.37) becomes V x F = 
i+j-+k. 4 
Derivations 


DIVERGENCE To obtain the first formula in Table 21.5, start with the divergence theorem 


[I] v 62 [fe Ne 


Invoke the Mean Value theorem for integrals by which, for F sufficiently continuous, there 
exists some point Q in the region of integration for which the equality 


v Fio fJ] dv= |f ¥-Nao 
AV S 


holds. The volume integral on the left now evaluates to the volume inside S, leading to 


I 
IV -Flo = zy [f -Ndo 
S 
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In the limit as the surface S shrinks to point P, the point Q must approach P and the formula 
[V - F]p = limao [SF - Ndo/AV is obtained. 


GRADIENT To obtain the second formula in Table 21.5, start with the divergence theorem 


and set F = fC, where C is an arbitrary constant vector, thus establishing fff, V f dv = 
Í I; f Ndo. The Mean Value Theorem for integrals then guarantees the existence of a point 


Q for which the equality 
vno fff av= ff fN do 
AV s 


holds. Evaluating the volume integral on the left leads to 


1 
[V flo = AV Ii fNdo 
S 


and in the limit to [V f]p = lima +9 “A 


To establish the all-important starting point [f,,, V f dv = ff, fNdo, manipulate 
the divergence theorem as follows. 


"i v-Fdv= |f F-Nao 
AV s 
"i v -Ueldo- ff vei Nae 
AV S 
Jl Iv C fV -Cldv= [f C-LrNIe 
AV S 
I", Iv f -C+ foldu= ff C- trNIdo 
AV S 
TIl (C-vfldv= ff C-1fN1ao 
AV S 
"i vfav= ff fNdo 
AV S 


The final equality follows because C, being arbitrary, could be one of the unit vectors i, j, 
or k, in which case one of the components of the vectors in the integrals is isolated. If the 
result is then true for each component of the vectors, it is true for the vectors themselves. 


Curt To obtain the third formula in Table 21.5, start with the divergence theorem and set 
F = B x C, with C an arbitrary constant vector, to establish 


fl «nec [en 


By the Mean Value Theorem for integrals, there is then a point Q for which the equality 


iv x Blo [ff dv= |] Nx Bac 
AV 5 


holds. The triple integral on the left evaluates to the volume AV, leading to 


1 
VxB]o = — N x Bd 
[V x Blo AV ll. x oO 


and in the limit to [V x B]p = limy.o [fN x Bdo/AV. 
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To establish the all-important starting point fff, ,, V x Bdv = ff. N x Bdo, manip- 
ulate the divergence theorem as follows. 


f[] v 6 [fe Nee 


Ii vix Cldv= f Bx CI Nac 
AV S 
I" IC- v x B- B: V x Cldv= ff N- m x Ciao 
AV S 
Iii IC - v x B- B-o1do- |] Nm x Ciao 
AV S 
TII IC- v xBldv= |f C-IN x BIdo 
AV S 


[[[ v x ff Nx nac 


As before, the final equality follows by choosing the arbitrary vector C as each of i, j, 
and k, which makes the equation true for each component of the vectors and hence for the 


vectors themselves. 


In the surface integral on the right, the triple scalar product was manipulated as follows 


ny n2 na ny n5 Ha C] C2 C3 
N-(BxC]= |; b; b3|——|cq co 03) = nj m na3| —C-[N x B] 
Cl C2 C3 bi b» b3 bi bz b3 
EXERCISES 21.6—Part A 
Al. Using the cube in Figure 21.14, obtain fN for the two faces A6. Verify the vectors in (21.33). 
orthogonal to j, and show how this leads to f. A7. Verify the calculations represented by (21.34). 
A2. Using the cube in Figure 21.14, obtain fN for the two faces AS. Verify the calculations leading to (21.35). 
thogonal to k, and show how this leads to fz. "s j l 
‘ poss. m ! iade ma i » sesto j; A9. Verify the vectors in (21.36). 
A3. Verify the calculations leading to (21.30). m ; 
CTY MCPA a LES SEES tOn ) A10. Verify the calculations represented by (21.37). 


A4. Verify the integral in (21.31). 


A5. Verify the calculations leading to (21.32). 


EXERCISES 21.6—Part B 


B1. Verify that interchanging two rows in a 3 x 3 determinant negates 
the determinant. 


In Exercises B2—4, at the given point P = (a, b, c) and for the given 
field F, verify the integral formula for V - F using 

(a) S, a sphere of radius p centered at P. 

(b) S, thecubex =at+p,y=btp,z=cHtop. 


(c) S, a cylindrical “can” with radius p and height 2p, centered 
at P. Thus, the cylinder will have equation (x — ay 4 
(y — by? = p? and "lids" in the planes z = c + p. 


B2. F = x*yi+ y?zj + xz)k, P = (2,3,5) 


B3. 
B4. 


F = (5y + xyz)i — 4x?zj + (y — 9y?z)k, P = (1, —7, —3) 
F = (474+ 6xy?)i+ (8xy? +327)j+ Gy? —7yz))k, P = (—8, 9, 4) 


In Exercises B5-7, at the given point P = (a, b, c) and for the given 
field F, verify the integral formula for V x F using 


(a) S, a sphere of radius p centered at P. 


(b) S, thecubex =a+p,y=b+p,z=cH+p. 


(c) S, a cylindrical “can” with radius p and height 2p, centered 
at P. Thus, the cylinder will have equation (x — a)? + 
(y — b = p? and “lids” in the planes z = c + p. 
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B5. F = (5y + 2xz°)i + (Jyz + 4y)j + (Tz + 6yz)k, P = (6, 8, 1) 
B6. F = (3z + 82 y)i + (9xz? — 3y)j + (9 — 3z°)k, P = (9, —9, —8) 
B7. F = xzi + (4x? + 8y°)j — yzk, P = (8, 9, 3) 


In Exercises B8-11, at the given point P = (a, b, c) and for the given 
scalar field $ (x, y, z), verify the integral formula for Vø using 


(a) S, a sphere of radius p centered at P. 


(b) S, thecubex =a+p,y=b+p,z=ctp. 
(c) S, a cylindrical “can” with radius p and height 2p, centered 
at P. Thus, the cylinder will have equation (x — a)? 4- 
(y — b = p? and "lids" in the planes z = c +p. 
B8. (x, y, z) = x?y?z, P = (2, —3, —5) 
B9. ó(x, y, z) = 3234+ 5x?, P= (7, 7, —1) 
B10. d(x, y, z) = 8xy — 7z?, P = (9, —9, —8) 
B11. (x, y, z) = 6x? + 2xyz, P = (2,9, —3) 
In Exercises B12-13, for the given fields F, verify the integral formula 
ShN x Fdo = fff, V x Fdv, where R is the interior of the closed 
surface S, N is the outward unit normal field on S, and S is 


(a) a sphere with radius 1 and center at the origin. 


(b) acube x = +1, y =+1,z=+1. 


l 
= 
N 
] 
it 


(c) the closed cylinder x4 y? 
B12. F = 7xyzi + (5x? — 5y*)j + (yz — 3)k 
B13. F = (5y + 4z°)i + (4xz — x?)j — 9xk 
In Exercises B14—16, for the given scalar field $, verify the integral for- 


mula f/f. Ndo = fff, Vó dv. where R is the interior of the closed 
surface S, N is the outward unit normal field on S, and S is 


(a) a sphere with radius | and center at the origin. 

(b) acubex = +1,y=4+1,z=H1. 

(c) the closed cylinder x? + y? = 1, z = +1. 
B14. d(x, y, z) = 62 — xyz 
B16. (x, y, z) = 4xy +323 


B15. ó(x, y, z) = xz — x?y 


In Exercises B17—19, for the given scalar field (x, y, z), verify the in- 
tegral formula $, 6dr = ff N x V$ do, where S is an open “capping” 
surface for the simple closed curve C lying in the plane z = —1, N is 


Chapter Review 


1. What is do, the element of surface area, for a surface described by 
(a z— f(x,y) (b) y=g(x,z) (c)x=h(y,z) 

2. Show that do = ||V f ||/| f.| dx dy for a surface that is defined 
implicitly by f(x, y, z) = 0 and has a projection on the xy-plane. 
Hint: Use Question 1(a) and implicit differentiation. 


3. What is meant by the phrase "surface integral?" Give an example. 


the unit normal field on S (positively oriented with respect to C), and S 
is taken to be 


(a) the unit upper hemisphere with center at the origin. 


(b) the cube x = +1, y = +1, z = +1 and open in the plane 
z=-l. 

(c) the cylinder x? + y? = 1, z = +1, capped in the plane z = 1 
and open in the plane z = —1. 


B17. o(x, y,z) =x? +5y?z B18. d(x, y, z) = 2xz — 2y/z 

B19. (x, y, z) = Axy?z 

In Exercises B20—21, for the given vector field F, verify the integral for- 
mula $- dr x F = ff.(N x V) x Fdo, where S is an open “capping” 
surface for the simple closed curve C lying in the plane z = —1, N is the 
unit normal field on S (positively oriented with respect to C), and S is 
taken to be 


(a) the unit upper hemisphere with center at the origin. 

(b) the open cube x = +1, y = +1,z=1. 

(c) the cylinder x? + y? = 1, capped in the plane z = 1. 
B20. 
B21. 
B22. 


F = 6y?zi + (622 — 9x°)j + (8xy + 7yz)k 
F = (4y + 6xyz)i + (Axz? + x?z)j + (9xz — 3y>)k 
Obtain the integral formula used in Exercises B20 and 21 by 


applying Stokes’ Theorem to the vector F x B, where B is an 
arbitrary constant vector. 


B23. Obtain the integral formula used in Exercises B17-19 by applying 
Stokes’ Theorem to the vector 9B, where B is an arbitrary 


constant vector. 


B24. Obtain the integral formula used in Exercises B14—16 by 
applying the divergence theorem to the vector 9B, where B is an 


arbitrary constant vector. 


. Obtain the integral formula used in Exercises B12 and 13 by 
applying the divergence theorem to the vector F x B, where B is 
an arbitrary constant vector. 


If B is a constant vector, show that ik N x (Bx r)do = 2Bv, 
where S is a closed surface, N is the outward unit normal field on 
S, r is the position vector to a point on S, and v is the volume 
enclosed by S. Hint: Use the integral formula from Exercises B12 
and 13 and a vector identity from Table 20.2. 


B26. 


4. If S is a surface described by z = f (x, y), write a mathematical 
recipe by which the flux of the field F through S is computed. State 
how one obtains the unit normal N. Give a verbal explanation of the 
prescription. 


5. What is the usual convention for selecting a normal on a closed 
surface when computing the flux through the surface? With that 
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convention, what physical significance attaches to a positive value 
of the flux? To negative value? 

Let S be a cylinder with a closed top and an open bottom. Let No be 
a unit normal attached to the top of the surface, and let it point into 
the cylinder. Use the device of orienting the surface to embed No in 
a continuous normal field on S. 


7. Repeat Question 6 for No pointing in the opposite direction. 


8. Let S be the first octant portion of the plane 2x + 3y 4- 4z — 5. 


12. 


13. 


14. 


15. 


16. 


17. 


Obtain the flux of F = 7xi + 8yj + 9zk through S. 


. State the divergence theorem. Give a verbal description of its 


conclusion. 


. State Stokes’ Theorem. Give a verbal description of its conclusion. 


State the “divergence form" of Green's Theorem. Write out its 
essential formula for the vector F = fi + gj. 


State the "Stokes" form" of Green's Theorem. Write out its 
essential formula for the vector F = fi + gj. 

Show how one form of Green's Theorem can be transformed into 
the other by an appropriate choice of vector field F. 


Demonstrate the application of the divergence theorem to the vector 
field F = 2xi + 3yj + 4zk for the region V’ that lies between 
concentric spheres of radii i and 1. 

Demonstrate the application of Stokes’ Theorem to the field of 
Question 14 for the surface S, the upper unit hemisphere with 
center at the origin. 

Demonstrate both forms of Green's Theorem for the field F — 

5xi — 3yj and the region R between concentric circles with radii 1 
and 2 and centers at the origin. 


Explain why the application of Stokes’ Theorem to a closed surface 
always results in the identity 0 = 0. 


. State five definitions for a conservative force. 


. What is an exact differential? Give an example. Give an example of 


a differential that is not exact. 


. Explain the phrase “path independent." What is its relationship 


with conservative forces? 


21. 


22. 


23. 
24. 


25. 
26. 
27. 
28. 


29. 


30 


31. 


32 


. 


33. 


34. 
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What is meant by the “closed path” property? What is its 
relationship with conservative forces? 


Present the argument that shows “path independence” is equivalent 
to the “closed path” property. 


What can be said about a force whose scalar potential is harmonic? 


What can be said about the scalar potential of a force that is both 
conservative and solenoidal? 


Give an example of a solenoidal field that is not conservative. 
Give an example of a field that is conservative but not solenoidal. 
Give an example of a field that is both conservative and solenoidal. 


State a formula for constructing the scalar potential from the 
components of an irrotational force field. 

If u(x, y, z) = xyz, obtain F = Vu and show it is irrotational. 
Then, determine the extent to which the formula in Question 28 
reconstructs u. 


State a formula for constructing the vector potential from the 
components of a solenoidal field. 

If A = 2xyi — 3yz?j + 4xzk, obtain F = V x A and show it is 
solenoidal. Then, determine the extent to which the formula in 
Question 30 reconstructs A. If A itself is not obtained, show that 
the difference is a gradient field. 

The integral equivalent of V x F contains the surface integral of 
N x F. The integral is a generalization of the circulation if N x F is 
the component of F tangential to the surface. Show that N x F lies 
in the plane tangent to N and, hence, in the surface to which N is 
normal. Further show that the length of N x F is the length of the 
component of F orthogonal to N. 


Describe how the integral equivalent of V - F is the direct 
generalization of “the limiting ratio of the flux per unit area 
enclosed." 


Use a cube centered at (a, b, c) and having its faces parallel to the 
coordinate planes to argue the validity of the integral equivalent to 
V f. The argument for the faces orthogonal to the yz-plane is given 
in the text. Provide the arguments for the faces parallel to the xz- 
and x y-planes. 


FIGURE 22.1 
coordinates 


522 


Element of area in polar 


Chapter 22 


NonCartesian Coordinates 


INTRODUCTION Up to this point in the unit, vector calculus has taken place in 
Cartesian coordinates. We now move into polar, cylindrical, and spherical coordinates, sys- 
tems that are orthogonal but nonCartesian. We first learn the relationship between a change 
of coordinates and a mapping. For example, in elementary calculus, polar coordinates are 
typically seen as a change of coordinates. The points in the xy-plane remain fixed, but their 
coordinates, or “addresses,” change. As a mapping, the coordinates in the xy-plane remain 
fixed, but the point is moved to the r0-plane, a separate plane with its own rectangular grid. 

Interpreting a change of coordinates as a mapping allows us to determine how to 
transform a multiple integral from one coordinate system to another. 

We then derive expressions for the gradient, divergence, and laplacian operators in 
polar coordinates. Each result is derived by mapping the calculation into the Cartesian 
plane where the operators are known, to the polar plane where the equivalent calculations 
are to be determined. 

Similar formulas for gradient, divergence, curl, and laplacian in cylindrical and spher- 
1cal coordinates appear in two separate tables. The table for spherical coordinates lists 
two common forms for this system found in the literature. Although these two versions of 
spherical coordinates differ only by an interchange in the names of two of its coordinates, it 
can be very confusing to read results in one system thinking they are given in the other. The 
results for cylindrical coordinates are not derived because the calculations would be almost 
identical to those for polar coordinates. Although the gradient in spherical coordinates is 
derived, the remaining formulas are left as exercises. 


Mappings and Changes of Coordinates 


Motivation—Double Integrals in Polar Coordinates 


More than once, double integrals in Cartesian coordinates have been converted to double 
integrals in polar coordinates. On each such occasion the conversion was done by declaring 
dx dy — r dr d0. Typically, in the multivariable calculus course an explanation, based on 
Figure 22.1, is given. The shaded region is roughly a rectangle with edges dr andr d0, from 
which it is argued that the element of area in the polar plane is r dr d0. This is intuitively 
appealing, but not a proof. 

Under the more general coordinate change x = a(u, v), y = B(u, v), a double integral 
changes according to the rule 


FIGURE 22.2 Graph of x? + y? +x = 
yx? + y? in the xy-plane 


FIGURE 22.3 Graph ofr = 1 — cos in 
a Cartesian r0-plane 


we 


FIGURE 22.4 Rectangular grid lines 
from r6-plane mapped back to xy-plane 
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I f(@, y)dxdy = iil f (ou, v), Blu, v)) ps 
" R O(u, v) 


In the integrand's f(x, y), each x is replaced by œ (u, v) and each y by B(u, v). But dx dy 
is replaced by the absolute value of the Jacobian = 2, the determinant of the Jacobian 
matrix 


dudv 


au(u,v) oy(u, v) 
Bí, v) pylu, v) 


Heuristically, imagine the “denominator” of the Jacobian “cancels” with du dv, so the 
integral on the right is left with 3 (x, y), which, if interpreted as dx dy, “makes” the integral 
on the right “equivalent” to the integral on the left. To understand why the Jacobian appears 
when changing variables in a multiple integral, a sound understanding of coordinate changes, 
per se, is necessary. 


Coordinate Change vs. Mapping 


POLAR COORDINATES AS COORDINATE CHANGE The typical treatment of polar coordinates 
in elementary calculus is slanted toward “change of coordinates." Thus, the point (x, y) = 
(1, 1) in Cartesian coordinates is given by the polar coordinates (r, 0) — (2. ud The 
"physical point" has remained fixed, but its “house number" has been changed. The house 
didn't move; the number attached to the front door changed. 

How is this interpretation as “change of coordinates" played out in the multivariable 
calculus course? When curves given in polar coordinates are plotted in the Cartesian plane, 
the interpretation is that the points remain fixed in the Cartesian plane but their identifying 
names are changed. 

For example, consider the Cartesian curve defined implicitly by the equation x? + 


and its “formula” would be more readily recognized if expressed in polar coordinates as 
r = | — cos 0. Figure 22.2 reinforces the interpretation of polar coordinates as a change of 
coordinates. The points remain in the xy-plane. Just their names change. 

But what happens if, in r = 1 — cos 8, the variables r and 0 are treated as belonging to 
a rectangular grid? What does it mean to plotr = f (0) in the r0-plane, a plane in which the 
grid lines 6 = constant and r = constant are themselves rectangular? Figure 22.3 results. 


POLAR COORDINATES AS A Mappine Plotting r = f(@) as an equation in the r@-plane 
means the polar plane is not identified with the xy-plane. The planes are treated as distinct 
worlds, with communication via the transformation equations, x = r cos 0, y = r sin 0, and 
r = x? + y, 0 = arctan(?). 

The graph in Figure 22.3 now hardly resembles the cardioid. Yet, it is the same curve, 
only mapped onto the rectangular r0-plane. In this interpretation of polar coordinates, 
imagine that the points in the xy-plane are moved to a new neighborhood. The rectangular 
xy-neighborhood is transported, being distorted as it goes through space, to a new planet, the 
r6-planet, where lines that were straight in the xy-world are curved to fit into the r0-world. 


MarPrING Grip Lines In elementary calculus, the rectangular grid lines in the r@-plane 
are mapped back to curves in the xy-plane by the action of the transformations x — r cos6, 
y = r sin ĝ. For example, the images of the r0-plane's grid lines r = 1 and 09 = 1 are a 
circle and a radial line through the origin in the xy-plane, as shown in Figure 22.4. 
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Elementary calculus treats polar coordinates as if they existed in the Cartesian xy-plane, 
giving the impression the r6-plane is “distorted.” The truth of the matter is that neither the 
xy-plane nor the r0-plane is distorted. The “distortion” arises only when one plane is mapped 
onto the other. 

When the rectangular r0-plane is mapped onto the xy-plane, the familiar picture of 
circles and radial lines is obtained. That represents only one view of the mapping induced 
by the transformations defining polar coordinates. The other view would be based on an 
image of the xy-plane's grid lines over in the r@-plane. For example, Figure 22.5(b) is the 
image in the r0-plane of the square 1 < x, y < 2, in xy-plane. Figure 22.5(c) is the image 
in the xy-plane of the square 1 < r, 0 < 2, in the r0-plane. 


Sb 


(c) (d) 


FIGURE 22.5 Square in xy-plane (a) mapped to r6-plane (b); square in r0-plane (d) 
mapped to xy-plane (c) 


The starting point has been regained. This investigation was begun by asking why 
the Jacobian appears when changing coordinates in a multiple integral. The answer is in 
the picture just drawn. A unit square in the r0-plane maps to the region shown in Figure 
22.5(c). A unit area in the r0-plane changes to some other amount of area when mapped 
to the xy-plane. If the factor by which this unit area changed can be deduced, the reason 


why the Jacobian appears when changing variables in a multiple integral will have been 
discovered. 


AREA The following calculation has appeared earlier. Represent the radius vector to a 
general point, use it to define coordinate curves, then differentiate the coordinate curves to 


zu 


-0.2 


FIGURE 22.6 Example 22.1: In xy-plane, 


inverse image of unit square in uv-plane 
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obtain vectors tangent to the coordinate curves. This is, in fact, how the surface area element 
was found and how the formula for a normal to a surface was determined. 

The xy-plane is mapped to the wv-plane by transformation equations of the form x = 
x(u, v), y = y(u, v), with inversion formulae of the form u = u(x, y), v = v(x, y). 

It is not known how to measure area in the uv-plane, so bring back to the xy-plane 
images of rectangular grid lines from the uv-plane. This puts into the xy-plane, images 
of coordinate curves from the uv-plane. Differentiation along these curves gives tangent 
vectors expressed in the xy-system. The area of the parallelogram spanned by these tangent 
vectors is the approximate area, expressed in xy-terms, of a unit rectangle in the uv-plane. 

The radius vector in the xy-plane is R = x(u, v)i+ y(u, v)j. Images, in the xy-plane, 
of grid lines v = f, and u = « in the uv-plane are given, respectively, by 


R, = x(u, B)i+ y(u, B)j and R, = x(g, v)i + ya, v)j 
Infinitesimal tangent vectors on these curves in the xy-plane are 
T, = (x,i+ y,j)du and T, = (xii + yaj) dv 
which lead to 


a(x, y) 


dud 
d(u, v) us 


IT, x Toll = || (Xu Yv — XvYu) du dvk|| = |xu Yv — xvyul du dv = | 


The symbol a = : represents the determinant of the Jacobian matrix 


for ®~!, the inverse transformation from the uv-plane to the xy-plane. The Jacobian matrix 
for o, the forward transformation from the xy-plane to the uv-plane, is 


J Ux Uy 
e Uy Uy 
9(u.v) 


and its determinant is 7-7. The two Jacobian matrices are related as multiplicative inverses, 


9(x.y)" 
so that 
1 0 


" . x,y) d(u,v 
and the two Jacobians are related as reciprocals, so that 30,9) 9050) a 1 


alu, v) 9(x,y) — 


For the forward mapping ® (given by u = 4x + 2y, v = 3x + 5y), taking the xy-plane to 


the uv-plane, 
uy uy| |4 2 
Je — b e j 


and |Jo| = e = 14. For the inverse map ^! (given by x = i; (5u — 2v), y = 4 (4v — 


3u)), taking the uv-plane to the xy-plane, 


Tess A 4|. 4 5 -2 

vb y] 14 [-3 4 
and |Jo-:| = 28:2 = i. The points (1, 0) and (0, 1) in the uv-plane are taken by ^ to 
(3, 2) and ( Z, 4), respectively, in the xy-plane. The vectors A = i; Gi — 3j) and 


B= i (-2i + 4j) span a parallelogram in the xy-plane, as shown in Figure 22.6. The area 
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of this parallelogram is ||A x B|| = 
back to a parallelogram with area 


1 _ 9Q5y) 
T (u,v) 


a(x, y 1; : 
3ü.y) = 14 1n the xy-plane. Thus, to measure this parallel- 


The unit square in the uv-plane is pulled 


ogram’s image in the uv-plane, the unit square's area of 1 must be multiplied by E = en $ 
Consequently, AM d u dv replaces dx dy as the element of area when changing a double 
integral from one in the xy-plane to one in the uv-plane. $ 


EXERCISES 22.1—Part A 


Al. 


A2. 


A3. 
A4. 


Give the polar coordinates of (x, y) — (2, —3). Plot its image in a 
rectangular r0-plane. 
Plot r(0) = 1 —2c0s0,0 < 0 < 2x, as a polar-coordinate curve 


in the xy-plane. 


Plotr(0) = 1 —2cos0,0 < 0 < 2x, ina rectangular r0-plane. 


Let x = 2u + 3v, y = 5u — 7v, determine a change of coordinates, 


and let R be the triangular region bounded by y = x, x = 1, 


EXERCISES 22.1—Part B 


y = 0. Evaluate ff, x?y? dy dx, transform the integral to 
uv-coordinates, and evaluate again. 


AS. Cylindrical coordinates are defined by x = r cos 0, y = r sin6, 


z = z. Obtain | 57:2 | and transform fff f (x, y, z) dz dy dx to 


cylindrical coordinates. 


B1. Spherical coordinates are sometimes defined by x = p sin $ cos 0, 


B2. 


y = psin $ sin, z = p cos $. (The angle $ is measured from the 
vertical z-axis to the radius vector, the angle 0 measures 
counterclockwise rotation around the z-axis, starting from the 
x-axis and p is the distance to the origin.) Obtain | TOT | and 
transform fff f (x. y, z) dz dy dx to this version of spherical 
coordinates. 


Spherical coordinates are sometimes defined by x = p sin 0 cos $, 
y = p sin sing, z = p cosÓ. (The angle 0 is measured from the 
vertical z-axis to the radius vector, the angle œ measures 
counterclockwise rotation around the z-axis, starting from the 
x-axis and p is the distance to the origin.) Obtain aa | and 
transform fff, f(x, y, z) dz dy dx to this version of spherical 
coordinates. 


In Exercises B3-12: 


. x? +y =2/x2 +y? +y BE. (x 
. (x? +y?) =4x?y? B8. x? +y = 
. (x? + y*)? = x(x? — 3y?) 


(a) Plot y(x) implicitly, using a computer algebra system. 


(b) Convert the given equation to polar coordinates, writing the 
result in the form r = f (0). 


(c) Plot, in polar coordinates, the result found in part (b). The 
resulting graph should agree with the one found in part (a). 


(d) Plot r = f(@) as a curve in a rectangular r6-plane. 


.2x? + 2y? = x? + y? 2x 


2x? + 2y? = 3/2 + y2 + 2y 


j x 
B10. 8x? + 9y? —14-2x 20 


B11. y? = 1 —2x 
B13. Let u = 3x + 2y, v = 5x — 7y define a mapping of the xy-plane 


B12. y? = 8x? — 6x +1 


to the uv-plane. 


(a) In the uv-plane, find and graph the images of the grid lines 
1542,35. 


(b) In the uv-plane, find and graph the images of the grid lines 
y-1,2,3. 


(c) Solve the transformation equations for x = x(u, v), 
y= y(u, v). 

(d) In the xy-plane, find and graph the inverse images of the grid 
lines u = 1,2,3. 


(e) In the xy-plane, find and graph the inverse images of the grid 
lines v — 1,2,3. 


(f) In the xy-plane, find and graph the inverse image of the square 
u = 0, u = 1, v = 0, v = 1. Find the area within this inverse 


image (it's a parallelogram) and show it is equal to IE! : 


(g) In the uv-plane, find and graph the image of the square 
GS cel, fi cel. 

(h) In the uv-plane, find and graph the image of the circle 
x+y = 

(i) In the uv-plane, find and graph the image of the circle 
(x —3)? +(y—-2) =1. 

(j) In the uwv-plane, find and graph the image of the parabola 
yeux. 


(K) In your favorite computer algebra system, install the 
coordinates found in part (c) as a new coordinate system 
called slant. Convert x? + y? = 1 to the slant coordinates, and 


use an implicit plotting device that knows the slant coordinate 
system to obtain its graph in the xy-plane. This process is the 
analog of what was done with polar coordinates in Exercises 
B3-12. (The accompanying Maple worksheet demonstrates 
the installation of new coordinates in Maple.) 


(1) Convert y = x? to the slant coordinates, and use an implicit 
plotting device that knows the s/ant coordinate system to 
obtain its graph in the xy-plane. 


B14. The mapping x = + (u? — v?), y = uv, with inversion equations 


ucc = , v = +y Vx? + y? — x, defines the parabolic 
v af x? y?—x 


coordinate system, known to some computer algebra systems. 


(a) In the xy-plane, find and graph the inverse images of the grid 
lines u — 1,2,3. 


(b) In the xy-plane, find and graph the inverse images of the grid 
lines v = 1, 2, 3. 


(c) In the «v-plane, find and graph the images of the grid lines 


x= 1,253. 
(d) In the wv-plane, find and graph the images of the grid lines 
y= 1, 2,3: 


(e) In the wv-plane, find and graph the image of the square 
| «xy 2. 


(£) In the uv-plane, find and graph the image of the circle 
(x — 3)? + (y—2)? = 1. 


(g) In the uv-plane, find and graph the image of the parabola 
yzx. 


(h) Convert x? + y? = 1 to uv-coordinates, and use an implicit 
plotting device that knows the parabolic coordinate system to 
obtain its graph in the xy-plane. 


(i) Convert y — x? to uv-coordinates, and use an implicit plotting 
device that knows the parabolic coordinate system to obtain 
its graph in the xy-plane. 


u y= 
ud pv? 4 


— " — s "T 
B15. The mapping x — uu With inversion equations 


ü = XL. Ù = z} 


E -z defines the tangent coordinate system that 
is known to some computer algebra systems. 


25 
y2 


(a) In the xy-plane, find and graph the inverse images of the grid 
lines u = 1, 2,3. 


(b) In the xy-plane, find and graph the inverse images of the grid 
lines v = 1, 2, 3. 


(c) In the uv-plane, find and graph the images of the grid lines 


= 1, 2,3 
(d) In the uv-plane, find and graph the images of the grid lines 
v= 1.2.3; 


(e) In the wv-plane, find and graph the image of the square 
] €x,» =2. 


(f) In the wv-plane, find and graph the image of the circle 
(x -—3P +(y-2P =1. 
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B16 


` 


B17. 
B18. 


B19. 


B20. 
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(g) In the uv-plane, find and graph the image of the parabola 
yen. 

(h) Convert x? + y? = 1 to uv-coordinates, and use an implicit 
plotting device that knows the tangent coordinate system to 
obtain its graph in the xy-plane. The unit circle should result. 
Once again, this process mirrors exactly what was done with 
polar coordinates in Exercise B3-12. 

(i) Convert y — x? to uv-coordinates, and use an implicit plotting 
device that knows the tangent coordinate system to obtain its 
graph in the xy-plane. 

Consider the parabolic coordinate system from Exercise B14. 


(a) In the xy-plane, obtain the inverse image of the grid line 
u = a. Differentiate R(x(u, v), y(u, v)) to obtain a vector 
tangent to this curve. 


(b) Repeat part (a) for the grid line v = £. 


(c) Find the area of the parallelogram determined by the tangent 
vectors in parts (a) and (b). 

a(x,y) 

9(u.v) l 

Repeat Exercise B16 for the tangent coordinate system. 


(d) Show that the area found in part (c) is 


Let R,, denote, in the xy-plane, the region bounded by 

y = 1 — x? and the x-axis. 

(a) Obtain R,,, the image of R,, under the mapping 
u = 4x — 7y, v = 3x + 5y, being sure to indicate the new 
bounding curves and their intersections. 

(b) Obtain as ff, dy dx, the area of Ryy. 


(c) Change variables in the double integral of part (b), writing it 
as ff... 26:2 | du dv, an integral in u and v. Evaluate this 
integral, obtaining the same value as found in part (b). 


Let x = u? + v?, y = 7, define a mapping from the uv-plane to 

the xy-plane. 

(a) Obtain u = u(x, y), v = v(x, y), the formulas for mapping 
the xy-plane back to the uv-plane. 

(b) In the uv-plane, obtain T’, the image of triangle T whose 
vertices are (1, 1), (3, 5), (2, 7), being sure to write the 
equations of the curves bounding the mapped region. Hint: It 
is easier to describe the boundaries as u = u(v). 

(c) Find the area of triangle T. 

(d) Obtain the area of T’ using double integration in the wv-plane. 

Let R,, be the region in the xy-plane bounded by the curves 

yi = x?, y2 = x? + 1, y3 = 2x +2, y4 = 2x. (One point of the 

boundary is the origin.) 


(a) Use double integrals to obtain the area of R,,. (It takes three 
such integrals whether the integration is done dy dx or dx dy.) 


(b) Change coordinates to u — y — x?, v — y — 2x, so that the 
region of integration becomes a rectangle in the uv-plane. 


. 9(x.y 
Obtain x = x(u, v), y = y(u, v), and also | 28? |. 
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(c) Compute the area as a double integral in the uv-plane. (b) Change coordinates to u — y — x, v — xy, so that the region 
Clearly, the answer should match that found in part (a). of integration becomes a rectangle in the uv-plane. Obtain 


IERS 
x = x(u, v), y = y(u, v), and also E- 2 |. 


B21. Let R,, by the region in the xy-plane bounded by the curves 


Vi =X, 92 = x42, 93 = i, ya = 2. (c) Compute the area as a double integral in the wv-plane. 


(a) Use double integrals to obtain the area of R,,. (It takes three Clearly, the answer should match that found in part (a). 


such integrals whether the integration is done dy dx or dx dy.) 


Vector Operators in Polar Coordinates 


Gradient in Polar Coordinates 


In Cartesian coordinates, the gradient of the scalar u(x, y) is the vector Vu = uxi + uyj, 
where i and j are unit basis vectors for the Cartesian system. What does it mean to compute 
the gradient of the scalar u(r, 0) in polar coordinates? 


GRADIENT IN POLAR CooRDINATES—DERIVATION Recall the equations defining polar 
coordinates, x = r cos 0, y = r sin 0, and the equations defining the inverse transformation, 
r = yx? + y?, 0 = arctan ~. Write the radius vector as R = xi + yj, with x = x(r, 0) 
and y = y(r, 0). If 0 is held constant and r allowed to vary, R = R(r), so an r-coordinate 
y curve is traced in the xy-plane. For example, 0 — 1 defines a radial line emanating from the 
A origin, while r = 1 defines the 0-coordinate curve that is a circle about the origin. 
T A fundamental idea of vector calculus, now long familiar, is that differentiation of a 
curve with respect to its parameter yields a vector tangent to that curve. Apply that principle 
to the radius vector R (r, 0), first differentiating with respect to r and then with respect to 
0. In the first case, obtain a vector tangent to an r-coordinate curve (a radial line) and in the 
second a vector tangent to a 0-coordinate curve, a circle about the origin. See Figure 22.7 
for a sketch of the vectors 2R and EI drawn at (x, y) = (V2, V2). 
+> x The vector tangent to the r-coordinate curve turns out to be a unit vector. The vector 
tangent to the 0-coordinate curve needs to be normalized since it does not automatically 


have unit length. Typical notation for these unit vectors in polar coordinates is 


-— l -— : 
e. = cos ĝi + sinj and e= —Ry = — sin ĝi + cos6j (22.1) 
FIGURE 22.7 The vector a and E in r 
polar coordinates Solving for i and j in terms of e, and ej, we have 
i = cos ĝe, —sin0e; and j= sine, + cos0e, (22.2) 


The point here is to discover the proper expressions for the gradient and laplacian 
of a scalar-valued function and the divergence of a vector-valued function, when each is 
given in polar coordinates. Since the expression for the gradient in Cartesian coordinates is 
already known, use that knowledge to deduce the result for polar coordinates. Start with the 
expression for the gradient in Cartesian coordinates, replacing i and j with their equivalents 
in terms of e, and eg and transforming the partial derivatives using the chain rule. 

The second step expresses u(x, y) as U (r(x, y). 0(x, y)) prior to using the chain rule 
for determining the equivalents of the partial derivatives uy and uy in polar coordinates. 
For insight, consider the function A(x, y) = xy? and its conversion to polar coordinates, 
h(x(r, 0), y(r,0)) = r?cos0 sin? 0 = H (r, 0). The introduction of H (r, 0) is essential, 
since it is a different function of r and 0 than h(x, y) was a function of x and y. In h(x, y) 
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the first variable, x, simply multiplies the square of the second. In H (r, 6), the first variable, r, 
is cubed. Thus, two different letters, and H, are more than appropriate, they are necessary. 
Now, go back the other way by writing H(r(x, y), 66. y)) = h(x, y), the starting 
point for the partial differentiations about to take place. Thus, start with 
u(x, y) = U(r(x, y), 0 (x, y)) 


and by the chain rule obtain 


Uy = U,r,-- Ug0, and uy = U,r, + Us, (22.3) 
Since r, = cos 6, 6, = — ane ry = sin 0, and 0, = cost the gradient in Cartesian coordi- 
nates becomes 
sin 0 cos 0 


|u cos 0 — Ug | [cos ĝe, — sin 0e;] + |o sin 0 + Us l [sin ĝe, + cos0e;] 


r r 


= U,e, + Upeo (22.4) 


Divergence in Polar Coordinates 


In Cartesian coordinates, the vector field F = f (x, y)i + g(x, y)j has as its divergence, the 
scalar field V+ F = fy + gy. The divergence of the vector B = U (r,0)e, + V(r, 0)eo is 
the scalar U, + IU + Lys. Notice the term without any derivative! There is something to 
discover here! 


DIVERGENCE IN POLAR CooRDINATES—DERIVATION To derive the expression for the 
divergence of the polar vector B = U(r, 6e, + V (r, 0)es, transform B completely to Carte- 
sian coordinates, compute the divergence in Cartesian coordinates, then transform that result 
back to polar coordinates. Therefore, in terms of i and j, we have B = F (r, 6)i + G(r, 0)j. 
where 


F =Ucos@—Vsin@ and G = U sin0 + V cos (22.5) 
Since F and G are functions of r and 0, define 
f(x,y) -F(GQG,y.0G,y) and g(,»)— G(r(x, y), 0 (x, y)) 


so that the Cartesian version of B is really f (x, y)i + g(x, y)j. Then, the partial derivatives 
f. and g,, computed by the chain rule, are precisely what is needed to determine the 
divergence of B. 

By the chain rule, fy = Fry + F50, and gy = G,ry + G50,, so 


fr = [U, cos 0 — V, sin 0] cos 0 


sind 
- [Uo cos@ — U sin — V; sind — V cos 6] = ) (22.6a) 
- 


gy = [U, sin 0 + V, cos60]sin 


os 0 
+ [Uo sin6 + U cos& + V; cos — V sin6] ( : ) (22.6b) 


The sum fy + gy = U, + IU + aZ — V - Bis the divergence in polar coordinates. 


laplacian in Polar Coordinates 


In rectangular coordinates, the laplacian of f (x, y) is V? f = fx + fyy. In polar coordi- 
nates, the laplacian is F,- + IF, + E Fog, where F = F (r, 0). 
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EXAMPLE 22.2 


sin? 6 
ry = cos0 fos 
F 
, cos? 0 
r,-— sino Ec 
1 ») F 
sin 0 sin 6 cos 0 
b=- ba xd 
r r? 
cos 0 sin 0 cos @ 
= ba Oe Se 
y yy > 
" y? 
TABLE 22.1 First and second partial 


derivatives of r(x, y) and 0(x, y) 


EXERCISES 22.2—Part A 
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For example, the laplacian of the function f (x, y) = x + y? is V? f = 6y. Converting the 
function f (x, y) = x + y? to polar coordinates gives 


F(r,0) = f(x(r,0), y(r, 0) 2rcos0 + r? sin? 0 


In polar coordinates, the laplacian of F(r, 0) is 6r sin 6, the same as if V? f = 6y were 
converted to polar coordinates. 


TRADITIONAL CHAIN RuLE Derivation The starting point for the differentiations is 
the statement f(x, y) = F(r(x, y), (x, y)). An application of the chain rule gives fy = 
Fry + Fo, and fy = F,r, + F50,. Noting that F, and Fo depend on r(x, y) and 0(x, y). 
second derivatives computed by the chain rule are 


ð ð 
das = — F, Fy + Pr E (že) 0, T Fo Ox. (22.7a) 
ax ax 
= (Fry T F,90x ry T Fry T (Forrx "E F960 )0, a Fo 0, x (22.7b) 
and 
. ð ð 
Fy ={— F, ry + Feiss + | — Fo 0, + Fob yy (22.8a) 
JJ dy J JJ Qy / JJ 
= (Ferry x F,o 0,)r, + Fry, + (Forry + F550,)0, + Fo Oyy (22.8b) 


Then, substituting the derivatives listed in Table 22.1, into the sum f,, + fyy and using 
F,g = For, we get 


(22.9) 


7 
v 


. l l 
VF = Fr + T" sp "2 


AT. Obtain the vectors in (22.1). 
A3. Obtain the derivatives in (22.3). 
A4. Verify the calculations in (22.4). 


AS. Verify the representations in (22.5). 


EXERCISES 22.2—Part B 


A2. Obtain the vectors in (22.2). 


A6. Verify the differentiations in (22.6a) and (22.6b). 
AT. Verify the calculations in (22.7a) and (22.7b). 
A8. Verify the calculations in (22.8a) and (22.8b). 


A9. Using (22.7a), (22.7b), (22.8a), (22.8b), and Table 22.1, obtain 
(22.9). 


B1. Obtain the derivatives in Table 22.1. 


(d) Obtain V F in polar coordinates, and compare with the vector 
found in part (b). 


For the scalar-valued functions f(x, y) in Exercises B2—-6: 


(a) Obtain V f, the gradient, in Cartesian coordinates. 


(b) Transform V f from part (a) to polar coordinates by 
substituting both for the variables x and y and for the basis 


vectors i and j. 


(c) Convert f (x, y) to polar coordinates by substituting for the 
variables x and y. (Since u is a scalar, there is no problem 
with changing basis vectors.) Call the transformed f (x, y) by 
a new name such as F(r, 0). 


B2. f(x, y) — 7x?y +2y 
B4. f(x,y) =x? —5y? 
B6. f(x, y) = 9x? + 6xy? 


B3. f(x, y) = 3xy 4- 7x 
BS. fG, y) = Ty? = 9x7 y 


For the vector-valued functions F(x, y) in Exercises B7-11: 


(a) Obtain V - F, the divergence, in Cartesian coordinates. 


(b) Transform V - F to polar coordinates. (Since the divergence is 
a scalar, simply substitute for the variables x and y.) 


(c) Change F to polar coordinates by substituting both for the 
variables x and y and for the basis vectors i and j. Call the 
transformed vector by the new name G(r, 0). 


(d) Compute V - G in polar coordinates, and compare with the 
result in part (b). 
B7. F = (9x? — 4y)i + (9? — 33)j 
B9. F = (5y? + 6x)i + (5xy? + 2y)j 
B10. F = (4x2y +7x)i+7x°j B11. F = (6? + 9x)i+ (8y? 4- 9j 


B8. F = 5y?i + (Sy? + 4x))j 


For the scalar-valued functions f(x, y) in Exercises B12-16: 


(a) Obtain V? f, the laplacian, in Cartesian coordinates. 


(b) Transform V? f to polar coordinates. (Since the laplacian is a 
scalar, simply substitute for the variables x and y.) 


(c) Convert f(x, y) to polar coordinates by substituting for the 
variables x and y. (Since f is a scalar, there is no problem 
with changing basis vectors.) Call the transformed f (x, y) by 
a new name such as F (r, 0). 


(d) Compute V? F in polar coordinates, and compare with the 
result in part (b). 
f(x, y) = 9x? y — 8x3 y 
ff, y) = 68 + Ty? 
f(x, y) = 8xy? — Ty? 


Let u = 3x — 2y, v = 5x + 7y, define a change of coordinates 
from (x, y) to (u, v). If F(u, v) is a scalar-valued function, 
implement the ensuing steps to derive an expression for V F in the 
skewed (uv) coordinate system. 


B12. 
B14. 
B16. 
B17. 


B13. f(x, y) = 82y + 4x* 
B15. f(x, y) = 2xy? -8x* 


(a) Obtain the inversion formulas x — x(u, v), y — y(u, v). 

(b) From R = x(u, v)i + y(u, v)j, obtain the tangent vectors R 
and R, 

(c) Obtain the unit tangent vectors ê, and é,, then express the unit 
basis vectors i and j in terms of é, and ê. 

(d) Write f(x, y) = F(u(x, y), v(x, y)), and use the chain rule to 
obtain f, and fy. 

(e) Convert V f = fyi + f,j to its equivalent in the uv-coordinate 
system. 

(f) Apply the result in part (e) to f = x?y?. (Transform f(x, y) 
to F(u, v), then compute the gradient in wv-coordinates.) 

(g) Compute V f in Cartesian coordinates, and, using the results 
of part (c), transform this gradient to skewed coordinates. 
Compare to the result obtained in part (f ). 


Add the skewed coordinates of Exercise B17 to the list of known 
coordinate systems in your favorite computer algebra system. 
Obtain a graph showing, in the xy-plane, the inverse images of the 
grid lines of the uv-plane. 


B18. 


B19. Using the skewed coordinates defined in Exercise B17: 


(a) Obtain, in the uv-coordinate system, an expression for VF, 
the laplacian of the arbitrary scalar F (u, v). (Write 


22.2 


B20. 


B21. 


B22. 
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f(x, y) = F(u(x, y), v(x, y)), and use the chain rule to 
obtain fy, fy, fex, and fyy. Convert V? f = fix + fyy to the 
desired expression in the uv-coordinate system.) 


(b) Apply the result in part (a) to f = x?y*. 
(c) Compute V? f in Cartesian coordinates. 


(d) Transform the result in part (c) to uv-coordinates. Compare to 
the result in part (b). 


Using the skewed coordinates defined in Exercise B17: 


(a) Obtain, in the uv-coordinate system, an expression for V - F, 
the divergence of the arbitrary vector F(u, v) = f (u, v)é, + 
g(u, v)é,. (Convert F to the form A(u, v)i + B(u, v)j, and 
apply the chain rule to a(x, y) — A(u(x, y), v(x, y)) and 
b(x, y) = B(u(x, y), v(x, y)).) 


(b) Apply the result in part (a) to the vector V = (2x?y — 3y?)i + 
(5xy? + Ax?)j. (Convert V (x, y) to F(u, v) = f(u, v), + 
g(u, v)é,, and compute the divergence in the uv-coordinate 
system.) 


(c) Compute V - V in Cartesian coordinates. 


(d) Transform the result in part (c) to uv-coordinates. Compare to 
the result in part (b). 


The equations x = zzz» y = zy. define the tangent 
coordinate system. If F (u, v) is a scalar, use the following steps 
to derive an expression for V F in the tangent (uv) coordinate 


system. 


(a) Obtain the inversion formulas u — u(x, y), v — v(x, y). 


(b) From R = x(u, v)i + y(u, v)j, obtain the tangent vectors IR 


a 
ðu 
aR 
and FU 
(c) Obtain the unit tangent vectors €, and ê, then express the unit 
basis vectors i and j in terms of ê, and é,. 


(d) Write f(x, y) = F(u(x, y), v(x, y)), and use the chain rule to 
obtain f, and fy. 


(e) Convert V f = fsi + f,j to its equivalent in the uv-coordinate 
system. 


(f) Apply the result in part (e) to f = x?y?. (Transform f (x, y) 


to F(u, v), and then compute the gradient in uv-coordinates.) 

(g) Compute V f in Cartesian coordinates and, using the results of 
part (c), transform this gradient to skewed coordinates. 
Compare to the result obtained in part (f). 


Using the tangent coordinates defined in Exercise B21: 

(a) Obtain, in the uv-coordinate system, an expression for V?F, 
the laplacian of the arbitrary scalar-valued function F (u, v). 
(Write f(x, y) 2 F(u(x, y), v(x, y)), and use the chain rule 
to obtain fy, fys fex, and fyy. Convert V? f = f, + fyy to 
the desired expression in the uv-coordinate system.) 


(b) Apply the result in part (a) to f = x?y^. (Transform f (x, y) 
to F(u, v), and then compute the gradient in uv-coordinates.) 


(c) Compute V? f in Cartesian coordinates. 
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(d) Transform the result in part (c) to uv-coordinates. Compare to 
the result in part (b). 

(e) Check parts (a) and (b) with a computer algebra system in 
which the tangent coordinate system is known. 


Using the tangent coordinates defined in Exercise B21: 


(a) Obtain, in the wv-coordinate system, an expression for V - F, 
the divergence of the arbitrary vector F(u, v) = f(u, v)&, + 
g(u, v)é,. (Convert F to the form A (u, v)i + B(u, v)j, and 
apply the chain rule to a(x, y) = A(u(x, y), v(x, y)) and 
b(x, y) = B(u(x, y), v(x, y)).) 

(b) Apply the result in part (a) to the vector V = (2x?y — 3y?)i + 
(5xy? 4 4x?jj. (Convert V (x, y) to F(u, v) = f(u, v)&, + 
g(u, v)6,, and compute the divergence in the wv-coordinate 
system.) 


(c) Compute V - V in Cartesian coordinates. 


(d) Transform the result in part (c) to wv-coordinates. Compare to 
the result in part (b). 


(e) Check parts (a) and (b) with a computer algebra system in 
which the tangent coordinate system is known. 


The parabolic coordinate system is defined by x = + (u? — v?), 

y = uv, but the inversion formulas u = u(x, y) and v = v(x, y) 
are sufficiently complex as to warrant computational adjustments. 
For example, to obtain an expression for the gradient of the scalar 
F (u, v), the chain rule is applied to f(x, y) = F (u(x, y). 

v(x, y)) to obtain f, = F,u, + F,v, and f, = F,u, + Fyvy. 


(a) Using x — iQ? — v), y = uv, and implicit differentiation, 
obtain, in terms of u and v, expressions for uy, Uy, Uy, Vy- 
(Computer algebra systems typically have commands for 
implicit differentiation.) 

(b) From R = x(u, v)i + y(u, v)j and part (a), obtain the tangent 
vectors E and 2R 


u ðv 


(c) Obtain the unit tangent vectors ê, and ê,, and then express the 
unit basis vectors i and j in terms of ê, and é,. 

(d) Convert V f = fi + f,j to its equivalent in the parabolic 
coordinate system. 

(e) Check the result in part (d) with a computer algebra system in 
which the parabolic coordinate system is known. 

(f) Apply the result in part (d) to f = x?y?. (Transform f (x, y) 
to F(u, v), and then compute the gradient in the parabolic 
coordinate system.) 

(g) Compute V f in Cartesian coordinates and, using the results of 
part (c), transform this gradient to parabolic coordinates. 
Compare to the result obtained in part (f). 


. Using the parabolic coordinate system from Exercise B24: 


(a) Obtain, in the uv-coordinate system, an expression for V - F, 
the divergence of the arbitrary vector-valued function 
F(u, v) = f (u, v)&, + g(u, v)&,. (Convert F to the form 
A(u, v)i + B(u, v)j, and apply the chain rule to 
a(x, y) = A(u(x, y), v(x, y)) and b(x, y) = B(u(x, y), 
v(x, y)). Again, use implicit differentiation to obtain 
expressions for Uy, Uy, Uy, Uy.) 

(b) Apply the result in part (a) to the vector V = (2x?y — 3y°)i + 
(5xy? + 4x?)j. (Convert V(x, y) to F(u, v) = f(u, v)&, + 
g(u, v)é,, and compute the divergence in the parabolic 
coordinate system.) 


(c) Compute V - V in Cartesian coordinates. 

(d) Transform the result in part (c) to parabolic coordinates. 
Compare to the result in part (b). 

(e) Check parts (a) and (b) with a computer algebra system in 
which the parabolic coordinate system is known. 


Vector Operators in Cylindrical 


and Spherical Coordinates 


Introduction 


Tangent to a coordinate curve, a natural tangent basis vector is formed by differentiating R, 
the radius vector, with respect to the parameter defining the coordinate curve. For example, 
R in polar coordinates is a natural tangent basis vector but is not the unit vector eg. Although 
natural tangent basis vectors are generally not unit vectors, they are the basis vectors used 
when generalizing vector calculus to the domain of tensor calculus. 

In the orthogonal coordinate systems considered in this text, polar, cylindrical, and 
spherical, the basis vectors are unit vectors. The formulas developed in Section 22.2 for 


polar coordinates, and those to be developed in this section for the differential operators div, 
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grad, curl, and laplacian in cylindrical and spherical coordinates, all use unit basis vectors. 
Based on these coordinate systems, it should be possible for the reader to decipher the 
vector operators in other orthogonal coordinate systems. The reader who confronts these 
operators in coordinate systems that are not orthogonal must therefore be careful about the 
basis vectors used. 


Unit Basis Vectors 


The notation e, and eg was introduced for unit basis vectors in the polar coordinate system. 
With respect to these unit basis vectors in polar coordinates, a vector is expressed as F — 
fe, + geg and the gradient vector as grad(u) = u,e, + (ug/r)eg. For the vector F given in 
polar coordinates, the divergence was found to be div(F) = f, + i ft : go. 

All these results are predicated on the unit basis vectors e, and eg. Using this convention 
for basis vectors, Table 22.2 lists expressions for div, grad, curl, and laplacian in Cartesian 
and cylindrical coordinates, where e, = k. Expressions for these operators in polar coor- 
dinates can be deduced from those in cylindrical coordinates. In Table 22.3, these same 
operators are listed for the two different versions of spherical coordinates found in the 
literature. 


System Cartesian Cylindrical 
Basis i,j,k e;,ej,e.—k 
x x = rcos(@) 
Coordinates y y=rsin(@) 
u Ur 
grad = 1 
Vu ae 
u- ^ 
div s Joss 1 
v.p "E + 8y +h, wd \r + " +h, 
e, e- y » 
i i k ) = e = he — (rg) 
curl 3 3 3 ly — gz 7 r - 
= & a^ f.—h, a a B [el fk 
Ox Oy Oz f : a Wm ON . 
o f g h Sx — fy àr 90 dz (rg); = to 
i f rg h " 
aplaciz (Fit); D 
lapl —— U xx = Uyy + Uz ame —=s + X + Uzz 
V^u : r r2 


TABLE 22.2 Vector operators in Cartesian and cylindrical coordinates 


Symbols for the unit basis vectors in each system are provided in the order in which 
the basis vectors are used. Hence, in each coordinate system, vectors are of the form F — 
fei + ge» + hes, where the ordering 1, 2, 3 is determined by the way the basis vectors are 
listed in the tables. For each system the gradient vector is given as a column vector. It is 
therefore essential that the order of the basis vectors be known. For each system the curl 
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Spherical Spherical 
System $ measured down from z-axis 0 measured down from z-axis 
Basis €p, Cy, €p ep, €p, € 
x = pcos sin ġ x = pcos $ sin 0 
Coordinates y = psin sin ġ y = psing sind 
z = pcos ġ z = pcos 
Up Up 
1 1 
grad —U¢ —Ug 
Vu p 
m ug 
psing psinð 
div lo fip " (e sin ġ)ọ " ho (f), . (gsin8)s hy 
V.F p? p sin $ p sin ó p? p sin p sin Ó 
e, €; €g e, €p ep 
plsinó psing p plsinÓ  psinO p 
a a a a a a 
0p dh 00 dp 00 ap 
f pg ph sin $ f pg ph sin 0 
curl 
VxF h coso ho go h cos ; hs Eo 
psing p p sin ó p sinô p p sin 
fe h fo h 
- hp Es - hp 
psinó p psinO p 
g fo 8 fo 
p = == = ud 
p p 
laplacian (pu), , (ugsinó)s | — uss (ou,), . (us sin), Ugo 
V^u p ^ phsnó ` psi p? p? sind p? sin? 6 


TABLE 22.3 Vector operators in spherical coordinates 


is given both as a determinant and as a column vector. The top row in the matrix for each 
determinant shows the order of the basis vectors. The column vectors are consistent with 
the determinants expanded by the top rows of these matrices. In addition, the order of the 
basis vectors stated at the top of each column corresponds to the order of the components 
in the column vectors for the gradient and curl vectors. 

The two definitions considered for spherical coordinates differ by an interchange of 
the angles 0 and $. The resulting formulas are similar enough that not having a complete 
reference to both systems can be very confusing. Hence, we have chosen to list all formulas 
in both systems. Note, however, that in both versions of spherical coordinates, the second 
component belongs to the angle measured downward from the z-axis. 


Cartesian to Cylindrical Coordinates 


Table 22.1 collects the relationships between the gradient, divergence, curl, and laplacian 
in Cartesian and cylindrical coordinates. 


this table is of little value if its entries are not understood. 


FIGURE 22.8 Spherical coordinates 
where $ is measured down from the z-axis 


22.3 Vector Operators in Cylindrical and Spherical Coordinates 535 


GRADIENT The gradient in cylindrical coordinates is the vector 
uy (r, 0, z) 
uy (r, 8, z) 
7 
uz(r, 0, z) 


Vu = 


1 
= u, (r, 0, z)e. + -ug(r, 0, z)eg + uz(r, 0, z)ez 
F 


DivERGENCE A general vector in cylindrical coordinates is 
F = f'(r,0, z)e, + g(r, 0, z)eo + h(r, 0, ze, 


for which the divergence is the scalar 


V.F- f-(r,0,2) + 


,9,2 ^ 0.z 
f(r, 0, z) 4 go, 0, z) +h,(r,0,z) 
7 F 


The first two terms are often combined into the single term Ir fyc I(rf, +f)= f+ i uf 


Curt When the curl is learned in Cartesian coordinates, its determinant form is proffered 
as a mnemonic, or memory, aid. The determinant form in cylindrical coordinates should be 
interpreted in the same light. 

The determinant, expanded along the first row, yields the vector 


ho — (rg): 
" 
VxF-| fesh | =~ (ho (092 — eh. — fe) rg) — fo) 
(rg), — fo 
F 
LAPLACIAN In cylindrical coordinates, the laplacian is the scalar V7u = (ru,),/r + 


Ugo /r? + uzz, in which the first term can be expanded to (ru, +u;,) = Urr + Lu. 


Spherical Coordinates 


Consider, first, spherical coordinates listed in the center column in Table 22.3. The angle 
0 measures rotation around the z-axis and lies in the interval [0, 277]. The angle @ (“phi”) 
measures rotation down from the vertical and lies in the interval [0, 2]. The basis vector 
ey is considered the second basis vector. Figure 22.8 illustrates this definition of spher- 
ical coordinates for which (22.10) lists the formulas for mapping from and to spherical 


coordinates, respectively. 
p= / x2 + y? z? 


x = p cos 0 sin ġ @ = arccos Zz 
y-—psin0sinó 4> Jx? + y? + 22 (22.10) 
z = pcos ġ y 

0 = arctan — 


X 


Cartesian to Spherical Coordinates 


Table 22.3 collects the relationships between the gradient, divergence, curl, and laplacian 
in Cartesian and spherical coordinates. In addition, results are listed for both definitions of 
spherical coordinates prevalent in the literature. For both systems, always take the angle that 
is measured down from the z-axis as the second coordinate. Thus, the permanent is that 
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the second coordinate in the list of coordinates always refers to the same physical angle, 
regardless of the name used for it. 


GRADIENT The gradient vector is the vector 


Up 
1 
—Hu ugCp, $, 0) ugCp, $, 0) 
Vu -— p 9 = up, $,0)e, t eo p sin $ 
ug 
psing 


DivEeRGENCE The divergence of the vector 
F = f (p. 6,0)e, + g(p, $, Oey +h(p, p, 0)eo 


is the scalar 


= (Dp F3 (g um De 4 ho 
p” p sin $ p sin ó 
in which the first and second terms, respectively, expand to 


V.F 


i . . 2 1 ] ] g coso 

=P fo 2pf)-— fat —f and — (ga sin $ + gcos) = — 85 + - 

p p p sin ó p p sind 
(22.11) 


Curt The determinant that expresses the curl in spherical coordinates is just a mnemonic, 
or memory device. It does not have conceptual content. Expanding the determinant by the 
first row yields the vector 

€, 


(h sin — i= 
" ding P $)o — P80) 


eo . eo 
sang Sin 9 (P), DE 5 (085 fp) 212) 


Carrying out the differentiations and adopting subscript notation for the resulting partial 
derivatives then yields 


h cos I 1 I 
»(: zig t "$ Su )+e( fo - = hy) +00 DE ie) 
psng p  psing psing p p p 


(22.13) 


LAPLACIAN The laplacian of the scalar u(p, $, 0) is the scalar 


5 245)p Uy sin u 
Yu - V pp , | $ 96 00 


p? p? sing p? sin? $ 
where the first and second terms, respectively, expand to 


5 


1,» 2 
SP Upp +2PUp) =Upp + -up and (ugg Sind +ugcos@) (22.14) 
p^ p 


1 
p? sin $ 


Gradient—From Cartesian to Spherical 


As an illustration, we derive one of the entries in Table 22.3. As was done for the gradient 
in polar coordinates, the gradient in spherical coordinates can be deduced by transforming 
the result from Cartesian coordinates to spherical coordinates. 


EXERCISES 22.3—Part A 
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In Cartesian coordinates, the radius vector is R = xi+ yj + zk. In spherical coordi- 
nates it becomes R = x(p, $,0)i + y(p, 6, 0)j + z(p, d, O)k or, better still, 


R = pcosÓ sin $i + p sin 8 sin dj + pcos ók 


Unit vectors tangent to the coordinate curves are obtained by differentiating R with respect 
to each of p, 0, and ġ and then normalizing. The results are 


e, = cos sin di + sin@ sin dj + cos dk (22.15a) 
e; = cos 0 cos di + sin 8 cos dj — sin jk (22.15b) 
ej; = — sin 6i + cos 6j (22.15c) 
which, when solved for i, j, k, give 
i = —sin6eg + cosÓ sin de, + cos 6 cos $e; (22.16a) 
j= cos Oe, + sin 0 sin de, + sin 0 cos peg (22.16b) 
k = cos $e, — sin $e; (22.16c) 


In Cartesian coordinates grad(u) = uxi + uyj + u,k, so we need to invoke the chain 
rule to express the derivatives in terms of spherical coordinates. For this, start from the 
identity 


u(x, y,z) = U(p(x, y, z), OQ y, z), dx, y, Z)) 


and differentiating by the chain rule, obtain 


Ux = Uppy + Uphs + Usb, (22.17a) 
uy = Uppy + Uppy + Usd, (22.17b) 
uz = Upp: + Ugh + Us, (22.17c) 


Replacing the derivatives with their equivalents from Table 22.4 and simplifying the assem- 
blage of all the terms, we find 


(22.18) 


U, ,0,0 U, 0,0 
VU = U,(p, d, Bey + APEP oy 4 P.O) 


psing 


px = sing cos 0 py = sing sind p; = cos ġ 
cos cos Ó cos @ sin 0 sing 
$x = ———_ oy = —— $: = ——— 
p p p 
isis sing 6, = cos? 6, =0 
p sinó s psing 


TABLE 22.4 First parital derivatives of p(x, y, z), $ (x, y, z), and 
0(x, y, Z) 


A]. Verify the simplifications in (22.11). 


A4. Verify the simplifications in (22.14). 


A2. Verify that a row-one expansion of the determinant in the middle AS. Show that (22.152), (22.15b), and (22.15c) indeed lead to (22.162), 


column of Table 22.3 leads to (22.12). 


(22.16b), and (22.16c). 


A3. Show that (22.13) is the simplification of (22.12). A6. Verify the derivatives listed in Table 22.4. 
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EXERCISES 22.3—Part B 


B1. Use Table 22.4, along with (22.17a—c), and (22.16a—c), to show 
(22.18) is grad(u) in spherical coordinates. 


For the scalar f(x, y, z) and point p = (xo, yo, zo) given in each of Ex- 
ercises B2-11: 

(a) Compute V? f, the laplacian, and evaluate it at p. 

(b) Transform f to spherical coordinates by writing F (p, ġ, 0) = 


f (x€o, $. 0). y (o. $, 0), z(p. o. 0)). Express p as a point P 
in spherical coordinates. 

(c) Compute V? F, the laplacian in spherical coordinates, and 
evaluate it at P. Since this is a scalar, the value should be 
exactly the one found in part (a). 


(d) Compute V f, the gradient, and evaluate it at p. 


(e) Compute V F, the gradient in spherical coordinates, and 
evaluate it at P. This vector will not match the result in part 
(d) until a change of basis is effected. 

(f) Evaluate the unit basis vectors e,, e;, e; at P and express VF 
in terms of i, j, and k. Agreement with V f at p should now be 
achieved. 


B2. 
B3. 


f(x, y, 2) =x°z + 6y3, p = (1,7, —9) 
f@, yz) =2yz — 7x2’, p = (7, —6, 6) 


B4. f(x,y,z) =xy* +27, p = (6,9, —1) 
Bs. f(x,y,z) = 2xz* — 8y°, p = (2, —4, —5) 
B6. f(x, y, z) = 6y!z — 4x7, p = (4, 2, —6) 


B7. 
B8. 
B9. 
B10. 
B11. 


fŒ y. z) = 8x?y --9xz?, p = (2,2, 7) 
f@, y, 2) = 7x’y — 2yz?, p = (1,7, —5) 
f(x, y, z) = 8x’y — (yz, p = (0, —5, —3) 
f(, yz =3y? +z p = (2,2, 8) 

f(x, y, z) = Ayz + 8? z), p = (6, —7, 8) 


For the vector f(x, y, z) and point p = (xo, yo. zo) given in each of Ex- 
ercises B12—21: 


(a) Compute V - f, the divergence, and evaluate it at p. 

(b) Transform f in Cartesian coordinates to F in spherical 
coordinates: transform the component functions by 
coordinate-substitution, and change the basis vectors from 
i,j, K, to e; , eg, ej. 

(c) Express p as a point P in spherical coordinates. 

(d) Compute V - F, the divergence in spherical coordinates, and 
evaluate it at P. Since this is a scalar, the value should be 
exactly the one found in part (a). 

(e) Compute V x f, the curl, and evaluate it at p. 

(f£) Compute V x F, the curl in spherical coordinates, and 


evaluate it at P. This vector will not match the result in part 
(e) until a change of basis is effected. 


B12. 
B13. 
B14. 


B15. 
B16. 


B17. 


B18. 


B19. 


B20. 


B21. 


B22. 


B23. 


B24. 


(g) Evaluate the unit basis vectors e,, eg, e; at P, and use these 
results to express V x F in terms of i, j, and k. Agreement 
with V x f at p should now be achieved. 


2 


f = (6xz + 5x)i + (52 — 6y?)j + Oy?z — xy)k, p = (6,5, —6) 
f = (8 + 6x?)i + (9z + 2xy”)j + (2? — 9xy)k, p = (2, —9, 1) 


f = Oy — 7y)i + (92 y — 3x2)j + (8y?z — xyz)k, 
p= (6,8,9) 


f = (9x?y + 223)i + (y? — 7xyz)j + (4+ 8x)k, p = (7, —7, 5) 
f = (5xy? + 8? y)i + Qx? y + 4x7)j + (92? — y)k, 
p = (9, —3, 6) 


f = (9xz? + x?y)i + (4y + 63)j + Gy? + 6xz)k, 
p—(,5,4) 

f = (xy? + 8xyz)i + (6 + 5x2)j + (8z? + Ax?z)k, 
p= (1,3; —1) 

f = (8xy? — xy)i + (Uxz? — 2yz2)j + (52 — 7yz?)k, 
pc(3 2.3) 

f = (6y? — zi + (?y — 8xy?)j + By? — 2xy)k, 
p= (Q9,—2,4) 

f = (6x?y — x?z)i + Qxy — 9x?2)j + (?z — x?)k, 
p = (3, —3, —2) 

Using a computer algebra system, derive the expression for the 
laplacian in spherical coordinates. 


(a) Obtain expressions for the nine derivatives p,,..., 0,, where, 


for example, po, = 


(b) Apply the chain rule to f(x, y, z) = F(p(x, y, z), ġ (x, y, z), 
0 (x, y, z)) to obtain the first partial derivatives fy, fy, fz. 

(c) Apply the chain rule to the derivatives found in part (b), 
obtaining the second derivatives fix, fyy, f... 

(d) Obtain the spherical-coordinate equivalent of fy» + fj, + f... 

Using a computer algebra system, derive the expression for the 

divergence in spherical coordinates. 

(a) Start with the vector F = U (p, $,0)e, + V (p, 6, 0)e; + 
W(p, $, 0)eo and convert it to Cartesian coordinates, 
obtaining f = a(p, $, 0)i 4- b(p, $, 0)j -- c(p, $, O)k. 

(b) Write A(x, y, z) = a(p(x, y. z), (x, y. z), A(X, y, z)), with 
similar expressions for b and c, and use the chain rule to 
obtain the derivatives A,, By, and C.. 

(c) Obtain the spherical-coordinate equivalent of A, + B, + C;. 

Using a computer algebra system, derive the expression for the 

curl in spherical coordinates. 

(a) Start with the vector in Exercise B23, part (a). As in part (b) 
of that exercise, obtain the derivatives A,, Az, Bx, Bz, Cy, Cy. 

(b) In V x f = (C, — B,)i+ (A, — C,)j + (B, — Ay)k, replace 

the derivatives with their values from part (a) and replace the 
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vectors i, j, k with their equivalents in terms of e,, eg, eo, 
thereby obtaining V x F in spherical coordinates. 

. The laplacian in spherical coordinates can be derived with a 
computer algebra system as follows. 


(a) Instead of starting with the generic f(x, y, z) = F(p(x, y. z), 


(x, y, 2,0 (x, y, z)), write f(x, y, z) = F( yx? + y? + z, 
arctan ET arccos +) and compute fy» + fyy + f... 
xy i 
(b) Restore the variables p, $, 0 and simplify, obtaining the 
expression for the laplacian in spherical coordinates. 
Using the technique of Exercise 25, obtain the divergence in 
spherical coordinates. 


(a) Start with F as in Exercise 23, part (a), and obtain f, as 
indicated. Instead of writing A(x, y, z) = a(p(x, y. z), 


(x, y, z), A(x, y, Z)), write A(x, y, z) = a(/ x? + y? +27, 


arctan , arccos 7). The component A contains the 


coefficients U, V, W from F and the variables p, $, 0 that are 
present explicitly, having been inherited from the change of 
basis vectors from e, , €g. eo, to i, j, k. So also with B and C. 
Now compute A, + B, + C;. 

(b) Restore the variables p, $, 0 and simplify, obtaining the 
expression for the divergence in spherical coordinates. 


. Using the technique of Exercise 25, obtain the curl in spherical 
coordinates. 


(a) Proceed as in Exercise 26, part (a). Compute the derivatives 
Ay, Az, Bz, Bz, Cy, Cy. 

(b) In V x f = (C, — B,)i+ (A, — Cy)j + (B, — A,)k, replace 
the derivatives with their values from part (a) and the vectors 
i, j, k with their equivalents in terms of ep, e;, eo, thereby 
obtaining V x F in spherical coordinates. 


The equations uy = ux (x, y, z), k = 1, 2, 3, define an orthogonal 
coordinate system, if, for R = uii + u»j + u3k, the tangent 
vectors OR/du,, k = 1, 2, 3, are mutually perpendicular. For such 
a system, define the scale factors hy = ||9R/9u; || and obtain the 
unit basis vectors e; = (1/hx)(AR/du;), k = 1, 2, 3. Then, as 
shown in [84], 


i IST NE a 
(i) Von, H2; us) T Ay ðu i h2 du2 + ha ðu3 
(ii) V + A(u1, U2, U3) = 


l EXCEL : (Azhıh3) + x Asia) | 


hihoha | du, uz 


hye, he2 h3e3 
cee 1 os a 2 
(iii) Vx AG, u», u3) = àu1 aur Qua 


hih2ha 
Ahı Ash» A3h3 


. 9 
(iv) V^$(uj, u2, u3) = 
1 a (hh 06 Y |, 9 (hahj ð | | 8 (uh 3 
hyhah3 | duy hy dy O 3u hy dun) | du3 h3 Qua 


(a) Obtain the scale factors for the spherical coordinate system. 


(b) Show that (i) gives the gradient in spherical coordinates. 


. 
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(c) Show that (ii) gives the divergence in spherical coordinates. 
(d) Show that (iii) gives the curl in spherical coordinates. 


(e) Show that (iv) gives the laplacian in spherical coordinates. 


. The 6-sphere coordinate system is defined by the equations 


u v y w 


y7 z, —-— 7, Z = ——5 jl. 
uc-Ev^- rur ^ s ure tw u*Tv*-crw^* 


(a) From R = x(u, v, w)i + y(u, v, w)j + z(u, v, w)k, obtain the 


tangent vectors 2E, 28 2R and verify that the coordinate 


: du? ðv’ dw 
system 1s orthogonal. 


x= 


(b) Obtain as space curves, the coordinate curves defined by this 
system. 

(c) Obtain the scale factors for this coordinate system. 

(d) Using (i) in Exercise B28, obtain the gradient in these 
coordinates and check via a computer algebra system. 

(e) Using (ii) in Exercise B28, obtain the divergence in these 
coordinates and check via a computer algebra system. 

(f) Using (iii) in Exercise B28, obtain the curl in these 
coordinates and check via a computer algebra system. 

(g) Using (iv) in Exercise B28, obtain the laplacian in these 
coordinates and check via a computer algebra system. 


. One definition of the paraboloidal coordinate system is given by 


the equations x = uv cos w, y = uv sin w, Z = La? —v’). 
Repeat the steps of Exercise B29 for these coordinates. 


The bispherical coordinate system is given by the equations 
xc i sinu cos w, y = i sinu sin wW, Z = I sinh v, where 
d — cosh v — cos u. Repeat the steps of Exercise B29 for these 


coordinates. 


| 


. For the 6-sphere coordinate system of Exercise B29: 


(a) Obtain the equations u = u(x, y, z), v = v(x, y, z), 
w = w(x, y, Z). 

(b) Obtain graphs of the coordinate surfaces, u = constant, 
v — constant, w — constant. 

(c) Use the built-in functionality of your favorite computer 
algebra system to draw these coordinate surfaces without the 
need for the explicit formulas found in part (a). 


. Obtain graphically, the coordinate surfaces for the paraboloidal 


coordinate system in Exercise B30. 


. Obtain graphically, the coordinate surfaces for the bispherical 


coordinate system in Exercise B31. 


. Repeat the steps of Exercises B2-11 for the 6-sphere coordinate 


system and the data in Exercise B2. 


Repeat the steps of Exercises B2-11 for the paraboloidal 
coordinate system and the data in Exercise B3. 


. Repeat the steps of Exercises B2-11 for the bispherical 


coordinate system and the data in Exercise B4 but with 
P = ($2, 21 v2), 0). 
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Chapter 22 NonCartesian Coordinates 


Chapter Review 


1. 


. Use an example to illustrate that the Jacobians 


. Compute the Jacobian 


Let ®, given by u = 7x — 3y, v = 5x + 2y, define a coordinate 
change on the xy-plane. Demonstrate why, in a double integral, 
dx dy must be replaced with Pr [du dv when invoking this 
change of coordinates. This demonstration might include the 


following steps. 


(a) Obtain x = x(u, v) and y = y(u, v). 

(b) Find the coordinates of the points in the xy-plane to which ^! 
maps (0, 0), (1,0, (1, 1), (0, 1). 

(c) Find the area of the parallelogram in the xy-plane formed by the 
points determined in part (b). 

(d) Find the value of the Jacobian aon and relate the area found in 
part (c) to the value of the Jacobian found in part (d). 


. Explain the difference between mapping the xy-plane to the 


uv-plane and changing coordinates from x and y to u and v. 


a(x, y) 


ð ) 
and (u,v) 


(u,v) d(x, y) ate 


reciprocals. 


Use an example to illustrate that the Jacobian matrices Jẹ and Jg-1 
are multiplicative inverses of each other. 


Zaa for spherical coordinates. Take 
(u, v.w) 


(u, v, w) = (p, $, 0) in a mathematical context and (p, 0, $) in an 
applied context, but in either case, the second variable should refer 
to the angle between the z-axis and the radius vector. 


. Let u(x, y) = x2y*. 


(a) Obtain Vu in Cartesian coordinates. 


(b) Transform Vu to a vector in polar coordinates, being sure to 
change basis vectors from {i, j} to the unit vectors (e, , êp}. 


(c) Obtain U(r, 0) = u(x(r, 0), y(r, 9)) and, from it, the gradient in 
polar coordinates. Compare to the result in part (b). 


(d) Obtain V?u, the laplacian of u in Cartesian coordinates. 
(e) Transform V?u to polar coordinates. 


(f) Obtain the laplacian of U (r, 0) directly in polar coordinates, and 
compare to the result in part (e). 


. Let v = Si 7j. 


(a) Obtain V - v, the divergence of v, in Cartesian coordinates. 
(b) Transform the divergence to polar coordinates. 
(c) Transform v to V, its equivalent in polar coordinates. 


(d) Obtain the divergence of V directly in polar coordinates, and 
compare to the result in part (b). 


Let u(x, y, z) = xyz. 


(a) Obtain Vu in cylindrical coordinates. 


(b) Transform Vu to a vector in cylindrical coordinates, being sure 
to change basis vectors from {i, j, k} to the unit vectors 
{ê,, ês, ê}. 


10. 


11. 


(c) Obtain U(r, 0, z) = u(x(r, 0), y(r, 0), z), and from it, the 
gradient in cylindrical coordinates. Compare to the result in 
part (b). 

(d) Obtain V?u, the laplacian of u in Cartesian coordinates. 

(e) Transform V?u to cylindrical coordinates. 

(f) Obtain the laplacian of U (r, 0) directly in cylindrical 
coordinates, and compare to the result in part (e). 

Let v = xyi+ yzj + zxk. 

(a) Obtain V - v, the divergence of v, in Cartesian coordinates. 

(b) Transform the divergence to cylindrical coordinates. 

(c) Transform v to V, its equivalent in cylindrical coordinates. 


(d) Obtain the divergence of V directly in cylindrical coordinates, 
and compare to the result in part (b). 


(e) Obtain V x v, the curl in Cartesian coordinates. 
(f) Transform the curl to a vector in cylindrical coordinates. 


(g) Obtain the curl of V in cylindrical coordinates and compare to 
the result in part (f). 

Let u(x, y, z) — xyz 

(a) Obtain Vu in spherical coordinates. 


(b) Transform Vu to a vector in spherical coordinates, being sure tc 
change basis vectors from {i, j, k} to the unit vectors 
{@,, êg. ĉo}, where $ is the angle from the z-axis to the radius 
vector. 


(c) Obtain U (p, ġ, 0) = u(x(p, $.0). y (o, $, 0), z(p, $, 0)) and, 
from it, the gradient in spherical coordinates. Compare to the 
result in part (b). 


(d) Obtain V?u, the laplacian of u in spherical coordinates. 
(e) Transform V?u to spherical coordinates. 


(f) Obtain the laplacian of U (r, 0) directly in spherical coordinates. 
and compare to the result in part (e). 


Let v = xyi + yzj + zxk. 

(a) Obtain V - v, the divergence of v, in Cartesian coordinates. 
(b) Transform the divergence to spherical coordinates. 

(c) Transform v to V, its equivalent in spherical coordinates. 


(d) Obtain the divergence of V directly in spherical coordinates, 
and compare to the result in part (b). 


(e) Obtain V x v, the curl in Cartesian coordinates. 
(f) Transform the curl to a vector in spherical coordinates. 


(g) Obtain the curl of V in spherical coordinates and compare to the 
result in part (f). 


EXAMPLE 23.1 


FIGURE 23.1 The surface S| in 
Example 23.1 


Chapter 25 


Miscellaneous Results 


INTRODUCTION This chapter contains a miscellaneous mix of four ideas. First, 
we see Gauss' Theorem, which appears repeatedly in courses on electricity and magnetism. 
Then, we show how to compute the surface integral for a surface given parametrically. Next, 
we derive the equation of continuity and gives some of its consequences; finally, we state, 
illustrate, and derive Green's first and second identities. 


Gauss’ Theorem 


Let Sı be a closed cylinder of radius 1 and height 2, with axis along the z-axis and situated 
between z = 1 and z = 3. Let Sz be the same cylinder but situated between z = —1 and 
z = 1. The origin is not inside $4 but is inside $5. We will show that the surface integral 


r 
N-(—)d 23.1 
I (5) 7 ( ) 
is zero for Sı and 47r for S5. 


A sketch of Sı, along with several outward normal vectors, is shown in Figure 23.1. 


To construct the integrand, first define the vector 
r D pe à 
F = = (x? +y +z) (eit yj + zk) (23.2) 
y 


The unit normal on top of the cylinder is k and on the bottom is —k. On the top and bottom 
of the cylinder, do = dx dy. The sum of F- k dø for z = 3 and z = 1 is 


3 1 
77 35 | dx dy (23.3) 
(x2 +y +9) ey 
The combined surface integral for the top and bottom of the cylinder is taken over the unit 
disk. Hence, v to polar coordinates to obtain 


(1-4 72^ — (9. 29? 
TE FT e) | aerial) (23.4) 


(9 4- r2? (14-2)? 


The curved wall of the cylinder is described implicitly by g(x, y, z) = x? + y? — 1 = 0, 
which has no projection onto the xy-plane. Therefore, project to the xz-plane and solve for 
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y = y(x, z) = +V1 — x?, giving 


x dx dz 
do = Jl-cTyltyidxdz- 


/1—-x? 
On the curved wall of the cylinder the unit normal vector N — xi 4- yj can be obtained from 
the gradient vector Vg — 2(xi 4- yj). so 


(23.5) 


"m 
F.Ndo — aar zz dx dz (23.6) 
V1 = x? (x2 +y? +22)" 
arises for both projections onto the rectangle R}, = {-1 < x € 1,1 < z x 3}. Since 


y, z) appears only as y?, we can double the contribution of one projection, obtaining 


JN 5 dx dz = e 2( 7. -1) (23.7) 
1 Jat 1— x? (1422)? J/5 


and the total contribution of all the surface integrals is then 0. 

Next, slide the cylinder down two units so that it lies between z = —1 and z = 1. 
Then, the unit normals on top, bottom, and side of 5» are still k, —k, and N, respectively. 
The functions g(x, y, z) and y = y(x, z) are also the same, as is do on the curved wall 
of the cylinder. Thus, the combined integrands for the top and bottom surfaces will be 
2(1 + x? + y?) 97? and the surface integral, in polar coordinates, will be 


2x 1 ? 
f / o din dr dt = 2x (2 — V2) (23.8) 
o0 Jo (1-72) ^ 


The integrand for the surface integral on the curved wall of the cylinder, namely, 
F-Ndo,is again the same, so the surface integral itself is 


1 pl 
1 
2 ; 
NE V1—x?(14 gy"? 
Hence, the total of the surface integrals is the predicted 42 and we have shown that (23.1) 


evaluates to 0 for a surface S; not enclosing the origin, and to 4z for a surface $5 which 
does enclose the origin. E 


dx dz = 2n 42 (23.9) 


This result is true in general and is known as Gauss' Theorem. This should not be 
confused with the divergence theorem, sometimes called the Gauss' divergence theorem, 
which is used in the proof of Gauss' Theorem, but is not equivalent to it. 


THEOREM 23.1 GAUSS’ THEOREM 
Let S be a closed surface with unit outward normal N and surface area element do. 


Letr = xi+ yj 4- zk be the radius vector from an origin O to the point (x, y, z), and 
let r = yx? + y? + z? be the scalar magnitude of the radius vector. Then 


N. G jo O if O lies outside S 
- ,3]*? T Van if O lies inside S 


Pnoor or Gauss’ THEOREM Case (1) Let O lie outside the surface S, which encloses 
the volume V. As long as the tip of the radius vector r lies outside S, r cannot be zero in 
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V, so the integrand in the volume integral remains finite and we can apply the divergence 
theorem fff, V-Fdv = ff F- Ndo, with F given by (23.2), for which V - F = 0, as a 
routine calculation shows. Hence, we get [f N- (5)do = fff, 0dv — 0. 

Case (2) Let O lie inside S so that there is one point inside S, namely O itself, at which 
r = 0. Because of the singularity so introduced, the divergence theorem cannot be applied 
to V, the region inside S. However, if O is surrounded by a small sphere s of radius a, 
the region inside S$ but outside s is one for which r isn't zero. The boundary of this closed 
region V' is S + s. Apply the divergence theorem to the closed surface S + s that encloses 
the volume V' and obtain 


ff v Can f ur fen ee fo O0 


The surface integral over S + s is zero because V’ does not contain O. The significant 


conclusion is that 
JIN )de = = - ff s-( ) do 


The surface integral over S can’t be pm because S is a uer surface, but that surface 
integral is equivalent to one over a small sphere of radius a. Now that surface integral can 
be computed. 

The origin O from which the vector r emanates is now at the center of the small sphere 
s. Describe this small sphere implicitly with f (x, y, z) = x? +y? +z? —a? = 0. To perform 
the surface integration on this small sphere, a unit normal vector N, a radius vector r with 
tip on the surface of the sphere s, and a surface area element do are all needed. The unit 
normal vector is obtained by normalizing the gradient vector computed for f. However, 
this normal vector must point outward on the surface S + s, which is “outward” on S but 
"inward" on the small sphere s! (This calculation is much like Example 21.9 in Section 
21.3.) The gradient vector for the small sphere is V f = 2(xi + yj + zk), so an outward 
unit normal on s, pointing toward the void inside S is N = -lQi + yj + zk). As for Case 
(1), both the surface and volume integrals require use of the vector F given by (23.2) and 
F-N=-— + on the surface of the small sphere s. Hence, the surface integral on S becomes 


l[ he f o f e 
E do = cma — 


THEOREM 23.2 GAUSS’ THEOREM IN THE PLANE 


Let C be a simple closed plane curve with unit outward normal N and arc-length 
element ds. Let r = xi + yj be the radius vector from an origin O to the point (x, y). 


Then r = yx? + y? and 


r 0  ifO lies outside C 
gn i (3) aj a if O lies inside C eM) 


The two-dimensional version of Gauss’ Theorem differs slightly from the three-dimen- 
sional case. In the plane, both the integrand and the computed value differ and, instead of 
a surface integral, there is a line integral. 
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EXAMPLE 23.2 


EXERCISES 23.1-Part A 
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Writing the vector 5 as 
r 


F= 5 =fitsj= 


xX 
i+ 

x2 + y? x? + y 

and noting that the line integral in (23.10) is a flux integral, it can be written in the more 

familiar form 


~ 


$x : (5)as =$ fay — gdx (23.11) 


(See, e.g., Section 19.2, where the flux integral in the plane was first developed.) 

The proof parallels exactly the proof seen for the three-dimensional case, provided the 
divergence form of Green's Theorem is used instead of the divergence theorem. The proof 
is left as an exercise, but the following example is provided. 


Let C be a circle of radius 1, with center at (0, 2) on the y-axis. If the origin O is taken as 
(0, 0), then O lies outside of C. Parametrize C via the obvious x = cos p, y = 2 + sin p so 
that (23.11) becomes 


?r2sinp 4-1 

$ fdy—gdx = f ZPT dines (23.12) 
C o 5+4sinp 

Now, move the circle so it encloses O. For example, let the circle have its center at the 


origin so that it is parametrized by x = cos p, y = sin p, in which case (23.11) becomes 
fo fdy—gdx = fy 1dp = 2r. * 


Al. 


A2. 


A3. 


A4. 


Verify that the sum of F - N do on the top and bottom surfaces of AS. Verify the integral and its value in (23.7). 


Sı in Example 23.1 is given by (23.3). 


Verify that when evaluated on the top and bottom surfaces of Sin — A7 


Example 23.1, (23.1) becomes (23.4). 


Verify that (23.5) gives do for the curved wall of S, in Example 


23.1. 


A6. Verify the integral and its value in (23.8). 
. Verify the integral and its value in (23.9). 
AS. Verify the integral and its value in (23.12). 


A9. Prove Gauss' Theorem in the plane. 


Verify that (23.6) gives F - N do for the curved wall of S, in 


Example 23.1. 


EXERCISES 23.1—Part B 


B1. If the origin is O — (0, 0, 0), verify Gauss' Theorem for the cube B4. If the origin is O — (0, 0), verify Gauss' Theorem in the plane for 


B2. 


B3. 


(a) 1x «3,1 «y €3,1] €z€3 


(b) |x| < 1, iy] Llz < 1 


If the origin is O = (0, 0, 0), verify Gauss’ Theorem for the 


cylindrical “can” bounded by 


the closed curve C determined by 
(a) the parabola y = 1 + x? and the line y = 2x + 9. 
(b) the parabola y = x? — 1 and the line y = 2x +7. 
B5. If the origin is O — (0, 0), verify Gauss' Theorem in the plane for 


()x-y!-Lz21z23 (bxiy-iz-z3 the closed curve C determined by 


If the origin is O — (0, 0, 0), verify Gauss' Theorem for the closed 


surface bounded by 


(a) z = 1 — x? — y? and z = 


1 

5 
2 

X 


(bz-1-x?- y? andz — x 


5 


Ty 


-1 


(a) the parabolas y = x? — 4 and y = g= 


(b) the parabolas y = x? — 4 and y = ix? 3-2. 
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B6. If the origin is O — (0, 0), verify Gauss' Theorem in the plane for (b) Show that in two dimensions, the only value of n for which 


r/r" is solenoidal is n — 2. 


(b) x = 3cos0, y =5+2sin6 B8. Show that in three dimensions, the only solenoidal field of the form 


(a) x = 3cos0, y = 2sin0 


B7. A key step in the derivation of Gauss' Theorem is discovering that 


F=rf(r)isF= C5. 


F= = and F = E are solenoidal fields in three dimensions and B9. Show that in two dimensions, the only solenoidal field of the form 


two dimensions, respectively. 


F=rf(r)isF= C5. 


(a) Show that in three dimensions, the only value of n for which 


r/r" is solenoidal is n — 3. 


| Surface Area for Parametrically Given Surfaces 


Explicitly Given Surface 


Recall that for the surface given explicitly by z — z(x, y) the element of surface area is 


given by 
do = J1-F z2--z? dx dy (23.13) 


obtained as the area of the parallelogram spanned by infinitesimal vectors tangent to the 
two coordinate curves 


R, =xi+ fjez(G. B)k and R,-oi-yj-z(o, y)k 
Thus, do = |T. x T,|, where T, = (i + z,k) dx and T, = (j + zyk) dy. 


Implicitly Given Surface 


If the surface z = z(x, y) is defined implicitly by f(x, y, z) = 0, the derivatives 


z =-= and z, =-= (23.14) 


(23.15) 


Parametrically Given Surface 


SURFACE AREA ELEMENT If the surface is given parametrically in terms of the two param- 
eters u and v by x = x(u, v), y = y(u, v), z = z(u, v), then the element of surface area is 


given by do = ,/ A + de + E du dv, where 
2090.2 |y » 
1 (u,v) Zu Zv 


O(Z,%)  |Zu £v 
2 = = 
^ dtu, v) Xu Xv 


= yu£v — YvZu 


= ZyXy — ZyXu 


a(x, y) A, X 
3 — =; 
9 (u, v) Yu Yv 


= Xu Yv — Xv Vu 


are Jacobians. 
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EXAMPLE 23.3 Parametric equations for the surface of a sphere of radius a and the resulting Jacobians Jz, 
k = 1, 2,3, are 


x — acosÓ sin ġo Ji = —a? cos 8 sin? ó 
y —asinÓsinó => J = —a?sin? 9 sin0 (23.16) 
z-—acosó J; = —a? sing cos ó 


Then, do = a? sin $ dé d$ and the surface area of the sphere is given by mma sin $ dé 
d$ = 4na’. 

It is also instructive to obtain from first principles, the expression for do in this example. 
Thus, form coordinate curves on the sphere, differentiate to form tangent vectors, and find 
do as the length of the cross-product of these tangent vectors. 

On the surface of the sphere, let a curve for which @ = f be Rg and let acurve for which 
6 =a be Rg, as listed in Table 23.1. Differentiating with respect to the curves’ parameters 
yields the tangent vectors T5, and Tg, listed in Table 23.1 for the generic point (0, $). The 


area spanned by these tangent vectors is | T5 x Ty|] = a’ sin $, from which the expression 
for do is obtained. $ 
R; = a(cos ð sin Bi + sin 0 sin Bj + cos Bk) T; = a(— sinÓ sin di + cos 8 sin dj) 
R; = a(cosa@ sin $i + sino sin dj + cos dk) T, = a(cos8 cos gi + sin 0 cos dj — sin ok) 


TABLE 23.1 Coordinate curves and their tangent vectors on a sphere 


GENERAL DERIVATION Using the same technique of forming coordinate curves, differen- 
tiating to form tangent vectors, and computing the area of the parallelogram so spanned. 
we can derive the general result for do for the surface given parametrically by x = x(u, v). 
y = y(u, v), z = z(u, v). The radius vector to a point on the surface is then 


R = x(u, v)i + y(u, v)j + z(u, v)k 
On the surface, let 
R, = x(u, B)i + y(u, Bj+zu, Bk and R, = x(o, v)i + y(o, v)j + z(o, v)k 


be curves for which v = f and u = o, respectively. Differentiate with respect to u and v 
to form vectors tangent to these curves, obtaining 


T, = Xni + Yuj + zuk and T, =x,i+ y,j+z.k 


The cross-product of these two tangent vectors must be a normal vector N = T, x T, whose 
value we obtain from a row-one expansion of the determinant 


oO — t 0o R t 


FIGURE 23.2 Example 23.4: The 
cylindrical surface S and its projections 
onto the xy-plane and yz-plane 


EXAMPLE 23.4 
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This gives 

N= Yu Zu i— Xu Zu j+ Ky Yu k 

Yv £v Xv Zv Xy Vy 
= Yu X i= Xu Xy i+ Xu Au k 

Su =p <u <v Yu Yv 

Yu Yu}. Zu Zul a Xu Xv 
= IT - | JT |e MI 

<u Sv Xu Xv Yu Yo 


8 2) a(z, x), | Ox, y) 
d(u, v) atu, vy! oa(u, v) 


with length ||N]| = Jot-- ag > ad. 


FLUX THROUGH PARAMETRICALLY GIVEN SURFACE The flux of the vector field 


k= Jit Joj + Jak 


F = P(x, y, z)i + Q(x, y, 2j + R(x, y, 2k 
through the surface S is 


Íl Pdydz+ f] Qdzdx+ ff Rdx dy (23.17) 
Ra Rey 


In the leftmost integral, the region Ry, is the projection of the surface S onto the yz- 
plane and the integration, merely a double integral (not a surface integral), is carried out 
over R,,. In the middle integral, the region Rz» is the projection of the surface S onto the 
zx-plane and the integration, merely a double integral (not a surface integral), is carried out 
over R,,. In the rightmost integral, the region R,, is the projection of the surface S onto 
the xy-plane and the integration, merely a double integral (not a surface integral), is carried 
out over Ry. 

As strange as this seems, this form of the flux integral is our best analog for the work 
integral. Recall that work is defined as the line integral of the component of the field 
tangential to the path of integration, that is, as 


[F6 | F-dr= f fax+gdy+haz 
C C C 


The flux, however, is the surface integral of the normal component of the field, that is, 
r i" F-Ndo. There is no perfect analog to f dx + g dy + h dz for the flux integral, but 
(23.17) is close to being F dotted with something. 

We conclude this discussion by showing how this formula can be obtained from the 
expression for flux through a parametrically given surface. But first, an example. 


yz 


Find the flux of the field 
F = Pi + Qj + Rk = zi + xj — 3y?zk 


through the surface S, the first octant portion of the cylinder g(x, y, z) = x? + y? — 16 = 0 
lying between z = 0 and z = 5, shown in Figure 23.2. The projections of S onto the xz-plane 
and the yz-plane are rectangles. There is no projection of S onto the xy-plane. 
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The Old Way Compute the flux through S by integrating F - N do on S. From Vg — 
2(xi + yj), obtain N = iGd + yj), a unit normal field on S. Since the surface S is 
parallel to the z-axis, g(x, y, z) — 0 cannot be solved for z — z(x, y). Instead, solve for 


y = y(x, z) = 416 — x?. The surface area element is do = Aem, so the flux is 


f [ (—— +x) dzdx = 90 (23.18) 
V16 — x? 


The New Way Now, compute the flux by (23.17). Since S has no projection onto the 
xy-plane, the rightmost integral vanishes. Hence, the flux is 


5 p4 5 p4 
Í Í zdydz+ i { xdx dz = 90 o 
o Jo o Jo 


The General Case In the general case, the surface S is given parametrically by x = 
x(u, v), y = y(u, v), z = z(u, v); the field is F = P(x, y,z)i+ QO, y, 2j + R(x, y, Ok: 


and a normal to S is Jji+ J2j + J3k, which comes from n = —zji — zyj +k and 
8(y.z) ü(z,x) 
"e auv) —— J; _ auv) —— Jo 
îs = Faye and Zy = -5y = Th (23.19) 
a(u,v) 2 ə (u,v) 


so that we get n = G Ji + (2 )j +k or i+ Joj + Jk. A unit normal, and the integrand 
of the flux integral Become, eapextivaly, 


Jii 4- bj + Ik _ PAAQIs+RI3 [5 
Wace br od M Ste eS NC PN 
J?+J}+J3 RAT AS; 


That gives the flux integral as 


J| *- Nac - |f [PJ14-QJ;-RJs]du dv 
S Ruy 
p22) a(z, x) RÊD ay dy 
- ff.» O(u, v) dudo ff. ouv eff. 5 au, z^ nn 
=f Pdydz+ Í Qdzdx+ || R dx dy 
[a R: Re 


yz zx xy 


= f P dydz+ Qazas + Rax ty 
s 


The third equality follows from the second by recognizing the formula for changing variables 
in a double integral. 


EXERCISES 23.2—Part A 


A1. If f(x, y, z) = 0 defines y = g(x, z) implicitly, obtain the analogs A5. Show that | T x T,|| = a? sin ¢ for Ty and T, given in Table 23.1. 
of (23.14) and (23.15). A6. Verify the integral and its value in (23.18). 


A2. If f(x, y, z) = 0 defines x = h(y, z) implicitly, obtain the analogs — A7, Establish the results in (23.19) as follows. Start with z(u, v) = 
of (23.14) and (23.15). 


zer u, vs y(u, v)), and use the chain rule to obtain the derivatives 
Z and 2 =, Use Cramer’s rule to solve for zx and zy. 


A3. Verify the Jacobians in (23.16). 


A4. Show that yJ? + J? + J? = a? sin ọ for the Jacobians J;, 
k — 1,2,3, given in (23.16). 


T 
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EXERCISES 23.2-Part B 
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B1. 


B2. 


B3. 


B4. 


B5. 


The surface described by z = z(x, y) = 12x? + Axy + 9y? has a 
minimum at the origin. The portion of the surface satisfying 
z(x, y) < 26 projects to a rotated ellipse in the xy-plane. 


(a) Obtain a graph of the surface. 

(b) Verify that z(x, y) has a minimum at the origin. 
(c) Graph the ellipse z — 26. 

(d) Obtain the element of surface area as 

1 +z% +z? dydx. 


(e) Obtain the surface area of that portion of the surface satisfying 
z(x, y) < 26. (Numeric integration may be necessary.) 

(f) Parametrize the surface via the equations x = 7u + 5v, 
y = 6u — 3v. (Of course, z(x(u, v), y(u, v)) = Z(u, v).) 

(g) Graph the ellipse Z(u, v) — 26. 

(h) Obtain the element of surface area in parametric form. 


(i) Use the result in part (h) to obtain the surface area of that 
portion of the surface satisfying Z(u, v) < 26. 


(j) To the double integral used in part (e), apply the change of 
coordinates defined by the equations in part (f). Show that the 
double integral used in part (i) results. 


Let f (x, y, z) = 5xy + 8xz — Ayz, F = xzi — y?j + yzk; and let 
S be the surface described parametrically by x = 3u — 4v, 
y=u?+v,z=10u+7v,0 <u <2,0 <0 <3. 

(a) Obtain a graph of S. 

(b) Evaluate the surface integral of f (x, y, z) on S. 


(c) Obtain, in the direction of the upward normal, the flux of F 
through S. 


Let f(x, y, z) = 8xy + 5yz + 9x?y, F = yzi — x? yj + xzk; and 

let S be the surface described parametrically by x = 8v + 4u, 

y = W? + 9uv, z = 8v + 9u, 3 < u < 4, —4 < v € -3. 

(a) Obtain a graph of S. 

(b) Evaluate the surface integral of f (x, y, z) on S. 

(c) Obtain, in the direction of the upward normal, the flux of F 
through S. 

Let f (x, y, z) = 3x?z — 5yz? + 3xyz, F = zi + y?j — xzk; and 

let S be the surface described parametrically by x = 7u + 8uv, 

y = 4v — 5u, z = 2v — 4u, —5 < u <5,-S<v<4. 


(a) Obtain a graph of S. 


(b) Evaluate the surface integral of f(x, y, z) on S. 


(c) Obtain, in the direction of the upward normal, the flux of F 
through S. 


Let f(x, y, z) = 2z? + 5xy? + xyz, F = x’i + 2?j — xyk; and let 
S be the surface described parametrically by x = 7v — Su, 

y = 4v — 4u, z = 9v + 6v? + 6u?, —2 < u < 5, —6 < v <4. 
(a) Obtain a graph of S. 

(b) Evaluate the surface integral of f(x, y, z) on S. 


B6. 


B7. 


B8. 


B9. 


B10. 


B11. 


(c) Obtain, in the direction of the upward normal, the flux of F 
through S. 

Let F = (92? + 4y?)i + (2x? + 7xy?)j — 4xyzk; and let S be the 

first-octant portion of the plane —12 + 84x + 23y + 46z = 0. 

Obtain, in the direction of the upward normal, the flux of F 

through S using 


(a) one double integral with do = ,/1-F- 22 + z? dy dx. 


(b) formula (23.17). 

(c) the parametrization x = 4u — 3v, y = 3u — v. 

Let F = (3z? — 8y?z)i + (9x? + 8x?y)j + (6x?z — 4x? y)k; and 
let $ be the first-octant portion of the plane —52 + 86x + 

41y + 81z = 0. Obtain, in the direction of the upward normal, the 
flux of F through 5 using 


(a) one double integral with do = ,/1 + 22 + z dy dx. 


(b) formula (23.17). 

(c) the parametrization x = 12u + 9v, y = 3u — 5v. 

Let F = (8x2y — 3xz2)i + (6xyz + x2)j + (xy? — 5xy)k; and let 
S be the first-octant portion of the plane —12 + 28x + 

27y -- 79z = 0. Obtain, in the direction of the upward normal, 
the flux of F through S using 


(a) one double integral with do = ,/1 + z2 + zi dy dx. 


(b) formula (23.17). 

(c) the parametrization x = 9u — 5v, y = 12u + v. 

Let F = (7x? + Axz)i + (8x + 8xz2)j + (5y?z — 8xz?)k; and let 
S be the first-octant portion of the plane —46 + 31x + 

74y + 6z = 0. Obtain, in the direction of the upward normal, the 
flux of F through S using 


(a) one double integral with do = 


(b) formula (23.17). 

(c) the parametrization x = 7u — v, y = 3u — 6v. 

Let F = (32y + 8y?z)i + (7 — 9xy)j + (x? — 8yz)k; and let S be 
the first-octant portion of the plane —100 + 25x + 


85y + 65z = 0. Obtain, in the direction of the upward normal, the 
flux of F through S using 


(a) one double integral with do = ,/1 + z2 +z% dy dx. 


(b) formula (23.17). 
(c) the parametrization x = 12u + 7v, y = u — 8v. 


Let F = (Sy? — 4xy?)i + (33 — y?z)j + ( + 8x? y)k; and let 5 be 
the upper hemisphere of the unit sphere. Obtain, in the direction 
of the upward normal, the flux of F through S using 


(a) one double integral with do = | /1 + 22 + z? dy dx. 


(b) formula (23.17). — (c) cylindrical coordinates. 


(d) spherical coordinates. 


1 +z} +z% dydx. 
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B12. Let F = (5x + 2x°)i + (6x?y + 6yz)j + (3x? — 2z?)k; and let S 
be the cone z = yx? + y2, 0 < z < 1. Obtain, in the direction of 
the upward normal, the flux of F through S using 


(a) one double integral with do = ,/1 4- 22 + z dy dx. 


(b) formula (23.17). (c) cylindrical coordinates. 


(d) spherical coordinates. Hint: On S, z = -&. 


7i 
v2 


B13. Let F = (7xyz — 6x2 y)i + (6x?z + 3xz)j + (3x — 4y?z)k; and let 
S be the paraboloid z = x? + y?, 0 < z < 1. Obtain, in the 


direction of the upward normal, the flux of F through S using 


(a) one double integral with do = ,/1 + z + E dy dx. 


(b) formula (23.17). (c) cylindrical coordinates. 
(d) spherical coordinates. Hint: On S, z = cot? $. 


B14. Let F = (x?z + 7y?)i + (9xyz + 8x?)j + (6z — 8xy?)k; and let S 
be the paraboloid z = 1 — x? — y?, 0 < z. Obtain, in the direction 


B15. 


B16. 


B17. 


B18. 


of the upward normal, the flux of F through S using 


(a) one double integral with do = | /1 +z? + zi dy dx. 


(b) formula (23.17). (c) cylindrical coordinates. 


Obtain the element of surface area for the coordinate surface 
$ = a in the spherical coordinate system. 


Obtain the element of surface area for the coordinate surface 
w =a in the 6-sphere coordinate system defined in Exercise B29, 
Section 22.3. 


Obtain the element of surface area for the coordinate surface 
v = a in the paraboloidal coordinate system defined in Exercise 
B30, Section 22.3. 


Obtain the element of surface area for the coordinate surface 
v = a in the bispherical coordinate system defined in Exercise 
B31, Section 22.3. 


The Equation of Continuity 


Equation of Continuity—Statement 


The partial differential equation 


—+V-(pv)=0 (23.20) 


called the equation of continuity, is a balance law for a substance of density p flowing with 
velocity v. It captures the reality that the substance can be neither created nor destroyed. 
The temporal rate of change of the density is balanced by the divergence of the product pv, 
where the divergence is computed with respect to the spatial variables x, y, z. 

In fact, consider a fluid of density p(x, y, z, t), moving so that at every point (x, y, z) 
in a fixed coordinate system an external observer sees fluid flowing with a velocity 


v= f(x,y,z, t)i + g(x, y, z, 0j h(x, y, z, 0k 


For example, think of water flowing through a glass trough, on the walls of which are painted 
the grid lines of an xyz-coordinate system. At any particular point inside the trough, fluid 
flowing with velocity v(x, y, z, t) will be observed. 
The product pv is a measure of mass-flow per unit time, per unit area, as the following 
examination of physical units suggests. 
mass distance mass 


pY > : = z 
volume time area time 


Derivation 


An insightful derivation based on the divergence theorem is easily given. Let S be a fixed, 
closed, but arbitrary surface enclosing a geometric region V inside the fluid. Fluid is imag- 
ined to flow through the surface S, which, again, does not move in time. Let M(t) be the 
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total mass of fluid inside S at any time t. Then 


so» fff, 


where the t-dependence of M (t) is through the density p(x, y, z, t) but not through the 
region V since the region V is fixed in time. Further note that dv is the volume element, 
not the velocity vector v that we typically write as boldfaced since it is a vector. 

The (time) rate of increase of mass inside S is 


dM d a 
dt dt y V ot 


which, by its very definition as a derivative, is positive if the mass inside S increases. The 
outward flux of the quantity pv passing out along N, an outward unit normal on S, is given 
by ff. pv - Ndo. But this flux is the amount of mass lost from V, through the walls of S, 
per unit time. Hence, 


aM _ d ENE Ng == 
e = fff 2a- ES Ndo — Ty (pv) dv (23.21) 


The middle equality in (23.21) was explained previously: the flux of mass outward is the 
surface integral without the minus sign. The derivative E measures the rate of mass increase 
(mass passing inward) in V. The rightmost equality in (23.21) results from an application 
of the divergence theorem to the surface integral. 


Combining the two triple integrals over the arbitrary volume V gives 


0p _ 
[| e vom] o 


Since V is arbitrary, this equality must hold for all possible regions V, and that can only 
happen if the integrand itself is zero. Hence, the equation of continuity (23.20) results. 

Some practitioners call the equation of continuity an accounting principle since it 
accounts for mass under transport. Others characterize the equation of continuity as a law 
of conservation, or mass-balance. In either event, it states that mass can't be created or 
destroyed without violating the continuity of the flow. 


Three Applications 


1. In the context of fluid flow, the equation of continuity leads to new conclusions about 
the flow. If p, the density of a fluid, is constant, then p, = 0 and V * (pv) = pV - v. 
Hence, the equation of continuity yields 0 + oV - v = 0, so V- v = 0. Therefore, a 
constant density means the flow field v is solenoidal, or divergence-free. 


2. Surprisingly, the equation of continuity arises in contexts other than fluid flows. For 
example, in electromagnetic theory where p is charge density, the quantity J — ov 
is current density obeying, as a consequence of Maxwell's equations, the continuity 
equation V- J + p, = 0. 

3. In traffic flow theory for long lines of cars moving on a one-lane road with no exits or 
entrances, at location x and time f, let u(x, t) be the observed car-velocity and p(x, t) 
be the traffic density in number of cars per mile. Then the conservation of cars demands 
the one-dimensional equation of continuity p; + (pu), = 0 be satisfied. In fact, such 
traffic flows have been successfully modeled as if the cars were gas particles in a tube. 
One of the results of such models is that the bunching-up braking causes travels back 
through the line of traffic like a shock wave in a gas-filled tube. 
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EXERCISES 23.3 


1. If p(x, t) is prescribed, show that the one-dimensional equation of 
continuity determines the velocity field as u(x, t) = 
a(f (t) — f pi dx), where f (t) is an arbitrary function. Thus, the 
velocity u(x, t) is constrained, but not uniquely determined, by the 
equation of continuity. 


- 
et)" 


2. In the model for single-lane traffic flow, let p(x, t) = e 
measured in number of cars per mile. 


(a) Show that the equation of continuity then yields u(x, t) = 
1+ f (ye o, where f(t) is an arbitrary function. 

(b) Take f(t) = 1 and graph, either as an animation or as a series of 
images, p(x, t) along with u(x, t), thereby showing the 
time-history of the traffic flow. (A localized region of higher 
density cars moves to the right along the x-axis. Where the 
density is high, the velocity is low, leading to the hypothesis that 
perhaps the equation of continuity always gives this result. The 
next two problems show this to be a false premise.) 


3. In the model for single-lane traffic flow, let p(x, t) = 1+ Ham be 
the density of cars per unit length of highway. 


(a) Show that p represents a localized region of high-density cars 
moving uniformly along the x-axis. 


1-f()0---0?) 


(b) Use the equation of continuity to obtain u(x, t) = 2i uy 


the velocity of the cars at location x. 


(c) Show that u, (t, t) = 0, making x = f a critical value for u. 
Show further that u,. (t£, t) = UL. so that at x = £t, u(x, t) will 
have, for example, a maximum if f(t) = 1 and a minimum, if 


ft) 22. 


(d) Let u; = 2 [5:855 , the solution with f(r) = 1. Along with 
pu, the number of cars per unit time that pass location x, graph 
p and u, showing either by an animation or by multiple images 


the time-history of the traffic flow. 


x= 


(e) Plot as a function of time, f i p dx, the number of cars 


between x = 1 and x = 2. 


Un 


Green's Identities 


. Repeat Exercise 3 for the density function p(x, t) = 1+ 


. Leto(x,f) = 


(f) Plot as a function of time, (pu1)x=1 — (PU1)x=2, the net change 
in the number of cars between x — 1 and x — 2. Is this graph 
consistent with that found in part (e)? 


3426-1? 


(g) Let u = 2400-1)? 
the number of cars per unit time that pass location x, graph p and 
u2, showing either by an animation or by multiple images the 
time-history of the traffic flow. 


, the solution with f(t) = 2. Along with pu». 


(h) Plot as a function of time, (pu2)x=1 — (PU2)x—2, the net change 
in the number of cars between x = | and x = 2. Is this graph 
consistent with that found in part (e)? 


2 
(x—t)* 


I(x-0?* 
> 
PT . " +(x—1)7)—1 
Show that the continuity equation gives u(x, t) = fone and 


that uxx(t, t) = 4 — 2 f(t). In part (d) take f(t) = 3, and in part (g), 
take f(t) — 1. 


. Still working in one dimension, determine u(x, t) when: 


(a) p—p(x) (bpocz-pt(t) 
-6-D* and obtain u(x, t). In succession, take f (t). 
the arbitrary function in u(x, t), as f, sint, and e~’. Analyze the 


traffic flow in each case. 


. Let p(x, t) = e”, and obtain u(x, t), taking f(t), the arbitrary 


function, to be zero. Analyze the traffic flow. 


. Ohm’s law, V = JR, linearly relates the voltage V to the current I 


via the proportionality constant R, the resistance. This direct 
proportionality is also expressed by the equivalent form of Ohm's 
law, E = rJ, where E is the electric field vector and r is the 
resistivity. Thus, the electric fleld is directly proportional to the 
current density. (See [25].) Recalling E = —V V, use the equation of 
continuity to show that for a steady DC current where p is constant, 
we obtain Laplace's equation V?V — 0. 


Statement of Green's Identities 


Green's first and second identities, in which V is a suitable well-behaved volume in space 
and S is its bounding surface, are given. 


GREEN’S First IDENTITY 


Í / f [fV?g + (Vf) -(Vg)dv = / l (fVg) -Ndo 
V S 


GREEN's SECOND IDENTITY 


I [fV?g — 8V? f]dv = I [f Vg — gVf]-Ndo 
V 8 
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In Green's second identity, pay particular attention to the symmetry of the operators in 
the integrand on the left. That will be the key to understanding why such a formula might 
be of interest. 


Adjoint Operator in Linear Algebra 


Some simple matrix algebra provides the motivation for Green's identities. The dot product 
between vectors is the basic mathematics being examined. For example, consider the vectors 
and matrix 


—4 10 —5 7 6 
x= y= | —-6 A=| —6 0 5 
8 —8 —10 1 1] 
for which x - y = x'y = —146, where xT = [—4, 7, 8] is the transpose of x, and x'y is a 


matrix product between the row vector x! and the column vector y. The dot product of the 
vector Ax with the vector y is (Ax) - y — 346. This new dot product is equiva-lent to the 
matrix product 


(Ax)Ty =x’ Aly = x" (ATy) = x - (ATy) =x: (A*y) 


where the matrix A* is just AT when A is real and AT, the complex conjugate, transposed, 
when A is complex. It is typically called the adjoint of A. 

Write the calculation as (AX) - y — x * (A*y) = 0, which becomes (Ax) - y —x* 
(Ay) = 0 for a Hermitian matrix, that is, one for which A = A* = A’. Another name for 
the Hermitian matrix is “self-adjoint,” a term first encountered for differential equations in 
Section 16.1. 

The left side in Green's second identity has this same structure. The matrix operator 
A becomes the laplacian. The vector x becomes the function g. The vector y becomes the 
function f. The dot product is the integral. 

In fact, the laplacian is just one example of a differential operator, the analog of the 
operator "multiply by the matrix A." In general, if the differential operator is denoted by the 
symbol L and its adjoint is denoted by L*, then Green's second identity is the multivariable 
generalization of 


[er — yL*v]dx = J(u, v) 


where J (u, v) is the bilinear concomitant. This is just Green's formula, equation (16.8), 
from Section 16.1. 


Deriving Green's Identities 


GREEN’s First IpeNTITY To obtain Green's first identity, set F = f Vg in the divergence 
theorem, that is, in fff, V - Fdv = ff F -N do, to obtain 


"i y. (Fvayav= [[uvo Nes 
V S 


J / [I/v «(Vp (f) (Weide = i | (vg -Nde 
V S 


Ii (Vie p vede ff üvo -Ndo 
V S 
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GREEN’S SECOND IDENTITY 


Green’s second identity is obtained by reversing the roles of 


f and g in the first identity, giving 


f Í Uf Vg + (VS): (Vg)dv- / (UN) “Nao 
y 


/ / [e V? f - (Vg) (V )]dv — / (eV f) -Ndo 
V S 


(23.22a) 


(23.22b) 


Then, (23.22b) is subtracted from (23.22a), causing the product of the gradients to 
cancel in the integrands on the left and resulting in Green’s second identity. 


EXERCISES 23.4 


1. Green’s identities are often described as nothing more than 
multidimensional versions of integration by parts. The validity of 
this claim is easily established for the first identity if the region of 
integration is taken as the box V = {xo < x < xv, yo € Y € yr, 
Zo € z € zı}, whose sides are parallel to the coordinate planes. 
Start with ¢ = fff, f V^g dv, and 
(a) write ¢ as an iterated triple integral, taking the order of 

integration as, for example, dz dy dx. 

(b) since f V?g = f(gxx + 85y + 8;;), Write $ as a sum of three 
triple integrals where the inner integral in each corresponds to 
the variable with respect to which the derivatives on g are taken. 

(c) apply integration by parts to the inner integral in each term. 

(d) obtain g + f/f, (Vf) (Vg) dv = f? f (Fgola dy dz + 
So Lo CF, dx dz + [i Soy (F821 dx dy. 

(e) show that the Tes double integrals on the right constitute 


[C Vg) - N do, where S is the surface of the box V and N is 
the unit outward normal on S. 


For the region V and functions f, g given in each of Exercises 2-6, verify 
Green's first and second identities. 
2. f = Ix?, g = 9z?; first octant, bounded by x = 5 and 
2527? + 36y? = 144 
3. ? = 3xy — 4y? 
= +1 


z, g = 5yz + 7x?z; the cube x = +1, y = +1, 


x?y — z*; the unit sphere centered at the origin 


4. " yz, g = 
5. f= nye + 5xz3, g = 2yz — 3x3; the cylindrical “can” 

x2 4 
EJ PS. 


z=1 


6. f = 4x?y? + 923, g = z? — 5xy°; first octant, under the plane 
12x + 23y + 37z = 100 


For the matrix A and vectors x and y given in each of Exercises 7-11, 
show that (Ax) - y — x : (ATy) = 0. 


—6 8 10 5 7 
7A=| 1 = 1),85 1|.y2|-9 
—2 6 9 —10 3 


= 12 =! 11 [3 
9,A—|11 4 -3],x=]-9],y=] 10 
11 -6 12 11 |1 

4 ıl 5 8] [5 

10.4—-| 4 6 -12},x=/11],y=/] 10 
-1 1 1 2) 11 

7 3 7 4 

11. A= 8 12|,x2|-5|.y-2|3 
= ME MET 12 L5 


8 
4 
3 
12 5 5 mi mi m} XI 
12. Let A = | 8 10 1 M= E m», s <= H 
2 —§ -U m3 mn m3 X3 


y 
y= H , and form the equation (Ax) - y — x - (My) = 0. By 
y 

treating this as an identity in the x, and yx, k = 1, 2, 3, show that 


M must be AT, the transpose of A. 


Chapter Review 


N 


. State Gauss’ Theorem in three dimensions. 
. State Gauss’ Theorem in two dimensions. 


. Give the expression for do, the surface area element, when the 


surface is given parametrically by equations of the form 
x = x(u, v), y = y(u, v), z = z(u, v). 


. Let the surface S be defined parametrically by x = 2u — 3v, 


y = 5u + Tv, z =u 4- Av. 
(a) Obtain do in parametric form. 


(b) Eliminate the parameters u and v, and obtain do in Cartesian 
coordinates. 
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. State the formula for the flux of F = P(x, y, z)i + Q(x, y, z)j + 


R(x, y, z)k through a parametrically given surface. 


. If S is as given in Question 4 and 0 < u, v < 1, obtain the flux of 


F = yi — zj + xk through S using the formula in Question 5. 


. State the equation of continuity and provide a derivation based on 


the divergence theorem. 


. Give at least one application of the equation of continuity. 


. State Green's identities, and illustrate each with an example. 


UNIT FIVE 


Boundary Value Problems 


Chapter 24 
Chapter 25 
Chapter 26 
Chapter 27 
Chapter 28 
Chapter 29 
Chapter 30 


Wave Equation 
Heat Equation 


The second-order partial differential equations referred to as the wave equa- 
tion, the heat equation, and Laplace's equation are archetypes of the impor- 
tant equations of engineering, science, and applied mathematics. These PDEs 
are usually posed in the context of side conditions, both initial and boundary, 
so we will actually study boundary value problems. 

The wave and heat equations are called evolution equations since they 
model how initial states propagate into the future. The wave equation gov- 
erns the propagation of disturbances that, in the absence of losses through 
dissipation, retain their initial shapes—thus, the notion of wave motion. 

The heat equation models diffusion processes in which initial configu- 
rations are immediately dissipated in an irreversible manner. The diffusion of 
dye in water, the spread of a rumor on a college campus, the spread of potato 
beetles through a farm, and the dispersal of heat in a conducting medium can 
all be modeled by the heat equation. In distinction to the wave equation, the 
heat equation immediately smooths out discontinuities in initial data. Heatat 
one end of a rod diffuses through the rod and cannot be resequestered into 
its original configuration. Yet, an electric pulse sent out along a wire travels 
along the wire as a pulse, retaining its shape in the absence of losses. 

We study the wave equation for a finite string in which disturbances 
take place in a single vertical plane. Modeling the string in a musical in- 
strument, this BVP allows us to describe the solution surface and its role in 
understanding a solution. Plane sections ofthis solution surface are images of 
the moving string, and a sequence of such plane sections constitute a movie 
of the motion of the string. 

The solution of the one-dimensional wave equation can be given by an 
infinite series, or it can be given by D'Alembert's formula. We examine both 
and give a numerical solution computed by finite differences. 

We also study longitudinal vibrations in an elastic rod. The same PDE 
governing displacements in the stretched string describe the displacements 
of cross-sections in the elastic rod. Visualizingthe vibrations in the rod is a sig- 
nificantly more difficult task, but one that appropriate computer simulations 
can help resolve. 

In two spatial dimensions, the simplest geometry for studying waves 
is that of the rectangle. We solve for the vibrations of a rectangular plate 
with clamped edges. We also consider vibrations in a circular disk and solve 
the wave equation in polar coordinates. This is the problem of the circular 
drumhead, a disk with clamped edges. 

The one-dimensional heat equation describes heat transfer along the 
axis of a rod that is wrapped in insulation. If both ends of the rod are kept 


Laplace's Equation in a Rectangle 

Nonhomogeneous Boundary Value Problems 
Time-Dependent Problems in Two Spatial Dimensions 
Separation of Variables in NonCartesian Coordinates 
Transform Techniques 


at the same constant temperature, a series solution for the time-dependent 
temperatures in the rod is readily given. If the endpoint temperatures differ, 
or vary in time, a series solution is a much more complicated computation. 
However, the finite-difference solution we study is readily adapted to varying 
endpoint temperatures, and we solve the thermal diffusion problem for the 
wall of a house air-conditioned on the inside and subjected to the daily cycle 
of heating and cooling during a Midwestern summer. 

Laplace's equation, also called the potential equation, models either 
the electrostatic potential or the steady-state temperatures of a plane region. 
The same BVP describes the physics in both cases. The equipotentials or the 
isotherms arethe level curves ofthe harmonic function that satisfies Laplace's 
equation. The negative of the gradient of this function gives the electric field 
vector or indicates the flux field for heat flow in the region. The field lines 
(lines of force) for the electric field are the flow lines for the thermal process. 

We solve Laplace's equation on a rectangle, on a disk, in a cylinder, 
and in a sphere. On the rectangle or disk, the solutions are given in terms 
of an infinite series akin to a Fourier series. In the cylinder, the solution is 
a series in Bessel functions; while in the sphere, it is a series in Legendre 
polynomials. For both the cylinder and the sphere, obtaining the series solu- 
tions is interesting and reducible to an algorithm. Visualizing the solutions is 
a greater challenge because in both cases the quantity to be visualized, either 
temperature or electric potential, exists in the interior of a solid object. Part 
of our study of these problems will involve the graphics options available for 
visualization. 

The classic solutions for Laplace's equation are series of eigenfunc- 
tions. The geometry of the region over which the equation is being solved 
determines the eigenfunctions. Hence, the series solution is feasible only for 
geometries in which the eigenfunctions are readily computed. In more com- 
plex geometries, numeric solutions are required, and we give an example of 
a finite-difference solution for the rectangle. 

If the spatial region for the wave, heat, or potential equation is infinite, 
then series solutions must give way to transform techniques. We will see how 
to use the Laplace transform to solve the heat equation on a semi-infinite 
rod. We must then introduce the Fourier transform to solve the wave and 
heat equations on an infinite domain, the wave equation on the semi-infinite 
domain, and Laplace's equation on quarter-planes and half-planes. For odd 
and even functions, the Fourier transform collapses to the Fourier sine and 
cosine transforms, respectively, and with these integral transforms, we can 
solve Laplace's equation on semi-infinite strips. 
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Chapter 24 


Wave Equation 


INTRODUCTION The one-dimensional wave equation is a partial differential 
equation describing how a disturbance propagates in time along a coordinate axis. It models 
the motion of a taut, finite string with fixed endpoints and constrained to move in a single 
plane. If put into motion by imparting an initial shape, we say the string has been plucked. 
Alternatively, the string can be put into motion by imparting an initial velocity. If this initial 
velocity is achieved by striking the string, we say the string has been struck. Therefore, our 
prototypical examples are the harpsichord, where the string is plucked, and the piano, where 
the string 1s struck. However, we do admit that in these two musical instruments, nothing 
constrains the strings to vibrate in a single plane. 

We solve both problems by the technique of separation of variables, which reduces 
the PDE to two ODEs. One ODE is part of a Sturm-Liouville eigenvalue problem whose 
eigenfunctions are the fundamental shapes, or modes, for oscillation in the string. The 
eigenvalues are then the harmonic frequencies supported by the string. Just the way a 
musical sound is a blend, or sum, of harmonics of different intensities, so too is the shape 
of the vibrating string a sum of fundamental mode shapes with distinctive intensities. This 
sum, a consequence of the principle of superposition, is the infinite series that represents 
the solution of the one-dimensional wave equation. 

By studying the solution of the plucked string, we discover that the initial disturbance 
in the string travels along the string with no distortion in its shape. Called a wave, this 
initial shape splits into two similar disturbances of half the initial amplitude, with one copy 
moving to the right and one to the left. Since the string is finite, the propagated waves are 
absorbed by the fixed endpoints and are returned reflected, to travel the string in the opposite 
direction. With no provision for energy loss built into our model of the wave equation, these 
waves continue to traverse the string indefinitely. 

This analysis of the motion of waves in a finite string is even more readily seen from 
D'Alembert's solution, a “closed-form” solution that does not require summing an infinite 
series. 

Using Newton’s Second Law and some simple physics, we derive the wave equation. 
The marvel is that the resulting equation gives such an accurate account of wave motion. 

The very same PDE that describes the plucked string also describes the longitudinal 
vibrations in an elastic rod. For the string, the deflection of the string is the unknown in 
the governing BVP, and a graph of the deflection at a fixed time simulates the shape of 
the string at that instant. However, for the elastic rod, the unknown deflections are those of 
cross-sections of the rod, and a graph of such a cross-section is not a direct visualization of 
the motion of the rod. Consequently, while the solution process for this BVP poses no new 
challenges, interpretation becomes the dominant issue, one for which computer simulation 
is a most welcomed partner. 
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FIGURE 24.1 The finite string with 


displacement u(x, t) 


EXAMPLE 24.1 
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Finally, we study a finite-difference numeric scheme for solving the wave equation in 
one dimension. Although our analytic techniques are restricted to problems with homoge- 
neous Dirichlet (u = 0) or Neumann (u, = 0) conditions, the numeric solution is sufficiently 
flexible that either type boundary condition can be nonhomogeneous. This means we can 
study how waves travel in a string that has one endpoint fixed, and the other made to execute 
a prescribed motion in time, much like a string that is tied to a post and “snapped” at its 
other end. 


|! The Plucked String 


Wave Equation on the Finite String 


An idealized string, uniform and without internal friction, is stretched along an x-axis from 
x — 0 to x — L. The ends are fixed, the string is taut, and it is constrained to move in a 
vertical plane. The equilibrium position for the string coincides with the interval [0, L] on 
the x-axis, and displacements in the string are measured vertically by u. At time ft, and at 
location x in [0, L], the displacement of the string from equilibrium is u(x, t). For fixed 
t =f, the shape of the string is given by u(x, f ). Figure 24.1 shows the shape of the string 
at a particular instant f > 0. 

As we will derive in Section 24.4, displacements in the string are governed by us = 
c?uxx the one-dimensional wave equation (1) in Table 24.1. This is a partial differential 
equation in the two independent variables x and t. The parameter c will turn out to be the 
wave speed, the speed at which a disturbance can propagate horizontally along the string. 
The boundary conditions (2) and (3) in Table 24.1 assure that the endpoints of the string 
remain fixed. Because they prescribe values of u at the endpoints, they are called Dirichlet 
conditions. Since the prescribed values are zero, these conditions are homogeneous Dirichlet 
conditions. The initial conditions (4) and (5) in Table 24.1 give the initial shape and velocity 
of the string. At first, we will take g(x) = 0, so that the string is given a (small) initial 
displacement f (x) and released. This corresponds to a gentle plucking of the string, much 
like the action in a harpsichord. 


Wave Equation (1) uj; = c2u,, for t > 0 


Fixed left end (2) u(0,t) =0 Initial shape (4) u(x, 0) = f(x) 
Fixed right end (3) u(L,t)=0 Initial velocity (5) u;(x, 0) = g(x) 


TABLE 24.1 BVP for wave equation on a finite string 


Together, the five equations in Table 24.1 constitute an initial boundary value problem 
(or BVP) for the finite string. Our goal is to obtain a solution to this BVP and to understand 
how the function u(x, t) so determined describes the physical motion of the string. 


We will show that u(x, t) = sin x cos 3t is a solution to the BVP in Table 24.1 when c = 3, 
L = x, g(x) = 0, and f(x) = sin x. A calculation shows 


. B " * 
Un = —9sinxcos3t and C'U, = 3? (— sin x) cos 3t 
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FIGURE 24.2 Two snapshots of the 


moving string in Example 24.1 


FIGURE 24.3 The solution surface for 
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Moreover, u(0, t) = u(x,t) = O since sinO = sinz = O. Finally, u(x, 0) = sin(x) = 
f(x). Figure 24.2 shows the shape of the string at two different times. Figure 24.3 shows 
the solution surface whereby u(x,t) is graphed as a surface in the xt-plane. Figure 24.4 
shows several snapshots of the string superimposed on the solution surface. The solution 
surface is traced out in time by a succession of moving images of the dynamic string, or 
equivalently, the plane sections of the solution surface are snapshots in time of the physical 
motion of the string. Figures 24.3 and 24.4 show that the motion of the string is an example 
of a standing wave because the points of zero displacement do not translate along the 
string. (The accompanying Maple worksheet contains complete animations corresponding 
to Figures 24.3 and 24.4.) 4 


FIGURE 24.4 Snapshots of the string in 


Example 24.1 Example 24.1 superimposed on the solution 
surface 
EXAMPLE 24.2 A wave free to move along the string is called a traveling wave. Suppose the initial dis- 
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FIGURE 24.5 Initial disturbance in 
Example 24.2 


(a) 


(b) 


FIGURE 24.6 Two snapshots of the 
traveling wave in Example 24.2 


turbance in the string has the shape shown in Figure 24.5. Under the action of the wave 
equation, that initial disturbance would travel along the string, reflecting at the endpoints 
and bouncing back and forth between them. Figure 24.6 shows the traveling wave at two 
successive times after t = 0. The initial energy splits into two equal parts, with each new 
wave traveling in opposite directions. When the wave reaches the boundary, it is absorbed 
and then retransmitted, only now, with a reflection. Figure 24.7 shows the solution surface 
for the traveling wave. The initial disturbance splits into two waves of half the initial height, 
one traveling left and one traveling right. Without changing shape, these waves move in 
the xt-plane along characteristics, the lines x + ct = constant, which are therefore said 
to "carry the initial information." (Animations of the traveling wave are available in the 
accompanying Maple worksheet.) 


FIGURE 24.7 Solution surface for the 
traveling wave in Example 24.2 
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Solution by Separation of Variables 


The classical method of solution for such BVPs is the method of separation of variables. 
Assume a solution of the separated form u(x,t) = X(x)T (t), a product of one function 
just containing x and one function just containing t. Recall the initial example, u(x, t) = 
sin x cos 3t. Now, generalize this to the product u(x,t) = X(x)T (t), to which we next 
apply the fixed endpoint conditions, obtaining X (0)T (t) = 0 and X(L)T(t) = 0. Ruling 
out the choice T (t) = 0 because that implies u(x, t) = 0, we conclude X (0) = X (L) = 0. 

Under the assumption of a separated solution, the initial conditions become u(x, 0) = 
X (x)T(0) = f (x), and u,(x, 0) = X(x)T'(0) = g(x). Unless either f(x) or g(x) is zero, 
no conclusion can be drawn from these two equations. Assuming, for simplicity, that the 
initial velocity is zero, so that g(x) = 0, we conclude 


u,(x,0) = X()T'(0 202 T'(0)20 


The initial condition u(x, 0) = f (x) can be satisfied with the aid of a Fourier series. 
Before we can see that, we must apply the separation assumption to the PDE itself, giving 


X QOT"(t) 2 c X"(x)T (t) 


We have just deliberately committed a notational no-no. The derivatives on the left are with 
respect to £, while the derivatives on the right are with respect to x. Yet, we have used the 
same symbol for each differentiation, a mathematical imprecision and ambiguity that is too 
convenient to avoid. 

Next, divide by eulx, t), with u(x, t) = X(x)T (t). This general strategy, which seems 
to work with linear second-order PDEs, gives 

T"(t) X" (x) 

ETA X(x) 
the separated form of the PDE wherein each side of the equation is a function of only one 
of the variables. Since on the left there is a function purely of f and, on the right, a function 
purely of x, and these two functions must be equal for all values of x and t, each must be 
equal to the same constant. 

This argument is generally not transparent to the novice. Consider the following. Stu- 
dent A is asked to state a "favorite function of t." Student B is asked to state a "favorite 
function of x.” Typically, the functions now written on the board are something like 1? 
and sin x. Student C is asked to select a “favorite value of t," and student D is asked for a 
“favorite value of x.” The functions 7? and sin x are now computed at values such as t = 1 
and x = x. The students then realize that because 1? ¢ sina = 0, the only way for a 
function of t to equal, consistently, a function of x is for the two functions to be the same 
constant function. 

This constant is typically taken as A and is called the Bernoulli separation constant. 


Hence, we have the two ordinary differential equations Ie =} and ve = À, which, 
together with the relevant data, form the two problems 
X"(x) —AX(x) 20 T") —c?AT(t) 20 
(x) (x) - (t) - c V) (24.1) 
X(0) = X(L) 20 T'(0) 20 


The problem on the left in (24.1) is a Sturm-Liouville eigenvalue problem, while the problem 
on the right is a modified initial value problem. 

The solution of the Sturm-Liouville eigenvalue problem, obtained in Section 16.1, is 
Xn(x) = B, sin ra with eigenvalues A, = LEX t= Ve2s ema For each value of n, the 
function T (t) is the solution of T” + c? Um T —0,T'(0) — 0,so we write each solution as 


T,(f) = Cyeos 975, n = 1,2, .... 
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A single eigensolution is the product 


" nix cnit . ATX cnzt 
us (x, t) = B, sin (=) C, cos = b, sin —— cos 
L L L 


L 


where we replaced the product B, C, with the single constant b,. The set of eigensolutions 
{un} can be thought of as the analog of a fundamental set for a linear ODE. The general 
solution of a linear ODE is a linear combination of all the members of the fundamental 
set. Similarly, the most general solution of the linear PDE is a linear combination of all the 
members of its “fundamental set,” namely, the set of eigensolutions (u, (x, t)}. Since there 
are an infinite number of eigensolutions, our general solution is the infinite sum 


co oo 


nx nit 
u(x,t) = » lis (X, t) = b, sin UL cos ‘ T (24.2) 


n-l n=1 


The final condition to be applied in this BVP is the initial shape requirement 


. NIX 
u(x, 0) = 5 sin CL = JE) 
n-l 

The coefficients b, must therefore be the Fourier sine series coefficients for the function 
f (x). There is no other choice for these constants if this final condition is to be satisfied. 
If f (x) is to be equal to a sum of sine terms, then the coefficients in that sum must be the 
Fourier sine series coefficients. Therefore, the b,’s are determined by the Fourier sine series 
formulas 

g f . NTX 

Dy = = f(x) sin — dx n=1,2,... (24.3) 

L Jo L 
and the solution u(x, t) is given by (24.2). This infinite sum, along with the defining inte- 
grals for the b,, constitutes the formal solution to the given BVP for the finite plucked 
string. 


EXAMPLE 24.3 A string of length L = zt has its ends fixed at x = 0 and x = x on an x-axis. The string is 


under tension, so when it is given the initial shape f (x) = EN as shown in Figure 24.8, 


and released, it oscillates. We solve for the motion of the string at any time t > 0. 
The associated BVP that models the motion of this string is given in Table 24.2. The 


oo 


aei. solution, given by (24.2) and (24.3), is then u(x, t) = 5, , b, sin nx cos cnt, where 
0.2 
2 [*x(r-x) . 2i-[-L 
0 | i 3 ul Dam zf Ns =a sin nx dx = al~ 
: 0 10 5 


T mn? 


FIGURE 24.8 Initial shape of the string 


TER - us M — ] 
in Example 243 Table 24.3 shows the first 10 coefficients both exactly and in floating-point form. Only the 


odd-indexed coefficients are nonzero, and these rapidly become zero since b, = O( A). 


Wave Equation (1) us = c?u,, for t > 0 


Fixed left end (2) u(0,1) 20 Initial shape (4) u(x, 0) = UU 
Fixed right end (3) ur, 0) 2 0 Initial velocity (5) u,(x,0) 20 


TABLE 24.2 BVP for Example 24.3 
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n l 2 3 4 5 6 7 8 9 10 
4 4 1 4 1 4 1 4 | 

b, — 0 is 0 — re 0 e 0 on 0 
5x 5x 27 5x 125 5x 343 5x 729 

b, 0.255 0 0.00943 0 0.00204 0 0.000742 0 0.0003493 0 


FIGURE 24.9 Example 24.3: f (x) 
(solid) and p, (dotted) 


EXERCISES 24.1- Part A 


Peer 10, in Example 24.3 


Hence, a very few terms will be needed to get a good approximation to u(x, t). We 
can test this by examining how many terms it takes to get the Fourier series of f(x) to 
approximate f (x) well. The first two distinct partial sums in the Fourier series for f (x) are 

4 


= — sinx and p= sin x 
"= Sy P= sn 1357 


sin 3x 


with f (x) (solid) and p; (dotted) shown in Figure 24.9. The experiment suggests that two 
terms of the series for u(x, t) might yield a reasonably good approximation, so write 


3 
i 4 
U = 5 sin nx cos cnt = 135 


n=l 


(27 sin x cos ct + sin 3x cos3ct) 
T 


as an approximation to the solution. Set c = 1 to obtain the graph of the solution surface 
seen in Figure 24.10. The plane sections t = f, are snapshots in time, freezing the physical 
motion of the string for each value of t;. Exhibiting these snapshots in succession forms a 
movie, or animation, of the physical motion of the string. (Such an animation can be found 


in the accompanying Maple worksheet.) ^ 


NUIT I} 
Ne” 


FIGURE 24.10 Solution surface for Example 24.3 


Al.Letc 22, L = 1, f(x) = x!(1 — x), and g(x) = 0 in Table24.1. the Fourier series. Apply the separation assumption to the PDE itself and 
Use (24.2) and (24.3) to write the solution u(x, t) for the resulting obtain the resulting separated ODEs. Do not attempt to find any eigenval- 


BVP. 


ues or to solve any of the ODEs. For your answers, group the appropriate 


A2. Starting with u(x, t) = X (x)T (t), provide all the details leading to conditions with each separated ODE. 


the solution given in Exercise Al. 


For the BVPs given in Exercises A3-8, write u(x, t) as the separated 


A3. uy, = 4u,, + 3u, u(0, t) = 0, u(x, 0) = f(x), u(x, t) = 0, 
u,(x,0) =0 


product X(x)T (t). Apply this assumption about u(x,t) to the given A4. un = 3u,, + 5uy, ux (0, t) = 0, u(x, 0) = 0, ux (7, t) = 0, 
initial and boundary data, being sure to identify the condition that leads to u;(x, 0) = g(x) 
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AS. u, = Russ F u u(0, f) —0,u(x,0) = f(x), u;(1,t) 20 


A6. 3u,, + 2u, + 5u; = 0, u(0, t) = 0, u(x, 0) = f(x), 
ux (4,1) =0 


EXERCISES 24.1—Part B 


AT. 2u, — Uy — uy 4-3uy, = 0, ux (1, t) = 0, u(x, 0) = 0, u(3, t) = 0, 
u;(x, 0) = g(x) 
A8. 6u, + 5u,, — 2u = 0, u,(0, t) = 0, u+ (x, 0) = h(x), u(1, t) = 0 


B1. If f(x) is twice differentiable, show that u(x,t) = f(x + ct) isa 
solution of the wave equation u, = c?u,,. 


B2. Repeat Exercise B1 for u(x, t) = f(x — ct). 
For the functions f(x) given in Exercises B3-10: 
(a) Show that f (x + ct) and f (x — ct) are solutions of the wave 
equation Us = C7Uxx. 

(b) Obtain graphs of f (x + t) for t = 0, 1, 2,3. 

(c) Obtain graphs of f(x — t) for t = 0, 1,2,3. 

(d) Graph the surface z = f (x + t) fort > 0. 

(e) Graph the surface z = f(x — t) fort > 0. 


. 2 l 1+x 
B3. f(x) 2e^ B4. f(x) = B5. f(x) = 
f(x) =e f(x) x f(x) 1x 
1— zx? 3 
B6. f(x) = Tax4 B7. f(x) = x?e-* 


B8. f(x) = e^ arctan x 
B10. f(x) = cos3x 


B9. f(x) — sin2x 


In Exercises B11—13, for the given value of the wave speed c: 


(a) Show that the given function u(x, t) is a solution of t, = 
Cx, u(0, t) = u(L, t) = 0, u(x, 0) = f(x), ui (x, 0) = 0, 
the BVP governing wave motion in a finite string. 


(b) From the given solution, determine f (x), the initial shape of 
the string. 


(c) Obtain a plot of the solution surface. 
(d) Obtain graphs of the “snapshots” u(x, t), t = 0, 1, 2, 3. 


(e) Using appropriate software, animate the motion of the string 
governed by the given BVP. 


(f) Plot the surface u, (x, t) and analyze the velocity of a finite 
string governed by the given BVP. 


(g) Use an animation utility to explore how, for the finite string 
governed by the given BVP, the velocity propagates in time. 


B11. u(x,t) = sin 2x cos 3t, L = x, c = 3 
. TX 
B12. u(x,t) = sin > Cost, AP 652 


. 2X 
B13. u(x,t) = sin ES cos2mt,L =3,¢= 


[STD 


For the data given in each of Exercises B14—23: 


(a) Solve u, = ?x,,,u(0,t) = u(L,t) = 0, u(x, 0) = Fe), 
u,(x, 0) = 0, the BVP for one-dimensional wave motion in a 
finite string supporting the wave speed c. 


(b) Choose U (x, t), a partial sum of the infinite series 
representing the solution, so that U (x, 0) gives a reasonable 
approximation to f(x), and graph U(x, 0) along with f (x). 

(c) Plot U (x, t), the approximate solution surface. 

(d) Using U (x, t), animate the motion, studying how the initial 
disturbance propagates in time. 

(e) Plot the surface determined by U, (x, t), the approximate 
velocity along the string. 

(f) In an attempt to study the propagation of the string's velocity 
in time, animate U, (x, t) and compare with the displacements 
given by U (x, t). 


x E 
B14. c=1, L =x, f(x) = * 2 
T—X —€xtXm- 
2 
0 0x] 
Wis ecd Eod, a x-1 1zx«2 
VACANT a dece afar 
0 3<x<4 
0 O0<x<l 
x—1 l<x<2 
B16. c=1,L=5, f@)= 1 24% <3 
4—x 3<x<4 
0 <x<5 
x O0<x <1 
B17. c = V2, L =3, f(x) ={ 1 l<x<2 
3-x 2<x<3 
0 ax <= 
3 
m 2z m 27 
B18. c= 1, L =x, f(x) = (x JG x) g ate 
0 2m x 
5 at E 
1 — cos; 
B19. c =2, L = 2r, f(x) = — 
X 0<x <1 
B20. c = V3, L =3, f(xy) =4{2-—x 1<x<2 
0 2=x <3 


B21. c = V3, L 24, f(x) = 


B22. c = x, L = 4, f(x) = 


(x — DQ — x) 


B23.c-LL-4, f(x) = 1 
0 2X 


B24. Modify the wave equation to Uu, = c^u,, — 2ou,, thereby 
including linear damping in the model of the motion of the finite 
string. Show that the assumption u(x, t) = X (x)T (t), in the BVP 
Un = cx, — 2au,, u(O, t) = u(L, t) = 0, u(x, 0) = f(x), 

u;(x, 0) = 0, yields 


(a) the same eigenvalues and eigenfunctions as for the undamped 
model. 


(b) T" + 2aT’ + (any T = 0, T'(0) = 0, for determining T (t). 
B25. For the model proposed in Exercise B24, let c = 1, L = 7r, 


a = 1, and f(x) = E529). Then: 
(a) Determine T7, (t) according to part (b) of Exercise B24. 
(b) Obtain u(x, t), the solution of the modified B VP. 


(c) Choose U (x, t), a partial sum of the infinite series 
representing the solution, so that U (x, 0) gives a reasonable 
approximation to f(x), and graph U(x, 0) along with f(x). 
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(d) Plot U(x, t), the approximate solution surface. 


(e) Using U(x, t), animate the motion, studying how the initial 
disturbance propagates in time. 
B26. Change the model in Exercise B25 so that æ = 3. Notice that 
T; (f) now contains just real exponentials. Obtain a solution of this 
. ct. . . 
BVP and comment on the effect of T, (1) in the solution. 


For the data given in each of Exercises B27—36, let a = 5 in the model 


of Exercise B24. 
(a) Solve the resulting BVP. 


(b) Choose U (x, t), a partial sum of the infinite series 
representing the solution, so that U (x, 0) gives a reasonable 
approximation to f (x), and graph U (x, 0) along with f (x). 


(c) Plot U(x, t), the approximate solution surface. 
B27. the data in Exercise B14 B28. the data in Exercise B15 
B29. the data in Exercise B16 B30. the data in Exercise B17 
B31. the data in Exercise B18 B32. the data in Exercise B19 
B33. the data in Exercise B20 B34. the data in Exercise B21 
B35. the data in Exercise B22 B36. the data in Exercise B23 


B37. For the model proposed in Exercise B24, discuss what happens to 
both T, (t) and u(x, t) ifa = S. (T(t) is the solution to the IVP 
in Exercise B24(b) when n = 1.) 


B38. For the model proposed in Exercise B24, discuss what happens to 


both T, (t) and u(x, t) if o = E (Ti(t) is the solution to the IVP 


in Exercise B24(b) when n — 1.) 


The Struck String 
The BVP 


An idealized string, uniform and having no internal friction, is stretched taut between x = 0 
and x — L on an x-axis. The ends of the string are fixed; the equilibrium position of the 
string is horizontal, along the axis; and the string is constrained to move only in a vertical 
plane. As in Section 24.1, let u(x, t) measure the deflection of the string from equilibrium. 

Attime t = 0, the string is struck, thereby acquiring, at all its points, the initial velocity 
distribution u;(x, 0) = g(x). The boundary value problem modeling the motion of this 
struck string is given in Table 24.4. For t > 0, the string obeys the wave equation (1). We 
take the initial shape (4) to be the equilibrium configuration, u(x, 0) = 0. 

In Section 24.1 we considered the wave equation on a finite string that had been plucked, 
suggesting the action in a harpsichord as a realization of the mathematical model. The struck 
string is found in a piano where a felt hammer hitting the string puts it into motion. 


The Solution by Separation of Variables 


Assuming a solution ofthe form u(x, t) = X (x)T (t) will again result in the Sturm-Liouville 
eigenvalue problem on the left in (24.4). The differential equation for T (t) on the right in 
(24.4) is the same as it was for the plucked string, but now, the initial condition is T (0) = 0 
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EXAMPLE 24.4 


Wave Equation (1) u;; = c?u,, for t > 0 


Fixed left end (2) u(0,t) 20 Initial shape (4) u(x,0) 20 
Fixed right end (3 u(L,t)=0 Initial velocity (5) u;(x,0) = g(x) 


TABLE 24.4 BVP for the struck string 


instead of T7’(0) = 0. 


X"(x) —AX(x) 20 T"(t) - CAT(t) 20 
and 24.4 
x()-xqu)-0 ^ T(0) =0 in 
As before, the Sturm-Liouville problem has eigenfunctions X, — B, sin "7 and eigenval- 
ues A, = —"7-,n-1,2,.... 


For each value of n, the function T (t), satisfying the differential equation T’(t) + 
c? T(t) = 0 and the condition T(0) = 0, is T,(t) = C, sin 7*. Consequently, the 
general eigensolution is 


. Axx , cnmí 
us (x, t) = by sin TL sin 


where the product of constants B, C, has been replaced with the single constant b,. As 
in Section 24.1, the general solution of the PDE will be a linear combination of all such 
eigensolutions. Hence, take the most general possible linear combination of all the eigen- 
solutions. Since there are an infinite number of eigensolutions, our linear combination is 
the infinite sum 

= nux , cnmt 
u(x,t) = Xb, sin L sin I 


n=1 


(24.5) 


The final condition to be applied in this BVP is the initial velocity requirement 


co oo 
1m mx nux 
u;(x,0)— J b, sin = ) B, sin CL = g(x) 


n=1 L n=1 
where B, = %7 b, must be the Fourier sine series coefficient of g(x). Thus, we must have 
nic o p . nxX 
B, = —b, = = g(x) sin —— dx 
L E L 


So. b, = = L4 g(x) sin "7 dx. The complete solution is then 


oo vB 
. nx , cnt 2 . NTX 
ux, tf) = J b, sin T sin b, = | g(x) sin Fa dx 
0 


L cnm 
n-l 


A finite string of length L = zr, with fixed endpoints at x = 0 and x = z, and c = 1, struck 
at its center, acquires the velocity profile g(x) — — x(a — x), graphed in Figure 24.11. 
The coefficients are 


nz 0 5 nin 


2. f* 1 a AUD" = 1 
b, = Í i x(a — x) sinnx dx = z ——, — (24.6) 
0 


Observing the n* in the denominator, we realize the b, rapidly decrease in magnitude, 
so the series for u(x, t) will converge rapidly. Thus, just several terms will be needed to 


+N 
Y 


-0.2 


FIGURE 24.11 
Example 24.4 


Initial velocity in 
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approximate this solution and we approximate u(x, t) with 


"3 dint ~ (si ind 4: 2 gin Sici 
= n SIN AX SN Aİ = —— | N x sin —— $in sin 
5x en 


n=1 


(24.7) 


Figure 24.12 holds a representation of the solution surface. The plane sections t = tę are 
snapshots in time, freezing the physical motion of the string for each value of t,. Animating 
these plane sections simulates the physical motion of the string. Figures 24.13(a) and (b) 
show snapshots of the string at t = = and t = ax respectively. As the string moves in 
space-time, its history generates the solution surface. This and the physical motion of the 


string appear as animations in the companion Maple worksheet. e 


FIGURE 24.12 


EXERCISES 24.2—Part A 


Solution surface for Example 24.4 


(b) 


FIGURE 24.13 Example 24.4: Snapshots 
of the string taken at t = 3 and t = = 


A1. Verify the calculations in (24.6). 


A2. Provide a complete solution to u, = 4x. u(0, t) = u(27, t) = 
0, u(x, 0) = 0, u; (x, 0) = 1 — cos x. Separate variables, solve the 
Sturm-Liouville problem for the eigenfunctions and eigenvalues, 


EXERCISES 24.2—Part B 


solve the equation for T, (t), find the eigensolutions u, (x, t), write 
u(x, t) in the form (24.5), and obtain 5,. 


A3. Give an example of an initial velocity u,(x, 0) = g(x) that causes 
standing waves, not traveling waves, to exist in the finite string. 


B1. Show that the error made using (24.7) instead of the infinite sum 
is no worse than 0.0006. 


In Exercises B2-8: 


(a) Solve u,, = uyy, u(0, t) = u(L, t) = 0, u(x, 0) = 0, 
u,(x, 0) = g(x), the BVP for one-dimensional wave motion 
in a finite string. 

(b) Choose U (x, t), a partial sum of the infinite series 
representing the solution, so that U, (x, 0) gives a reasonable 
approximation to g(x), and graph U(x, 0). 

(c) Plot U(x, t), the approximate solution surface. 


(d) Using U(x, t), animate the motion, studying how the 


displacements caused by the initial velocity propagate in time. 


(e) Plot the surface determined by U, (x, t), the approximate 
velocity along the string. 

(f) In an attempt to study the propagation of the string's velocity 
in time, animate U, (x, t) and compare with the displacements 
given by U (x, t). 


0 zrel 


Up—T1? Lae 22 
BZ. e= 1,£.=5,.2(%) = 1 2xx«3 
(x—4y 3<x<4 


0 4x er) 
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xe 0xx«l (d) Use an animation of U(x, t) to study how the displacements 
B3.c-2,L =3, g(x) = 1 ] €x <2 caused by the initial velocity propagate in time. 
@—3)? 2&xz3 (e) Plot the surface determined by U, (x, t), the approximate 
0 i velocity along the string. 
SxX¥<35 ; ; . 
B4.c—-iL-lg(x)- i : (f) In an attempt to study the propagation of the string's velocity 
1—-x 5; €xxl Sa : : f 
BNET in time, animate U, (x, t) and compare with the displacements 
0 Osx <1 given by U(x, t). 
4-1 lzx«2 1 
B5. c =2,L =4, g(x) = 1. c dili abe 
3-x 2<x<3 B9.c—-3,L-—3,gx)—ix-1 1<x<2 
0 3x =4 3-x 2<x<3 
0 Oss «1 0 0zx«l1 
t=] l1zx«2 B10. LL =4, o(x) —] l<x<2 
B6. c = 1, L = 5, g(x) = 1 iex "I agis fes RE 1 2<x <3 
4—x 3<x<4 4—x 3<x<4 
0 4<x<5 x O<x<2 
X 0zx-«l 2 
BtesdhLezaWde! 1 lara? Rea aI) 1 dede 
Xo 2; 3, g(x X x2 Beg Kanade 
3—-x 2<x<3 
" 0 O0<x<l 
0 O<x< 3 Bl2.c—-2,L—4,g(x)—-1(x-DQ2-x) 1xx«2 
0 2<x<4 
27 5 — ” — 
B8.c—i,L-—mg(x)- (x 3G x) = <x<@ 3x 
3 3 3 ` 0 O<x< = 
2 
0 A ee ao B13. c=2,L=7, g(x) = 3 3a 
3 (s- m)e-» u $5" 
In Exercises B9—15, add linear damping to the wave equation so that it à 
becomes u, = c^u,, — 2au, witha = $7. Then: 10x OSX < 5 
= = E L 2. 

(a) Solve u, = c?u,, — 2au,, u(0, t) = u(L,t) = 0, u(x, 0) = 0, BIA c=3, L =1, 8%) = : 10 =* < jp 
u; (x, 0) = g(x), the BVP for damped one-dimensional wave 10(1 — x) a <x<l 
motion in a finite string. BIS. c= J2,.L=1. 

(b) With a = Sr» choose U(x, t), a partial sum of the infinite —2000x? + 300x? 0zx-« u 
series representing the solution, so that U, (x, 0) gives a i a 
reasonable approximation to g(x), and graph U (x, 0). 8X) = l 10 $X < gg 

(c) Plot U (x, t), the approximate solution surface. 2000x? — 5700x? + 5400x — 1700 a <x<l 

, , : 
D'Alembert's Solution 


Separation of Variables Solution 


If the initial velocity is zero, that is, if u, (x, 0) = g(x) = 0, then the solution of the BVP 
for the finite string with fixed endpoints (see Table 24.1) is 


oo 
. ATX cnzt 
urn t=) fa ain: —,— 608 z 


n=l 


(24.8a) 


2 f* nux 
_ A sin —— dx 24. 
de Í f (x) sin dx (24.8b) 
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Alternatively, if f(x) — 0, the BVP in Table 24.1 will have the solution 


oo 
. AXX , cnux 
ug(x, t) = > Sn Sin — sin 
L L; 

n=1 

with 
2 i . NTX L 2 fl . nax L 
Sn = — g(x) sin — dx = ——— g(x)sin dx = " 
cnt Jo L cnt L Jo L cnz 

where 


JE 
n= g(x) sin — dx 
Amp kg: 


is the Fourier coefficient for the Fourier sine series of g(x). If neither f(x) nor g(x) is zero, 
then the solution will be the sum of the two separate solutions u y and ug. 


D’Alembert’s Solution 


The function 
1 1 x-ct x—ct 

Hor) = FG een FG - ene [f So - | coar] (24.9) 
where F (x) and G(x) are the odd periodic-extensions of f (x) and g(x), respectively, turns 
out to be a solution called D'Alembert's solution. In the absence of an initial velocity, the 
solution reduces to u(x, t) = ipF(x + ct) + F(x — ct)], which justifies earlier claims that 
the initial disturbance splits into two waves of half the initial energy, one traveling to the 
left and one to the right, along the string. In the xt-plane, these waves travel along x + ct = 
constant, the characteristics of Section 24.1. 

D'Alembert's solution can be derived from the separation-of-variables solution. Con- 
sider, first, the case where g(x) = 0, so the solution is u ; given in (24.8a). The coefficients 
fn, given in (24.8b), are the coefficients of the series $7 , f, sin "7 that converges to F (x), 
the odd periodic extension of f(x). This is a crucial point and will have great significance 
shortly. 

Transform the product of trig terms sin A cos B with the identity 


sin A cos B = 5 sin(A + B) + 5 sin(A — B) 


Impose this identity on the terms in u f, so 


lx nnz(x 4- ct) lx nnz(x — ct) 
(x,t) => asina — + = n Sin —————— 24.10 
u y (x, t) 2»: i L + adh si 7 ( ) 
The sum 5 7, f, sin "74 converges to F(c), the odd periodic-extension evaluated at c. 
Consequently, the first sum in (24.10) converges to iF(x + ct) and the second to i F (x — ct). 
In the case where f (x) = 0, transforming ug, the separation-of-variables solution, to 
D'Alembert's solution 


1 Ker x =e 1 x+ct 
ug(x, t) = cw | G(y) dy -f G(y) ay| = =Í G(y)dy (24.11) 
0 0 x 


—ct 


requires one additional but subtle step. First, apply the trig formula 


sin Asin B — $ cos(A — B)- $ cos(A + B) 
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EXAMPLE 24.5 


FIGURE 24.14 Initial shape function 
f (x) in Example 24.5 


FIGURE 24.15 Odd periodic extension of 
f (x) in Figure 24.14 


EXERCISES 24.3—Part A 


so that the separation-of-variables solution becomes 


= +s [es HRS T) cos i= 2| (24.12) 


L L 


^" n=l 
from which we conclude that 
u(x,t) = g(x t ct) — g(x — ct) 


Applying the initial condition u, (x, 0) = g(x), we get 2cg'(x) = g(x), and 
1 x 
g(x) = m f G(y)dy (24.13) 
2e Ja 
where « arises, as a constant of integration. Hence, u(x, t) is given by (24.11). 


Even when g(x) = O so there is no initial velocity, it is not a trivial task implementing 
D'Alembert's solution to the wave equation. Let c = 1, define the initial displacement 
function on the interval [0, 3] by (24.14), and graph it in Figure 24.14. 


0 O0<x <1 
f@)=4{@-DQ-x) 1<x<2 (24.14) 
0 2 35x 393 


The odd periodic extension of f (x), namely, F(x), is graphed in Figure 24.15. 

Forming an analytic representation of F (x) is the challenge. Once an expression for 
F(x) exists, the solution u(x,t) = lpF(x + t) + F(x — t)] is easily formed and can 
be graphed as in Figure 24.16 or used to create a simulation of the string's motion. (See 
the accompanying Maple worksheet for a representation of F(x) and an animation that 
simulates the motion of the string.) $ 


FIGURE 24.16 Solution surface to Example 24.5 


A1. Obtain the series in (24.12) and determine the coefficients s, . (c) Obtain F'(x) by applying Leibniz’ rule, and then compare to 


By Leibniz’ rule, the derivative of the function F(x) = f, 


part (b). 


^u(x) f(x, t) dt 


"sin x 


is F'(x) = f" f(x, t) dt + f (x, u(x))u' (x). In Exercises A2and3: — A2 F(x) = [t Qx +1 dt AS. F(x) = fy sinxt dt 


(a) Obtain F(x) explicitly by evaluating the given integral. 


A4. Use direct substitution to verify that (24.9) satisfies the wave 
equation. Hint: Use Leibniz’ rule to differentiate the integrals. 


(b) Obtain F'(x) from the representation obtained in part (a). 


EXERCISES 24.3—Part B 
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24.4 Derivation of the Wave Equation 


B1. If f(x) = 0 and g(x) = sin x, use (24.11) to obtain u(x, t), the 
solution of the wave equation on [0, z ]. Why is (24.11) so easy to 
apply in this case? 

In each of Exercises B2-11, g(x) = 0 and c, L, and f(x) are given. For 
each: 
(a) Obtain D’ Alembert's solution. 


(b) Using D'Alembert's solution, plot the solution surface. This 
requires finding a representation of the odd periodic extension 
of f (x), the initial-shape function. (See the accompanying 
Maple worksheet for software tools that yield a graphical 
representation of a periodic extension.) 

(c) Animate D’ Alembert’s solution and compare with the 
animation based on the approximation used in Section 24.1. 


B2. Exercise B14, Section 24.1 
B4. Exercise B16, Section 24.1 


B3. Exercise B15, Section 24.1 
B5. Exercise B17, Section 24.1 


Derivation 


B6. Exercise B18, Section 24.1 
B8. Exercise B20, Section 24.1 
B10. Exercise B22, Section 24.1 


B7. Exercise B19, Section 24.1 
B9. Exercise B21, Section 24.1 
B11. Exercise B23, Section 24.1 
Given the initial velocity u; (x, t) = g(x), integration of G(y), the odd 
periodic extension of g(x), can become a difficult tangle of conditional 
statements. However, let 2 (x) be the odd extension of g(x) to the interval 
[-L, L]; let G(x) = f g(x) dx be the indefinite integral of g(x), mean- 
ingful on the interval [—L, L]; and let G (x) be the periodic extension of 
G(x). Then (24.11) becomes u(x, t) = £[G(x + ct) — G(x — cr)]. In 
Exercises B12-18, use software to evaluate G(x + ct) and graph u(x, t), 
showing that this solution replicates the solution obtained earlier. 

B12. Exercise B2, Section 24.2 B13. Exercise B3, Section 24.2 
B14. Exercise B4, Section 24.2 B15. Exercise B5, Section 24.2 
B16. Exercise B6, Section 24.2 B17. Exercise B7, Section 24.2 
B18. Exercise B8, Section 24.2 


Derivation of the Wave Equation 


The wave equation is a consequence of Newton’s Second Law, F = ma. Just what forces 
are exerted on the string are established by some simple assumptions and the diagram in 


Figure 24.17. 
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FIGURE 24.17 Forces on a segment of an ideal string under 


tension 


The string is ideal, so it is uniform and frictionless. It is at equilibrium, and under 
tension, so every point that is not an endpoint is subjected to equal and opposite forces 
whose common magnitude we denote by r. The string is subjected to a “gentle plucking” 
f (x) so that it experiences a small deflection from equilibrium, one small enough that the 


572 Chapter 24 Wave Equation 


magnitude of the tension remains t. We also assume that the tension in the deformed string 
acts tangential to the string and that individual particles in the string move only vertically. 
The string experiences no lateral translation and remains in horizontal equilibrium. 

At some fixed time f, consider a small segment of the string lying between x and x + dx. 
Let w be the weight per unit length of the string. Let m = a be the mass per unit length 
of the string, where g is the gravitational constant. The segment of string in [x, x + dx] in 
Figure 24.17 has total weight c dx and total mass m dx. The horizontal components of the 
tension are equal in magnitude, so we have 


Tı cos ĝi = Ta cosh = T (24.15) 


Applying Newton’s Second Law (F = ma) to the vertical direction, with the accelera- 
tion a = ug (x, t) = uy, and the net vertical force 


F= (h sin 05 e Ti sin 0, = wdx)i 
we obtain 


z " w 
T sin 6, — T; sin 0; — wdx = — dX uy 


From (24.15) we have, upon multiplication by tan 0x, 
Tı sin; = t tan; and T»5sin0, = t tan 0; 


Hence, the equation F = ma becomes 
w 
t[tan 6. — tan 01] — o dx = — dX uy 
g 


Divide by dx, obtaining 


tan 6. — tan 0 
[22 =e O= Eia (24.16) 


dx 


Now make the obvious geometric interpretation of tan 0, and tan @ as derivatives. 
From elementary calculus, the derivative is the slope of the tangent line and the slope of the 
tangent line is the tangent of the angle it makes with the horizontal. Thus, the slopes at the 
two endpoints are 


tan 0 = u,(x --dx,t) and tanĝı = u,(x, t) 


so (24.16) becomes 


w = u 
d 2 tt 


The fraction in the bracket on the left is a difference quotient for the x-derivative of u, (x, t). 
Hence, in the limit as the segment of string becomes very small (dx — 0) we have 


: EE +dx,t) — u(x, 2| w 


w 
Tüxx(X, t) =0 = —ug(x, t) 
8 
Multiply through by £ and write u, as the left side of the equation, giving 
TE 
Ut = — Uxx — 8 
@ 
Define c? = 75, leading to 


5 
Un = C Uxx — g 


Assume that the tension t is great enough that the term c?u,, is large in comparison to g, 
resulting in uj, = c?uxx, the wave equation. 
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The constant c? — " has dimensions of velocity squared, so c is the wave speed. the 
speed with which the initial disturbance (or shape) travels along the string. 


EXERCISES 24.4—Part A 


A1. Show that c = Jz has the units of velocity. (b) Show that for any twice-differentiable functions f;(o), 
kesk crs 6, the sum u = fi (x + ct) + fa(x — ct) + 

f(y +ct)+ fa(y — ct) + fs(z + ct) + fs(z — ct) isa 
solution of the wave equation. 


A2. In three dimensions, the Cartesian form of the wave equation would 
be un = c V?u = c? (Uxx + Uyy + Uz), Where u = u(x, y, Z, t). 
(a) Show that u = 2 sin(x + ct) — cos(x — ct) + e+“ + 
arctan(y — ct) — LZ is a solution of the three- 
dimensional wave equation. 


EXERCISES 24.4- Part B 


B1. The telegrapher's equation, u, = c?u,, — 2au, — ku, models the (c) For the solution in part (b), take k — J2,L-2m,c- 1, and 
transmission of electrical signals along a wire. The term —2ou; 20x (4 —x) O<x< TG . 
models a linear viscous damping, and the term —ku models an fa) = 0 B cites and determine u(x, t). 


elastic restoring force akin to the Hooke’s law term in the damped : . 39 77 
oscillator? Unit One. (d) Obtain a plot of the solution surface for the BVP solved in 


- : : — : "NT . part (c). 
(a) Verify that inclusion of a linear elastic restoring force in the 


model of the finite string results in the modification seen in the 
telegrapher's equation. 


(e) Plot time-slices for the solution found in part (c), and animate 
them if possible. 


(b) Obtain a formal solution to the undamped telegrapher's (f) Compare the solution found in part © with the solution for 
equation (a = 0), u(0, 1) = u(L, t) = 0, u(x, 0) = f(x), and which k = 0. Determine what physical effects inclusion of the 
vafe Des 8 iid. f iid 1 Se elastic restorative force has on the model of the finite string. 

(x, 0) = 0. 


Longitudinal Vibrations in an Elastic Rod 


Introduction 


A rod of length L and density o (mass per unit volume) is deformed by pulling or pushing 
in opposite directions at its ends. The rod is said to stretch or compress linearly along its 
axis if the restorative forces induced in the rod obey Hooke's law. In effect, the rod behaves 
like a spring that is both extensible and compressible. Such a rod is called elastic if after a 
deformation, it returns to its original state. 

Under compression, the distance between contiguous cross-sections in the rod de- 
creases, while under expansion (rarefaction) it increases. Compression or expansion expe- 
rienced by neighboring plane cross-sections can propagate through the rod as a wave that 
obeys the wave equation us = Cu». Since the disturbance travels along the axis of the 
rod, the wave is said to be longitudinal. Thus, a steel rod, hammered on its end, will support 
longitudinal waves of compression and rarefaction traveling the length of the rod. Similarly, 
the rubber engine mounts supporting the engine in an automobile, when subjected to shock, 
experience the same passage of distortions progressing as plane waves through the medium. 

Although such longitudinal vibrations in a rod are governed by the same wave equation 
as the vibrating string, the meaning of the displacement u(x, t) is different and subtly so. 
In the rod, u(x, t) measures the displacement, at time f, of the plane in the rod that was at 
x initially. Since these displacements are relative to where the plane section was located 
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EXAMPLE 24.6 


initially, there is an additivity that makes the complete motion much harder to fathom than 
the vibrations in the finite string where the displacement was directly observable. 

In addition, the free endpoint condition whereby an end is free to move is formalized 
in terms of the strain, a new concept for the reader not familiar with the theory of elasticity. 
Hence, our approach will be to state an appropriate boundary value problem, nurture intu- 
ition by illustrating the solution, and finally develop the theory and derive the governing 
partial differential equation. 


PROBLEM STATEMENT Formulate and solve an appropriate boundary value problem for 
the longitudinal elastic vibrations in a rod of length 2 whose left and right ends are both 
free. Assume c — 1 as the wave speed, and uniformly stretch the rod by one unit, releasing 
it without imparting any initial velocity. 


PROBLEM FORMULATION If the rod is placed between x = 0 and x = 7 on an x-axis and 

a copy of the x-axis is etched on the rod at equilibrium, then the desired boundary value 

problem consists of the wave equation u;; = Uxx, the boundary conditions on the left in 
(24.17), and the initial conditions on the right. 

x 

u,(0,t) =0 u(x,0) = f(x) = — 

T 


(24.17) 
uxCGr,1) 20  4(x,0) 20 


The function u(x,t) measures the displacement, at time f, of the plane section in the 
rod that was at location x initially. The endpoint conditions are derivatives because, as we 
will see later when we derive the governing equations, “free ends" mean no forces act on 
the ends. In fact, we will show the elastic force on a face at location x is proportional to 
ux(x, t). 

To determine the initial distribution of displacements in the rod, we must first obtain 
the constant value of the strain, defined as the change in length, per unit length. Thus, we 
compute the constant strain as 

AL (x+1)-z 1 


L T T 


The initial distribution of displacements is then found by accumulating the strain along the 
rod, obtaining 


Finally, the initial velocity, namely, u; (x, 0), is zero. This boundary value problem is 
new because we have not yet solved the wave equation with homogeneous Neumann con- 
ditions (as derivative conditions at the endpoints are called). 


SOLUTION BY SEPARATION OF VARIABLES Assume u(x,t) = X(x)T (t) as the separated 
form of the solution. As in Sections 24.1 and 24.2, the wave equation then yields the two 
ODEs 


X'"(x) —AX(x) 20 and T"(t)—AT(t)-0 


However, applying the separation assumption to the endpoint conditions now gives 
ux(0, f) 20 => XOT) =0 > X'(0) 20 
lt, t)=0 > X@)TO=0> X'() =0 
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In addition, applying the separation assumption to the initial velocity condition yields 
u,(x,0 202 X(x)T’(0) 202 T'(0) 20 


a result we obtained each time we solved the wave equation with a similarly vanishing 
initial velocity. 

We therefore face the Sturm-Liouville system on the left in (24.18) and the modified 
IVP on the right. 


X"(x) — AX(x) 20 T" —AT —0 


24.18 

X'(0) = X'(1) 20 T'(0)—0 ( ) 

From Section 16.1, the Sturm-Liouville BVP for X (x) has the eigenvalues A = —n?, n = 
0, 1, 2, ..., and the corresponding eigenfunctions X, = A, cosnx, n =0,1,2,.... The 
corresponding solutions for T (t) are then Tp, = B, cosnt, n = 0,1,2, .... A typical eigen- 


solution is therefore 
us (X, t) = a, cos nx cosnt 


and u(x, t) is a linear combination of all such eigensolutions. Evaluating at t = 0 tells us 
the coefficients in the sum are the Fourier coefficients for f(x), so we have the solution 


oo x 
ao 2 
us): = ri -+ ) a,cosnxcosnt a= Ji f(x) cosnx dx 
z 0 


n=1 
For f(x) = =n the Fourier coefficients are 


2 T3 2 "3x (-1)" —1 
ay = — —dx=1 and a,=— — cos nx dx = 2— 
0 X m Jo m n^n? 


20 
n=1 


The partial sum w9(x, t) 2 à +25 
surface in Figure 24.18. 


[((—1)" — D)/z?n?] cos nx cos nt is graphed as a 


FIGURE 24.18 Solution surface for Example 24.6 


The wave-like properties of the solution are apparent, but the detailed interpretation 
of the meaning of these waves requires more investigation. Remember, u(x, t) gives the 
displacement, at time f, of the plane section that was at x initially. What we want to see is 
a representation of the physical motion of the elastic rod, and unlike the transverse waves 
on the finite string, u(x, t) does not directly show these physical motions. 

An animation of the solution u(x, t) is a dynamic interpretation of the solution surface 
but is still not a representation of the physical motions in the rod. It shows the displacements 
u(x,t) that each face that was at location x is now experiencing at time f. It tells us that 
whatever is happening is happening linearly, and it takes place from the endpoints in and 
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(a) 


t 
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FIGURE 24.19 Example 24.6: u(x, t) at 
t = 0, 0.5, 1.4 


l 
ol 2 4 


FIGURE 24.20 Example 24.6: Snapshot 
of the moving elastic rod at t = 3.7 


strain 
0.3 £31 
0 : —]—— x 
1 2 3 
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(a) 


(b) 


FIGURE 24.21 Example 24.6: The 
strains u(x,t) att = 1l and t = 4 
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back with a wave-front like a shock wave. Several frames of this animation appear in Figure 
24.19. 

A more revealing animation in the accompanying software simulates the actual rod by 
imagining a set of 11 equispaced scratch marks on the rod and following the motion of these 
scratch marks in real time. Figure 24.20 shows the bar at t = 3.7. 

The uniformly stretched rod relaxes to its natural length, with the collapse occurring 
from the “outside, in.” The center of the rod is the only part of the rod that does not move. 
Then, the collapse continues past the point of reaching natural length, and the rod contracts 
by an amount equal to the original stretch. This continuing contraction now takes place from 
“inside, out” as the center of the rod first experiences the compression, with the outside of the 
rod feeling the compression last. The rod then expands from this state of full compression 
to natural length, from “outside, in.” Having achieved natural length, the rod continues 
expanding to its initial stretched state, this time from the “inside, out.” 

In addition to this simulation of the rod itself, it is also instructive to examine an ani- 
mation of u(x, t), which is the localized (per-face) value of the strain, AL. This animation 
shows more clearly how the compression and rarefaction waves travel with a “front” through 
the rod. To compute the derivative u, (x, t) we have to differentiate the infinite sum repre- 
senting the solution u(x, t). The derivative of a Fourier series converges even more slowly 
than the original series. Where we obtained acceptable results with a 20-term approximation 
for u(x, t) itself, it will take 100 terms for the derived series to converge. This translates 
into a modest increase in computation time. 

Figure 24.21 shows, at times  — | and t = 4, the strain in the rod. The strain moves 
longitudinally through the rod, as a shock wave. It starts out uniform across the rod and 
drops to zero with a shock-front. When the strain is completely gone, the rod has reached 
its natural length. As the rod then enters a compressive mode, the strain becomes negative 
and the region of compression expands from the center out to the ends. At this juncture 
the strain graph is a constant negative amount. The compression then starts to vanish from 
the ends, inward, until the rod again reaches its natural length. This corresponds to the 
vanishing of the strain. As the rod enters an expansion phase, the strain appears above the 
x-axis, growing, with a shock-front, outward from the center. The expansion continues until 
the rod returns to its original stretched state. 

The accompanying Maple worksheet contains animations of the displacement u(x, t), 
the physical motion x + u(x, t), and the strain u, (x, t). A simultaneous side-by-side dis- 
play of these three animations is also available in the worksheet. $ 


Theory and Derivation 


A rod that obeys a linear law of elasticity is said to obey Hooke's law, wherein forces 
are proportional to displacement. This linear relationship between force and displacement, 
expressed by the formula F = kx, is a staple of elementary calculus and general physics, 
especially in any discussion of the behavior of a spring. In fact, the linear spring was an 
essential element in Chapters 5 and 6. Thus, F, the force required to stretch a spring, is 
proportional to x, the amount of the stretch. The constant of proportionality, k, is called the 
spring constant. 

In the context of elasticity, Hooke's law is sometimes stated as "stress is proportional 
to the strain," where stress is the force per unit cross-sectional area and 


strain = —— 
L 


is defined as the elongation per unit length. In the context of elasticity, Hooke's law is then 
stress — E strain, where E is Young's modulus, the constant of proportionality between 


x 


FIGURE 24.22 
rod 


x+dx E 


A segment of an elastic 
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stress and strain. This gives Young’s modulus the units of 


force 
area 
strain length area 
length 


stress force 
N 


^ 


In fact, starting with F = kx and dividing through by A, the cross-sectional area, we 


have t ES Ex. The displacement x is the elongation AL from the definition of strain, 


namely, strain — X. Hence, the spring law becomes 


stress — il = LET: — —Lstrain — E strain 
A A A 
where E, Young's modulus, is P2 Hence, the two statements of Hooke's law are equivalent. 

Since longitudinal waves travel in the direction of the rod's axis, we want a coordinate 
system along that axis. However, we must assume a linear elasticity that keeps plane sections 
both plane and parallel. Thus, forces within the rod obey the linear Hooke's law and preserve 
the orientation of all plane sections that are perpendicular to the axis of the rod. 

Put the rod (whose equilibrium length is L) on a ruler, aligning the left end of the rod 
with the left end of the ruler. At equilibrium, paint a copy of the ruler's coordinates on the 
rod. For clarity, take this linear coordinate system to be an x-coordinate system. Identify 
a face (i.e., a plane section) within the rod by the coordinate it had at equilibrium. If the 
equilibrium coordinates are painted on the rod, then these coordinates travel with the rod 
should the rod be stretched or compressed. In addition, leave the ruler on the table so that 
the original meaning of an x-coordinate is preserved. 

Consider R, a segment of the rod bounded at equilibrium by faces at x and x +dx. This 
segment has length dx and is shown in Figure 24.22. Let u(x, t) denote the displacement 
experienced, at time f, by the face, which at equilibrium, was located at x. It helps to 
remember that this face still bears the coordinate x. The displacement undergone by this 
face is the quantity u(x, t) and is measured along the axis of the rod. Unlike the vibrating 
string where the displacements are very obvious, the lateral displacements of faces in the 
rod are much more difficult to visualize. 

The partial differential equation governing longitudinal vibrations in the rod will be a 
consequence of F — ma, Newton's Second Law of Motion. It's not hard to guess that a, the 
acceleration of the face bearing the coordinate x, is given by a = uj; (x, t)i. Determining 
F, the net force acting on this face, is more subtle. 

At time f, the left and right faces of the segment R are now located, respectively, at 


Xet =X d u(x,t) and Xin =x + dx +u(x + dx,t) 
The length of the deformed segment is then 
A=dx+u(x +dx,t) — u(x,t) 
The change in length of this segment is therefore 
A — dx — u(x + dx,t) — u(x,t) 


the relative displacement between the left and right faces of the segment. The strain asso- 
ciated with the face that, at equilibrium, was at location x, is given by the limiting ratio 
limg4.0 Ac Notice that strain, an extensive property, is ascribed to a point by this limit. 
This definition parallels the definition of pressure, which is also an extensive property, force 
per unit area, ascribed to a point. 

Thus, the strain on the single face bearing the coordinate x is lima, o “te 
so the value of the strain is strain = u,(x, f). This is a fundamental result in the theory 


of elasticity. Getting this correct at the beginning is well worth the time invested. Thus, at 


E 
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time ¢ and location x, the strain caused by the displacement u(x, t) is positive if the applied 
force tends to increase the size of the region R and negative otherwise. 

The force on a plane section can be obtained from the strain, using Hooke's law, stress 
— E strain. With A as the cross-sectional area of the rod, we have 


force i 
= stress = E strain 


area 
so that 
force = EA strain = EAu,(x, t) 


Thus, the elastic force on the face whose equilibrium coordinate was x is given by F (x, t) = 
EAu,(x, t). 

The net force on segment R is given by the sum of the forces acting on the left and 
right faces of R, namely, by 


EAu,(x + dx,t) — EAu,(x, t) 


The total mass of segment R is m = pA dx since the volume of the segment is A, the cross- 
sectional area, times the length, dx. Taking the acceleration of a face as u;; (x, t), we can 
write the i-component of Newton's Second Law, F — ma, as 


EAu,(x + dx,t) — EAu,(x, t) = pAdxug(x,t) 
Divide by Ap dx to get 
E uy (x + dx,t) — uy(x, t) 
p dx 


= ugn(x,t) 
which, in the limit as dx — 0, becomes 


E 
—Uyy(X, f) = Uy, (X, t) (24.19) 
p 


Upon defining c? — d. (24.19) becomes us = c?^u,,, the very same wave equation we de- 


rived for the vibrating string. The difference here is that u(x, t) represents the displacement 
of the face that was at x at time ft, and this displacement is lateral, along the axis of the rod. 


EXERCISES 24.5 


1. An elastic rod of length 10 whose ends are free is uniformly 
stretched by two units and released without imparting an initial 
velocity. 


sections depict the actual motions undergone by the 
corresponding three faces in the rod. 


2. An elastic rod of length z whose left end is held fixed and whose 
right end is free is uniformly stretched by one unit and released 
without imparting an initial velocity. 


(a) Formulate an appropriate B VP. 


(b) Solve the BVP by separating variables and obtain the relevant 


Fourier series. 
(c) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 


(d) With c = 1, graph, as a function of time, the displacements of 
the free left end of the rod. 


(e) With c = 1, obtain a plot of the surface x + u(x, t) for 
0 € x x 10 and 0 <t < 20. Each plane section x = x9 depicts 
the motion undergone by the face initially located at x — xo. 


(f£) With c = 1, graph the curves xo + u(xo, t), where O < t < 20 
and xo assumes the values 1, 4, and 7. Again, these plane 


(a) Formulate an appropriate B VP. 


(b) Solve the BVP by separation of variables and obtain the 
relevant Fourier series. 


(c) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 


(d) With c = 1, obtain a plot of the surface x + u(x, t) for 
0x x x z and0 <t < 20. 


(e) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 
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3. An elastic rod of length x whose ends are free is stretched by one 
unit and released without imparting an initial velocity. The initial 
strain is not uniform but is proportional to location. Thus, it is given 
by u,(x,0) = 2x, so the initial displacement is given by 
u(x,0) = iC ux(s,0)ds = n. Note that w(z, 0) = 1, which is 
consistent with the hypothesis of a total stretch of one unit. 

(a) Formulate an appropriate B VP. 

(b) Solve the BVP by separating variables and obtain the relevant 
Fourier series. 

(c) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(d) With c — 1, graph, as a function of time, the displacements of 
the free left end of the rod. 

(e) With c = 1, obtain a plot of the surface x + u(x, t) for 
0 x x x z and 0 <t < 20. 

(f) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 

4. The elastic rod of Exercise 3 has its left end fixed. 
(a) Formulate and solve the relevant B VP. 


(b) Set c = 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(c) With c = 1, obtain a plot of the surface x + u(x, t) for 
O<x <a and0 «x t < 20. 

(d) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 

5. An elastic rod of length 5 whose left end is at the origin of an 
x-axis, is nonuniformly stretched a total of one unit. The strain in 
the rod is proportional to the square root of the coordinate of the 
location. Both ends of the rod are free, and after stretching, the rod 
is released without imparting an initial velocity. 

(a) Obtain u(x, 0), the initial displacement function for the rod. 

(b) Formulate and solve the relevant B VP. 

(c) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(d) With c — 1, graph, as a function of time, the displacements of 
the free left end of the rod. 

(e) With c = 1, obtain a plot of the surface x + u(x, t) for 
0<x<5and0 <t < 20. 

(f) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 5, and 4. 

6. The elastic rod of Exercise 5 has its left end fixed. 

(a) Formulate and solve the relevant B VP. 

(b) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(c) With c = 1, obtain a plot of the surface x + u(x, t) for 
0<x <S5and0 <t x 20. 


(d) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 4. 


7. 


8. 


10. 


11. 
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An elastic rod of length zz whose ends are free is uniformly 
compressed one unit and released without imparting an initial 
velocity. 


(a) Formulate and solve the relevant BVP. 


(b) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 


(c) With c — 1, graph, as a function of time, the displacements of 
the free left end of the rod. 


(d) With c = 1, obtain a plot of the surface x + u(x, t) for 
0<x xz and0 <t < 20. 


(e) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 


The elastic rod of Exercise 7 has its left end fixed. 
(a) Formulate and solve the relevant BVP. 


(b) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(c) With c = 1, obtain a plot of the surface x + u(x, t) for 
0O<x <a and0 <t x 20. 

(d) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 


. An elastic rod of length 2 whose ends are free is compressed by 


one unit and released without imparting an initial velocity. The 
initial strain is not uniform but is proportional to location. Thus, it is 
given by u,(x, 0) = E27 so the initial displacement is given by 
u(x,0) = f ux(s, 0) ds = -Lix. Note that u(zr, 0) = —1, which 
is consistent with the hypothesis of a total compression of one unit. 
(a) Formulate and solve the relevant BVP. 


(b) Set c = 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(c) With c = 1, graph, as a function of time, the displacements of 
the free left end of the rod. 

(d) With c = 1, obtain a plot of the surface x + u(x, t) for 
0<x <a and0 <t < 20. 

(e) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 

The elastic rod of Exercise 9 has its left end fixed. 

(a) Formulate and solve the relevant B VP. 

(b) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(c) With c = 1, obtain a plot of the surface x + u(x, t) for 
0<x <a and0 <t < 20. 

(d) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 

An elastic rod of length z is nonuniformly compressed a total of 

one unit. The strain in the rod is proportional to the square of the 


location. Both ends of the rod are free, and after compression, the 
rod is released without imparting an initial velocity. 
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(a) Obtain u (x, 0), the initial displacement function for the rod. 

(b) Formulate and solve the relevant B VP. 

(c) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(d) With c — 1, graph, as a function of time, the displacements of 
the free left end of the rod. 


(e) With c = 1, obtain a plot of the surface x + u(x, t) for 
0zxx xz andO <t < 20. 


12. The elastic rod of Exercise 11 has its left end fixed. 


(a) Formulate and solve the relevant BVP. 

(b) Set c — 1 and graph, as a function of time, the displacements of 
the free right end of the rod. 

(c) With c = 1, obtain a plot of the surface x + u(x, t) for 
0x x x z and 0 <t < 20. 

(d) With c = 1, graph the curves xo + u(xo, t), where 0 < t < 20 
and xo assumes the values 1, 2, and 3. 


(f) With c = 1, graph the curves xo + u(xo. t), where 0 € t < 20 
and xo assumes the values |, 2, and 3. 


Finite-Difference Solution of the One-Dimensional 
Wave Equation 


Problem Statement 


A numeric solution is sought for the boundary value problem consisting of the one-dimen- 
sional wave equation u, = c^u,, in a string of length L, the boundary conditions on the 
left in (24.20), and the initial conditions on the right. 


u(0,2) 2 Vi(t) | u(x,0) = f(x) 
u(L,t)- wot) u(x, 0) = g(x) 


Notice that the boundary conditions are not homogeneous. 

We will describe and implement a finite-difference technique in which derivatives in 
the wave equation are replaced by the O(h?) central difference approximations given in 
(24.22) and derived in Exercises A1 and A2. 

An exact solution of this problem would require analytic techniques similar to those 
developed in Section 27.2. Of course, if Yı (t) = v»(t) = 0, the problem reduces to one for 
which we can compute an exact solution. 


(24.20) 


An Explicit Scheme 


First, a grid is defined on that portion of the xt-plane corresponding to the extension of the 
string in space-time. Let the x-interval [0, L] be divided into N equal subintervals of length 
Ax = i by the N + 1 points x, = xo 4- nAx, n —0, 1,..., N. Similarly, discretize the 
t-axis with the partition tn = to + m At, m = 0,1,..., M, where At < At, For the explicit 
method being described, this is a very real restriction on the size of the time-step permitted. 
It is derived in a subsequent discussion. 

Let u(x,, tm) be the exact value of the solution at the point (Xn, tm). Let vy, be the 
numeric approximation to that exact value, where v, ,, is computed from 


Un,m+1 = K^ sm F Un+1,m) sp 2(l TER A Vino — Un,m-1 (24.21) 


where A = ea < 1. (The restriction on A is derived next.) Then, except for round-off error, 
the difference u(x,, tn) — Un.m goes to zero as x, and tm themselves go to zero. (See [18] 
for details.) 
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Xn-1 Xn Xn 


FIGURE 24.23 Computational molecule 
for the explicit finite-difference scheme for 
the wave equation 


Theoretical Considerations 


Derivation The explicit method given by (24.21) is obtained by making the O(h?) cen- 
tral difference replacements 


Un,m+1 — 2Un,m RU Un.m—1 
(At)? 


Un--1,m — 2Us,m = Un—1,m 
(Ax)? 


and Ui (Xn, tm) = 


Uxx Xn, tn) = 


(24.22) 


in the wave equation, multiplying through by (Ar)*, introducing A = eM and solving for 
Un.m.1. Values at “interior points” are computed with (24.21). 


IMPLEMENTATION A careful examination of the terms on the right in (24.21) suggests 
the schematic, or computational molecule, shown in Figure 24.23. The solid dots represent 
known values that are used to compute the unknown Vy, m+1, represented by the open dot in 
the schematic. Moreover, the diagram shows that to compute v, ,,,;, v must be known for 
the previous two time-steps. 

The very first time-step forward from the initial data at time t = O is taken via the equa- 
tion 


Val = A? (vs 10 F Un+1,0) F 2(1 = 7) Un, — Un,-1 (24.23) 


When computing v; ;, the index is m = 0, so the row with three black dots is the very first 
row consisting of the values of u(x, 0) = f(x). Thus, with the values of v, 9 = f(x,) = 
Jn, the equation for the very first row of new values becomes 


Val = XM fua zs fna) =F 2(1 = M35 = Uyi (24.24) 


The value v,,—;, represented by the lone black dot in the row beneath, has to be obtained 
from the other initial condition u; (x, 0) = g(x). For this, solve the O(h?) central-difference 
representation 


: = Un,| — Vn,—1 — si 
Us (Xy, to) —  2N — = 8 (Xn) = En 
for Vn, —1 = —2g, At + v, 1, Which, when inserted into (24.24), yields 
"TER G 
Un] = (1 = A^) fr F y fm + i-i) + y At (24.25) 


STABILITY ANALYsis The following technique for determining the stability of a finite- 
difference method such as (24.21) is due to John von Neumann. At time tn = fo + m At, 
assume v,,, can be expanded in Fourier series, the terms of which are of the form 
(tm) cos(ox,). Equation (24.21) is then transformed by 


using dx and dt in place of Ax and At, respectively when defining A. 
writing b(t.) = dk. 
noting cos(@Xn41) = cos(w (Xn + dx)) = cos(wx,) cos(o dx) F sin(wx,) sin(w dx). 


dividing through by m cos(@x,). 


aS SYS 


defining R = }m+1/m and noting it is the amplification factor by which a given com- 
ponent in the numeric solution grows in time. 


6. noting that dn—1/¢m = 4 because it is the reciprocal of R = $m/$m-—1- 
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R,(0, A) = R_(O, A) =1 


FIGURE 24.26 Graphs of 
R4,(0, 4) = R.(0, A) = 1 and R«(—2, A) 


EXAMPLE 24.7 


These steps result in R = 222 (cos(o dx) — 1) + 2 — Lj Writing A = cos(o dx) — 1 
yields, for R = R(A, 4), the two roots 


R =14+NAtAV2A 42242 


Stability requires | R4.| < 1 for both roots with —2 < A < 0, achieved for 0 < A < 1. The 
bounds on A follow from the behavior of the cosine function, and the bounds on A can be 
deduced from Figure 24.24, where | R, (A, 4)| is graphed, Figure 24.25, where | R. (A, A)| 
is graphed, and Figure 24.26, where R4(0, A) = R-(0, à) = 1 and R«(—2, A), constituting 
the curve, are graphed. 


0 A 0 X 


> A FIGURE 24.24 Graph of |R,(A, A)| FIGURE 24.25 Graph of |R_(A, A)| 


If 1 < A, at least one branch of the amplification factor R has a magnitude greater 
than 1. The gap in the graph over the interval 0 < A < 1 suggests that at least one branch 
of R is complex in that range. Thus, the amplification factor R = $(tm+1)/@(tm) has 
magnitude 1 for any value of cos(ox,) as long as 0 < A < 1. For these values of i, the 
explicit scheme (24.21) is stable for the one-dimensional wave equation. Readers interested 
in alternate approaches to this stability analysis should consult more specialized texts such 
as [18] or [90]. 


Let L = 1,c = 1, yı = sint, y? = cost, f(x) = x, and g(x) = x — 1, and take Ax = + 


10 
corresponding to the choice N = 10. Let At = 1; so à = c4 = 1, and define the nodes 
(Xn, tm) = (T> 15) At the first time-step, compute the N — 1 = 9 values v,,; with (24.25), 


which becomes 


Uk = ua — 5 (24.26) 


The values v, m+1 for m = 1,2,... are given by (24.21), which becomes 
Un,m4-1 = Un—i,m + Un+ijm — Un,m-1 (24.27) 


Ordinarily, from three contiguous values at time f,, and one value at time tm—1, one new 
value of the approximate solution can be computed at time f,,4 using (24.21). The choice 
of A = 1 eliminates Va, m, so (24.27) is particularly simple. The open dot in Figure 24.23 
moves from left to right between x, and xo, so the values of v9.41 and V19,m+1 are computed 
from the endpoint data, not from the same formula used to compute at the N — 1 — 9 interior 
points. 

For the first “row,” the values of v, o are obtained from the initial function, f (x). Hence, 
to begin the calculation, the initialization step defines values for v, 9, n = 0,..., N. Then, 


FIGURE 24.27 Solution surface for 
Example 24.7 


EXERCISES 24.6—Part A 
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row 1 is computed from (24.26), after which each new row can be computed from the 
previous two rows provided (24.27) is used for the N — 1 = 9 interior points, and the 
endpoints are computed from the boundary functions. 

If only the numeric values of the approximate solution are desired, there is no need to 
store the values for every row during the computation. Only three rows are needed during the 
computation, the last two known rows and the new row being computed. After a complete 
row has been computed, the values in that row can be printed or stored for further processing 
and graphical displays. Then, the values in the row m are shifted to become the oldest row, 
the most recently computed row becomes row m, and the iteration repeats. 

The companion Maple worksheet contains code embodying the algorithm just enunci- 
ated. The results of the calculations appear as the solution surface in Figure 24.27. Three 
plane sections f = fm, m = 10, 15, 40, are shown in Figure 24.28. A complete animation 
of the motion of the string is given in the companion Maple worksheet. $ 


(a) (b) (c) 


FIGURE 24.28 Example 24.7: Three snapshots of the moving string 
taken at times (a) tio = 1; (b) tis = 1.5; (c) tao = 4 


Al. By adding the Taylor expansions 


and solving for uxx, obtain the O(h?) central difference formula 


u(x +h, t) = u(x, t) ux, Dh + ius (x, D)? appearing on the left in (24.22). 
$ TE (x, Dh? + TA A2. Obtain the O(h?) central difference formula appearing on the right 
in (24.22). 
u(x — h, f) = ue, f) — us Qr Dh jus Gs DI A3. Use (24.22) to obtain (24.21). — A4. Derive (24.25). 
— dax, t + OM) AS. Obtain (24.26). 


EXERCISES 24.6—Part B 


B1. In Example 24.7, take c = 1 sodA = 


. Keeping all other data the A string of length L has its endpoints fixed. For that string and the data 


same, apply the explicit finite-difference method, obtaining a given in each of Exercises B3-8: 


graph of the solution surface. 


(a) Obtain the exact solution by the methods of Sections 24.1 


B2. In Example 24.7, take c = 2 so A = 2. Keeping all other data the and 24.2. 


same, apply the explicit finite-difference method. Since A > 1, 
your results should show the computation becomes unstable, 


(b) Letting N = 10 so Ax = 4 and choosing Ar < $, obtain a 
numeric solution. 


generating meaningless large values for the displacement u. 
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(c) Compare the exact and numeric solutions by graphing the 
resulting solution surfaces. 

(d) Compare the exact and numeric solutions by graphing the 
time-dependent displacement at the midpoint of the string. 


B3. u(x, 0) = xGt —x),u,(x,0 =0,c=1,L =x 
x 0<x< Il 
B4. u(x,0) = 42-x 1<x <2, u,4,0 =0,c=1,L=3 
0 DEH SS 
0 O<x<1 
BS. u(x,0) = 4(x—D(2—-x) 1<x<2, u,(x,0) =0, 
0 2.=% <3 
Qe, EL 3 
] — cosx 
B6. u(x, 0) = 0, u,(x, 0) = e= l L = 2% 
x(x-1) O<x <1 
B7. «e 706.0 2 P^ aes ,~6=1.2=3 
0 ]x m3 
x(1—x) O<x 
B8. «sos |" "i aS 
0 Sya 
0 O<x <2 
un (x,0) = , C=2,6=3 
(x—2)x—-3) 2<x<3 


The displacements u(x, t) in a string of length 10 obey the differential 
equation u; = Uxx, the endpoint data u (0, t) = W(t), u(10, t) = vo(t), 
and the initial conditions u(x, 0) = f(x), u;(x, 0) = g(x). Using the ad- 
ditional data provided in each of Exercises B9-17: 


B9. 
B10. 
B11. 
B12. 


B13. 


B14. 


B15. 


Ax 
5 


(a) Let N = 20 so Ax = $, choose At < 
a numeric solution. 


= Ax, and obtain 


(b) Plot the solution surface. 


(c) Animate the motion of the string, or minimally, plot several 
snapshots of the shape of the string for successive times. 


pilt) = sint, W(t) = sin2t, f(x) = g(x) = 0 
pilt) = sint, W(t) = 0, f(x) = g(x) = 0 
Va (t) = sin? t, y(t) = 0, f(x) = g(x) 20 


Vi (t) = |sint|, w(t) = 0, f(x) = g(x) 20 
sint O<t<az " 
W(t) = , W2(t) = 0, f(x) = g(x) 20 
0 GE 
snf sian 
y(t) = 
0 tS a 
0 Garer 
p(t) 21—sint m <t<2r, f(x) 2 g(x) 20 
0 t 22 
sint O<t<z 
p(t) = W(t) = 0, 
0 I 


B16. 


B17. 


B18. 


B19. 


( 0 O<x <8 (x) =0 
X) = ; DUC 
f-lu&..güo-x) 8<x<10 * 
sint O<t<az 
pıt) = 0 "- » W(t) —0, 
P 0 O<x <8 
fe) = (x—8)10—x) 8<x<10 
0 O0<x <4 
g(ix)=4(x-ADX-6) 45x <6 
0 6<x <10 
W(t) = sint O<t<az 
> 0 t2mx 
0 O<t<z 
y(t) = {-—sint m<t<27 
0 t-2z 
f(x) 0 0<x<8 
x)= 
` (x—8)(10—x) 8<x<10 
0 0xx«4 
g(x)- (x—4)(x—6) 4<x <6 
0 6<x <10 


Add viscous damping to the model of the finite string so that the 
partial differential equation becomes u;, = c?u,, — buy. 
Reformulate the explicit finite-difference scheme to account for 
this additional term, and test the new algorithm on the BVP for 
which u(0, t) = u(1, t) = 0, u(x, 0) = f(x) = x(1 — x), 
5(x,0) = g(xy0,6mlb-2,L-.l. 
(a) Approximate u, with the O(h?) central-difference formula 
Ut (Xn, tn) = (Vnm41 — Unm—i)/2At. 


(b) Obtain, in place of (24.21), the equation v, m+1 = 
[A2 (v 1, + Un--1,m) + 2(1 m A? yos m — Un,m-1 T 


bAt 1 
2 Vnm-il irana: 


(c) Obtain, in place of (24.25), the equation 
vna = (1 22) fa + fata + faci) + gut 
(d) Obtain a plot of the solution surface. 


b(Aty? 
y 8n. 


(e) Animate the motion of the string, being sure to observe 
damping of the oscillations. 

Take the damping coefficient as b — 2 and numerically solve the 

damped wave equation for the system in Exercise B17. Obtain 

both a solution surface and an animation of the motion of the 

string. If damping isn't observed, adjust b until damping is visible. 


In Exercises B20—22, a time-dependent wave speed is given. For each: 


(a) Modify the explicit algorithm for the undamped wave 
equation to account for the variable wave speed. In particular, 
leto, 2:c(1,) and A; — 6, A. Apply the modified algorithm 
to the undamped wave equation on a string of length L — 10, 


24.6 Finite-Difference Solution of the One-Dimensional Wave Equation 


for which u(0, t) = u(10, t) = 0, u(x, 0) = 


EE 4x(1—x) O<x <1 T m c zs 
f= | 0 n Uu, (x, 0) = g(x) = 0. Obtain 
a plot of the solution surface, and animate the motion of the 


string. 
(b) Compare the solution in part (a) with the solution to the same 
problem for which the wave speed remains constant at c — 1. 


t ]1— st 
sin — B21. c(t) — EE 


B20. c(t) = 
x 10 2 


B22. c(t) — ; 


1-0 


In each of Exercises B23—25, a position-dependent wave speed is given. 
For each: 


(a) Modify the explicit algorithm for the undamped wave 
equation to account for the variable wave speed. In particular, 


let c, = c(x,) and Ay, = c, A, Apply the modified algorithm 


Chapter Review 


1. Formulate a boundary value problem whose solution describes the 
planar motion of a taut string of length L, stretched between two 
fixed endpoints, and whose initial shape and velocity are f (x) and 
g(x), respectively. 

2. In Question 1, let L = x, g(x) = 0, and f(x) = ixa — x). Show 
how to obtain the solution by the technique of separation of 
variables. Discuss the Sturm-Liouville eigenvalue problem that 
arises from the separation process, and show how the eigenvalues 
and eigenfunctions are obtained. Also, show how the coefficients in 
the infinite series solution are determined as coefficients of a 
Fourier sine series. 

3. In Question 1, let L = x, f (x) = 0, and g(x) = 1xGr — x). Show 
how to solve the resulting BVP by separation of variables. 

4. State D' Alembert’s solution to the wave equation. In the case 
g(x) = 0, use D'Alembert's formula to explain what happens to an 
initial disturbance. Explain how to use D' Alembert's formula for 
wave motion on a finite string given that g(x) = 0. 
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to the undamped wave equation on a string of length L — 2, 
for which u(0, t) = u(2, t) 20,u(x,0) = f(x) = x(2— x), 
u,(x, 0) = g(x) = 0. Obtain a plot of the solution surface, 
and animate the motion of the string. 
(b) Compare the solution in part (a) with the solution to the same 
problem for which the wave speed remains constant at c — 1. 
x(1—x) O<x<1 
0 l<ss9 
solve the wave equation with position-dependent wave speed, 
and graphically examine the behavior of the solution. 


1 
1+x? 


(c) In part (a), take f(x) = and L = 5; 


B23. c(x)=1 +x B24. c(x) = 


B25. c(x) = 1 + (x — 1? 


5. Summarize the derivation of the wave equation for the finite string. 


6. Formulate a boundary value problem for the longitudinal vibrations 
in a finite elastic rod whose ends are fixed and whose plane sections 
that start parallel remain parallel during the motion. 


7. Formulate a boundary value problem for the longitudinal vibrations 
in a finite elastic rod whose ends are free and whose plane sections 
that start parallel remain parallel during the motion. 


8. If u(x, t) represents the longitudinal displacements of plane 
sections in an elastic rod, explain why EAu, (a, t) should represent 
the elastic force on the face that was at x — a at equilibrium. 


9, Justify calling u, (x, t) the strain in the elastic rod. 


10. Demonstrate how to obtain a finite-difference solution to the wave 
equation on a finite string with fixed endpoints and with initial shape 
and velocity given by the functions f(x) and g(x), respectively. 
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Chapter 25 


Heat Equation 


INTRODUCTION Heat transfer along a finite rod whose curved surface is 
insulated is modeled by the one-dimensional heat equation u; = Ku xx. We obtain analytic 
solutions of three BVPs posed for this rod. First, we maintain the temperatures at each 
end at the same constant temperature, which we take to be zero. Then, we insulate each 
end so no heat can enter or leave the rod. Then, we consider the problem of time-varying 
temperatures at the endpoints. 

In the first case, that of zero endpoint temperatures, the steady-state solution for the rod 
is atemperature of zero throughout. In the second, the steady-state temperature is the average 
value of the initial temperature profile. In both cases, we use the technique of separation 
of variables, converting the PDE into two ODEs, one of which forms a Sturm-Liouville 
eigenvalue problem. The problem with fixed endpoint temperatures results in the same 
eigenfunctions and eigenvalues as we had for the plucked string. Thus, the eigenfunctions 
are sine functions. The problem with insulated ends has cosines for eigenfunctions, like the 
elastic rod with free ends. 

The analytic solution of the problem with time-varying endpoint conditions is signif- 
icantly more complex than either of the first two BVPs. The difficulties of this analytic 
approach are circumvented by a finite-difference numeric solution that easily implements 
a solution for the BVP with time-varying endpoint temperatures. An analytic solution is 
postponed for a later chapter. 


One-Dimensional Heat Diffusion 


Problem Statement 


If an insulated rod of length L has its end faces maintained at a temperature of 0°, then heat 
dispersion in the rod is governed by the boundary value problem in Table 25.1, where (1) is 
the heat equation that we will derive in Section 25.2, (2) and (3) are homogeneous Dirichlet 
boundary conditions, and (4) is an initial condition. The function u(x, t) gives, at time f, 
the temperature of the rod at location x (measured from the left end where x — 0). Heat can 
enter and leave the rod only through the ends, not through the round lateral surface. The 
constant « is called the thermal diffusivity, has units length. , and is large in metal, which is 
a good conductor of heat, but small in wool, which is a good insulator. Since the units of « 
are essentially =~, « can be interpreted as the amount of area to which heat can spread per 


e 
unit time. 


EXAMPLE 25.1 


0 
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Heat equation (1) u, = Kus, t>0 

Boundary condition (2) u(0,t) 20 Left end at 0° 

Boundary condition (3) u(L,t) =0 Right end at 0° 

Initial condition (4) u(x, 0) = f(x) Initial temperature profile 


TABLE 25.1 BVP for heat transfer in an insulated rod 


The function u(x,t) = e™ sin x is the solution of the heat equation in a rod of length z 
for which the initial temperature was u(x, 0) = sin x and for which the thermal diffusivity 
is x = 1. Direct substitution into the heat equation, the partial differential satisfied by 
many diffusion processes, of which heat transfer is one familiar example, gives the identity 
—e™ sinx = —e'sinx. 

Figure 25.1 is a plot of u(x, t) as a surface over the xt-plane. The plane section t = 0 
is the initial temperature profile, the graph of u(x, 0) = sinx, 0 < x < x. The edges of the 
solution surface corresponding to x = 0 and x = x remain at u = 0. The plane sections 
t = c for c > 0 show a decrease in temperature throughout the rod. This is because heat 
escapes through the ends, which are held at temperature u = 0. A collection of such plane 
sections are shown in Figure 25.2. 


25 
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t o 0 0 
FIGURE 25.1 Solution surface for Example 25.1 FIGURE 25.2 Example 25.1: Several 
temperature profiles for t — E, k= los 4. 


The dotted curve is u(x, 0) 


Figure 25.2 shows graphs of temperature profiles at various times £ > 0. Each plane 
section £ = f* is the plot of u(x, t*), the temperature profile in the rod at time ¢ = t*. 
The initial temperature profile is the dotted curve. The other curves, decreasing in height 
because the rod is cooling, correspond to profiles at increasing times. Were these profiles 
to be viewed in sequence, an animation of the temperature history in the rod would result. 
This more dynamic view would show the decrease in temperatures as a function of time and 
would illustrate how heat is extracted from the rod by the ice-bath at each end. The ultimate 
state of the rod, its steady state, is a uniform temperature of 0°. The accompanying Maple 
worksheet contains such an animation. $ 


Solution by Separation of Variables 


We next apply the technique of separation of variables to the BVP in Table 25.1, the problem 
of heat conduction in an insulated rod of length L. According to the separation assumption, 
setu(x, t) — X(x)T (t) and apply this separation assumption to the endpoint data, obtaining 
X(0)T(t) = 0 and X(L)T(t) = 0, from which we conclude, as in Section 24.1, that 
X(0) = X(L) = 0. 
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EXAMPLE 25.2 


0 1 2 3 


FIGURE 25.3 Initial termperature profile 
for Example 25.2 


Next, apply the separation assumption to the heat equation, which, after division by 
Ku(x, t) — kX(x)T (t), gives 


TO Xu 
KTO XW 
The variables are separated, and the two ordinary differential equations 


X"(x)—AX(x)=0 and T'(t)—ìkT(t)=0 (25.1) 


follow. The Sturm-Liouville eigenvalue problem that results is the same one we saw for the 
wave equation on the finite string. We know, therefore, that the solution to the BVP 


X'(x)—AX(x)20 X(0)=X(L)=0 


is X, = A, sin "75, A, = "5, E= E We can now solve the ODE 


22 
nm 


T2 T(t) 20 (25.2) 


T'(t) +« 


for TA) = Hat WE, 
Next, we form the general eigensolution 
zo BAS . 2:22 2 
Un(x,t) = X4Q)T,(t) = b, sin "E Kara tus 


A linear combination of all such eigensolutions, 


oo 
nux 2,2, T2 
R aep 
u(x,t) = 5. sin "E bci 
n-l 
is the most general solution possible for the original BVP. Application of the initial condi- 
tion u(x, 0) = f (x), the condition on the initial temperature profile in the rod, leads to the 
Fourier series. Because 


oo 
. nzx : 
u(x,0) = * d sin "t f(x) 
n-l 
means the coefficients b, in the series for u(x, t) must therefore be the Fourier sine series 
. : . y) s 
coefficients for representing f (x) on the interval [0, L], we have b, = 2 f(x) sin "dx. 


Let the thermal diffusivity be x = L, and let the rod have length z. If the initial temperature 
distribution u(x, 0) is given by 


0 O0xx«l1 
f@w)= 41 1xzxx2 


0 2 xm 


we may obtain the complete solution to the heat transfer BVP on this rod. Figure 25.3 shows 
the physically impossible discontinuities in f(x). This discontinuous temperature profile 
might be achieved by cutting the rod into three segments, cooling the outer two segments, 
and heating the center section. Then, at the instant the clock starts ticking, the three segments 
are slammed together with enough pressure that the thermal interfaces between the segments 
disappear. 

Applying ice cubes to the ends of a warm rod would generate the same discontinuities a: 
t = 0. The purpose of this example is to demonstrate that the heat equation instantly smooths 


n e" 9.0/2 e" 0-9/2 
1 0.951 0.607 

2 0.819 0.135 

3 0.638 0.0111 

4 0.449 0.335107° 
5 0.287 0.373107? 
6 0.165 0.152107? 
T 0.0863 0.22910- 9 
8 0.0408 0.12710? 

TABLE 25.2 Att = 0.1 and 1.0, the 


exponential factors for the first eight 
terms in the solution for Example 25.2 
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out these initial discontinuities because it embodies Newton's law of cooling whereby heat 
flows as soon as a temperature gradient is established. 
For the Fourier sine series for f (x), we compute the coefficients 


2 [* 2 

b, = — Í f(x)sinnx dx = — (cosn — cos2n) (25.3) 
T Jo nj 

Then the solution to the boundary value problem is the infinite series 

9 oo 


1 : —n*t/2 

u(x,t) = — 2, — (cosn — cos 2n) sin(nx )e = 

mi—n 
n= 


At t = 0 the series is the Fourier sine series for f(x), a series whose coefficients slowly 
decrease in magnitude since b, — O(1). However, for t > 0, the exponential term rapidly 
becomes small with increasing n. Hence, for t > 0 only a few terms of this series are needed 
for an accurate approximation, whereas for t = 0 a very large number of terms are needed 
to represent the discontinuity in f (x). Approximating the exact solution with the finite sum 


50 


1 2,/2 
uso(x, t) = = » z (cos n — cos 2n) sin(nx)e ™ '? (25.4) 


n=l 


we obtain Figure 25.4, a graph of the solution surface. First, note the difficulty the disconti- 
nuity in the initial temperature profile causes. The approximate solution does not represent 
the discontinuity very well and tends to show a smooth profile instead of a discontinuous 
one. Second, note that for t > 0, the discontinuity is indeed smoothed out since heat flows 
instantaneously and everywhere. 


FIGURE 25.4 Solution surface in Example 25.2 FIGURE 25.5 Example 25.2: Temperature 


profiles at t = 0.01, 0.1, and 1.0 


Figure 25.5 shows temperature profiles observed at times ¢ = 0.01, 0.1, and 1.0. 
Again, temperatures change everywhere instantaneously. Every portion of the cool seg- 
ments instantly experiences a rise in temperature, and every portion of the heated segment 
instantaneously experiences a drop in temperature. A complete animation of the cooling of 
this cooling process is found in the accompanying Maple worksheet. 

Table 25.2 lists values for the exponential factor e^"''/? for t = 0.1 and 1.0. For the 
larger value of t, the exponential decays more rapidly. Consequently, for t > 1, u(x, t) can 
be well approximated by a few terms of the series. However, as t gets smaller, it requires 
more and more terms of the series to approximate the solution accurately. The rapid decay 
of the exponential term e-*7/"' in the solution of the heat equation is responsible for 
the smoothing seen in solutions of this equation. This smoothing property is built into the 


equation, as the derivation in the Section 25.2 will show. z 
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EXERCISES 25.1-Part A 


A1. Verify the derivation of the equations in (25.1). 
A2. Obtain the solution of (25.2). 
A3. Verify the integration in (25.3). 


EXERCISES 25.1—Part B 


A4. Evaluate e-"^09)/2 forn = 5, 10, 20. 

AS. Show that the method of separation of variables fails for the BVP 
in Table 25.1 if the Dirichlet conditions at the endpoints are not 
homogeneous. 


B1. Use (25.4) to obtain a graph of u, (0, t), the heat flux at the left end 
of the rod in Example 25.2. Verify that this partial sum suffices by 
comparing this graph with the one generated by a partial sum of 
100 terms. Explain the physics this graph represents. 


B2. Repeat Exercise B1 at x = 1, the point where the initial 
temperature was discontinuous. 


In Exercises B3-7: 


(a) Formulate and solve u, = ku,,, u(0, f) = u(L,t) = 0, 
u(x,0) = f (x), the BVP for heat transfer in an insulated rod 
with its ends kept at a temperature of zero. 

(b) For the series found in part (a), let U(x, t) be a partial sum 
with enough terms so that U (x, 0) is a reasonable 
approximation to f (x). Plot U(x, t) as an approximation to 
the solution surface. 

(c) Animate U (x, t), or at least plot time-slices at a sequence of 
increasing times. 

(d) Plot U,(0, t) and U, (L, t). These are the temperature 
gradients at the end faces and are proportional to the heat 
flowing through the respective ends of the rod. Give a 
physical interpretation of the graphs. 


B3: Lar, k= F, f(x) =a — x) 


B4. L=7,k =}, 
0 Gers% 
3 
2x gr 2x 
f(x) = 5(x SE x) gd e 
2 
0 T9 arg a 
3 
0 O<x <2 
B5. L-4r-4fx—i15 22443 
0 3<x<4 
0 O<x <1 
ph=3c«=5, fo) = = 
BE g e F(x) (x—DG3-x) 1<x<3 
0 0<x<1l 
] lsx«3 
BAL-—Ss-i$fG-40 2<x<3 
1 Bex <4 
0 4<x<5 


B8. For 0 < « < 1, what is the maximum temperature at x = 2 in the 
rod of Exercise B7? Hint: Obtain an approximate solution U(x, t) 
in which « is a parameter, then examine graphs of U (2.5, t) for 
different values of x. An efficient way to do this is to animate on 
the parameter x. 

B9. The partial differential equation u; = ku, + hu, h > 0, models 
one-dimensional heat transfer in the presence of a source term. A 
finite rod made of heat-generating radioactive material might be 
so modeled. 


(a) Let L = x, and solve the BVP u, = uxx + hu, u(0, t) = 
u(z,t) = 0, u(x, 0) = x(a — x). Note that 7, (f) is a constant 
multiple of e ^ . so the solution will behave differently 
depending on the magnitude of h. 

(b) Let h = 1, and plot the resulting solution surface. Also, plot 
the rod’s temperature at a succession of several times. If 
possible, obtain an animation of the time-history of the 
temperatures in the rod. Plot u, (0, t), the temperature 
gradient at the left end of the rod. 


(c) Let h = 1 and repeat part (b). 
(d) Leth = 3 and repeat part (b). 
(e) In each case, explain the observed behavior of the solution. 


B10. In the belief that the term u, adds viscous resistance to the flow of 
heat in a rod of length L = x, the partial differential equation 
uU; = KUxx + 2au, is used to model heat flow in this rod whose 


ends are kept at a temperature of zero. 


(a) Show that the differential equation is separable, with 
eigenvalues 1, = —n^ — 5,n = 1,... and eigenfunctions 
X, (x) = b,e^**/* sinnx, where b, is a constant. 


(b) Show that 7; (f) is a constant multiple of e- ^ /«*«^, 


(c) Show that on the interval [0, x], the eigenfunctions X, (x) are 


orthogonal with respect to the weight function w(x) = e?**/*, 
oo 


(d) The solution of the BVP can be written as u(x, t) = b, 
b,e-**/* sin(nx)e- € / c. where b, = 2 ha f G)w(x) 
X, (x) dx. Obtain U(x, t), an approximating partial sum for 

the BVP with f(x) = x(x — x) anda = 1,k = i. 


(e) Animate U (x, t), or at least plot time-slices at a sequence of 
increasing times. Is the viscous damping independent of x? 


x 


FIGURE 25.6 
rod 


x+dx L 


Segment of an insulated 
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Derivation of the One-Dimensional Heat Equation 


Derivation of the Heat Equation 


Consider a rod of length L on an x-axis, the left end being at the origin. In this rod imagine 
R, a segment of length dx, lying between x and x + dx. (See Figure 25.6.) Let Q(t) be 
the total quantity of heat, measured in calories, contained in the region R; let u(x, t) be the 
temperature at location x at time f; and let M be a constant that converts temperatures (in 
degrees) to heat (in calories) via the integral 


x+dx 
on = f Mu(x,t) dx 


calories 


The constant M has units Saee arf This is not unreasonable, since specific heat is defined 
as el so M is a "linear" specific heat that gives the number of calories required to 
raise the temperature of a one-unit length of rod one degree. 

The rate of change of the amount of heat in the region R is then 

x+dx 
sc = Mu,(x,t)dx 
dt x 
For a small segment R (dx is small) we can argue heuristically that u;(x, t) is roughly 
constant over the interval [x, x + dx]. Hence, the integral is approximately 
d Q x+dx 
— = Mu, (x, Df dx = Mu,(x,t)dx 
dt - 

For there to be a change in heat content in R, heat must pass through one of the faces 
of R, faces located at x and x + dx. Now heat will flow across one of these faces if there 
is a difference of temperature on either side of such a face. A spatial region in which there 
is a difference in temperature is said to have a temperature gradient, much like land has 
a gradient wherever it has a difference in height. Let u, (x, t) be the temperature gradient 
across the face at location x, and let u,(x + dx, t) be the temperature gradient across the 
face at location x + dx. Newton’s law of cooling (from Section 2.4) says that the flow of 
heat is proportional to the difference in temperature. Make that same assumption here. It 
amounts to the claim that heat has no inertia. Hence, there is instantaneous heat flow the 
instant a temperature gradient exists. (This assumption is responsible for the smoothing 
property of the heat equation.) 

Let N be a constant of proportionality between the temperature gradient, which itself 
has units —. and the resulting amount of heat that flows, which therefore has units EN 
The constant N will consequently have the units mar so that Nu, (x, t) is the amount 
of heat flowing per second across the face at x and Nu, (x + dx, t) is the amount of heat 
flowing per second across the face at x "n The net heat flowing in/out of R, per second, 

! 


which is actually the same quantity as 7*, is therefore N [uy (x + dx, t) — ux (x, t)]. 


Thus, the equation for monitoring heat flow into and out of R is 
Mu;(x,t)dx = N[u,(x + dx, t) — u;(x, t)] 
Dividing by both dx and M we have 
N | u,(«+dx,t) —u,(x, t) 
M | dx | 
In the limit as dx — 0, the difference quotient on the right becomes u xx(x, t). The constant 


u;(x, t) = 
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FIGURE 25.7 Uniform slab supporting 
one-dimensional heat flow in Example 25.3 


EXAMPLE 25.3 


0 1 2 3 4 


FIGURE 25.8 Example 25.3: 
u(x, 0) — f (x), the initial temperature 
distribution 


Heat Equation 


E is the thermal diffusivity x with units 


calories length 
time degrees 


length? 
calories = 

degrees length 

The reader is cautioned that there is another, similar constant used in heat transfer. The 
thermal conductivity K has units at and is related to the thermal diffusivity 
by x = E, where p is the density, with units -555-, and c, the specific heat with units 
n is the amount of heat required to raise the temperature of a unit mass by one 
degree. A moment’s notice suggests that both x and K will be “big” in metals and “small” 


in insulators. 


time 


The rectangular slab in Figure 25.7 has width 4, and, except for its left and right faces (which 
are kept at a temperature of zero degrees), is coated with insulation. Assuming x = i and 
that heat flow is one-dimensional (strictly horizontal, as suggested by arrows A and B in 
Figure 25.7), solve for the temperatures in the slab if the initial temperature distribution 
along any horizontal line is given by the function f (x) on the right in (25.5). Figure 25.8 
contains a graph of f (x), and x — 0 corresponds to the left edge of the slab. The boundary 
value problem to be solved is on the left in 


u(x, t) = dussQr t) t -0 u0,t)=0 . 0 Usa 
z with f(x) = 4(1—53)x 3) 1zxx3 
u(x, 0) = f(x) u(4, t) 20 0 3<x<4 
(25.5) 
From our work in Section 25.1, the solution of (25.5) is 
co 
n : nx —n?z?t/48 
u(x,t)= De sin ( 4 ) e (25.6a) 
i f* . nx 
by == | f(x)sin—— dx (25.6b) 
2 Jo 4 


16 nim AT 3nz 
= (4 cos 1 nz sin 4 cos 


ne 


— nz sin =z) (25.6c) 


Table 25.3 lists the first 16 coefficients, giving some sense of how fast these coefficients 


n bn 
j ag en 
a zm 

2 0 

3 16 /2(4 + 3x) 
27 m? 

4 0 

" 16 42(—4 +57) 
125 m? 

6 0 

" 16 J2(4 72) 
343 m? 

8 0 


n bn 
1 —4 
0.626 9 6 V2(—4 + 9m) —0.0243 
729 m 
—0.194 x 107? 10 0 —0.155 x 10-19 
6 24411 
—0.363 11 16 V2(4 +117) 0.0211 
1331 m? 
0.165 x 10-9 12 0 0.100 x 10-9 
16 J2(-4 4-13 
0.0684 13 v2(—4 + 137) 0.0122 
2197 m? 
0 14 0 0.752 x 10-!! 
16 /2(4+15 
0.0553 15 -16 24+ 15) 0.0111 
3375 m 
0.178 x 10779 16 0 —0.796 x 10-19 


TABLE 25.3 Example 25.3: Coefficients b, in exact and floating-point form 


FIGURE 25.10 Example 25.3: 
Temperature profiles at times t — 0.01, 
0.5, and 1.5 
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get small. The even-indexed coefficients are zero, and the odd-indexed coefficients slowly 
decay. Hence, it will take a partial sum with more than just a few terms to approximate the 
solution well in any region which includes the x-axis. 

The 50-term approximation uso(x, f) = Y jb, sin(222 je" ™ th 48 is graphed in Fig- 
ure 25.9. Fort > 0, the temperatures change everywhere and instantaneously. Where u = 0 
initially, the temperature instantly rises. Where the temperatures were positive initially, they 


decrease instantly. 


ZL 
A A 
LLALL] 


FIGURE 25.9 Solution surface for Example 25.3 


The dynamic behavior of the temperature profiles is better seen by examining the plane 
sections t = c representing instantaneous temperature profiles. Temperatures in the intervals 
[0, 1] and [3, 4] instantly rise from zero to some positive temperature, then later decrease 
back to zero. This happens because of the assumption that heat flows the instant there is 
a temperature gradient (Newton’s law of cooling). Instantly, the temperatures in those two 


A segments rise. Heat flow is everywhere, instantaneous, and has no inertia. The three plane 
0.15 T sections t = 0.01, 0.5, and 1.5 are shown in Figure 25.10, and an animation of the cooling 
process is found in the accompanying Maple worksheet. 
0.14- In fact, if the temperatures at x — i are plotted as a function of time, Figure 25.11 
results, showing that for at least one point outside the initially heated region, the temperature 
0.05 L does immediately increase. $ 
t t t t x1 
0 2 4 6 8 10 
FIGURE 25.14 A graph of u(5, t) in 
Example 25.3 
EXERCISES 25.2 
1. Verify that (25.6c) gives the correct evaluation of (25.6b). (b) For the series found in part (a), let U (x, t) be a partial sum with 


In each of Exercises 2—6, a rectangular slab of width L has its front and 
back faces, as well as its top and bottom edges, insulated. The left and 


enough terms so that U (x, 0) is a reasonable approximation to 
f (x). Plot U(x, t) as an approximation to the solution surface. 


right edges are kept at a temperature of zero degrees, the flow of heat (c) Animate U (x, t), or at least plot time-slices at a sequence of 
is one-dimensional, and the initial temperature distribution along any Increasing times. 


horizontal line is given by u(x, 0) — f(x). 


(a) Formulate and solve a relevant BVP for the temperatures in the 


slab. 


(d) On the same set of axes, plot U, (0, t) and U,(L, t). These are 
the temperature gradients at the end faces and are proportional 
to the heat flowing through the respective ends of the rod. 
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For each of the indicated heat-flow problems in Exercises 7-11: 


(a) Calculate Op = M E f (x) dx, the initial heat content, where 
M, constant, is unknown. 

(b) Calculate F5 = NU,(0, t) and F; = NU,(L, t), the heat flux 
at the left and right faces, respectively. The constant N = «kM 
is unknown. Having used U (x, t) instead of u(x, t), these 
time-dependent fluxes are approximate, not exact. 

(c) Calculate A Qiu = fo (Fo — F,,) dt, an approximation to the 
total heat that has flowed from the slab. 


(d) Using N = kM, show that Qo = A Qi, thus showing that the 


total initial heat content has dissipated through the two ends. 


(e) Calculate Q(t) = M h U (x, t) dx, the time-dependent heat 
content in the slab. 


(f) Plot E and go = E U, (x, t) dx, where the latter is 


proportional to the change in heat content in the slab. 


(g) Show that Q'(r) = F; — Fo by showing 
[U.(L, t) — U.(0, 1)]/ fy U (x, t) dx = 1. 


7. Exercise 2. 8. Exercise3 9. Exercise 4 
10. Exercise 5 11. Exercise 6 
When computing the Fourier sine series for f(x) = cos3x, 0 < x < 7, 
the coefficients are given by 
n 2n(1 + (-1)") 
b, = — f cos 3x sin nx dx = mn? — 9) 
= g0 0 n=3 
The integral formula that yields 2n(1 + (—1)")/zr (n? — 9) is not valid 
when n = 3. A different integration formula must be used to compute b3. 
When instructing a computer program to construct a partial sum of this 
Fourier series, it is best to obtain bj = 0 and b; = -£ first. Then, the 


partial sum -i + Ru b, sin nx can be written. In Exercises 12-14: 
(a) Solve the BVP u; = ku,,,u(0, t) = u(x, t) = 0, 
u(x,0) = f (x). 
(b) For the series found in part (a), let U (x, t) be a partial sum with 


enough terms so that U (x, 0) is a reasonable approximation to 
f (x). Plot U(x, t) as an approximation to the solution surface. 


(c) Animate U(x, t), or at least plot time-slices at a sequence of 
increasing times. 


12. x — 2, f(x) = 3cos2x 13. « = 
14. k = V2, f (x) = x cos 5x 


, f(x) = 5cos4x 


Nin 


Heat Flow in a Rod with Insulated Ends 


General Solution 


Consider the heat equation in a rod whose length is L and whose ends are insulated. The 
associated boundary value problem consists of the heat equation u; (x, t) = Ku, x, an initial 
temperature distribution u(x, 0) = f(x), and homogeneous Neumann boundary conditions 
ux (0, t) = 0 and u,(L, t) = 0 at the ends of the rod. Requiring the temperature gradient at 
the ends of the rod to vanish means there is no temperature gradient at those faces. Hence, 
there can be no heat flow across the ends of the rod, so “insulation” has been achieved. 
Where there is no temperature gradient, there can be no heat flow. 

To solve this problem by the technique of separation of variables, assume a solution of 
the form u(x, t) = X (x)T (t), a product of one function just containing x and one function 
just containing t. Then, apply the separation assumption to the initial data, obtaining 


us (0, f) =0 > X'(0)T(t) =0 > X'(0) =0 


ux(L,t) 20-2 X(L)T() =0 => X'(L) = 0 


EXAMPLE 25.4 


0 1 2 3 


FIGURE 25.12 Example 25.4: 
u(x,0) = f(x), the initial temperature 
distribution 
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The consequences of the separation assumption and a division by ku(x, t) = KX (x)T (t) 
are the separated form 


T) XG) E 
KT) X(x) 


and the two ODEs 
X'"(x) C AX(xX) 20 and T'(t)— AkT(t) =0 
These ODEs are not solved in isolation. There is data belonging to each equation. Hence, 
in (25.7) we have two problems to solve, namely, 
X"(x) — AX (x) 20 
X'(0) = X'(L) 20 
a Sturm-Liouville eigenvalue problem on the left and an ODE on the right. 

As seen in Section 16.1, the solution of this Sturm-Liouville eigenvalue problem is 
not sin(^7-). For this problem, A = 0 is an eigenvalue, with corresponding eigenfunction 
Xo(x) = constant. In addition, the other eigenvalues are A = — (*-) ,n = 1,2,..., with 
corresponding eigenfunctions X,(x) = c, cos(“*). The functions T, (t) now satisfy 


L 
2 


T/(t) +K (=) no =0 


and T'(f) - AKT (t) =0 (25.7) 


so To(t) = constant and T, (t) = d,e * "7/7", The general eigensolution is then 
nux i . 
Un (x,t) = Xn (x)Tn (t) = an cos (F) g "On/D*t 


The complete solution of the partial differential equation will be a linear combination 
of all such eigensolutions. Hence, we take the most general possible linear combination 
of all the eigensolutions. Since there are an infinite number of eigensolutions, our linear 
combination is the infinite sum 


oo 
nzx 2 
u(x,t) = S 4 Xa, cos (F) e TES (25.8) 


n=1 


The final condition to be applied is the initial shape requirement, u(x, 0) = f(x), giving 


nx ae f( Ü 
É -—JAX 


u(x,0) = T -— > dis cos 


n=1 


Ag. S E . SÉ r L 
The coefficients must be the Fourier cosine series coefficients a, = ; Jn f(x) cos(**) dx, 
A= 10,1, 2i00%5 for the function f(x). 


Let a rod with insulated ends have length zr, thermal diffusivity « = L, and initial temper- 
ature distribution 


- 

0 0<x<— 

3 

. 4 27 T a 22 

f(x) = (5 x) x 3 3 $*5 3 
2c 

0 — «xm 
3 


graphed in Figure 25.12. This puts heat in the center of the rod, heat that cannot escape 
out the insulated ends. Hence, the long-term outcome will be to even out the temperature 
throughout the rod. 
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u 


ol 1 2 3 
(c) 
FIGURE 25.14 Example 25.4: 


Temperature profiles at times t = 0.2, 2.0, 
and 20 
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The coefficients for the Fourier cosine series of f(x) are 


2 H. 
ao = Ji f(x)dx = $m? (25.9a) 
7T Jo 
2 X 
ds c g f(x) cosnx dx (25.9b) 
T Jo 
8 2 2 . nT 
= AH (nx cos ia 6sin dd + NIT COS = + 6sin =| (25.9c) 


These coefficients are O(n~*), so they decrease at a satisfactory rate. Figure 25.13 contains 
a graph of the solution surface as approximated by 


50 
Uso (x,t) = S + N as cos(nx)e™™"/4 
n=1 

the 50-term partial sum. Again, there is instantaneous heat flow everywhere. In the portions 
of the rod where u = 0 initially, there is an immediate rise in temperature for t > 0 and 
an immediate reduction in temperature where initially the temperature was positive. In 
addition, along the insulated edges x = 0 and x = z, the temperature rises since heat can 
no longer escape from the ends of the rod. In fact, the temperature of the rod approaches 
a constant value for sufficiently large f. It's as if the heat content were water enclosed in a 
vessel, and the water flowed out to a uniform level. 


FIGURE 25.13 Solution surface in Example 25.4 


Some of this time-dependent behavior can be seen in Figure 25.14, which contains 
the plane sections t = 0.2, 2.0, and 20. The steady-state solution is not u(x,t) = 0, but 
rather, some nonzero constant. The total initial caloric content of the rod becomes evened 
out, much like water seeking its own level. The uniform level representing the steady-state 
temperature in the rod can be guessed from €? = 0.2436939359. In fact, ift — oo in (25.8), 
it’s clear that the only term surviving at steady state is the constant term outside the sum, 
the only term not multiplied by an exponential function. That surviving constant is 2. 

Evolution to steady state can be seen in an animation available with the accompanying 
software. E 
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EXERCISES 25,5 
1. Verify the integration in (25.92) and verify that (25.9c) gives the 8.L-—m,k-3,f(x) =sin’x 
correct evaluation of the integral in (25.9b). 0 0<x<1 
In Exercises 2-16: | 14x<2 
. o. 9, £=3,0=2,fO= 10 2x3 
(a) Formulate and solve the BVP governing heat transfer in the 1 tee wd 
indicated rod whose ends are insulated and whose initial 0 4 is ~ »» 
temperature profile is given by the function f (x). yd eis 
= - NEN D 3 
(b) For the series found in part (a), let U (x, t) be a partial sum with 10. L = 3,« = V3, f(x) 2 3i? - x 
enough terms so that U(x, 0) is a reasonable approximation to 0 O0€x«1 
f (x). Plot U(x, t) as an approximation to the solution surface. Ll di£zx«2 
(c) Animate U (x, t), or at least plot time-slices at a sequence of 11.L5L25,« 22, f(x) 240 2<x% <3 
increasing times. 3 3<x<4 
(d) Obtain the steady-state temperature of the rod. 0 4<x5 
(e) Since u, (x, t) is proportional to the heat flow at x, obtain and 0 0sx«l 
plot Ur (j, t), j = 1, 2,3. x-l izxx«2 
1 12, DL —5,.«—2,f(x)— 1 2<x <3 
à 2 3«-x-«5 
Ly 2 AS X = 
, Osa<1 0 O0<x<l 
3 4(x — 1)(2 — x) l<x <2 i . 1 1zx«2 
2«x«3 13. L- 4,k = 3, f(x) = 4 jegas 
V2, f (x) = 5sin3 3 3<x<4 
14. DL -—1.-— Ll f(x) =x 
3 3 
2 I LbhkeeRfG)er 
X O<x <1 
4 033 GL=44=1f@M=4 9 1lzx«3 
i Ixxz3 4-x 32x64 


| Finite-Difference Solution of the One-Dimensional 
Heat Equation 


Problem Statement 


As in Section 24.6 we seek a numeric solution by the finite-difference technique for the 
boundary value problem consisting of the one-dimensional heat equation u; = ku, ina 
rod of length L, the boundary conditions u(0, t) = W(t), u(L, t) = vo(t), and the initial 
condition u(x, 0) = f(x). Notice that the boundary conditions are not homogeneous, 
so an exact solution of this problem must be postponed until Section 27.2. Of course, if 
w(t) = y(t) = 0, the problem reduces to one for which we can compute an exact solution 
with the tools presently at hand. 


An Explicit Scheme 


First, a grid is defined on the rectangle 0 € x < L,0 < t < T, in the xt-plane, with T 
being the length of time for which the solution is to be computed. Let the x-interval [0, L] 
be divided into N equal subintervals of length Ax — E by the N + 1 points x, = xo +n Ax, 
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EXAMPLE 25.5 


FIGURE 25.15 Computational molecule 
for the explicit finite-difference scheme for 
the heat equation 


nn- 1.3.2 N. Similarly, discretize the t-axis with the partition £,, = tọ + mAt, m = 
0. d. cus M, where At < (xy For the explicit method being described, this is a very real 
restriction on the size of the time-step permitted and is derived. 

Let u(x,, tm) be the exact value of the solution at the point (Xn, tm). Let Vn,m be the 


numeric approximation to that exact value, where v, ,, is computed from 


Un mti = AUg-1,m t (l— 2À)Un, m + AUn4Am (25.10) 


with A = at < a (Both (25.10) and the restriction on A are derived here.) Then, except 


for round-off error, the difference u(x,, tm) — Un.m goes to zero as Ax and Af themselves 
go to zero. 


Let L = 1; and define W(t) = sint, W(t) = cost. Take k = i and pick Ax — 1 corres- 
ponding to the choice N = 5. Let At = 0.03 < ux = 0.04, and take f(x) = x as the 
initial temperature in the rod. Define the nodes (xn, tm) = 2. qm). Then, with A = 3, 
define o = 1—2A = L, There are N — 1 = 4 interior points at which new values v, m+1 


are computed from old values by the equation 


Vn,m+1 = ÀUn—1,m s O Vn,m T ÀUn+1,m (25.11) 


as per the computational molecule (schematic) in Figure 25.15. The solid dots represent 
known values that are used to compute the unknown v, ,,.,; represented by the open dot in 
the schematic. 

From three contiguous values at time tm, one new value of v, ,,4; can be computed at 
time £,,,.,. The “vertical riser” connecting (xn, tm) with (xn, fn41) moves from left to right 
between x, and xy_1, so the values of vo,m+1 and Vy,m41 are computed from the endpoint 
data, not from (25.11). 

For the first “row,” the values of v, o are obtained from the initial function, f (x). Hence, 
to begin the calculation, the initialization step defines values for v,.9, n = 0,..., N. Then, 
each new “row” can be computed from the previous “row” provided (25.11) is used for the 
N — | interior points, and the endpoints are computed from the boundary functions. 

The solution surface in Figure 25.16 and the three temperature profiles in Figure 25.17 
are obtained by graphing the results of these calculations. $ 


FIGURE 25.16 Solution surface for Example 25.5 


-1+ 


(a) 


(b) 


FIGURE 25.17 Example 25.5: 
Temperature profiles at times t = =, 


and 22 
and ; 


9 18 
s 
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Derivation of the Explicit Method 


The explicit method (25.10) is obtained by making the O(A?) central-difference replacement 


Uxy (Xp, t ) = Un—1,m—2Vn,m+Vn+1,m 
xx NV^ns m asd 
(Ax)? 
and the O(h) forward-difference replacement 
Un m-4-1 — Un,m 
Ut (Xp, tn) = emn 
At 
in the heat equation, defining 4 = TU , and solving 
Un,m+1 — Un,m Un—l,m — nm oP Un--1,m 
=K : (25.12) 
At (Ax)* 


for v, 4,44. (See Exercise 1.) 


DERIVATION OF THE RESTRICTION 0 < A < i The following technique for determining 
the stability of a finite-difference scheme is due to John von Neumann. At time tm = to + 
m At, assume v, can be expanded in Fourier series, the terms of which are of the form 


(tm) cos(ox,). Equation (25.10) is then transformed by 
1. using dx and dt in place of Ax and At, respectively when defining À. 
2. writing $ (fy) = $i. 


3. noting that cos(ox,41) = cos(o(x, + dx)) = cos(ox,) cos(o dx) F sin(cx,) 
sin(c dx). 


4. dividing through by Øm cos(ox, ). 


5. defining R = m+1/m and noting it is the amplification factor by which a given 
component in the numeric solution grows in time. 


These steps result in R = 2A(cos(o dx) — 1) + 1, which must satisfy |R] < 1 if the 
scheme is to be stable. Hence, we are interested in the values of A for which the nonlinear 
inequality 


|2A(cos(wdx) — 1) -- 1| € 1 (25.13) 
holds for all values of cos(c dx) in [—1, 1]. Under the substitution A = cos(w dx) we have 
R= R(A,A) =2A(A—-1)4+1 


Figure 25.18 contains a graph of the surface |R(A, A)| plotted over the à A-plane. It shows 
a surface lying between R = 0 and R = 1 for only a portion of the rectangular domain. 
Rotating Figure 25.18 so that it appears viewed from directly above yields Figure 25.19, 
in which the shaded region represents points (A, A) satisfying |R(A, A)| < 1. For this 
inequality to hold for —1 < A < 1, we can see from Figure 25.19 that 0 < À < L. 
Alternatively, solve R = 2A (A — 1) + 1 for A = PHR, and plot A (À) for several 
values of R in [—1, 1]. Figure 25.20 shows these level curves, along with cross-hatching 
where the inequality is satisfied for all A in [—1, 1]. The inequality |R| < 1 is valid at the 


solid dot but not for all A in [— 1, 1]. 
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FIGURE 25.19 Region in AA-plane 
determined by |R(A, A)| € 1 


-1# 


FIGURE 25.20 Region in AA-plane 
where |R(A, A)| < 1 holds for all A in 
[-1, 1] 


— —— 


) 
n,m+1 Un, m+2 


L 


nel Xn-1 Xn Xp] 


FIGURE 25.21 Computational molecule 
for Saul yev's alternating direction scheme 


FIGURE 25.18 Graph of |R(A, A)| 


Proceeding analytically, we note the inequality |2A(A — 1) + 1| < 1 is really the two 
inequalities 


—1 < 1+2A(A-—1)<1 
Subtracting 1 from each side of each of the two inequalities, we get 
—2 < 2A(A—-1)<0 
Dividing by 2 gives 
—] xA(A—1)x0 


Since both inequalities must hold for all A in [—1, 1], in particular when A = —1, we 
have —1 < —24, from which follows the restriction A < i No matter how this inequality 
is obtained, it implies (25.10) is only conditionally stable, that is, it is stable only if A is 


suitably restricted. 


An Explicit Unconditionally Stable Method 


The method expressed by (25.10) has the advantage of being explicit, that is, (25.10) di- 
rectly and explicitly gives the new function value v, ,,,.;. Unfortunately, (25.10) is only 
conditionally stable, as we have just seen. There are several explicit unconditionally stable 
finite-difference schemes for solving the one-dimensional heat equation. These methods 
remove the restriction on step-size but remain explicit. There is some additional compu- 
tational complexity, however, but that is a small price to pay for being able to take larger 
steps in time. We will consider the method of Saul’yev and only mention the names Larkin, 
Barakat and Clark, and DuFort—Frankel. Texts such as [90] and [18] give the details of these 
other methods. 

The method of Saul’ yev is an example of an alternating direction schemewherein the 
computation proceeds from left to right and from right to left in alternating "rows." The 


values vy, 4441, n =1,..., N — 1, are computed from left to right by the formula 
1 
Un,m+1 = Tra” T A (Un—1,m41 — Un,m T Un+tm)] (25.14) 
whereas the values v, 42,0 = 1,..., N — 1, are computed from right to left by the formula 
1 
Un.m--2 = — — [Bema t A (Un 1,m4-1 — Un,m44 F Vn4 1m42)] (25.15) 
14A 


The schematic in Figure 25.21 highlights how these alternating formulas are related to 
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the alternating directions. The solid dots represent known values, whereas the open dots 
represent the unknown values. In each case, the dots correspond to the terms appearing in 


(25.14) and (25.15). 


EXERCISES 25.4 


1. Solve (25.12) for n, ,m+1, thereby obtaining (25.10). 

2. Verify that (25.13) is obtained via the five steps given in the text. 
In Exercises 3-8, the given data specified a BVP of the form u, = Kus, 
u(0, t) = y(t), u(L, t) = y(t), u(x, 0) = f(x). For each: 

(a) Use the explicit finite-difference scheme to obtain a plot of the 
solution surface. 
(b) Animate the temperature profiles as they vary in time. 

3. L — z,k = 4, Wilt) = sint, yo (t) = sin2t, f(x) = xGr — x) 

4. L -3,k =2, Vi (t) 2 4(0 — e), yo (t) 20, f(x) 20 

5. L = n,k = 42, y (t) = sint, ya(r) = 0, f(x) = x? (m — x) 

6. L =x, k = 3, y(t) = | sint], W(t) = 0, f(x) = sinx 

T. L =5,K = $, y(t) = sin 2t, 


vo | 0 0<t<1 


f(x) = sin? Z 
cos —ij Ter 4/79» 


P 


8. L =4, K = i, y(t) = sin? t, WO) = 
0<x<l 
1<x<2 
22% 23 
0 3<x<4 
. Modify the explicit finite-difference scheme so that it applies to the 
heat equation with insulated ends. 


t 
1402’ 


NUO 


fœ) = 


© 


(a) Discretize u, (0, tn) = 0 with the O(h?) approximation 
(Vi,m = V_-1,m)/2Ax = 0 so that U-1,m = Utm- 
(b) Apply (25.10) at xo = 0, replacing v. ;,,, with v; m, obtaining 
VO,m+1 = (1 = 2A) Vo, +F 2ÀV1,m- 
(c) Apply (25.10) at xy = L, making the appropriate replacements, 
and obtaining vy 444 = (1 — 2À)UN,m + 2ÀVyN-1,m- 
(d) Apply (25.10) to the N — 1 interior nodes to obtain v; m41, 
B= lues -—l. 
In Exercises 10—15, the given data specifies a BVP of the formu, = Kyy, 
(0,1) = u;(L,t) = 0,u(x,0) = f(x). For each, test the algorithm 
developed in Exercise 9. In particular: 
(a) Obtain the exact solution using the techniques of Section 25.3. 
(b) Obtain a numeric solution with à = ae = v plotting the 
solution surface and animating the temperature profiles. 


(c) Compare the exact and numeric solutions at the point 
(x,t) = (5,15). 
10.L=1,«=2,f(w=e 
11. L =3, K = V2, f(x) 2 5x(8 — x) 


13. L= mk =3, f(x) = sin? x 


12. L = 5,k = 2, f(x) = x? 


14. L =4,K = 2, f(x) = sin? =x 15. L22,k = $, f(x) =x? 


16. Modify the explicit finite-difference algorithm to solve the BVP 
Uy = KUyy + uy, u(0, t) = W(t), u(L, t) = y(t), u(x, 0) = 
f (x). Hint: Discretize ux (x,, tm) with the O(h?) approximation 
(Un+1.m — Un—1,m)/2Ax, obtaining, in place of (25.10), the equation 
Un,m+1 = Ahim F (d ai 2A) Unm T AU cm ERE (Us tim d Un im): 


In Exercises 17—21, apply the algorithm developed in Exercise 16. Plot 
the solution surface and animate the temperature profiles. 


17.L-3,k = 1, a = 1, yi (t) = sint, W(t) = 1— e^, 
f(x) 2 x*8 — x) 


I8. L Bmv23Bm 1, W(t) = cost, vo (t) = 1, f(x) = cos? x 
19. L-2,k = 3,0 =2, W(t) = 1, W(t) = 2e™, f(x) 319 
19. Dig? 


20. L = 4,k 22,0 = 3, Y(t) = —2, y(t) = 3 + cost, 
JE -8x + ay —2 

Eo heute Late T an 
zs T 

f(x) ipi 9x) 


22. In the programming language of your choice, implement the 
method of Saul yev. 


In Exercises 23 28, apply the algorithm developed in Exercise 22 to each 
of the following BVPs. Plot the solution surface and animate the tempera- 
ture profiles. Caution: Even though Saul’ yev’s method is unconditionally 
stable, its time-step is still restricted by 0 < A < "n although only for ac- 
curacy. See [42] for a similar outcome with the DuFort—Frankel method, 


another unconditionally stable explicit method. 
23. the BVP determined by Exercise 3 
24. the BVP determined by Exercise 4 
25. the BVP determined by Exercise 5 
26. the BVP determined by Exercise 6 
27. the BVP determined by Exercise 7 
28. the BVP determined by Exercise 8 


29. Modify the explicit finite difference method to provide a solution to 
the BVP u, = ku, u(0, t) = 0,u,(L, t) = 0, u(x, 0) = f(x). 
Thus, the left end of a rod of length L is kept at a temperature of 
zero, whereas the right end is insulated. See Exercise 9 where an 
explicit finite-difference scheme was developed for a finite rod with 
both ends insulated. 
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In Exercises 30-32, apply the algorithm of Exercise 29 to the given BVP, 
graphing the solution surface and animating the temperature profiles. 


30. L = m,k 22, f(x) = om — x) 

32,235, = 1, fomes 

33. Modify the explicit finite-difference method to provide a solution to 
the BVP u, = ku,4, u(0,t) = W (t), u(L, t) = 0, 
u(x,0) = f(x). Thus, the left end of a rod of length L is 
maintained at the varying temperature y(t). Clearly, a solution to 
this exercise provides a solution to Exercise 29. 


31. Lex» fü) rx 


In Exercises 34 —36, apply the algorithm of Exercise 33 to the given BVP, 
graphing the solution surface and animating the temperature profiles. 


Chapter Review 


1. Formulate a boundary value problem describing one-dimensional 
heat flow in a homogeneous solid of length L that is kept at a 
temperature of zero at each end and has an initial temperature 
profile of f (x). 


2. Describe the separation of variables process by which a series 
solution to the BVP in Question 1 can be obtained. Include a 
discussion of the Sturm-Liouville eigenvalue problem that arises 
from separating variables, especially its solution for eigenvalues 
and eigenfunctions. Also, describe how the coefficients of the 
series solution are found to be the Fourier sine coefficients of the 
initial temperature distribution function. 


3. Formulate a boundary value problem describing one-dimensional 
heat flow in a homogeneous solid of length L that has its ends 
insulated and an initial temperature profile of f (x). 


4. Describe the separation of variables process by which a series 
solution of the BVP in Question 3 can be obtained. Include a 
discussion of the Sturm-Liouville eigenvalue problem that arises 


34. L = z,k =2, (t) = sint, f(x) = x? (m — x) 
35. 5 —9,K — i w(t) = cos t, f(x) 20 
36. L 25,k =3, W(t) 220 — e), f(x) = (a 


5 
37. Using separation of variables, obtain a series solution of the BVP 


given in Exercise 29. 


In Exercises 38—40, use the results of Exercise 37 to obtain an analytic 
solution. Compare to the numeric solution. 


38. the BVP of Exercise 30 39. the BVP of Exercise 31 
40. the BVP of Exercise 32 


from separating variables, especially its solution for eigenvalues 
and eigenfunctions. Also, describe how the coefficients of the 
series solution are found to be the Fourier cosine coefficients of the 
initial temperature distribution function. 


5. Using the solution detailed in Question 4, determine the 
steady-state temperature for the solid in Question 3. Explain why 
this result is intuitive and perfectly reasonable. 

6. Using separation of variables, solve the BVP consisting of the 
one-dimensional heat equation for a finite rod of length L if the left 
end is insulated, the right end is kept at a temperature of zero, and 
the initial temperature distribution is u(x, 0) = f (x). 

7. Solve the BVP in Question 6 if L = x, x = 1, and 
f(x) = x(t = x). 

8. Sketch a derivation of the one-dimensional heat equation. 

9. Sketch a finite-difference solution for the BVP in Question 1. 


10. Sketch a finite-difference solution for the BVP in Question 3. 


Chapter 26 


Laplace's Equation in a Rectangle 


INTRODUCTION Laplace’s equation on a region R can be solved if the 
values of the dependent variable or its normal derivative are prescribed on the boundary of 
the region. If the values of the dependent variable are prescribed, the conditions are called 
Dirichlet conditions and the BVP is called the Dirichlet problem for the region R. 

The normal derivative along the boundary is the directional derivative in the direction 
of the normal on the boundary. If this derivative is prescribed, the condition is called a 
Neumann condition. If only Neumann conditions are prescribed for Laplace's equation on 
the region R, then the resulting BVP is called the Neumann problem for R. 

The simplest region on which to solve either the Dirichlet or Neumann problems is 
the rectangle. Working in Cartesian coordinates, we use separation of variables to reduce 
Laplace's PDE to two ODEs, one of which forms a Sturm—Liouville eigenvalue problem. If 
homogeneous Dirichlet conditions have been prescribed, then the eigenfunctions are sines; 
if Neumann conditions, then cosines. In either event, the solution is an infinite series of 
eigensolutions. 

The Dirichlet problem for the rectangle models the electric potential or the steady-state 
temperatures in a rectangular plate. For the potential problem, the edges are grounded, that 
is, maintained at a zero potential. For the thermal problem, the edges are maintained at 
a temperature of zero. The level curves of the solution are equipotentials in the potential 
problem or isotherms in the thermal problem. In either case, the gradient vectors are or- 
thogonal to the level curves, so the flow lines that have these gradients as tangents are also 
orthogonal to the level curves. In the potential problem, the negative of the gradient vector 
is the electric field vector and the flow lines are the field lines or lines of force. In the thermal 
problem, the flow lines indicate the path of the heat energy flowing through the plate. 

The Neumann problem models the rectangular plate with insulated edges, either electro- 
static or thermal insulation. The homogeneous Neumann condition in the first case indicates 
the gradient of the potential is zero at the boundary. Thus, no charges can flow across the 
boundary, the meaning of electrostatic insulation. For the thermal problem, the vanishing 
of the temperature gradient at the boundary means no heat can flow across it, so thermal 
insulation is achieved. 

Various combinations of nonhomogeneous Dirichlet conditions on different edges lead 
to a variety of problems that can be solved by superposition of the solutions of simpler 
problems. We can even combine Dirichlet and Neumann on different edges. 

Finally, we obtain a finite-difference solution of the Dirichlet problem on the rectangle. 
The difference between this numeric scheme and the ones for the wave and heat equations 
is that now, the unknown values at all the interior nodes must be solved for simultaneously. 
For the evolution equations (wave and heat), the solution is computed at each time-step. For 
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u(x, b) 20 (a, b) 


u(0, y) 2 0 ula, y) 2 0 


O u(x, 0) = g(x) 


FIGURE 26.1 
rectangle 


A Dirichlet problem for a 


EXAMPLE 26.1 


FIGURE 26.2 
Example 26.1 


Solution surface for 
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Laplace's equation, the solution must be computed for the whole region R simultaneously. 
Thus, solving Laplace's equation requires hardware and software capable of solving large 
systems of simultaneous algebraic equations. 


Nonzero Temperature on the Bottom Edge 


Steady-State Temperatures in a Rectangle 


The time-dependent heat equation in one spatial dimension is u; (x, t) = ku, (x, t). In two 
spatial dimensions (such as in a rectangular slab), this equation generalizes to u; (x, y, t) = 
K (ux (X, y, t) + uy Qr, y, £)). At steady state when the temperatures have stopped chang- 
ing, u; = 0, so the steady-state heat equation in two dimensions becomes u,, (x, y) + 
uy, (x, y) = 0. This is Laplace's equation, V?u = 0, the same equation that governs the 
electrostatic potential in a rectangular dielectric (insulator). It is this equation we now embed 
in a boundary value problem and then solve via separation of variables. 

With respect to Figure 26.1, the boundary value problem to consider consists of 
Laplace’s equation uxx + uyy = OinsidetherectangleO < x < a,0 < y < band the bound- 
ary conditions u(x, 0) = g(x), u(0, y) = 0, u(a, y) = 0, u(x, b) = 0. A BVP such as this, 
consisting of Laplace’s equation and Dirichlet conditions, is called a Dirichlet problem. 


The solution of the Dirichlet problem corresponding to Figure 26.1 when u(x, 0) = g(x) = 
sin =* along the bottom edge is 


1 
z(y—b) 


sin sinh 
a a (26. 1) 


u(x,y)= -= 


sinh 72 

A straightforward computation shows V°u = 0. Setting a = z and b = 1 we draw the 
solution surface shown in Figure 26.2. The rectangle over which the surface is plotted is 
the physical slab whose temperatures are being measured. Thus, the heights plotted above 


this rectangle are representative of the actual temperatures in the slab. 


1 


0 l 


N 
ws) 


X 
FIGURE 26.3  Isotherms (in color), flow 
lines (in black), and several arrows from the 
negative gradient field for the solution in 
Example 26.1 


The contour lines (level curves) on the solution surface (26.1) are the isotherms, curves 
of constant temperature. A contour plot, the equivalent of looking straight down at Figure 
26.2, appears in Figure 26.3. Along with the isotherms, Figure 26.3 also contains several 
arrows of the gradient field, 


1 
—Vu = ——— (cos x sinh(y — 1)i+ sin x cosh(y — 1)j) 
sinh(1) j ` 
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which is orthogonal to the isotherms. The minus sign is included because here, u(x, y) 
represents temperatures and heat flows from hotter temperatures to cooler temperatures, 
and we want arrows pointing in the direction of decreasing, not increasing, values of u(x, y). 
Figure 26.3 also shows the flow lines, the paths along which heat would flow if it were a 
fluid. Since the flow is along the gradient vectors, these lines are solutions of the differential 
equations R’ = —V (u). In component form, these equations are 


x'(t) = —ux (x(t), y(t) and y'(t)= —uy(x(t), y(t)) 
The gradient vectors are tangent to the flow lines, so the flow lines are orthogonal to the 
isotherms. * 
Separation of Variables 


We now apply the separation of variables technique to obtain a series solution of this 
boundary value problem. First, the separation assumption u(x, y) = X (x)Y (y) is applied 
to the homogeneous (Dirichlet) boundary data, resulting in 


X(0)Y(y) 20 X(a)Y(y) 20 X(x)Y(b) 20 


from which we conclude 


X(0) = X(a) = Y(b) 0 (26.2) 

Next, apply the separation assumption to the partial differential equation, and, after dividing 
by u(x, y) = X (x)Y (y), obtain 

X" (x) Y"(y) 

Xo Yo) 


and the two ODEs 
X"(x) — AX(x) 20 and Y"(y)-cAY(y)-0 (26.3) 


(Again, the primes on X and Y denote differentiation with respect to different independent 
variables.) 

The first equation in (26.3) and the first two conditions in (26.2) form the familiar 
Sturm-Liouville BVP on the left in (26.4), the solution of which appears on the right in 


. NTX 
X" AX 0 Xn (x) - B, sin ——— 
= = a 
=> “oe (26.4) 
X(0) = X(a) = 0 . n nÀ 
Ap == mec 1.2. 
a? 


With à determined, the equation for Y (y) becomes Y” — i = 0, with solution 
Y.y) = cele F d,en™la (26.5) 


The condition Y, (b) = 0 from (26.2) gives d, = —c,e2"7/4 and consequently 
Y.(y) - c, (ela = e2inrb/a ,7nz) /a) 


nmb[a ( —nnb/a (nzy/la — gr bla 


e CRGA 


AT e 


nzbía (g^ 1 yb) /a —(ax(y—b)/a) 


=e —e 


. nz 
— C, sinh (—o — b)) 
a 
Therefore we have the eigensolutions 
nu 


. TX 
ün(x, y) = A, sin sinh ( (y b)) 
a 


a 
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where A, — B,C,. A linear combination of all possible eigensolutions gives the general 


solution 


2 n 
u(x, y) = p» Ay sin 


Ux nit 
inh »—L 
: sin ( : (y »)) 


n=1 


Application of the inhomogeneous Dirichlet condition on the edge y = 0 yields the equation 


u(x, 0) = g(x) 


za. sin - — sinh (=e ») 


n=l 


Unlike the solutions of the wave and heat equation in Ey T,(0) = 1(cos(0), and e, 


respectively), for Laplace’s equation Y, (0) = sinh(“ (— 


)) Æ 1. Thus, match the coeffi- 


cients in the Fourier sine series 


oo 


nux 


g(x) = 


n=! 


b, sin —— 5s 


and g(x) = > [An sinh (= 2) sin ied 


2 [^ nux ; a 
ze . 7 1=1 
b, = — g(x) sin —— dx 
0 a 


a 


concluding [A, sinh(—- 


An =— 


BE ( 


—b))] = bn, so 
by 2 
sinh nzb = h 22 nah 


a . nzxX 
g(x)sin —— dx 
0 a 


a sin 


Hence, the complete solution to the given Dirichlet problem is the series 


TX T 
u(x, y) = > As sin z - sinh d (y 2) 


EXERCISES 26.1—Part A 


(26.6a) 


n=1 


A,= € a sinh = eu] s (x) sin! —— * dx (26.6b) 


Al. Verify that (26.1) satisfies Laplace’s equation. 
A2. Separate variables in Laplace's equation and obtain (26.3). 


A3. Separate variables in the Dirichlet problem corresponding to 
Figure 26.1 and obtain (26.2). 


EXERCISES 26.1—Part B 


A4. Obtain (26.5). 
AS. Verify the identity cosh(u + v) = cosh u cosh v + sinh u sinh v. 


A6. Verify the identity sinh(u — v) = sinh u cosh v — cosh u sinh v. 


B1. Write the solution of Y” — op Y, = 0 as Y (y) =a, cosh a F 
B, sinh ™ and apply the condition Y (b) = 0. Use Exercise A6 to 
obtain Y.) = = C, sinh(“ (y — b)). 


In Exercises B2-21: 


(a) Solve the Dirichlet problem corresponding to Figure 26.1. 


(b) For the series solution found in part (a), let U(x, y) bea 
partial sum for which U (x, 0) is a reasonable approximation 
to g(x). Use U(x, y) to approximate u(£, 
the center of the rectangle. | 


2). the value of u at 


(c) Graph the solution surface. 

(d) Obtain a contour plot showing the isotherms (interpreting 
u(x, y) as temperatures) or equipotentials (interpreting 
u(x, y) as a potential). 

(e) Obtain a plot of the gradient field arising from u(x, y). 

(f) Calculate and plot the flow lines of the gradient field. 

(g) Superimpose the flow lines on the contour plot of the level 
curves of u. 


B2. (a, b) 2 (1,1), g(x) 2 x(x — x) 
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B3. (a, b) = Gt, 1), g(x) = x° — x) B16. (a,b) = (2,3), (x) = b al = = 
B4. (a, b) = (x, 1), g(x) = x? (x — x) “x Sx<s2 
B5. (a, b) = (x, 1), g(x) = sin 2x x 0<x<1 
] e B17. (a, b) = (4,4), g(x) = l | <x <3 
B6. (a, b) = (t, 1), g(x) = sin? x dex baud 
B7. (a, b) = (x, 1), g(x) = sin^ 2x E "— 
B8. (a, b) = Gt, 1), g(x) = cosx B18. (a,b) = (4,4), g(x) = 1 legas 
B9. (a, b) = (t, 1), g(x) = cos? x (4—x) 3<x<4 
B10. (a,b) = (1, D, g(x) =x B11. (a,b) = (1, 1), g(x) = x? x(2 — x) 0zx-«l1 
B12. (a,b) 2 (1,1), g(x) 2x? B13. (a, b) = (2, 3), g(x) = e™ B19. (a, b) = (4, 4), g(x) = 1 ] €x«3 
(x—2)(4—x) 3<x<4 
0 O0zxx 
l Iss = u x O<x<l 
B14. (a, b) = (4,4), g(x) = 4 Bux B20. (a,b) = (3,2), g(x) = {16 a tees 
0 3<x 2 OSx%<)] 
0 O<x <1 B21. (a,b) = (4,4), g(x)= 40 IL<x <3 
x—1 1<x<2 3 Zapa 


B15. (a, b) = (4,4), g(x) = 


3—x 2x 23 


0 3<x<4 


EXAMPLE 26.2 


u 


| 
0 1 2 3 4 


FIGURE 26.4 Graph of u(x, 0) = g(x) 
in Example 26.2 


Nonzero Temperature on the Top Edge 


Nonzero Temperature on Bottom Edge 


In Section 26.1 we learned how to solve the Dirichlet problem for a rectangle on which a 
nonhomogeneous Dirichlet condition is prescribed on the bottom edge. Our immediate goal 
is to solve the Dirichlet problem for a rectangle with a nonhomogeneous Dirichlet condition 
prescribed on the top edge. Our strategy for solving this new problem will be to parallel, 
as much as possible, our solution to the old problem. Hence, we start with an example of 
the Dirichlet problem for a rectangle with a nonhomogeneous Dirichlet condition on the 
bottom edge. 


In the BVP summarized in Figure 26.1, let a = 4, b = 4, and 


0 Q x«l 
gx)21(0-x)x-3) 1xx x3 
0 3<x<4 


Graph g(x) in Figure 26.4, and interpret the boundary value problem as the steady-state 
temperatures in a square plate. Obtain the solution u(x, y) by computing the coefficients 


l B . AMX 
An = eae Í g(x) sin 3 d dx 
16 
~ mam sinh nz 


(26.7a) 


3nz 


(4 cos E nz sin = 4cos nz sin =) (26.7b) 
4 4 4 
the first 10 of which appear in Table 26.1, whose entries are consistent with A, = O(n ?e^"7), 
In the interior of the rectangle, away from y = 0, the denominators contain sinh n, 
which gets large quickly, so the coefficients themselves equally quickly get small. Hence, 
the partial sum uz(x, y) = m A, sin ^7 sinh (^7 (y — 4)), graphed in Figure 26.5, is a 
satisfactory approximation to the solution. 
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n An An n An Án 
I(r —4 
1 2-4) —0.0542 6 0 0 
x? sinh zx Ja 
16 J2(Tz +4 
2 0 0.723 x 10-? 7 a —0.311 x 107! 
r 343 x? sinh 7x 
2(8z +4 . 
3 mau ru 0.586 x 10-4 8 0 —0.433 x 10-2! 
27 m?sinh3z A 
16 42(9z — 4) 
—0.115 x 10-4 9 LL. es 0.255 x 10-33 
b i a x 729 3 sinh 9x 
(Sz —: : | 
5 16 soe — 0.206 x 1077 10 0 0.703 x 10-24 


125 x? sinh 5x7 


TABLE 26.1 Coefficients A, in Example 26.2. The numbers Å, are the floating-point values produced by (26.7b) 


0 0 


FIGURE 26.5 Solution surface in Example 26.2 


The contours on the surface in Figure 26.5 are the isotherms, or level curves, shown as 
a contour plot in Figure 26.6. In addition, Figure 26.6 shows the vectors — Vu, the minus 
sign because heat flows from higher to lower temperatures, but gradients point from lower 
to higher values. Thus, the vector field plotted shows the direction of heat flow. Finally, 
Figure 26.6 also shows the flow lines along which heat would flow if heat were water and 
the solution surface, a hill. These lines are orthogonal to the isotherms, the level curves of 
u(x, y). Thus, the flow lines are along the vectors — Vu; that is, the flow lines have as their 
tangent vectors the negatives of the gradient vectors of u(x, y) and are obtained as solutions 
to the differential equations x'(t) = —u,(x(t), y(t)), y'(t) = —uy(x(t), y(t). $ 


FIGURE 26.6  Isotherms (in color), flow 
lines (in black), and the negative of the 
gradient field for the solution in Example 
26.2 


Nonzero Temperature on Top Edge 


Consider the following slight variation of the boundary value problem in Example 26.2. 
Instead of prescribing a nonzero temperature on the edge y = 0, prescribe it on the edge y = 
b. Thus, the boundary value problem now consists of Laplace’s equation in the rectangular 
region shown in Figure 26.7, with the top edge maintained at a temperature of G(x) and 
the bottom edge maintained at a temperature of zero. The two edges x = 0 and x = a 
are still held at a temperature of zero, so the complete statement of the problem consists 
of Laplace's equation u,, + “yy = 0 and the Dirichlet boundary conditions u(x, 0) = 0, 
u(a, y) - 0 u(0, y) = 0, ula; y) = 0, u(x, b) = G(x). 

A little thought will help avoid repeating many of the computations in Section 26.1. 
O u(x, 0) 20 “First, separation of variables will still yield the Sturm-Liouville eigenvalue problem 


u(x,b)=G) (a,b) 


u(0, y) 2 0 


FIGURE 26.7 Dirichlet problem for X'"(x) — AX(x) 20 and X(0)2 X(a)20 
rectangle where top edge supports 
nonhomogeneous Dirichlet condition because the homogeneous Dirichlet conditions on the opposing edges x — 0 and x — a 


EXAMPLE 26.3 


E 
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FIGURE 26.8 Graph of G(x) in 
Example 26.3 


FIGURE 26.10  Isotherms (in color), flow 
lines (in black), and the negative of the 
gradient field for the solution in Example 
26.3 
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haven't changed. Hence, the eigenfunctions and eigenvalues 


5 
_ NTX n^n? 

X5, (x) = B, sin —— Ay == M15 200s 

a a 


will be the same as before. The only part that will be different is the solution for Y (y), and 
that, not by much. The function Y (y) must still be a hyperbolic sine because it must be zero 
exactly once. In fact, Y„(y) will satisfy the same ODE as before, 


9 y 


m n m^ 
I (y) = Mu in) = 0 (26.8) 


because the separation of variables steps will be the same as before. However, there will now 
be the different initial condition Y,,(0) = 0, so that Y„ (y) = C, sinh =e and the solution to 
the boundary value problem will be 
= nzazx ny 2 s nux 
u(x, y) = 5 A, sin — sinh —- where A, = 13! G(x) sin —— dx 

a a sinh ^ Jo a 


a 
n=l 


As an example of a problem with a nonzero temperature on the top edge, solve Laplace’s 
equation for the steady-state temperatures in the plate of Example 26.2 (where a = 4, 
b = 4) if G(x) = #472, graphed in Figure 26.8. 

The coefficients, 


A : f Gi aps qu 1 0 (26.9) 
1 a X xX) sin AX —- - | 
2sinhnz Jo 4 n?m? sinh nz 


are O(n 2e"), so the partial sum 


4 4 4 
sinh x 27 sinh 37 125 sinh 5x 


. e my "E e my TNCS NE Sry 
32 (sin Z* sinh% — sin "7 sinh ae sin 22% sinh 222 
us(x, y) = 


graphed in Figure 26.9, will be an adequate approximation of the solution. 


=» 


3 


y 1 2 
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FIGURE 26.9 Solution surface in Example 26.3 


The contours on the surface in Figure 26.9 are the isotherms, or level curves. They 
again appear in Figure 26.10 where, in addition, the flow lines and vectors — Vu also appear. 
The flow lines are orthogonal to the isotherms, that is, they are along the negatives of the 
gradient vectors of u(x, y). The vectors —Vu are tangent vectors along the flow lines, which 
themselves are obtained by integrating the differential equations x'(f) = —u, (x(t), y(t)), 
y(t) = —uy(x(t), y(t)). The minus sign is present because heat flows from higher to lower 
temperatures, but gradient vectors point from lower to higher function values. 
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EXAMPLE 26.4 


u(x, b) = G(x) 


(a, b) 


u(0, y) =0 u(a, y) - 0 


[6] u(x, 0) = g(x) 


FIGURE 26.11  Dirichlet problem for 
rectangle where both top and bottom edges 
support nonhomogeneous Dirichlet 
conditions 
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FIGURE 26.13  Isotherms (in color), flow 
lines (in black), and the negative of the 
gradient field in Example 26.4 
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Nonzero Temperatures on Top and Bottom Edges 


The solution to Laplace's equation on a rectangle that has two nonhomogeneous Dirichlet 
conditions can be obtained by adding the solutions to two simpler problems, each of which 
has only one nonhomogeneous Dirichlet condition. 


For example, suppose u(x, 0) = g(x) and u(x, b) = G(x), as shown in Figure 26.11. The 
solution of Laplace's equation on this rectangle, with the top and bottom edges held at the 
respective temperature profiles G (x) and g(x), is the sum of the solutions of the problems in 
Examples 26.2 and 26.3. Hence, we merely have to add the solutions u, (x, y) and uc (x, y) 
found, respectively, in Examples 26.2 and 26.3, and we will have the solution to the problem 
in Example 26.4. Linearity is the key here, since the sum u4G (x, y) = ug(x, y) +uc(x, y) 
will satisfy Laplace's equation and the homogeneous Dirichlet conditions on the edges 
x = O and x = a because u, and ug both do. The verifications are 


usg(0, y) =Ug(0, y) - ug(0, y) 20-020 
ugg(d, y) — ug(a, y) t ug(a, y) 204-00 


and 
ugsg (x, 0) = ug (x, 0) +ug(x, 0) = g(x) 4-0 = g(x) 
UgG(X, b) = u(x, b) +ug(x, b) = 0 + G(x) = G(x) 
Figure 26.12 contains the graph of the solution surface u,G (x, y) = ug(x, y) + 


ug(x, y). Figure 26.13 combines images of the flow lines (thick curves), isotherms (thin 
curves), and the arrows of the field — Vu,c. The flow lines are interesting. Those contributed 
by G(x) do the expected. They show heat flows from the edge y = 4 to the two sides x = 0 
and x = 4. However, the flow lines contributed by g(x) show heat flowing into the plate 
along this heated edge, then back out at a cooler spot on the same heated edge! Not all the 
heat escapes to the edges x = 0 and x = 4. Some also flows out in the two outer segments 
on the edge y — 0, where u is maintained at temperature zero. $ 


E 


CA 
3 3 
2 
y 1 p ^ 
0 0 
FIGURE 26.12 Solution surface for Example 26.4 


Neumann Boundary Conditions 


In Section 25.3 the heat equation was solved for a finite rod with insulated ends. Thus, 
the endpoint conditions u,(0, t) = 0 and u,(L,t) = 0 were imposed. Boundary condi- 
tions such as these which prescribe the value of the derviative are examples of Neumann 
conditions. 

The general Neumann boundary condition prescribes the normal derivative u, = 
V(u) * n, where n is a unit normal vector on the boundary of the region R over which 
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the BVP is posed. The homogeneous Neumann condition u„ = 0 corresponds to thermal 
insulation in heat-transfer problems, and electrostatic grounding in potential problems. 
Boundary value problems with Neumann conditions are left to the exercises. 


EXERCISES 26.2-Part A 


A]. Verify that the integral in (26.7a) evaluates to the result shown in 
(26.7b). 


A2. Show that A, in (26.7b) is O(n^?e^"7). For example, show 
graphically that the ratio |A, /n ?e^""| is bounded by a constant. 


EXERCISES 26.2—Part B 


A3. Show that (26.8) and Y, (0) = 0 are satisfied by Y,(y) = 
C, sinh =. 

A4. Verify the integration in (26.9). 

AS. Show that A, in (26.9) is O(ne7"*). 


B1. Using u7(x, y) as the solution to the Dirichlet problem in 
Example 26.2, show that the net heat flow through the rectangle is 
zero by evaluating the flux of Vu through the boundary. 


B2. Using us(x, y) as the solution to the Dirichlet problem in 
Example 26.3, show that the net heat flow through the rectangle is 
zero by evaluating the flux of Vu through the boundary. 


In Exercises B3-22: 


(a) Solve the Dirichlet problem corresponding to Figure 26.7. 


(b) For the series solution found in part (a), let U(x, y) bea 
partial sum for which U(x, b) is a reasonable approximation 
to G(x). Use U(x, y) to approximate u($, by. the value of u 

at the center of the rectangle. d 


(c) Graph the solution surface. 
(d) Obtain a contour plot showing the isotherms (interpreting 
u(x, y) as temperatures) or equipotentials (interpreting 
u(x, y) as a potential). 
(e) Obtain a plot of the gradient field arising from u(x, y). 
(f) Calculate and plot the flow lines of the gradient field. 
(g) Superimpose the flow lines on the contour plot of the level 
curves of u. 
B3. (a,b) = (x, 1), G(x) = x(a — x? 
B4. (a, b) = (x, 1), G(x) = x(a — x} 
B5. (a, b) = (a, 1), G(x) = x(a — x) 
B6. (a, b) = (x, 1), G(x) = cos 2x 


B10. (a, b) = (t, 1), G(x) = sin? x 

B11. (a,b) = (1,1), G(x) =x? B12. (a,b) = (1, 1), G(x) = x 
B13. (a,b) = (1, 1), GG) = x? 

B14. (a, b) = (2,3), Ga) 21—e7 


0 O0<x<l 
a js Ise <2 
B15. (a, b) = (4, 4), G(x) = | 24x43 
0 3<x<4 
1 Oargel 
2—Xx l3sx«2 
B16. (a, b) = (4,4), G(x) = x=2 22x3 
1 3% <4 
I=% O<x <I] 
emm 5 d gee = 
B17. (a,b) = (2,3), G(x) = -I leee2 
x O<x<1 
B18. (a,b) = (4.4,GQ) 21. ! 1 S*<? 
jas Sep 
2 <x< 
x? O<x<!l 
B19. (a, b) = (4,4), G(x) = 1 ]se3 
(4—x) 3<x<4 
x(2— x) QE x ss] 
B20. (a, b) = (4,4), G(x) = l l<x <3 
(x—2)(4—-x) 3<x<4 
x 
E 0-2 
B21. (a,b) = (3,2), G(x) 2 4. 2 
3-x 2<x<3 
5 0<%<1 
B22. (a,b) = (4.4), G(x) 2-0 1zxx <3 
2 3<x<4 


In Exercises B23-32, functions g(x) and G(x) are given for the Dirichlet 
problem corresponding to Figure 26.11. In each case, the rectangles for 
which g(x) and G (x) are given have the same dimensions. The solution 
is the sum of Dirichlet problems corresponding to Figures 26.1 and 26.7. 


(a) Graph the solution surface. 


(b) Obtain a contour plot showing the isotherms (interpreting 
u(x, y) as temperatures) or equipotentials (interpreting 
u(x, y) as a potential). 
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(c) Obtain a plot of the gradient field arising from u(x, y). 

(d) Calculate and plot the flow lines of the gradient field. 

(e) Superimpose the flow lines on the contour plot of the level 
curves of u. 


B23. g(x) from Exercise B2, Section 26.1, and G(x) from Exercise B3, 


Section 26.2 


g(x) from Exercise B3, Section 26.1, and G(x) from Exercise B4, 
Section 26.2 


B24. 


B25. g(x) from Exercise B4, Section 26.1, and G(x) from Exercise B5, 


Section 26.2 


g(x) from Exercise B5, Section 26.1, and G(x) from Exercise B6, 
Section 26.2 


B26. 


B27. g(x) from Exercise B6, Section 26.1, and G(x) from Exercise B7, 


Section 26.2 


g(x) from Exercise B12, Section 26.1, and G(x) from Exercise 
B13, Section 26.2 


g(x) from Exercise B13, Section 26.1, and G(x) from Exercise 
B14, Section 26.2 


g(x) from Exercise B14, Section 26.1, and G(x) from Exercise 
B15, Section 26.2 


g(x) from Exercise B15, Section 26.1, and G(x) from Exercise 
B16, Section 26.2 


g(x) from Exercise B16, Section 26.1, and G(x) from Exercise 
B17, Section 26.2 


In Figure 26.1, change the homogeneous Dirichlet conditions on 

the left and right edges to the homogeneous Neumann conditions 
ux (0, y) = ux (a, y) = 0, thereby applying insulation to the pair 

of opposing edges. Obtain the general solution for this BVP. 


B28. 
B29. 
B30. 
B31. 
B32. 


B33. 


For the data in Exercises B34—43, apply the results of Exercise B33 to 
solve the corresponding BVP. 


(a) Graph the solution surface. 


(b) Obtain a contour plot showing the isotherms (interpreting 
u(x, y) as temperatures) or equipotentials (interpreting 
u(x, y) as a potential). 


(c) Obtain a plot of the gradient field arising from u(x, y). 
(d) Calculate and plot the flow lines of the gradient field. 


(e) Superimpose the flow lines on the contour plot of the level 
curves of u. 


(f) Compute the flux of Vu through the boundary of the rectangle. 
B34. 
B35. 
B36. 
B37. 
B38. 
B39. 


the data in Exercise B7, Section 26.1 
the data in Exercise B8, Section 26.1 
the data in Exercise B9, Section 26.1 


the data in Exercise B10, Section 26.1 


the data in Exercise B11, Section 26.1 
the data in Exercise B17, Section 26.1 
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B40. 
B41. 
B42. 
B43. 
B44. 


the data in Exercise B18, Section 26.1 
the data in Exercise B19, Section 26.1 
the data in Exercise B20, Section 26.1 
the data in Exercise B21, Section 26.1 


In Figure 26.7, change the homogeneous Dirichlet conditions on 
the left and right edges to the homogeneous Neumann conditions 
ux (0, y) = u,(a, y) = 0, and obtain the general solution for this 
BVP. 


For the data in Exercises B45—46, use the results of Exercise B44 to solve 
the corresponding BVP. 


(a) Plot the solution surface. 

(b) Obtain level curves and flow lines. 

(c) Compute the flux of Vu through the boundary of the rectangle. 
B45. 
B46. 
B47. 


(a, b) = (x, 1), G(x) = x? (a — x) 
the data in Exercise B4, Section 26.2 


In Figure 26.11, change the homogeneous Dirichlet conditions on 
the left and right edges to the homogeneous Neumann conditions 
ux (0, y) = u,(a, y) = 0, and obtain the general solution for this 
BVP. 

For the data in Exercises B48 and 49, use the results of Exercise B47 to 


solve the corresponding BVP. The given functions are defined for rect- 
angles with the same dimensions. 


(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 


(c) Compute the flux of Vu through the boundary of the 
rectangle. 


B48. g(x) from Exercise B7, Section 26.1, and G(x) from Exercise B8, 


Section 26.2 


B49. g(x) from Exercise B8, Section 26.1, and G(x) from Exercise B9, 


Section 26.2 


In Figure 26.1, change the homogeneous Dirichlet condition on 
the top edge to the homogeneous Neumann condition 
uy(x, b) = 0, and obtain the general solution to the resulting BVP. 


B50. 


For the data in Exercises B51 and 52, use the results of Exercise B50 to 
solve the corresponding B VP. 
(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 
(c) Compute the flux of Vu through the boundary of the 
rectangle. 
B51. the data from Exercise B16, Section 26.1 
B52. the data from Exercise B17, Section 26.1 


B53. In Figure 26.1, change the homogeneous Dirichlet conditions on 
the top and right edges to homogeneous Neumann conditions, and 
obtain the general solution to the resulting BVP. 


For the data in Exercises B54 and 55, use the results of Exercise B53 to 
solve the corresponding BVP. 
(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 
(c) Compute the flux of Vu through the boundary of the 
rectangle. 
B54. the data from Exercise B18, Section 26.1 
B55. the data from Exercise B19, Section 26.1 


B56. In Figure 26.1, change all three homogeneous Dirichlet 
conditions to homogeneous Neumann conditions, and solve the 
corresponding B VP. 


For the data in Exercises B57 and 58, use the results of Exercise B56 to 
solve the corresponding BVP. 
(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 
(c) Compute the flux of Vu through the boundary of the 
rectangle. 
B57. the data from Exercise B20, Section 26.1 
B58. the data from Exercise B21, Section 26.1 


B59. In Figure 26.7, change the homogeneous Dirichlet condition on 
the bottom edge to the homogeneous Neumann condition 
u , (x, 0) = 0, and obtain the general solution of the resulting BVP. 


For the data in Exercises B60 and 61, use the results of Exercise B59 to 
solve the corresponding BVP. 
(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 
(c) Compute the flux of Vu through the boundary of the 
rectangle. 
B60. the data from Exercise B19, Section 26.2 
B61. the data from Exercise B20, Section 26.2 


B62. In Figure 26.7, change the homogeneous Dirichlet conditions on 
the bottom and left edges to homogeneous Neumann conditions, 
and obtain the general solution of the resulting BVP. 
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For the data in Exercises B63 and 64, use the results of Exercise B62 to 
solve the corresponding BVP. 
(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 
(c) Compute the flux of Vu through the boundary of the 
rectangle. 
B63. the data from Exercise B21, Section 26.2 
B64. the data from Exercise B22, Section 26.2 


B65. In Figure 26.11, change the homogeneous Dirichlet condition on 
the left edge to the homogeneous Neumann condition 
us (0, y) = 0, and obtain the general solution to the resulting BVP. 


For the data in Exercises B66 and 67, use the results of Exercise B65 to 
solve the corresponding B VP. 


(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 


(c) Compute the flux of Vu through the boundary of the 
rectangle. 


B66. the data from Exercise B9, Section 26.1, and Exercise B10, 


Section 26.2 
B67. the data from Exercise B10, Section 26.1, and Exercise B11, 


Section 26.2 
In Figure 26.11, change the homogeneous Dirichlet condition on 


the right edge to the homogeneous Neumann condition 
ux (a, y) = 0, and obtain the general solution to the resulting BVP. 


B68. 


For the data in Exercises B69 and 70, use the results of Exercise B68 to 
solve the corresponding BVP. 
(a) Plot the solution surface. 
(b) Obtain level curves and flow lines. 
(c) Compute the flux of Vu through the boundary of the 
rectangle. 
B69. the data from Exercise B11, Section 26.1, and Exercise B12, 
Section 26.2 


B70. the data from Exercise B12, Section 26.1, and Exercise B13, 
Section 26.2 


Í Nonzero Temperature on the Left Edge 


Problem Formulation 


Suppose the one nonhomogeneous Dirichlet condition on the rectangle in Sections 26.1 or 
26.2 were imposed on the left edge, namely, on the edge x = 0. The temperature on that 
edge would be a function of y, as summarized in Figure 26.14. A formal statement of this 
boundary value problem would include Laplace's equation ux» + uyy = 0 in the rectangle 
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u(x,b)=0 (a,b) 


u(0, y) = f(y) 


O  u(x0)-20 


FIGURE 26.14 Dirichlet problem on 
rectangle whose left edge satisfies the 
nonhomogeneous Dirichlet condition 


EXAMPLE 26.5 


| 
1 
1 2 3 4 


FIGURE 26.15 
u(0, y) = f(y) 


Dirichlet condition 


FIGURE 26.17  Isotherms (in color), flow 
lines (in black), and vectors from the field 
—Vu for Example 26.5 
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0 <x <a,0 < y < band the Dirichlet boundary conditions u(x, 0) = 0, u(0, y) = f(y). 
u(a, y) = 0, u(x, b) = 0. 


Solution by Symmetry 


If the variables x and y and parameters a and b are interchanged in (26.6a) and (26.6b), 
the solution of the Dirichlet problem where the bottom edge is maintained at a nonzero 
temperature, we obtain the solution of the Dirichlet problem associated with Figure 26.14. 
In fact, that interchange of variables leads to the solution 


= _ ANTY . nr 
u(x, y)= 2 A, sin b sinh ( 5 (x a)) (26.10a) 
p b ; 
r=- | f(y)sin— ay (26.10b) 
b sinh 5 Jo b 


where f(y) replaces g(x) in (26.6b). 


Let a = 4, b = 4, and define 
y? O< yell 
fo) = l 1sy»y£3 
(y-4» 3<y<4 
graphed in Figure 26.15. The series coefficients (26.10b) evaluate to 
16 4 3nz nit +1- C1” . ànzx "m nit 
— os — cos —(— — nz | sin —— + sin — 
n?m? sinh nz dE. 4 á 4 4 


(26.11) 


and are O(n ?e^"7), so the partial sum 


9 
ug(x, y) = > A, sin m sinh ‘ac — 4)) 
n-l 


graphed in Figure 26.16, will adequately approximate the solution on the interior of the 
square. 


0 l E 3 $ 
X 

FIGURE 26.16 Solution surface for Example 26.5 

Figure 26.17 shows, along with the contours on the surface in Figure 26.16, the vectors 
of the field — Vu and the flow lines for which these vectors are tangent. The contours are 
the thin curves, and the flow lines, the thick. There is just a hint that heat flows into the slab 
from warmer portions of the heated edge and then flows back out, not only on the three 
edges kept at temperature zero but also on a cooler portion of the heated edge! e 
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Solution by Separation of Variables 


First, the separation assumption u(x, y) = X(x)Y (y) is applied to the boundary data to 
conclude Y (0) = 0, X (a) = 0, and Y (b) = 0. Then, Laplace's equation is separated to 
Y"(y) _ X" (x) " 
Yœ) | XQ) 


from which we obtain the ODEs 
Y'(y)  AY(y) 20 and X"(x)--AX(x)20 


The first equation for Y (y) is incorporated into the Sturm-Liouville BVP on the left in 
(26.12); the eigenfunctions and eigenvalues are shown on the right. 


_ nity 
Y'y)-ayo)20 _ T0) = Cr sin [— (26.12) 
EX 2r ] 
Y(0) = Y(b) 20 dn = F n=1,2,... 
That leaves us with the ODE 
" nx? 
AC) p X,(x) =0 


for which the general solution is X, (x) = cpe” +.d,e7"*/ b Application of the condition 
X,(a) = 0 gives d, = —c,e?"74/^ so that 


=f 2 er 
X,(x) = (err p ennajb,, PIRE 


- cpe el? (e tb prin = gara o BTR B 


HEED (pum(x—a)/b -nz (x—a)/b 


er 4 —e 


= B, sinh (e — a)) 


Therefore we have the general eigensolution 


; QOnUTy. nuc 
us (x, y) = A, sin —— sinh ( x a)) 
b b 


where A, = B,,C,,. The general solution is then (26. 10a), a linear combination of all possible 
eigensolutions. To this solution we apply the final boundary condition, obtaining 


= nyu ATY 
u(0, y) = fO) = X [-^. sinh — | sin d 


h b 


n=1 


œ b, sin =, so 


n-l b? 


This is a Fourier sine series for f(y) = pi 


.. nzàá 2 55 . nity 

[-An sinh | =b,=- f(y) sin — dy 
b b Jo 

and A, is given by (26.10b). Hence, the complete solution to the given BVP is the series 

given by (26.10a) and (26.10b). 


Extensions 


A companion Dirichlet problem has the nonhomogeneous Dirichlet condition on the right 
edge of the rectangle in Figure 26.14. As we saw in the exercises in Section 26.2, we are now 
in a position to solve the Dirichlet problem for a rectangle where any two opposing edges 
support a nonhomogeneous Dirichlet condition. Using the same strategy of superposition, 
we can also solve Dirichlet problems where any three edges, or even all four edges, support 
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nonhomogeneous Dirichlet conditions. As we also saw in the exercises in Section 26.2, we 
can introduce nonhomogeneous Neumann conditions to insulate one or more edges of the 
rectangle. These and other variations of the basic problem for Laplace's equation on the 
rectangle are left to the exercises. 


EXERCISES 26.3—Part A 


Al. 


Verify that A,, in Example 26.5 is given by (26.11). 


two nonhomogeneous Dirichlet conditions u(0, y) = f (y) and 
u(a, y) — F(y) on the left and right edges, respectively. 


A2. Verify graphically that in Example 26.5, A,, given by (26.11), is 
O(n 2e"), AS. Write the general solution of the Dirichlet problem for the 

A3. Obtain the general solution to the Dirichlet problem for the rectangle in Figure 26.14 if it has the nonhomogeneous Dirichlet 
rectangle in Figure 26.14 if it has three homogeneous Dirichlet conditions u(0, y) » f(y) and u(a, y) = F(y) on the left and 
conditions and one nonhomogeneous Dirichlet condition right edges, respectively, and u(x, 0) = g(x) and u(x, b) = G(x) 
u(a, y) = F(y) on the right edge. on the bottom and top edges, respectively. 

A4. Write the general solution to the Dirichlet problem for the rectangle 
in Figure 26.14 if it has two homogeneous Dirichlet conditions and 

EXERCISES 26.3—Part B 

B1. Obtain the general solution to the BVP on the rectangle in Figure conditions u, (a, y) = 0 and u, (x, 0) = 0, respectively, on the 
26.14 if the solution satisfies the homogeneous Neumann right and bottom edges, the homogeneous Dirichlet condition 
condition u, (0, y) = 0 on the left edge, homogeneous Dirichlet u(x, b) = 0 on the top, and the nonhomogeneous Dirichlet 
conditions on the top and bottom edges, and the nonhomogeneous condition u(0, y) = f (y) on the left. 

Dirichlet condition u(a, y) = F(y) on the right edge. B7. Obtain the general solution to the BVP on the rectangle in Figure 

B2. Obtain the general solution to the BVP on the rectangle in Figure 26.14 if the solution satisfies the homogeneous Neumann 
26.14 if the solution satisfies the homogeneous Neumann conditions u, (a, y) = 0 and u, (x, b) = 0, respectively, on the 
condition u, (a, y) = 0 on the right edge, homogeneous Dirichlet right and top edges, the homogeneous Dirichlet condition 
conditions on the top and bottom edges, and the nonhomogeneous u(x, 0) = 0 on the bottom, and the nonhomogeneous Dirichlet 
Dirichlet condition u(0, y) = f (y) on the left edge. condition u(0, y) = f (y) on the left. 

B3. Obtain the general solution to the BVP on the rectangle in Figure B8. Obtain the general solution to the BVP on the rectangle in Figure 
26.14 if the solution satisfies the homogeneous Neumann 26.14 if the solution satisfies the homogeneous Neumann 
condition u, (x, b) = 0 on the top edge, a homogeneous Dirichlet conditions u, (0, y) = 0 and u, (x, 0) = 0, respectively, on the left 
condition on the bottom, and the nonhomogeneous Dirichlet and bottom edges, the homogeneous Dirichlet condition 
conditions u(0, y) = f (y) and u(a, y) = F(y) on the left and u(x, b) — 0 on the top, and the nonhomogeneous Dirichlet 
right edges, respectively. condition u(a, y) — F(y) on the right. 

B4. Obtain the general solution to the BVP on the rectangle in Figure B9. Obtain the general solution to the BVP on the rectangle in Figure 
26.14 if the solution satisfies the homogeneous Neumann 26.14 if the solution satisfies the homogeneous Neumann 
condition u, (x, 0) = 0 on the bottom edge, a homogeneous conditions u, (0, y) = 0 and u, (x, b) = 0, respectively, on the 
Dirichlet condition on the top, and the nonhomogeneous Dirichlet left and top edges, the homogeneous Dirichlet condition 
conditions u(0, y) = f(y) and u(a, y) = F(y) on the left and u(x, 0) = 0 on the bottom, and the nonhomogeneous Dirichlet 
right edges, respectively. condition u (a, y) = F(y) on the right. 

B5. Obtain the general solution to the BVP on the rectangle in Figure B10. Solve the BVP in Exercise A5 if the Dirichlet condition on the left 
26.14 if the solution satisfies the homogeneous Neumann edge is replaced with a homogeneous Neumann condition. 
conditions u,(x, b) = 0 and u, (x, 0) = 0, respectively, on the top B11. Solve the BVP in Exercise A5 if the Dirichlet condition on the 
and bottom edges, and the nonhomogeneous Dirichlet conditions right edge is replaced with a homogeneous Neumann condition. 
u(0, aia (y) and u(a, y) = F(y) on the left and right edges, B12. Solve the BVP in Exercise A5 if the Dirichlet condition on the 
an ential bottom edge is replaced with a homogeneous Neumann condition. 

B6. Obtain the general solution to the BVP on the rectangle in Figure B13, Solve the BVP in Exercise A5 if the Dirichlet condition on the top 


26.14 if the solution satisfies the homogeneous Neumann 


edge is replaced with a homogeneous Neumann condition. 


For the data given in each of Exercises B14—18: 


(a) Solve the Dirichlet problem corresponding to Figure 26.14. 


(b) For the series solution found in part (a), let U (x, y) bea 
partial sum for which U (0, y) is a reasonable approximation 
to f (y). Use U(x, y) to approximate u(5, 2) the value of u at 
the center of the rectangle. 

(c) Graph the solution surface. 

(d) Obtain a contour plot showing the isotherms (interpreting 
u(x, y) as temperatures) or equipotentials (interpreting 
u(x, y) as a potential). 

(e) Obtain a plot of the gradient field arising from u(x, y). 

(f) Calculate and plot the flow lines of the gradient field. 


(g) Superimpose the flow lines on the contour plot of the level 
curves of u. 


B14. (a, b) = (1,1), f(y) = y(1— y) 
B15. (a, b) = Gr, D, f (y) =z} — y) 
B16. (a, b) = (x, 1), f (y) = y! 0 — y) 
B17. (a, b) = (x, 1), f (y) = sin2zy 
B18. (a, b) = (t, 1), f(y) = sin? zy 


For the data given in each of Exercises B19—23: 


(a) Use Exercise A3 to solve the Dirichlet problem uxx + uy, = 0, 
u(x,0) = u(x, b) = u(0, y) = 0, u(a, y) = F(y). 


(b) For the series solution found in part (a), let U(x, y) bea 
partial sum for which U (0, y) is a reasonable approximation 
to f (y). Use U(x, y) to approximate u (5, 2), the value of u at 


the center of the rectangle. 


(c) Graph the solution surface. 


(d) Obtain a contour plot showing the isotherms (interpreting 
u(x, y) as temperatures) or equipotentials (interpreting 
u(x, y) as a potential). 


(e) Obtain a plot of the gradient field arising from u(x, y). 
(f) Calculate and plot the flow lines of the gradient field. 


(g) Superimpose the flow lines on the contour plot of the level 
curves of u. 


B19. (a, b) = (x, 1), F(y) = yd — y}? 
B20. (a, b) = (x, 1), F(y) = yi — y» 
B21. (a, b) = (x, 1), F(y = y(0— y) 
B22. (a, b) = Gt, 1), F(y) = cos 2r y 
B23. (a, b) = (zt, 1), F(y) = cos? zy 


In Exercises B24 and 25, apply the results in Exercise A4 to the given 
data, obtaining 
(a) the solution surface. 
(b) the flow lines superimposed on the level curves. 
B24. (a, b) = (x, 1), f (y) = sin? 2xy, F (y) = cos? 2ry 
B25. (a, b) = (x, 1), f (y) = cos zy, F(y) = sin my 
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In Exercises B26 and 27, apply the results of Exercise B1 to the given 
data, obtaining 

(a) the solution surface. 

(b) the flow lines superimposed on the level curves. 
B26. (a, b) = (x, 1), F(y) = sin? zy 
B27. (a,b) = (1, D, Fy) = 1 — y? 
In Exercises B28 and 29, apply the results of Exercise B2 to the given 
data, obtaining 


(a) the solution surface. 


(b) the flow lines superimposed on the level curves. 

(a, b) = (x, 1), f(y) = cos? xy 

@b)=(4).7Q)=1=y 

Apply the results of Exercise B3 to the data (a, b) = (1, 1), 

f(y) =1—y?, F(y) = 1 — y, obtaining the solution surface, the 
level curves, and the flow lines. Compute the flux of Vu through 
the boundary of the rectangle. 


B28. 
B29. 
B30. 


B31. Apply the results of Exercise B4 to the data (a, b) = (1, 1), 
f) =1—y3, F(y) = 1 — y?, obtaining the solution surface, 
the level curves, and the flow lines. Compute the flux of Vu 


through the boundary of the rectangle. 


B32. Apply the results of Exercise B5 to the data (a, b) — (2, 3), 
f(y) = ye’, F(y) = y?e^, obtaining the solution surface, the 
level curves, and the flow lines. Compute the flux of Vu through 


the boundary of the rectangle. 


B33. Apply the results of Exercise B6 to the data 
0 0zxy«l 
(a, b) = (4,4), f(y) = : “ee í » obtaining the solution 
0 3zyx4 


surface, the level curves, and the flow lines. Compute the flux of 
Vu through the boundary of the rectangle. 


B34. Apply the results of Exercise B7 to the data 
0 0<y<l 
- q—J)o-D? l<y<2 hes 
(a, b) = (4,4), f(y) = 4-3 2 < y < 3° Obtaining the 
0 Laysa 


solution surface, the level curves, and the flow lines. Compute the 
flux of Vu through the boundary of the rectangle. 


B35. Apply the results of Exercise B8 to the data 
-1 0z<y<l 
1 il<y<2 
2 25yse3 
0 3<ys4 
surface, the level curves, and the flow lines. Compute the flux of 


Vu through the boundary of the rectangle. 


(a, b) = (4,4), FQ) = , obtaining the solution 


B36. Apply the results of Exercise B9 to the data 
0 O<y<l 
" j A. y-1 l<y<2 ates 
(a, b) = (4,4), F(y) = Bayi ee obtaining the 
0 3sy<4 


solution surface, the level curves, and the flow lines. Compute the 
flux of Vu through the boundary of the rectangle. 
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B37. Apply the results of Exercise B10 to the data B39. Apply the results of Exercise B12 to the data 
y? 0<y<l y O0<y<l 
(a, b) = (4,4), FQ) = l | € y <3, g(x) as given in (a, b) = (4,4), f(y) = | l l<y <3, 
(4—y) 3<y<4 (4—-y? 3zyz4 
Exercise B17, Section 26.1, and G(x) as given in Exercise B18, y! 0xy«l - . . pE - 
Section 26.2. Obtain the solution surface, the level curves, and the PO) = 1 " 1 <y <3, and G(x) as given in Exercise B22, 
: 3 E (4—»* 3<y<4 
flow lines. Compute the flux of Vu through the boundary of the Section 26.2. Obtain the solution surface, the level curves, and the 
rectangle. flow lines. 
B38. Apply the results of Exercise B11 to the data B40. Apply the results of Exercise B13 to the data 
» zyel . 3 y2- y? 0zxy«l 
(a, b) = (4,4), fO) = | l | € y <3, g(x) as given in (a, b) = (4,4), fO) = 1 l<y<3, 
=f Jeys4 (y-2)(4-y) 3<y<4 
Exercise B19, Section 26.1, and G(x) as given in Exercise B20, 3 O<y<l 
Section 26.2. Obtain the solution surface, the level curves, and the F(y) =} 0 1<y <3, and g(x) as given in Exercise B21, 
flow lines. Compute the flux of Vu through the boundary of the ] -2 SSPE ' . 
resctarele: Section 26.1. Obtain the solution surface, the level curves, and the 
E flow lines. Compute the flux of Vu through the boundary of the 
rectangle. 
. . . . > . 
Finite-Difference Solution of Laplace's Equation 
in a Rectangle 
Dirichlet Problem on a Rectangle 
y In accord with Figure 26.18, we derive a finite-difference solution of the Dirichlet problem 
consisting of Laplace’s equation in the rectangle 0 < x < a,0 < y < b and the (nonhomo- 
u(x, P) = GG). (a,b) geneous) Dirichlet boundary conditions u(0, y) = f (y), u(a, y) = F (y), u(x, 0) = g(x), 


u(x, b) = G(x). 


u(0, y) = f(y) u(a, y) = F(y) 


, Discretization 
O u(x, 0) = g(x) 
First, define a grid on the rectangle. Let the x-interval [0, a] be divided by the N + 1 points 


FIGURE 26.18 Dirichlet problem on a : ; ub 
3 % = nAxn = 0, hers N, into N equal subintervals of length Ax = 5. Similarly, 


rectangle where all four edges support á . Sr 

nonhomogeneous Dirichlet conditions discretize the y-interval [0, b] with the partition ym = mAy, m = 0,1,..., M, where 
Ay = 2. Let u (Xn, Ym) be the exact value of the solution at the point (Xn, Ym). Let Vn,m 
be the numeric approximation to that exact value, obtained by replacing wu, (x,, Ym) and 
Uy (X5, Ym) With the second-order central-difference formulas 
Les (Xn, Ym) = Vnt, m — 2Un.m + Un—lan and uw, Yr) Vn,m+1 — 2Un. m + Vn,m-1 

Xx Nn» Ym T yy Vn» Ym =e 
: A : í (Ax)? ds (Ay)? 
TE E EE ee (26.13) 


in Laplace's equation, giving 


Un--1,m — 2 isa T Us l,m Un,m+1 — QU yim F Vn,m—1 


"wm — - - 26.14 
9 Yn (AxY? T (Ay)? ( ) 


Figure 26.19 shows the computational *molecule" expressing the discretized Laplacian 
at each interior node (Xn, Ym), 1 <n < N —1, 1 € m < M — 1. The open dots represent 
: unknown values of v. At each node, the equation to be formed is the sum of the "north, 

E Xn Xl east, south, and west” nodal values minus four times the value at that node. There are no 
FIGURE 26.19 Computational molecule “Known values” in the interior of the rectangle! All the N; x M; = (N — 1) x (M — 1) nodal 
for Laplace's equation equations are coupled. Boundary data is propagated to the interior through the interlocking 


EXAMPLE 26.6 


FIGURE 26.20 Boundary functions for 
Example 26.6 
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of these nodal equations, and a fine mesh generates large systems of algebraic equations 
whose solutions often require sophisticated techniques from numerical linear algebra rather 
than from the theory of partial differential equations. 


For simplicity, takea = b = 1, N = M = 5sothat Ax = Ay = i. Then define the boundary 
functions f(y) = y(1 — y), F(y) = sinzy, g(x) = sin 27x, and G(x) = x(x — 1). Figure 
26.20 shows these functions and their relative orientation on the square. 

The grid imposed on the rectangle contains six rows of six nodes, for a total of 36 
nodes. There are N; x M; = (N — 1) x (M — 1) = 16 interior unknown values to compute, 
so we will need to formulate and solve a system of 16 equations in 16 unknowns. Rather 
than work with doubly indexed variables, label the unknowns according the pattern shown 
in the schematic in Figure 26.21, where the letter b indicates a value determined from a 
boundary function. 


b b b b b b 
b Vj v2 V3 U4 b 
b "f Us V6 v7 Ug b 
b Ug vio Uli Ui2 b 
b V13 V14 Uis Ui6 b 
b b b b b b 


FIGURE 26.21 Schematic for the nodal values in 
Example 26.6 


For the grid chosen, the discretized Laplacian becomes 


Un--1,m — 2j m T Vn—1,m + Un.m4-1 T Un,m=1 = 0 (26.15) 
The coordinates at the nodes are (xn, Ym) = (s "1 = ns S) and a mapping from the 
nodal point (x,, Ym) to the corresponding variable v,, s = 1, 2,..., 16, is achieved with 


the help of the function 


s(n, m) =n + (M, —m)N, (26.16) 


where M, = M — 1 and N, = N — 1. The values of (n, m) corresponding to the grid points 
(Xn, Ym) do not readily correlate with (r, c), the row-column indices on a matrix. The index 
n on x, is the “column” index on the rectangle's grid. The index m on ym is the “row” index, 
but in the reverse order, for the rows in the rectangle's grid. Thus, to map the points (xn, Ym) 
to the array of nodal values v;, there must be two “reversals” in the indices. First, the row 
and column indices must be interchanged; then, the column index must run in the opposite 
order. The matrix with entries 


Aj s(j;M—i)—-jc-tG—-D)N -27Z-G-1XN- 1) (26.17) 
is therefore 
1 2 3 4 
5 6 7 8 
9 10 11 12 (26.18) 
13 14 15 16 


Equation (26.15) becomes, at each grid point, 


West + East + North + South — 4v, = 0 


—4 1 0 
1 —4 1 
0 ] —4 
0 0 l 
1 0 0 
0 1 0 
0 0 1 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
TABLE 26.2 


" 0.5 
u 0 
-0.5 
1 
1 
y 
0 0 d 
FIGURE 26.22 Example 26.6: Solution 


surface computed with M = N — 5 
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When West, East, North, or South represent a node on the boundary, the value must 
be obtained from the appropriate function f(y), F(y), G(x), g(x), respectively. Thus, 
formation of the equations for this system requires a distinction between nodes that are next 
to no boundary points, one boundary point, or two boundary points (at the four corners). 
For example, at the point (x4, y4), the variable v4 represents v4 4. The neighbor to the west 
is v3 and to the south is vg. The neighbor to the east is F(y4) and the neighbor to the 
north is G (x4). Code for obtaining the nodal equations is given in the accompanying Maple 


worksheet. 


If the 16 equations are written in the form Av — c, the matrix A containing the coeffi- 
cients of all 16 equations is given in Table 26.2. 


0 1 0 0 0 0 0 0 0 
0 0 1 0 0 0 0 0 0 
1 0 0 1 0 0 0 0 0 
4 0 0 0 I 0 0 0 0 
0 —4 1 0 0 1 0 0 0 
0 1 —4 1 0 0 l 0 0 
0 0 1 —4 1 0 0 1 0 
l 0 0 ] =4 0 0 0 1 
0 1 0 0 0 —4 1 0 0 
0 0 I 0 0 1 —4 1 0 
0 0 0 1 0 0 | —4 I 
0 0 0 0 l 0 0 1 —4 
0 0 0 0 0 1 0 0 0 
0 0 0 0 0 0 1 0 0 
0 0 0 0 0 0 0 1 0 
0 0 0 0 0 0 0 0 1 


Coefficient matrix A for Example 26.6 


The vector c and the solution vector v are 


0 

0.2400000000 

0.2400000000 
—0.4277852520 
—0.2400000000 

0 

0 
—0.9510565160 
—0.2400000000 

0 

0 
—0.9510565160 
—1.111056516 
—0.5877852520 

0.5877852520 

0.3632712640 


oorerlccoorcoogoo 6 © oo & 
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0.04610335322 
0.00533911906 
0.05477087277 
0.2337890290 
0.1790742938 
0.1604822503 
0.2199553429 
0.4525999913 
0.2697115717 
0.2375602453 
0.2119682571 
0.4055990772 
0.4222117474 
0.3080789020 
—0.01524163722 
0.00677154400 


A graph of the solution surface appears in Figure 26.22. 


(26.19) 
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FIGURE 26.23 Example 26.6: Contours 
generated by a5 x 5 grid 
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OBSERVATIONS AND COMMENTS The matrix A is very regular and very sparse. It is regular 
because it is essentially banded and sparse because it consists mostly of zeros. Thus, it could 
have been constructed without ever writing a single nodal equation. Deducing the pattern is 
left to the exercises. By the same token, deducing the pattern for the vector c in the system 
Av — c is also left to the exercises. 

Banded matrices can be stored as lists of diagonal elements. Diagonals of zeros need 
not be stored. Arithmetic consisting of adding, subtracting, and multiplying zeros can also 
be avoided by special algorithms for solving systems with banded matrices. Thus, the effort 
it took to organize the variables and establish patterns makes it possible to solve much larger 
problems. These matters are typically dealt with in texts on numerical linear algebra. 


Contours Figure 26.23 is a contour plot obtained from the data upon which Figure 26.22 
is based. The contours are not smooth because the grid was a course 5 x 5. If N and M are 
both increased to 20, there will be 361 equations in 361 unknowns to solve, a task taking 
several minutes to complete. The resulting solution surface, pleasant to view, is given in 


. . . *. 
Figure 26.24. Figure 26.25 contains a smoother contour plot. kd 


© 


AR: 


FIGURE 26.24 FIGURE 26.25 Example 26 
Example 26.6: Solution Contours generated by a 20 x 3 
surface generated on a grid 


20 x 20 grid 


A1. Show that for equal grid spacing (Ax = Ay), (26.14) becomes evaluated. Each such interior node becomes an unknown in the 


(26.15). 


A2. Obtain the analog of the array in Figure 26.21 when N = M = 6. 
A3. Show that (26.16) correctly maps v, ,, to v, when N = M = 6. 


A4. If N = M = 6, show that (26.17) correctly maps v, toa 5 x 5 
matrix analogous to the array in (26.18). 


AS. Modify the finite-difference scheme for the Dirichlet problem to 
account for homogeneous Neumann conditions. For example, 


problem, and function values at nodes outside the rectangle are 
replaced by function values along the line x = h. 


A6. In Figure 26.18, replace the Dirichlet condition on the right edge 
with a homogeneous Neumann condition. Obtain a finite- 
difference algorithm for the resulting B VP. 


A7. In Figure 26.18, replace the Dirichlet condition on the top edge 
with a homogeneous Neumann condition. Obtain a finite- 
difference algorithm for the resulting B VP. 


suppose :, (0, y) = 0 is imposed on the left edge of the rectangle 


in Figure 26.18. The O(h?) central-difference approximation 


A8. In Figure 26.18, replace the Dirichlet condition on the bottom edge 


L (u(0 +h, y) — u(0 — h, y)) = O leads to u(—h, y) = u(h, y). with a homogeneous Neumann condition. Obtain a finite- 


For each interior node along the edge x = 0, the Laplacian is 


difference algorithm for the resulting BVP. 
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B1. In Figure 26.18, replace the Dirichlet conditions on the top and 
bottom edges with homogeneous Neumann conditions. Obtain a 
finite-difference algorithm for the resulting B VP. 


B2. In Figure 26.18, replace the Dirichlet conditions on the bottom 
and right edges with homogeneous Neumann conditions. Obtain a 
finite-difference algorithm for the resulting B VP. 


B3. In Figure 26.18, replace the Dirichlet conditions on the top and 
right edges with homogeneous Neumann conditions. Obtain a 
finite-difference algorithm for the resulting BVP. 


B4. In Figure 26.18, replace the Dirichlet conditions on the left and 
bottom edges with homogeneous Neumann conditions. Obtain a 
finite-difference algorithm for the resulting B VP. 

B5. In Figure 26.18, replace the Dirichlet conditions on the left and 
top edges with homogeneous Neumann conditions. Obtain a 
finite-difference algorithm for the resulting BVP. 


In Exercises B6—10, solve the indicated BVP using finite differences. 
Take N = M = 5, and plot the solution surface and the level curves. 
Compare to the analytic solution found in Section 26.3. 

B6. Exercise B14, Section 26.3 

B7. Exercise B15, Section 26.3 

B8. Exercise B16, Section 26.3 

B9. Exercise B17, Section 26.3 
B10. Exercise B18, Section 26.3 
B11. Deduce the pattern of entries in the matrix shown in Table 26.2, 


verifying the deductions by comparing their consequences to the 
coefficient matrices obtained in any of Exercises B6-10. 


B12. Deduce the pattern of entries in the vector c found in (26.19), 
verifying the deductions by comparing their consequences to the 


corresponding vectors obtained in any of Exercises B6-10. 


In Exercises B13—-17, solve the indicated BVP using finite differences. 
Take N = M = 10, and plot the solution surface and the level curves. 
Compare to the analytic solution found in Section 26.3. 

B13. Exercise B19, Section 26.3 B14. Exercise B20, Section 26.3 
B15. Exercise B21, Section 26.3 B16. Exercise B22, Section 26.3 
B17. Exercise B23, Section 26.3 

In Exercises B18 and 19, solve the indicated BVP using finite differences. 


Take N = M = 20, and plot the solution surface and level curves. Com- 
pare to the analytic solution found in Section 26.3. 


B18. Exercise B24, Section 26.3 B19. Exercise B25, Section 26.3 


In Exercises B20 and 21, use the results in Exercise A5 to solve the 
indicated BVP by finite differences. Take N = M = 15, and plot the so- 
lution surface and level curves. Compare to the analytic solution found 
in Section 26.3. 


B20. Exercise B26, Section 26.3 B21. Exercise B27, Section 26.3 


In Exercises B22 and 23, use the results in Exercise A6 to solve the 
indicated BVP by finite differences. Take N = M = 15, and plot the so- 
lution surface and level curves. Compare to the analytic solution found 
in Section 26.3. 


B22. Exercise B28, Section 26.3 B23. Exercise B29, Section 26.3 


B24. Use the results in Exercise A7 to solve Exercise B30, Section 
26,3, by finite differences. Take N = M = 10, and plot the 
solution surface and level curves. Compare to the analytic 
solution found in Section 26.3. 


B25. Use the results in Exercise A8 to solve Exercise B31, Section 
26.3, by finite differences. Take N = M = 12, and plot the 
solution surface and level curves. Compare to the analytic 


solution found in Section 26.3. 


B26. Use the results in Exercise B1 to solve Exercise B32, Section 
26.3, by finite differences. Take N = M = 20, and plot the 
solution surface and level curves. Compare to the analytic 


solution found in Section 26.3. 


B27. Use the results in Exercise B2 to solve Exercise B33, Section 
26.3, by finite differences. Take N = M = 10, and plot the 
solution surface and level curves. Compare to the analytic 


solution found in Section 26.3. 


B28. Use the results in Exercise B3 to solve Exercise B34, Section 
26.3, by finite differences. Take N = M = 15, and plot the 
solution surface and level curves. Compare to the analytic 


solution found in Section 26.3. 


B29. Use the results in Exercise B4 to solve Exercise B35, Section 
26.3, by finite differences. Take N — M — 12, and plot the 
solution surface and level curves. Compare to the analytic 


solution found in Section 26.3. 


B30. Use the results in Exercise B5 to solve Exercise B36, Section 
26.3, by finite differences. Take N = M = 10, and plot the 
solution surface and level curves. Compare to the analytic 


solution found in Section 26.3. 


B31. Obtain a finite-difference solution for the BVP in Exercise B37, 
Section 26.3. Take N — M — 15, and plot the solution surface 
and level curves. Compare to the analytic solution found in 


Section 26.3. 


Obtain a finite-difference solution for the BVP in Exercise B38, 
Section 26.3. Take N = M = 15, and plot the solution surface 
and level curves. Compare to the analytic solution found in 
Section 26.3. 

Obtain a finite-difference solution for the BVP in Exercise B39, 
Section 26.3. Take N — M — 20, and plot the solution surface 


and level curves: Compare to the analytic solution found in 
Section 26.3. 


B32. 


B33. 


B34. 


Obtain a finite-difference solution for the BVP in Exercise B40, 
Section 26.3. Take N — M — 20, and plot the solution surface 
and level curves. Compare to the analytic solution found in 
Section 26.3. 


26.4 Finite-Difference Solution of Laplace's Equation in a Rectangle 


Chapter Review 


1. The Dirichlet problem for a rectangle consists of Laplace's 
equation V?u = 0 in the rectangle and the specification of u on the 
boundary of the rectangle. Write the solution for the Dirichlet 
problem on a rectangle that has one corner at the origin of the 
X y-plane and the opposite corner at the point (a, b). On the bottom 
edge, u is g(x); and on the other three edges, it is zero. 


2. Write the solution for the Dirichlet problem on the rectangle of 
Question 1 if u is G(x) on the top edge and is zero on the other 
three edges. 


3. Write the solution for the Dirichlet problem on the rectangle of 
Question 1 if u is f (y) on the left edge and is zero on the other 
three edges. 


4. Write the solution for the Dirichlet problem on the rectangle of 
Question 1 if u is F(y) on the right edge and is zero on the other 
three edges. 

5. Show how to use the results of Questions 1—4 to solve the Dirichlet 
problem on the same rectangle if the boundary conditions 
u(x, 0) = g(x), u(x, b) = G(x), u(0, y) = f(y), and 
u(a, y) = F(y) are imposed. 

6. Detail the separation of variables process by which the solution 
stated in Question 1 is obtained. 


10. 


11. 


12. 
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. Detail the separation of variables process by which the solution 


stated in Question 2 is obtained. 


. Detail the separation of variables process by which the solution 


stated in Question 3 is obtained. 


. Detail the separation of variables process by which the solution 


stated in Question 4 is obtained. 


Obtain the separation of variables solution for Laplace's equation 
on the rectangle of Question 1, if the conditions u, (a, y) = 

ux(b, y) = 0 are imposed on the left and right edges, u(x, b) = 0 
is imposed on the top edge, and u(x, 0) = f(x) is imposed on the 
bottom edge. 


Obtain the separation of variables solution for Laplace's equation 
on the rectangle of Question 1, if, on the left edge u satisfies the 
homogeneous Neumann condition u, (0, y) = 0, on the bottom 
edge it satisfies the nonhomogeneous Dirichlet condition 

u(x, 0) = f (x), and on the other two edges it is zero. 

Obtain the solution for the BVP described in Question 11 if 

(a, b) = Gr, 1) and f(x) = x(a — x). Obtain a plot of the level 
curves of u(x, y). 
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Chapter 27 


Nonhomogeneous Boundary 
Value Problems 


INTRODUCTION The nonhomogeneous Dirichlet condition in either the heat 
or wave equation poses a severe challenge for the method of separation of variables. One of 
the ODEs generated by separating variables must have two boundary conditions to become 
a Sturm-Liouville eigenvalue problem. Unless this happens, there can be no solution in 
terms of eigenfunctions. 

A thermal transfer problem in a rod with one end subject to a nonhomogeneous but 
constant-valued Dirichlet condition is readily solved analytically by superposition. The 
desired solution is a sum of two parts, one of which satisfies a BVP with homogeneous 
Dirichlet conditions. 

However, the BVP governing heat transfer in the wall of a house whose interior is 
air-conditioned and whose exterior is subjected to the time-varying temperatures of the 
daily heating-cooling cycle of a Midwestern summer can only be solved analytically by a 
significant extension of the process of separating variables. 

By superposition, the BVP must be split into two problems, one of which has homoge- 
neous Dirichlet conditions. This problem will lead to a Sturm-Liouville eigenvalue problem 
that has a full set of eigenfunctions for building a series solution. However, the PDE for this 
problem is now the nonhomogeneous heat equation whose solution can be given only as 
an eigenfunction expansion with time-dependent coefficients. Thus, the nonhomogeneity 
in the boundary data is exchanged for a nonhomogeneity in the PDE, an exchange resulting 
in a much more difficult solution process for the PDE. 

We do discover, however, that while the temperatures outside the house vary sinu- 
soidally during the course of the daily cycle, the wall retains a residual heat content and its 
temperature profile varies in a decidedly nonlinear way. We even discover how the solution 
depends on the thermal diffusivity. Although we could have obtained these insights with a 
numerical solution of this BVP, there is merit in exposure to the strengths and weaknesses 
of analytic and numeric techniques. 
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One-Dimensional Heat Equation with Different 
Endpoint Temperatures 


Problem Statement 


If the boundary conditions in a boundary value problem are not homogeneous, the method 
of separation of variables cannot be used without modification. Consider one-dimensional 
heat flow in an insulated rod with left end at temperature zero but right end at some nonzero, 
but constant, temperature @. In particular, consider the boundary value problem 
thy = d iL: u(0,1) =O 
. and (27.1) 
u(x, 0) = f(x) u(L,th=¢ 
Separation of variables fails, not because of the differential equation but because of 
the boundary conditions. Separation of the partial differential equation, as we have seen 
earlier, leads, as expected, to the ODEs X"(x) — AX (x) = 0 and T’(t) — AkT(t) = 0. 
However, trouble arises when separating the data. The homogeneous boundary condition 
on the left leads to a conclusion since u(0,t) = 0 => X(0)T(t) = 0 > X(0) = 0. No 
conclusion can be drawn from the nonhomogeneous boundary condition on the right since 
u(L,t) — $ => X(L)T(t) = $ x: 0. We no longer can conclude that X (L) = 0, so there is 
no Sturm-Liouville boundary value problem for determining the eigenvalues A. Separation 
of variables fails. 


Homogenizing Substitution 


We consider the substitution u(x, t) = v(x, t) + w(x) in an attempt to reformulate (27.1) 
as a BVP with homogeneous boundary conditions. Applied to the heat equation, we obtain 
v = k(vy, + V^). Demanding yY” = 0 restores this differential equation to the simple 
form of the heat equation. Applying the endpoint conditions to the hypothesized solution 
u(x,t) = v(x,t) + w(x) leads to 
v(0,t) - v(0) 20 and v(L,t)+4Y(L)=¢ 
Now, if we demand that v/(0) = 0 and V (L) = $, then v(0, t) = 0 and v(L, t) = 0. 
Thus, if we demand y” = 0, along with V/(0) = 0 and v (L) = $, then v(x, t) satis- 
fies the homogeneous heat equation with homogeneous boundary conditions. The initial 
condition v(x, t) must now satisfy is v(x, 0) = f(x) — v (x), since 
u(x,0) = f(x) > v(x,0) + W(x) = f(x) > v(x, 0) = f(x) — v(x) 
If we can find such a function w(x), then v(x, t) satisfies the homogeneous BVP 
v (x, t) = kuy.(x, t) v(0, t) = 0 
an 
v(x,0) = f(x) — w(x) v(L,t) =0 
and the solution to (27.1) will be u(x, t) = v(x, t) + Y (x). 
A simple integration gives V (x) = a + bx, but the conditions y(0) = 0 and w(L) = 
$ determine a and b so that W(x) = ox, We can now solve for v(x, t), obtaining 


co 
Q /NTX\ _. : 
vee, = >" By sin (—)e K(nx/L)*t 


2 


[uc — V G)]sin Z2 ax 
LJ, US x sin- xX 


bn = 
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EXAMPLE 27.1 


u 


\ 
bi 


j 


e 


FIGURE 27.1 Solution surface for 
Example 27.1 


EXERCISES 27.1 


and consequently, u(x, t) = v(x, t) + v (x). Since v(x, t) tends to zero for large values of 
t, the steady-state solution is uo; = v (x) = $x, 


Consider a rod of length zr, with left end held at temperature zero and right end maintained 
at a temperature of 10°. The thermal diffusivity is k = P and the initial temperature profile 
is f (x) 2 x(x — x). 

From the preceding calculations, we find w(x) = ox = Wx, then write u(x,t) = 
10 


v(x, t) + zx, and solve for v(x, t) by computing the Fourier coefficients for the function 
F(x) = f@) -—v@) =x —-x)- Dy, We get 
2 10 . 4 j 
by = zf x(Gr — x)——x | sinnx dx -—A(l + (-1)"(5n* — 1) (27.2) 
m Jo 1 zn 


coefficients that are O( 1) and therefore slowly decaying. 


è 3 " aay . " 
Taking the partial sum vso(x, f) = dent b, sin(nx)e ^" '? as an approximation to 


v(x, t), we then have uso = v30 + Dy as an approximation to the solution u(x, t). Figure 
27.1 shows this approximate solution surface. The temperature is initially discontinuous at 
X = 7, but that discontinuity is immediately smoothed out by heat flowing into the rod 
from the heated right end. 

Progress to the ultimate steady state of a linear temperature distribution across the rod 
can be better seen via plane sections t = c. Figure 27.2 contains the plane sections t = 0, 
0.01, and 0.1. The approximate solution exhibits the Gibbs phenomenon at x = x because 
of the discontinuity in the initial temperatures there. Immediately after, the solution begins 
smoothing out, the steady state being the linear temperature profile uso = Dy, The pro- 


gression to equilibrium can be seen as an animation in the accompanying Maple worksheet. 
e. 
v 


(a) (b) (c) 


FIGURE 27.2 Example 27.1: At times t = 0, 0.01, and 0.1, plane 
sections determined by a partial sum of the series solution 


1. Verify the calculations in (27.2). 


(c) Graph u(s, t). 


2. Demonstrate graphically that 5, in (27.2) is indeed O( i ). (d) Obtain and graph the steady-state solution. 


In Exercises 3-7: 


(a) Obtain an analytic solution of the BVP (27.1). 


(b) Graph the solution surface. 


(e) Animate the temperature profiles as they change in time. 


(f) Obtain a finite-difference solution via the scheme of Section 
25.4. Compare the numerical solution with the exact solution. 
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3.L—m,k-—2,0—1,f(x) =sinx (d) Obtain and graph the steady-state solution. 
4. L=3,k = 2 ¢=25, f(x) = 2x3 (e) Animate the temperature profiles as they change in time. 
5. L =10,« 242,0 275, f(x) = ax (f) Obtain a finite-difference solution via the scheme of Section 
6. 33a m dies 50, Fes 2g 25.4. Compare the numerical solution with the exact solution. 
7. L = lk 25,0 = 30, f(x) = 30x" 9. bed ea%e =i, Ao = £ 
8. Obtain an analytic solution of the BVP u, = ku,,, u(0, t) =0, 50 m 
u(L,t) = 0, u(x, 0) = f(x). 10, L = 15, = 2,0 = 100, f(x) = 100 (1 E ay 
In Exercises 9-13, the given data specifies a BVP of the type solved in 11, L = 4.x =3.0 = 12, fœ) = 3(16 — x2) 
Exercise 8. For each: -— 
(a) Use the results of Exercise 8 to solve the resulting BVP. 12. L =5,« = 43,0 = —1, f(x) = (=) =f 
(b) Graph the solution surface. 13, beans 1, o = 15, f(x) = ig — x4) 


(c) Graph u(, t). 


0 10 20 30 40 50 


FIGURE 27.3 Graph of $ (t), the 
time-varying temperature on the outer wall 
for the BVP in Table 27.1 


One-Dimensional Heat Equation with Time-Varying 
Endpoint Temperatures 


Problem Formulation 


We will model the time-varying temperature profile within the wall of a mid-western house 
during the summer air-conditioning season. The wall has thickness L = x and is insulated. 
Since the wall of a frame house is approximately 6-in thick, our units of length are each 
about 2 in. Our coordinate system (an x-axis) has its origin on the surface of the wall inside 
the house and extends into the wall. The outside surface of the wall (the part receiving the 
beating rays of the sun) is located at x — 7r. 

The surface of the wall facing the living quarters is maintained at 70?F, and we take this 
temperature as the reference temperature u(0, t) = 0. The time-varying temperature of the 
outside wall is modeled as (t) = 15(1 + sin 751), graphed in Figure 27.3. This represents 
a sinusoidal variation over a 24-hr period, with a maximum of 30 and a minimum of 0. That 
range corresponds to a mid-day temperature of 100°F and a night-time low of 70°F. 

A boundary value problem governing this physical system is given in Table 27.1. The 
initial condition suggests that at time 7 = 0 the air-conditioner is turned on after the house 
and its walls heated up to the maximum outside temperature during, say, a power outage. 
We are also assuming that as soon as the air-conditioner is turned on, the surface of the wall 
inside the house is instantly at 70?F. 


u;(x,f) = kuyy(x, t) . u(0,t) =0 


an Hu = m3 
u(x,0) = 30 ul, t) — $(t) = 15(1 + sin =) 


TABLE 27.1 BVP governing time-varying temperatures in a wall 


Solution 


The time-varying endpoint temperature at the right end leads to a much more complex 
solution than the nonhomogeneous, but constant, Dirichlet condition generated in Section 
27.1. The solution to the BVP in Table 27.1 is obtained by executing, in the order given, the 
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calculations in Table 27.2. After implementing this solution in Example 27.2 and exploring 
its implications, we will derive it in the last part of this section. 


x 15 
(1) F@) = 30 $(0) = — (2x — x) 
T uz 
2 f" 30 
(23) b, =f F(x) sinnx dx = — (2 — (—1)") 
7 Jo zn 


(3 G(x.t) ~ $'(t) : a 
S X, = => X COS 
a m g 53 


= : 5 uz 
(4) G,(t) = i G(x, t)sinnx dx = —(—1)" cos —t 
0 


2n 12 


LEES 


30(—1)"(12«n? cos St + x sin St — I2kn?e7*" !) 


(144«?n* + x?)n 


t 
(5) Ant) = f G, (sje "" €79) ds = 
0 


(6) v(x, t) — >. A, (t) sinnx + 5 sin(nx)e *""! 


n=1 n=) 


(7) u(x,t) = v(x,t)+ Tq) 
T 


TABLE 27.2 Calculations which solve BVP in Table 27.1 


EXAMPLE 27.2 If we take x = i execute the calculations in Table 27.2, and then approximate the solution 
u=v-+=(t) with 


10 9 


— >, A, (f) sinnx + b» b, sin(nx)e *"" + —9(t) (27.3) 


n=1 n=1 


we get, in Figure 27.4, the surface plot for 0.1 < t < 5. Even though the graph starts six 
minutes into the first hour, there is still rippling in the surface initially because of the slow 
convergence of the series solution. 

Looking beyond the transient phase of this thermal process, a graph starting after the 
second day and extending for two days is then given in Figure 27.5. The temperatures 


FIGURE 27.4 Example 27.2: Approximate FIGURE 27.5 Example 27.2: Solution surface 
solution surface for 0.1 <t <5 for 48 « t « 96 
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(a) 


(b) 


104- 


05123 
(c) 


FIGURE 27.6 Plane sections at times 
t = 48, 63, and 96 hours 


inside the wall rise and fall in step with the variation of the outdoor temperatures, but in 
diminishing proportions. 

The temperature profiles ¢ = c are not linear, as Figure 27.6 attests. It depicts plane 
sections at £ = 48, 63, and 93 hours, frames from a complete animation included in the 
accompanying Maple worksheet. The temperature profiles do not simply rise and fall lin- 
early but undergo a decidedly nonlinear variation. It turns out that at the coolest part of the 


outdoor cycle, t = 18 + 24k, k = 0, 1. .... the temperature in the wall never goes to zero. 
There is always some residual heat trapped in the wall. $ 
Derivation 


Given the nonhomogeneous boundary value problem 


u;(x, t) = kuyy(x, t) u(0, t) = do(t) 
and 
u(x,0) — f(x) u(L,t) = $(t) 
define the functions 
" 


V (x, t) = polt) + AVI —@o(t)] and G(x,t) = —w,(x,t) 
Let v(x, t) be the solution of the boundary value problem 
v (X, f) = ku. (x, £) + G(x, f) v(0,1) 20 
and 
v(x,0) = f(x) — v(x,0) = F(x) v(L,t) 20 


If u(x, t) is defined by u(x, t) = v(x, t) + Y (x, t), then u(x, t) satisfies the original nonho- 
mogeneous boundary value problem. 

Before investigating how to find v(x, t), the solution to a nonhomogeneous partial 
differential equation, we verify the claims made about the utility of w(x, t) and G(x, t). 
Since v(0, t) = 0 and 4 (0, t) = $o(t), we clearly have u(0, t) = $o(t). Similarly, since 
v(L, t) = 0 and V(L,t) = $i(t), we clearly have u(L, t) = d (t). Finally, if 

v(x,0) = f(x)  v(x,O) and u(x,t) 2 v(x,t) 4- wv, tf) 


then u(x, 0) = v(x,0) + v(x,0) = f(x) — v(x,0) + W(x, 0) = f(x). 
To verify that v(x, t) should satisfy the partial differential equation 


v (x, t) = ku. (x, t) + G(x, f) = kv. (x, t) — vix, t) (27.4) 
define u(x, t) = v(x, f) + V (x, t) and compute u, = ku, obtaining 
V; + V, = K(Vyx + V) 
Moving y; (x, t) from the left side to the right yields 
Vp = K(Uxx + Wax) — Vi 


Noting that y(x,t) = do(t) + ¢[di() — $o(1)] depends linearly on x, we realize that 
Wr (x,t) = 0. Hence, the partial differential equation that v(x, t) must satisfy becomes 
Up = KUxy — Wr. 

Now we face the serious challenge of solving this nonhomogeneous partial differential 
equation for which separation of variables fails. Were v(x, t) to satisfy the homogeneous 
heat equation, we could immediately write 


oo 
QO(hAXXN _, i 
vx, t) 2 Y b, sin (7 Je «(nz /Lyt 


n=0 
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EXERCISES 27.2—Part A 


Hence, for the nonhomogeneous equation, we are moved to seek a solution of the form 


oo 
tt) = pj» B, (t) sin = 


n-l 


This will require that G(x, t) = — y(x, t) also be expanded in an eigenfunction expansion 
of the form 
= > MTX 2 p . AIX 
G(x,t) — > G,(t) sin “> where G, (ft) = L [ G(x, t) sin | dx (27.5) 


nal 


oo 


na} Bn(t) sinA4x 


To compute the coefficients B, (1), set A, = "and substitute v = Py 


into the differential equation on the left in (27.4), obtaining 
XO (B. (0 + KAB, (t) — Gn(t)) sin Anx = 0 


n=1 
from which the differential equations 
Bi (t)+«d2B,(t)=G,(t) n=1,2,... (27.6) 


follow. These first-order linear equations are readily solved for 
t 
B,(t) = em | e" G, (u) du + e^! b, (27.7) 
0 


the additive constant of integration having been chosen so that at t = 0, B, (0) = dy. 
In Table 27.2, we wrote this coefficient in the form 


t 
B, (t) = i Gn [jg et 9 ds + bye F^» 
0 


giving 
oo 


v(x,t)-— ». | 


n=1 


t 
| G,(s)e en" ds + d sin A,x 
0 


Since v(x, 0) — F(x), we then find 


[oe] 


0 
F(x) = >, p G,(s)e *»C9 ds + be! sin A,X 
0 


n=1 
E: = nx 
= uU -b,]sinA,x = >, b, sin L 
n-l n=l 
Thus, the b, must be the Fourier sine series coefficients for F (x) and are thus given by 


o rnb . nx 
ba = = F (x) sin — dx 
L Jo L 


Al. Verify the results in (27.6). 
A2. Verify the results in (27.7). 


A3. Obtain an analytic solution of the BVP u, = ku, u(0,t) = o (t), 
u(L,t) —0,u(x, 0) = f(x). 
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EXERCISES 27.2—Part B 
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B1. Execute the calculations in Table 27.2 to obtain (27.3). 


B2. Use (27.5) to obtain the eigenfunction expansion of p(x, t) — 
x(a — x)e "' onO < x < z. Use a partial sum and a three- 
dimensional graph to demonstrate the validity of the expansion. 


In Exercises B3-7: 
(a) Obtain an analytic solution of the BVP u, = ku, 
u(0, t) = 0, u(L, t) = ġı (t), u(x, 0) = f(x). 
(b) Graph the solution surface. 
(c) Graph ul% t) 
(d) Animate the temperature profiles as they change in time. 


(e) Obtain a finite-difference solution via the scheme of Section 


25.4. Compare the numerical solution with the exact solution. 

X 

B3. L =m k =2,,(t) — cost, f(x) = — 
T 


B4. L =5,k = =, pilt) = 3cos? t, f(x) = psit 


BS. L —3,k = V2, ¢,(t) = 5(1— e^), f(x) = xB — x) 
Chapter Review 


1. Given the BVP consisting of the one-dimensional heat equation, the 
endpoint conditions u(0, t) = A, u(L, t) = 0, and the initial 
condition u(x, 0) = f (x), demonstrate how to use the substitution 
u(x,t) = v(x, t) + V (x) to convert it to one with homogeneous 
boundary conditions. 


N 


. Obtain the separation of variables solution for the BVP in Question 1 
if A = 10, L = 1, k = 4, and f(x) = 10(x — 1). 


3. Solve the one-dimensional heat equation on the interval 0 < x < L 
if u(0, t) = A, u(L, t) = B, and u(x, O) = f(x). 


B6.L—-lk-i 
B7. L=4,k = 1 


=> Pil (t) = sin 24t, f (x) — x(1 — xy 
i(t) = 2te 5, f(x) 2 x(4 — xy? 


10* 


In Exercises B8-12: 


(a) Using the results of Exercise A3, solve the BVP u, = ku, 
u(0, t) = do(t), u(L, t) 20,u(x, 0) = f(x). 


(b) Graph the solution surface. 
(c) Graph u(£, t). 
(d) Animate the temperature profiles as they change in time. 


(e) Obtain a finite-difference solution via the scheme of Section 
25.4. Compare the numerical solution with the exact solution. 


L. = 7, = =h polt) = sint, f(x) = x?(z — x) 
B9. L = 3,k = 3, holt) = 2sin?2t, f(x) = x (8 — xy? 
B10. L = 10, « = 3, p(t) = 4(1 — e^), f( (x) = Ssin =x 
B11. L =1,« = 15. do(t) = 1 + cos2t, f(x) = 2(1 — x5) 
B12. L = 4, « = V2, polt) = 3e9"*, f(x) = $(4 x) 
4. Solve the one-dimensional heat equation on the interval 0 < x < L 


5. 


if u, (0, t) = A,u(L,t) = 0, and u(x, 0) = f(x). 

Given the BVP consisting of the one-dimensional heat equation, the 
endpoint conditions u(0, t) = $o(t), u(L, t) = ġı (t), and the initial 
condition u(x, 0) — f(x), show p the substitution u(x,t) — 
v(x, t) + W(x, t), where V (x, t) = do(t) + FIG — $o(10)]. 
converts it to a new BVP with homogeneous boundary conditions, 
V; (x, t), and the 


the nonhomogeneous PDE v; (x, t) = kv (x, t) — 
new initial condition v(x, 0) = f(x) — v (x, 0). 
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Chapter 28 


Time-Dependent Problems 
in Two Spatial Dimensions 


INTRODUCTION The wave and heat equations are evolution equations for 
which one independent variable is time. So far, we have solved BVPs for these equations 
in which there has been but a single spatial variable. In this chapter we consider problems 
with three independent variables, time, and two spatial variables. 

The wave equation in two dimensions is most easily solved on a rectangle. The BVP 
consisting of the wave equation on a rectangle with homogeneous Dirichlet conditions 
on the edges models the vibrations in a rectangular plate with clamped edges. Thus, the 
oscillations in a plate in a ship's hull, in a window in a sky scraper, or in a panel in an 
aircraft's wing are all examples of physical systems governed by the two-dimensional wave 
equation. Surprisingly, where the vibrating string can support nodes, that is, points that 
remain at rest throughout the motion, the plate can exhibit nodal curves along which no 
motion occurs. 

If these same rectangular plates are the object of thermal processes, then we are inter- 
ested in solving the time-dependent heat equation with two spatial variables. For simplicity, 
we consider only the case of homogeneous Dirichlet conditions. 

For either equation, separation of variables now generates two Sturm—Liouville eigen- 
value problems, and the solution to the original BVPs will be double sums of eigensolutions. 
Hence, to solve these problems, we must develop a theory of two-dimensional Fourier se- 
ries. For the wave equation we discover that there is a doubly indexed set of fundamental 
frequencies, but they are not integer multiples of a smallest frequency. Hence, the oscilla- 
tions of the rectangular plate are not musical, in distinction to the oscillations of the finite 
string. 


Oscillations of a Rectangular Membrane 


Problem Formulation 


A rectangular membrane such as a steel plate in a ship's hull or a plate of glass in a sky- 
scraper's window supports oscillations governed by the two-dimensional wave equation. 
A boundary value problem for the wave equation on a rectangular membrane with all four 
edges clamped consists of the partial differential equation on the left in Table 28.1, the 


u(x, b, t) 2 0 


u(0, y, t) =0 


O u(x0,t0)20 


FIGURE 28.1 Rectangular domain with 
homogeneous Dirichlet conditions on each 
edge 


EXAMPLE 28.1 
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28.1 Oscillations of a Rectangular Membrane 


u(0, y, t) 20 

NN u(x, 0,1) 20 u(x, y, 0) = f(x, y) 

Ut = C (ux Tuy) u(a, y, t) =0 u;(x, y, 0) = g(x, y) 
u(x,b,t) =0 


TABLE 28.1 BVP for the two-dimensional wave equation on a 
rectangular plate with clamped edges 


boundary conditions in the middle, and the initial conditions on the right. Figure 28.1 is an 
icon for this BVP. 


Statement of the Solution 


Taking the initial velocity g(x, y) to be zero and seeking a solution by the method of separ- 
ation of variables, assume u(x, y, t) = X (x)Y (y)T (t). Then, the solution is given by 


oo œœ 7 5 
. NTX . MTY n? m? 
u(x, y, t) — ) ) dim sin — sin cos | czt4/ —5 9 —t 
a b a* b* 
m=1 n=1 
4 5 pa : . AX , MTY 
dum = — f(x, y) sin —— sin dx dy 
ab Jo Jo a b 


where the two-dimensional Fourier series, discussed below, has been used. In the simplest 
case, the rectangle is a square with sides a = b = x, so the solution is 


coo oo 


u(x,y,t)— 5 » dam sin nx sin my cos (cv n? + m?) 


m=1 n=1 


4 wu UT 
— f Í f(x, y) sinnx sin my dx dy 
7T^ Jo Jo 


In either event, several interesting features are exhibited by such solutions of the wave 


dum = 


equation. First, the natural frequencies @pm = 7 T + FT are not integer multiples of a 
smallest fundamental frequency. Hence, the sound made by a vibrating rectangular mem- 
brane is not “musical.” Second, while the vibrating string can exhibit nodal points where 


u = 0, the vibrating membrane can exhibit nodal curves, curves along which u = 0. 


COMPUTING u(x, y, t) Take the rectangle as a square of side a = b = x, the wave speed 
asc = l,and f(x, y) = xy — zx )(y — 7) as the initial displacement function. As an 
initial displacement, f(x, y) represents a symmetric “dimpling up" of the surface, as seen 
in Figure 28.2. The Fourier coefficients are 


(—1)yr^ E (—1)" — 


z2m?n? 


(-—1)" +1 


4 n m 
dnm = — Í Í f(x, y) sinnx sin my dx dy = 2 
7^ Jo Jo 
(28.1) 


To see how many of these coefficients are zero and how big the nonzero coefficients might 
be, the first 25 are arranged in Table 28.2. The coefficients are zero unless both n and m are 
odd integers, in which case it appears that dym = A. 


Some values of c, = Vn? + m? appearing in the function cos(4/n? + m?t) are listed 
in Table 28.3. We see in this table the reason why a drum is not “musical.” Unlike the 
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FIGURE 28.2 Initial displacement function 
for Example 28.1 


n\m m=1 m=2 m= m=4 m=5 
8 8 8 8 
n=1 0 a 0 : 
x^ 27 zx? m^ 
n=2 0 0 0 0 0 
8 8 8 8 8 
n=3 —— 0 — = 0 eee 
271 729 1? 3375 x? 
n=4 0 0 0 0 0 
8 8 0 8 0 8 8 
nz NN a ZR 
i 125 x? 3375 x? 15625 12 
TABLE 28.2 Coefficients dpm in Example 28.1 
n\m m= m = m=3 m=4 m= 
n=1 Jf 2 J/10 J26 /50 V 82 
n=2 V10 A/18 J/34 V58 /90 
n=3 26 V34 V50 J74 106 
n=4 V50 V58 J74 V98 J130 
n=5 J/82 V90 106 J130 V162 


TABLE 28.3 Values of w,,, in Example 28.1 


vibrating string that supports harmonics (frequencies that are multiples of a fundamental 
note), the membrane does not have higher frequencies that are multiples of some lowest 
fundamental frequency. Remarkably, the Caribbean steel drum, hammered out of a 50-gal 
steel drum, actually sounds more musical than would be expected for a vibrating membrane. 
Special shaping and tempering of the steel account for the drum's unique properties. 

Taking the wave speed as c = 1, and noting how quickly the magnitude of the Fourier 
coefficients decreases, we approximate u(x, y, t) with 

10 


10 
8 : : ? ? 
uo(x, y, t) = 5 » ——3—5 Sin nx sin my cos (Vn? + m?t) 
n?m?z* 


m=1 n=1 


Figure 28.3 shows ujo(x, y, 2), the solution surface at time f = 2. 


FIGURE 28.4 Nodal points determined 
by sin x =0 


(a) sinx sin2y + 1 sin 2x sin y — 0 

(b) sinx sin 2y + + sin 2x sin y = 0 
ve 

(c) sinx sin2y + 3sin2xsiny = 0 


(d) sinx sin3y + sin 3x sin y = 0 


TABLE 28.4 Equations that implicitly 
define the nodal curves in Figure 28.5 
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FIGURE 28.3 Example 28.1: Solution surface 
at time f = 2 


Nopat Anatysis_ The vibrating string supports both traveling waves and standing waves. 
The standing wave exhibits nodes, points at which the string is at rest. Such points are found 
as solutions of the equation 


. AX cnzt 
uy,(x,t) = sin u^ cos 


=0 (28.2) 


The points x in [0, L] satisfying this equation for all values of t are solutions of sin^77 = 0, 
and the nodes are therefore solutions of ^74 = kx, k = 0, 1,2, .... Thus, the nodes are lo- 


catedatx — REL. k=0,1,2,...,n.Forexample,if L = 5andn = 7,thenodesareatx = 0, 


2, 2(3), 3(3), 4(3), 5(3), 6(3), 7(3) = 5, as confirmed by Figure 28.4, in which D = 3. 

The situation with the vibrating membrane is more complex. Instead of nodal points, 
there are nodal curves, curves along which it is possible to have no displacement. In fact, 
sand spread on a membrane driven by the vibrations of an acoustic speaker will show the 
patterns of nodal curves. For the present example where a = b = x, the mathematical 


equivalent are nodal curves defined implicitly by the vanishing of an eigenfunction 


Y(n, m) = sinnx sin my 


Each such eigenfunction generates its own nodal curves. Forn zz m the equation y(n, m) = 
0 has solutions x = a, y= kx b Em, osos These are just straight lines parallel to the 
axes. 

However, on the square, two eigenfunctions can have the same frequency. In fact, the 
eigenfunctions 


w(n,m)=sinnxsinmy and w(m,n) = sinmx sinny 
both have the equal frequencies Onm = Onn = VN? +m? = c, so the terms 
dam SIN NX SİN MY COSCOp»mt and dmnn SIN MX SIN NY COS CHyp_t 
can be grouped into the equation 
(œ sin nx sin my + B sin mx sin ny) cos cot = 0 
Since the equation must hold for any time f, we are led to 
a sin nx sin my + B sin mx sinny = 0 
Letting £ = h, we finally get 
sin nx sin my + h sin mx sin ny = 0 


as an equation defining nodal curves for the plate under consideration. 
The nodal curves defined implicitly by the equations in Table 28.4 appear in Figure 
28.5. Figure 28.6 represents the nodal curves y(x) determined by 


sin x sin 3y + h sin 3x sin y = 0 (28.3) 


636 Chapter 28 Time-Dependent Problems in Two Spatial Dimensions 


FIGURE 28.6 Level curves of h(x, y) 
defined implicitly by sin x sin 3y 4- 
h sin 3x sin y = 0 


when values of h are fixed. Alternatively, (28.3) can be interpreted as a definition of the 
implicit function h(x, y) whose level curves are the nodal curves. The accompanying Maple 


worksheet animates a sequence of these curves for 0 < h < 2. d 
BÀ y 
3 3 
2 2 
l l 
X X 
0 | 2 3 v l 2 3 
(a) (b) 
y y 
3 3 
2 2 
1 1 
x X 
0 1 2 3 0 1 2 3 
(c) (d) 
FIGURE 28.5 Nodal curves defined implicitly by the equations in Table 28.4 


Solution by Separation of Variables 


We will next develop the solution of the two-dimensional wave equation by separation of 
variables. To this end, assume u(x, y, t) = X(x)Y(y)T (t) and apply the separation as- 
sumption to the boundary conditions, obtaining 


X(0)Y G)T (t) = X(a)YCy)T (t) = XQ)Y(0)T (t) = Xo)Y(b)T(t) 20 
from which we conclude X (0) = X (a) = Y (0) = Y (b) = 0. In addition, apply the separa- 
tion assumption to the initial velocity condition, finding 
u;(x, y,0) = X()Y(y)T'(0) 209 T'(0) 20 


Apply the separation assumption to the equation itself, divide by c7u(x, y, t), and 
obtain 
T"(t) X'"(x) | Y"(y) 
ETA Xx) + Y (y) 
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Rearrange this to 
T" YY)  X"(x) 
CTA YO) XQ) 


a function of ¢ and y on the left and a function of just x on the right. Hence, each side is a 
constant, say A, so 


(28.4) 


X" (x) T" (t) Y"(y) 


=A and — = =A 
X (x) c*T (t) Y(y) 


From the first equation, the familiar ODE X"(x) — AX (x) = 0 results. From the second, 
obtain 

Y"(y) H T T" (t) 

Y(y) u c?T (t) 


where, on the left we find a function of just y and on the right a function of just t. Hence, 
each side is a constant, say 4, and we have the equations 
Y"(y) T"(t) 


— = and —A+ = 
Yo ^ eT) 


The y-equation becomes the familiar Y"(y) — LY (y) = 0, and the t-equation can be put 
into the form T" (t) — c?(A + x) T(t) = 0. 
The three separated ODEs, with their accompanying conditions, are therefore 


X"(x) — AX (x) 20, X(0) = X(a) 20 
Y"(y) — uY(y) 20, Y(0) = Y(b) 20 
T"(t) — (A -- WT) 30, T (0) 20 


The functions X (x) and Y (y) each satisfy identical Sturm-Liouville boundary value prob- 
lems, problems for which we have already found the solution. The solutions for the eigen- 
functions and eigenvalues are therefore 


. AXX . mmy 
Xn (x) = An sin Ua Yn(y) = By, sin 
ü 
and 
nm \2 mi \2 
An = —(—) Hi asas Ym =- (=) m 535 
a b 


There are two different sets of eigenvalues, each indexed by an integer. As we went from 
one spatial dimension to two, we correspondingly went from one set of eigenvalues to two. 
Finally, we solve the remaining ODE for 7 (t), which now reads 


2 
m 


b2 


T"(t) - cz? (5 + )ro =0 
m 


Were the equation T” + oT = 0, the solution would be 
T = ci cos ot + c» sin wt 
and the condition 7’(0) = 0 would imply c2 = 0 so that T = c; cos wt. Thus, define 


2 2 
n- m~ 
Ong = a n b2 
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and the desired solution becomes 


T, (t) = Cam COS Cj f. = Crm cos | ex cB 
a* b* 
A single eigensolution is the product 

9 ? 

.ORZX . MTY n? m? 

Unm (X, y, t) = dy sin sin cos | cz 4| — + —t 
a b a^ b* 
where danm = AnBmCnm. The general solution is then a linear combination of all such 


eigenfunctions, a double sum over the two indices n and m, so 


nex , m-y n? qm? 
;Yub 3 3 dus sir cos | czt4| — + —t 
b a? p? 


m=1 n=l 


Applying the initial-shape condition yields the equation 


oo oo 
nzx m y 
(x. y) = ) 1,4, Sin —— si : 28.5 
f(x,y) My dum Sin P sin b ( ) 


m=1 n=1 


from which we obtain the constants 


" N LS 
dim = aff fx s) sin - — $1 b r dy (28.6) 
by the usual Fourier techniques. The details are as follows. 


THE Two-DIMENSIONAL FOURIER SERIES The equation (28.5) and the orthogonality of 
the eigenfunctions 


. hx , MTY 
Yam = sin —— sin 
a b 


on the rectangle R = {0 € x < a,0 < y < b} lead to the definition of the Fourier coef- 
ficients dam. The orthogonality of the eigenfunctions is realized in the vanishing of the 
integrals 


b ja br? nux , may . Nax , May 
WanWwo dx dy = sin sin sin sin dx dy 
0 JO 0 J0 a L 


b a b 


when n Æ N,m 4 M, and N and M are integers. When N = n and M = m, the integral 


becomes 
b pa 
. o NTX , , MTY ab 
/ sin“ sin^ dxdy= (28.7) 
0 Jo a b 4 


If (28.5) is multiplied by the eigenfunction yyy and integrated over the rectangle R, 
the left side is just 


Narx , Mmy 
 fG )sin sin dx dy 
0 a b 


but the right side contains an infinite sum of integrals of the products of eigenfunctions. All 
but one of these integrals on the right vanish by orthogonality of the eigenfunctions. The 


28.1 
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one integral that does not vanish is the one in which n = N and m = M, whence the value 
is S dy. Thus, from the equation 


results the Fourier coefficient dy y = 


: Ty ab 
"f x, y) ga sin dx dy = —dym 
4 
4 ofe pes Nz m 
ab JoJo f (X. y) sit Y dx dy. 


EXERCISES 28.1-Part A 


Al. Verify the integration in (28.1). 
A2. If n — 5 and L — 3, find the first six nonnegative nodal points 
determined by (28.2). 


A3. Explain how (28.3) determines a function h(x, y) whose level 
curves are nodal curves y(x). 


EXERCISES 28.1—Part B 


A4. Starting with the wave equation on the left in Table 28.1, obtain the 
results in (28.4). 


AS. Verify the integration in (28.7). 


B1. Investigate the nodal curves determined by sin 2x sin 3y + 
h sin 3x sin 2y = 0, where 0 < h < 2, and 0 < x, y < 7. 
Exercises B2-S give an eigensolution of the BVP for the vibrating string 
of length L. For each: 
(a) Find the nodes. 
(b) Give the value of c, the wave speed. 
(c) Give the period of the motion. 
(d) Animate the motion of string oscillating in the given mode 
shape. 
B2. L =z, u(x,t) = sin 2x cos 3t 
B3. L = 27, u(x, t) = sin 3x cos 4t 
B4. L = 
BS. L = 


In Exercises B6-10, the data pertains to a x x zt plate with clamped 
edges. For each, graph the nodal curves generated by sin nx sin my + 
h sin mx sinny = 0. 


3, u(x,t) = sin2z x cos 5t 


5.u(x,t) = sinzx cos /2t 


B6, n=2,m=3,h =} B7.n =3,m=1,h=2 
B8. n=4,m =2,h =} B9. n =4,m =3,h=2 
B10. nas meo hg 


For g(x, y) = 0, and the data given in each of Exercises B11—15: 


(a) Solve the BVP in Table 28.1. 
(b) Plot f(x, y). 


(c) For the series found in part (a), let U (x, y, t) be a partial sum 
for which U (x, y, 0) is a reasonable approximation to 
f(x ». Obtain graphs of the solution surface at times 
t= 1, 2,9; 

(d) Graph the motion of the center of the plate. 


(e) Animate the solution surface using the appropriate software. 


B11. (a,b) = (a, 0) £ ai fœ, Y) = aX 3y2(x — zx)(y — 7) 
B12. (a, b) = (zt, 1), I? fxs;y)- " m)(y — 1)3 
B13. (a, b) = (3, 3), ¢ ion f(x, y) = xy — 3)?(y - 3)? 
B14. (a,b) = (3,5).c = $, f(x = 1b" 2(x — 3)3(y — 5) 
B15. (a, = (5,4),¢= = 3, f(x = yxy (x — 5 (4 — y) 


In Exercises B16—20: 
(a) On the rectangle 0 € x < a, 0 < y < b, obtain the double 
Fourier series (28.5), where dam are given by (28.6). 
(b) On the rectangle 0 € x < a, 0 < y < b, plot F(x, y), a 
partial sum that gives a reasonable approximation to f (x, y). 


(c) Plot F(x, y) on the rectangle Ca € x < a, —b < y < b. 
Observe that this Fourier series converges to a function that is 


the extension of f (x, y) odd in both x and y. 


B16. (a,b) 
B17. (a, b) = Gt. 1). f(x. y) 
B18. (a, b) = (3,3), f(x, y) = (x — 3)(y — 3)’ sin x sin y 

B19. (a, b) = (3,5), f(x, y) = (1 — e?7?)(1— e??)(x —3)(y — 5) 


= (a,x), f(x, y) =xy(x—T)(y —a)e” 


= x*y(x — 2)(y — 1)? 
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B20. (a, b) = (5,4), f(x, y) = xy(x — 5)*(y — 4 C= = sit f sin Z dx dy 
2ab 


For f(x, y) defined on the rectangle R = {—a < x xa, —b < y x b), Qmm 
the general Fourier series representation is given by f (x, y) = doo + A + C= Jab zS [ f co X ds dy 
ab 


B+C, where 
mmy 2 nux my à QUE 
A= (a; gla - —— T gli : 1^. cos —— cos Cu 5 fft f si ? dx dy 
È E ü nm in b + a nm a b dab 
NS mt y " nīx , MTy In Exercises B21-25: 
+ dym Si cos + d,, COS —— sin ) . : . 
a b a (a) Obtain the general Fourier series on R. 
oo . 
mG : $ (b) Plot a reasonably accurate partial sum. 
B = » (a cos —— +c; sin c) i . . " i f 
= a a (c) If f(x, y) is odd in both x and y, show that the general Fourier 
el series collapses to the case determined by (28.5) and (28.6). 
C= X (c cos HE &. sin a) (x? + DO? --2y-y-41D 
ial b b B21. a = 1,b = 1, f(x, y) = 30 
1 "(y F seo 
dec us ll, fürdy B22. a 23, b =4, f(x, y) =x? + y? — 25 
B23. a 22,b 23, f(x, y) 2x? +7 
1 vj f sin NIX. mL dedy B24. a = n, b = 1, f(x, y) = (y? — 1) cos(V2x) 
nm — dB 2 2) 2 r? 
BS, d ben, a ET ) 
2 y 100 
dim = ab b dx dy B26. Specialize the general Fourier series of Exercises B21—25 for a 
function that is even in both x and y. 
d, = vA f dip EE gof X dx dy B27. Specialize the general Fourier series of Exercises B21—25 for a 
function that is even in x but odd in y. 
j 1 i nx , p EY ted B28. Specialize the general Fourier series of Exercises B21—25 for a 
Cnm al ee ^ ay function that is odd in x but even in y. 


a= Lif f cos 7. dx dy 


2 Time-Varying Temperatures in a Rectangular Plate 


Problem Formulation 


Suppose the rectangular plate in Figure 28.1 has its flat faces insulated and its edges kept 
at a temperature of zero. If initially the temperatures in the plate are u(x, y,0) = f(x, y), 
the steady-state temperatures will eventually be zero. However a boundary value prob- 
lem describing the time-dependent temperatures throughout the plate consists of the two- 
dimensional heat equation on the left in Table 28.5, the boundary conditions in the center, 
and the initial condition on the right. 


u(0, y,t) 20 
u(x, 0,1) 20 sh. 

Uy = K (Uxx + yy) un, c es f u(x,y,0) = f(x, y) 
u(x, b,t) =0 


TABLE 28.5 BVP for two-dimensional heat equation on a rectangular 
plate whose edges are maintained at temperature zero 


EXAMPLE 28.2 
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Statement of the Solution 


Separation of variables leads to the solution 


oo oo 
. AXX , my NEUE RAD) 2,52 
u(x, y,t)= dam Sin —— sin Gee Ie ae E (28.8a) 
7 a b 


m=ln=1 


4 b pa x " 
dnm = — f f (x, y) sin = sin E dx dy (28.8b) 
ab Jo Jo a a 


As in Example 28.1, take the rectangle to be a square of side a = b = x but take the initial 
temperature profile to be the function f(x, y) = ix, y?(x — x)(y — 2), plotted in Figure 
28.7, which suggests the plate has initially been heated in an asymmetric way. The Fourier 


coefficients are 


A [UM LR. a 
dim = — n Í =xy (x — z)(y — T) sin nx sin my dx dy 
mT- Jo Jo 8 
(28.9) 
Q(-1)"™ e 2(—1)" + (=1)? - 1 


—2- 


zmn 
Table 28.6, listing the first 25 coefficients, shows the coefficients are zero when n is even 
and rapidly decrease in magnitude with increasing n or m. 


FIGURE 28.7 Initial temperature distribution 
in Example 28.2 


n\m m=1 m=2 m=3 m=4 m=5 
us 4 1 41 31 l 
"= m 2m 27 16 125 x 
n=2 0 0 0 0 0 

n 41 11 4 1 1] 4 1 
"es 21m 18x 729 x 144 x 3375 x 
TET 0 0 0 0 0 
- l 8 1 4 1 $ Í 4 1 
E 125 x 250 x 3375 x 2000 x 15625 x 


TABLE 28.6 Coefficients dam in Example 28.2 
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Taking the thermal diffusivity as x = 1 and noting how quickly the Fourier coefficients 
decay, we approximate u(x, y, t) with the partial sum 
10 10 
uio(x, y, t) = x x dum Sin nx sin(my)e- o ^"^ 
m=1n=1 
Figure 28.8 shows ujo(x, y, 0.5), but the accompanying Maple worksheet contains an an- 
imation of the cooling process as all heat escapes from the plate and its temperature ap- 


proaches the steady-state u = 0. $ 


FIGURE 28.8 Example 28.2: Solution surface 
I 


at time t = 5 
Solution by Separation of Variables 


Separation of variables proceeds as in the solution of the wave equation on the rectangular 
membrane. First, apply the separation assumption, namely, u(x, y, t) = X (x)Y (y)T (t), to 
the boundary conditions, obtaining 


X(0)Y (y)T(t) = X(a)Y MTA 2 XG)Y(0)T (r) 2 XG)Y(b)T (t) = 0 


and hence X (0) = X (a) = Y(0) = Y (b) = 0. Applying the separation assumption to the 
heat equation, dividing by ku(x, y, t), and rearranging lead to 

Tt)  Y'(yp _ X"@) =e 

kT(t) YO) X (x) 
where A is the Bernoulli separation constant introduced because the function of t and y on the 


left must equal the function of x on the right. The self-adjoint equation X"(x) — AX (x) = 0 
follows, as does 


T'(t) n Y"(y) 

KT (t) Y(y) 
where ju is a second separation constant introduced because the function of t on the left must 
equal the function of y on the right. Consequently, we have the additional two differential 
equations 


u 


Y'(y — uY(y) 30 and T’'(t)—K(A+p)T(t) 20 


The equation for 7 (1) is solved after obtaining the eigenfunctions ofthe two Sturm-Liouville 


BVPs 
X"(x) — AX (x) 20 Y'(y) - uY (y) 20 
xO=x@=-0 ™ roOsreso 
Just as for the wave equation in Section 28.1, we have 
X,(x) = A, sin Im E.G) — B, sin my 
7.39 J and 


Ay = n zl s Um ————— 1.2.5... 
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As with the wave equation on the rectangular membrane, there are two different sets of 
integer-indexed eigenvalues. They make the equation and solution for T (t) become 


9 
n^ 
(a (f) + kn (5 F 


" 
m^ 


=) Thm (f) = 0) zs Thm (t) = Gma O N (28.10) 
h2 


A single eigensolution is 


Unm = Anm Sin 


MICK: . my nba 2/52 
sin ( . )e ka“ (n* /a^4-m* [b^)t 
a D 


where dum replaces the product A, Bm Cnm. The general solution is then given by (28.8a), the 
sum over all such eigensolutions. Application of the initial condition leads to the equation 


ee) = SS de sin —— sin 


nix mT y 


(28.11) 


m=i n=l 


from which Fourier techniques identical to those of Section 28.1 determine the constants 
dam to be given by (28.8b). 


EXERCISES 28.2-Part A 


A]. Verify the integration in (28.9). 
A2. Verify the DE and its solution in (28.10). 


A3. Show how (28.11) leads to (28.8b) for the coefficients dam in 
(28.82). 

A4. Insulate the left and right edges of the plate in Figure 28.1 and 
solve the BVP u, = K (Uxx + uyy), us (0, y, t) = u, (a, y, t) = 
u(x, 0, t) = u(x, b, t) = 0, u(x, y, O) = f(x, y). See Exercise 


EXERCISES 28.2—Part B 


B27, Section 28.1, for details on the appropriate Fourier series in 
two variables. 

AS. Insulate the top and bottom edges of the plate in Figure 28.1 and 
solve the BVP u; = K (ux, + uyy), u(0, y. t) = u(a, y, t) = 
us (x, 0, t) = uy(x, b, t) = 0, u(x, y, 0) = f(x, y). See Exercise 
B28, Section 28.1, for details on the appropriate Fourier series in 
two variables. 


B1. Insulate the top and right edges of the plate in Figure 28.1 and 
solve the BVP u, = k (Uxx + uyy), u(0, y, t) = u, (a, y, f) = 
u(x, 0, t) = uy(x, b, t) = 0, u(x, y, 0) = f(x, y). Develop the 
appropriate Fourier series in two variables. 


Using the data given in Exercises B2-6: 


(a) Solve the BVP in Table 28.5. 

(b) Using a suitable partial sum of the series developed in part 
(a), obtain a plot of the solution surface at times t = 1, 2, 3. 

(c) Obtain contour plots (graphs of the isotherms) at times 
[12,3 

(d) Using appropriate software, animate the solution surface as it 
varies in time. 


y) = xy x) (m — y) 


f 
fx, ed eats D*(y — x) 
fo. y) = txyx - 3)? - 3)? 


B2. a = mpb = mk = 2; 
B3. a =1,b=7,K = }, 
B4. a =3,b =3,« = 3, 


B5. a = 5,b = 3, k = V3, fx.yX)- PAN 5)Cy 3 
B6. a=4 b= 5 e= fü y= gx 3y2(x — 4)(y — 5) 


In Exercises B7-11, use the given data and the results of Exercise A4. 
For each: 
(a) Solve the BVP detailed in Exercise A4. 
(b) Using a suitable partial sum of the series developed in part 
(a), obtain a plot of the solution surface at times t = 1, 2, 3. 
(c) Obtain contour plots (graphs of the isotherms) at times 
b= 1,2 
(d) Using appropriate software, animate the solution surface as it 
varies in time. 
B8. the data from Exercise B3 
B10. the data from Exercise B5 


B7. the data from Exercise B2 
B9. the data from Exercise B4 
B11. the data from Exercise B6 
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In Exercises B12-16, use the given data and the results of Exercise A5. 


For each: 


(a) Solve the BVP detailed in Exercise A5. 
(b) Using a suitable partial sum of the series developed in part 
(a), obtain a plot of the solution surface at times t = 1, 2, 3. 


(c) Obtain contour plots (graphs of the isotherms) at times 
f= 1,23: 


(d) Using appropriate software, animate the solution surface as it 


varies in time. 


B12. the data from Exercise B2 B13. the data from Exercise B3 
B14. the data from Exercise B4 B15. the data from Exercise B5 


Chapter Review 


1. 


Expand f(x, y) = (x — 1} (y -27,0 x xa22,0x y xb 


— 4, in a double Fourier series whose terms are of the form sin x7 


sin“, with n and m positive integers. 


. Sketch the separation of variables solution of the two-dimensional 


wave equation for a rectangular plate with clamped edges and an 
initial displacement u(x, y, 0) = f(x, y). 


. What are nodal lines, and how do they occur? 


. Sketch the separation of variables solution of the two-dimensional 
heat equation for a rectangular plate with each of its edges kept at a 
temperature of zero and an initial temperature distribution given by 


Chapter 28 Time-Dependent Problems in Two Spatial Dimensions 


B16. the data from Exercise B6 
In Exercises B17-18, use the given data and the results of Exercise B1 
For each: 

(a) Solve the BVP detailed in Exercise B1. 


(b) Using a suitable partial sum of the series developed in part 


2 


(a), obtain a plot of the solution surface at times t = 1, 2, 3. 


(c) Obtain contour plots (graphs of the isotherms) at times 
P= 1,253. 


(d) Obtain graphs of u($, b, t) and u(a, 


NIS 


Ds 


B17. a = n, b = n,k =2, f(x, y) = xy? 


A 


BÓiS8.a = Lbs Arm hS aE y 


u(x, y, 0) = f(x, y). Let one corner of the plate be at the origin in 
the xy-plane and the diagonally opposite corner be at (a, b). 


5. Sketch the separation of variables solution of the two-dimensional 
heat equation for a rectangular plate situated with one corner at the 
origin in the xy-plane and the diagonally opposite corner at (a, b). 
The left and right edges are insulated, and the top and bottom edges 
are kept at a temperature of zero. The initial temperature distribution 
is given by u(x, y, 0) = f(x, y). The eigenfunctions in x will be 
cosines, while the eigenfunctions in y will be sines. This means a 
new double Fourier series must be devised and justified. 


Chapter 29 


Separation of Variables 
in NonCartesian Coordinates 


INTRODUCTION So far, the technique of separation of variables has been 
demonstrated for a variety of BVPs but always in Cartesian coordinates. The technique 
does extend to other coordinate systems, but with an increasing complexity for the resulting 
Sturm-Liouville eigenvalue problems. 

To solve Laplace's equation on a disk, we use polar coordinates because the disk's 
boundary, a circle, is a grid line in that system. Separation of variables leads to a Sturm— 
Liouville eigenvalue problem in which each nonzero eigenvalue has two associated eigen- 
functions. In this case, solutions of BVPs rest on the theory of the general Fourier series. 

To solve Laplace's equation in a cylinder, we use cylindrical coordinates. Separation 
of variables leads to a Sturm-Liouville eigenvalue problem in which the ODE is Bessel's 
equation and for which the eigenfunctions are Bessel functions. In this case, solutions of 
BVPs rest on the theory of Fourier-Bessel series. 

To solve Laplace's equation in a sphere, we use spherical coordinates. Separation of 
variables leads to a Sturm-Liouville eigenvalue problem in which the ODE 1s Legendre's 
equation and for which the eigenfunctions are the Legendre polynomials. In this case, 
solutions of BVPs rest on the theory of Fourier-Legendre series. 

With these tools, we are able to solve such problems as the Dirichlet problem on the 
disk and in a sphere and a heat transfer problem in a cylinder. For the cylinder, although 
we impose both Dirichlet and Neumann conditions, the bulk of the analysis is graphical 
because the challenge is to visualize and represent temperatures inside a solid cylinder. For 
the sphere, we solve the Dirichlet problem but face the same challenge for visualization and 
interpretation as we faced for the cylinder. 

Finally, we solve Laplace's equation for the potential inside and outside a spherical 
dielectric shell. This is a thin hollow nonconducting sphere placed in a uniform electric 
field. We find that inside the sphere, the field is not distorted, but outside the sphere, there 
is local distortion which diminishes with distance away from the shell. 


L| Laplace's Equation in a Disk 


laplacian in Polar Coordinates 


In rectangular coordinates, the laplacian of f (x, y) is V? f(x, y) = f(x, y)+fyy (x, y).In 
polar coordinates, the laplacian of u(r, 0) is V7u(r, 0) = uy; (r, 0) + Lu, (r, 0) + 5 uoo (r, 0), 
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Problem Formulation 


The Dirichlet problem on the disk of radius ø consists of Laplace's equation V?u(r, 0) = 0 
inside the disk and a Dirichlet boundary condition of the form u(o, 9) = f (0) on the cir- 
cumference of the disk. The domain for the angle 0 is the interval (—z, 7]. 

Implicit in this boundary value problem is the requirement that inside the disk, u(r, 0) 
be continuous with a continuous derivative. These continuity conditions require, for each 
value ofr < c, u(r, —) = u(r, x) and ug(r, —) = ug(r, 7), conditions that guarantee 
continuity across the negative portion of the x-axis where 0 jumps from —z to 7r. 

The problem models the steady-state temperatures in a disk around the boundary of 
which the temperatures have been prescribed by the function f (0). 


Statement of the Solution 


The solution of the Dirichlet problem on the disk is 


u(r, 0) = 71 + 2 (A cos nO + B,r" sin n0) (29.1a) 
1 m 

A, — / f@)cosn6d@ n=0,1,2,... (29.1b) 
to” = 
1 m 

Bl f(@)sinn6d@ n=1,2,... (29.1c) 
ro" Jz 


Some texts give this solution in the form 


u(r, 0) — D + y (an (=) cos nO + b, (=) sin n8) 


n=1 
1 T 
a, = — f(0)cosn0dO0 n=0,1,2,... 
T 


== 


1 T 
b, = — f(0)sinnüdO n=1,2,... 
T —J 


In this alternate form, the coefficients a, and b, are the Fourier coefficients of the boundary 
function f (0). 


EXAMPLE 29.1 Take the radius of the circle to be o = 2, and let the boundary function be 


f(8) = 0 —z7 «0x0 
f 13 0<0 <x 
=3 
- as depicted in Figure 29.1. Using (29.1b) and (29.1c), we obtain 
1 T 
Ao = — f(0) dé =3 (29.2a) 
T =E 
1 T 
A, = zz] f(8)cosn0 d0 = 0 (29.2b) 
2"m = 
1 mE 3 
B, = zl f (8) sinn0 dé = (1— (-1)") (29.2c) 
2^3 jJ 2"mn 
u=0 Using (29. 1a), a partial sum of the series is then uao(r, 0) = i + $a Bar” sin(n0), graphed 


FIGURE 29.1 Boundary function f(@) in in Figure 29.2. At 9 = 0 and 0 = zr, the solution is discontinuous on the boundary. It is dif- 


Example 29.1 ficult to represent these discontinuities with the finite sum used to approximate the solution. 


FIGURE 29.2 Solution surface in 
Example 29.1 


FIGURE 29.3 Level curves in Example 
29.1 
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An alternative view of the difficulties the discontinuities cause is the solution's contour 
plot contained in Figure 29.3, which shows all contour lines converging at the two points of 
discontinuity on the boundary where the temperature jumps from u — 0 to u — 3. Corre- 
sponding to these jumps, the solution surface takes on all intermediate temperatures along 
two vertical lines that are nearly discernible in Figure 29.2. $ 


Solution by Separation of Variables 


The solution by separation of variables for Laplace's equation in a disk of radius o begins 
with the separated form of the solution, u(r, 9) = R(r)8(0). The boundary conditions are 
the implicit continuity conditions u(r, —7) = u(r, x) and ug(r, —) = ue(r, x), which, 
by the obvious substitutions, lead to the periodic boundary conditions ©(—z) = GO(z) 
and ©’(—z) = ©’(z). Applying the separation assumption to Laplace's equation in polar 
coordinates, multiplying by r?, dividing by u = RO, rearranging, and introducing the Ber- 
noulli separation constant, we get 


G"() . rR'(r) rR'() | 
G(8) R(r) R) — 
which then gives the two ODEs 


Q"(80) — 4O(8) 20 and r?^R"(r)4rR'(r) - AR(r) 20 (29.3) 


The ©-equation belongs to the Sturm—Liouville eigenvalue problem on the left in 
(29.4). The eigenfunctions and eigenvalues on the right in (29.4) were derived in Section 
16.1. 


Q"(8) — 140(8) =0 
6(—1)20(10) => 
Q'(—z) = O'(x) 


O,(0) = a, cos nO + B, sin n8 
: (29.4) 
ds m^ w= 0; Qi 


This is a case where the single eigenvalue —7? has associated with it the two eigenfunctions 
cos nO and sin n6, except for n = 0 when the only eigenfunction is O9(0) = constant. 
To solve for R(r), consider first the case Ao = O where we find 


r? R" (r) - rR'(r) 309 Ro(r) =c  eolnr (29.5) 


The solution must remain bounded at r — 0, so we set c» — 0, effectively eliminating the 
log term and leaving just Ro(r) — « for some constant o. 

For the case A, = —n? # 0, the differential equation on the right in (29.3) is the Euler 
equation (Section 5.12) 


r? R'(r) - rR'(r) - Rr) 20 (29.6) 


with solution R,(r) = Cir" + Cor". For the solution to remain bounded at r = 0, we 
must take C5 = 0, so R,(r) = Cyr”. 
The eigensolutions are then 


ug(r, 9) = Ro(r)8o(0) =C and uj,(r,0) = (A, cosné + B, sinn0)r" 


where we have redefined the constants A, = a,c, and B, = ncn. The general solution, 
oo 
u(r,O)-2C-c As cos nO + B, sin n0)r" 


n-l 


is a sum over all possible eigensolutions. 
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Applying the Dirichlet boundary condition yields the equation 


oo 
f@=C+H+ Yio" An cos nO +o" B, sin nO) 


n-l 


but a Fourier series expansion of f (0) is 


fO= 


oo 
do ; , 
" + X cos nO + b, sin nO) 


n=l 


1 m 
an = = / f (8) cos n0 dé 
T =E 


T 


1 J 
b, = — f (8) sin n0 dO 
m — 


By comparison, then, we conclude C = ® and, from 


L f" | 
o" A, =a, = Ji f(8)cosn0d0 and o”B, = b, = Ji 
T J—r T 


T 


f (0) sin n0 dé 


=x 


that (29.1b), (29.1c), and (29.1a) must hold. 


EXERCISES 29.1—Part A 


A]. Verify the integrations in (29.2a), (29.2b), and (29.2c). 


A2. Starting with the laplacian in polar coordinates, separate variables 
and show the equations in (29.3) result. 


EXERCISES 29.1—Part B 


A3. Obtain the eigenfunctions and eigenvalues on the right in (29.4). 
A4. Verify the solution in (29.5). 
AS. Solve the Euler equation in (29.6). 


B1. The flow lines for u(r, 0), a solution of Laplace's equation 
Vu = 0, can be obtained in polar coordinates by solving 
(numerically) the pair of ODEs R’(t) = —Vu. Working in polar 
coordinates, R’(t) = r'(t)e, + r(1)0'(t)e;, whereas Vu = u,e, + 
(ug /r)es, so the equations to solve are r’(t) = —u, and 0'(r) = 
—up /r?. Take initial conditions of the form r(0) = ø, 0 (0) = bo; 
and assume that as f, the parameter along the flow line, increases 
from 0 to t;, the flow line moves through the interior of the disk. 
Almost any numeric solver will provide r(t) and 8 (t). The 
challenge is to merge the output of the solver with a graphics 
utility that will plot the flow line in polar coordinates. Obtain 
graphs of several flow lines for Example 29.1. 


In Exercises B2-11: 


(a) Using polar coordinates where —z < 0 < m, solve Laplace's 
equation in the disk of radius c . Included in this BVP is the 
requirement that u(r, 0) is smooth across the negative x-axis. 

(b) Plot the solution as a surface over the appropriate disk. 

(c) Plot the level curves (isotherms or equipotentials) in the given 
disk. 


(d) Obtain, and superimpose on the level curves, graphs of the 


flow lines. 
B2. o —2,f(0)—sin0 B3. o —2, f (0) = cos? 0 
B4.o =}, f(@)=cos26 B5. o = 1, f (0) = sin? 20 
B6. o —3, f(0) 2 sin30 B7. o —3, f (0) = cos? 30 
"- eV me 6 
B& o =$, f@)=1- (F B9. o = =, f()=1 
T c : E 
d g 0 
B10. o —2, f(0) = F 
2 x 
—(r-0) -=r <0<-— 
T 2 
B11. ¢ = $, f (0) = l -5 «637 
2 
—(m-—80 —«0-€ 
zs (zt ) 2 <O0<7 
B12. Solve the nonhomogeneous Neumann problem on the disk of 


radius c . This problem consists of Laplace’s equation in the disk, 
a smoothness requirement across the negative x-axis, and the 
prescription u,(o, 0) = F(0). In the context of steady-state 


temperatures on the disk, u, (c, 0), the directional derivative in 
the normal direction, is the flux of heat across the boundary of the 
disk. In the context of electrostatics, it would be the normal 
component of the electric field. 


(a) Make a formal statement of the BVP, including Laplace's 
equation in polar coordinates, the induced periodic boundary 
conditions arising from the smoothness requirement, and the 
imposed Neumann condition. 


(b) Separate variables and obtain the solution u(r, 0) = 2 + 
357 Lr" (A, cos n0 + B, sinn). 


(c) Compute u, (r, 0), the normal derivative, and evaluate it on 
the boundary where r =o. 


(d) Impose the Neumann condition, obtaining u,(o, 0) = 
p g 
d no"-(A, cosn@ + B, sinn0) = F(0), and deduce 


1 X 
(i) A, = — | F(@)cosn6dé,n > 1 
nro” m 


=g 


1 m 
Gi) B, = 23 F(80)sinn0d0,n > 1 
Humo" ^ Ja 


x 


(iii) 0 = f”, F(0) d6. Since the derived series has “no 
constant term,” the integral normally giving this constant 
term must be zero. Hence, the average value of the 
imposed boundary flux must be zero or there is no 
solution to this BVP. Laplace's equation arises, for 
example, from the steady state heat transfer problem, so 
if the flux is not in balance, there can be no steady state 
and a solution to the BVP cannot exist. 


In Exercises B13-17, with —z <0 < x: 


B13. 
B15. 


B16. 


B17. 


B18. 


(a) Verify that the average value of F(0) vanishes. 


(b) Apply the results of Exercise 12 and obtain a solution to the 
indicated nonhomogeneous Neumann problem. 


(c) Plot the solution as a surface over the appropriate disk. 

(d) Plot the level curves (isotherms or equipotentials) in the given 
disk. 

(e) Obtain, and superimpose on the level curves, graphs of the 
flow lines. 


o —2,F(0)—sinO0 B14. o = 3, F(0) = cos0 
o = 3,F(0)=0 
23 F= |l -2z<6@<0 
SOBEDEET d 0<@0<z 
1 
-l --«0x-—— 
3 
4, F(0 A P 
o = 4, F(0) = 2 3 «xU SS 3 
NEC C. T 
3 = < T 
3 sS 
For a disk with radius c, find the steady-state temperatures in the 


sector 0 < 0 < w < z if the radial boundaries are kept at a 
temperature of zero and the temperature along the circumference 


29.1 
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is given by f(0). Thus, in 0 <r «6,0 < 0 <a, solve 
V?u(r, 0) = 0 subject to the conditions u(r, 0) = u(r, v) = 0, 
u(o,0) = f(0). 


(a) The boundary conditions along the radii are u(r, 0) = 
u(r, œw) = 0. Assume the separated solution u(r, 0) = 
R(r)@(@) and find the boundary conditions © (0) = 
O(w) = 0. 

(b) Obtain the separated ODEs r^ R'(r) -rR'(r) +AR(r) 20 
and OG"(8) — AG(0) = 0. 

(c) Obtain the eigenvalues 1, = —(^ )? and the eigenfunctions 
©, = B, sin 70,n — l,.... 


(d) Show that ©, and ©,, are orthogonal for n 4 m by showing 
o sin "6 sin "26 d9 = 0. 


JO e 


(e) Obtain R, = r77/°. 
(f) Obtain u(r, 0) = Y , B,r""/^ sin "0. and use 


u(c,0) = f(0) to determine B,. 


In Exercises B19—28: 


(a) Apply the results of Exercise B18 to obtain the solution of the 
Dirichlet problem given for the sector. 


(b) Plot the solution surface over the sector. 
(c) Plot the isotherms (level curves or contours) in the sector. 


(d) Obtain, and superimpose on the level curves, graphs of the 


flow lines. 
c m 
.0 —2,0-——,f(0)-— —=— 6 
B19. o =2,0= 7, fO) 66 (^; 0) 
B20. o 22,0 = 7 f (8) = sin 49 
T T 2 
21.0 = 3, w = —, f (0) 2 40( — —0 
B21. o =3,0= 5, f (0) 40 (5 0) 
B22. ¢ =3,0= =f) = sin 30 
m T 3 
Fark Sm, a 
B23. o = 4,0 = 5. f (8) 20 (7 0) 
B24. o =4,0 =~, f(0) = sin20 
- 3 ma zd J 
B25. o = 5,0 = =. f0) 166 (= — 6) 
2 2 3 
Mie oer re) =0 (= - e) 
2 3 3 
7 27r : "m 
B27. o = a ,f(0) = sin 59 
7 2 3 
B28. o = <,0= T. £0) = sin? 30 
B29. For an annulus with radii c; and o», find the steady-state 


temperatures in the sector 0 < 0 < c < z if the radial boundaries 
and the inner circumference are kept at a temperature of zero and 
the temperature along the outer circumference is given by f (0). 
Thus, ino; < r < 03,0 < 0 < w, solve V?u(r, 09) = 0 subject to 
the conditions u(r, 0) = u(r, œ) = u(o;1, 0) = 0, 

u(05, 0) = f(0). 
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(a) The boundary conditions along the radii are u(r, 0) — 
u(r, œw) = 0. As in Exercise B18, assume the separated 
solution u(r, 0) = R(r)8 (0) and find the boundary 
conditions G(0) = O (w) = 0 and R(o,) = 0. 

(b) Obtain the separated ODEs r? R"(r) + r R'(r) +AR(r) «0 
and ©” (8) — 20 (0) = 0. 

(c) Obtain the eigenvalues A, = —( any and the eigenfunctions 
©, = sin 70, n — 1,.... 


(d) Show that ©, and ©,, are orthogonal for n 4 m by showing 
Jy sin "£6 sin “6 do = 0. 


(e) Obtain R, = A,r"7/* + B, r-"7/^. apply R,(o,) = 0, and 


obtain 
r nz[o (onl nz/o 
R, = Cn ES x (=) 
01 r 


Note that when o; = 1, the simpler R, = Cp [r/e — p -"7/e] 
oo 
ul, B) = Y 


results. 
nao 
r oo| | nn 
— — (=) sin —@ 
01 r w 
n-l 


(f) Obtain 
and use u(05, 0) = f (0) to determine C,,. 


In Exercises B30-39: 


B30. 


B31. 


B32. 


B33. 


B34. 


B35. 


B36. 


B37. 


B38. 


B39. 
B40. 


(a) Apply the results of Exercise B29 to obtain the solution of the 


Dirichlet problem given for the sector of the annulus. 
(b) Plot the solution surface over the sector. 
(c) Plot the isotherms (level curves or contours) in the sector. 


(d) Obtain, and superimpose on the level curves, graphs of the 


flow lines. 
ud x 
01 = 1,02 =2,0= 7, f0) = 60 (7-0) 
eic lo =2,0@= T, f(0) = sin 46 
T yd 2 
0, = 2,0, =3 o — 5, f() =40 (7 - 0) 
01 72,0 =3,0= 5, f (0) = sin36 
Jb . m 3 
a=20=40= 5, f() -26(7 —6) 
1 1 x 3 
01 = 3,0 =3,0= E, f(0) = 160 (7 e) 
-2 acude Z Anto 
0552 ‚0 = 4” peu 
E 3 _ 2n (0 0 2z à 2 
B Ss dubios S dre, FER pun 
lo; — 2 o Z, f(9) — sin 30 
0 = 1,0 = 25,0 — " = = 
1 : 2 3 sin 5 
1 = f (0) = sin? 30 
0i = 1,0 = —, = , =< 
1 2 2:9 3" sin 
For an annulus with radii c; and o5, find the steady-state 


temperatures in the sector 0 < 0 < œ < z if the radial boundaries 
are kept at a temperature of zero, the inner circumference is 
insulated, and the outer circumference is kept at temperature 
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f(8). Thus, ino <r < 02,0 < 0 < œ, solve V^u(r, 0) = 0 
subject to the conditions u(r, 0) = u(r, œ) = 0, u,(o1, 0) = 0, 
u(05, 0) = f(0). 


(a) The boundary conditions along the radii are u(r, 0) — 
u(r, @) = 0. As in Exercise B29, assume the separated 
solution u(r, 0) = R(r)©(@) and find the boundary 
conditions © (0) = O (w) = 0 and R' (o1) = 0. 


(b) Obtain the separated ODEs r? R” (r) +r R'(r) +AR(r) =0 
and ©” (80) — 20 (0) = 0. 


(c) Obtain the eigenvalues à„ = -(uy and the eigenfunctions 
©, — sin ^76,n — l,.... 


(d) Show that O, and ©,, are orthogonal for n 4 m by showing 
Jo sin 0 sin “6 do = 0. 


(e) Obtain R, = A,r""/^ + B,r-""/^. apply R’ (o1) = 0, and 


obtain 
r nx /w o nm [eo 
R, = C, == + (=) 
O71 F 


Note that when o; = 1, the simpler R, = C, [r""/? + py-"7/e] 
u(r,0) = i. Ca 


results. 
najo 
r orz /o| | nz 
(= + (=) sin — 0 
— 0, r w 


(f) Obtain 
and use u(05, 0) = f (0) to determine C,.. 


In Exercises B41—50: 


B41. 


B42. 


B43. 


B44. 


B45. 


B46. 


B47. 


B48. 


B49. 


B50. 


(a) Apply the results of Exercise B40 to obtain the solution of the 
BVP given for the sector of the annulus. 


(b) Plot the solution surface over the sector. 
(c) Plot the isotherms (level curves or contours) in the sector. 


(d) Obtain, and superimpose on the level curves, graphs of the 


flow lines. 
mon LT 
e = La =2,0= 5, f0)- 6 (7 -0) 
g= e; = 2,0 = 7. f (0) = sin46 
hA X 2 
01 = 2,0 =3,0= 5, f0) =4 (7 e) 
EL LR I. - f (8) = sin30 
" T 3 
01 = 2,0, —4 0 = 7. f(6) = 20 (7 0) 
0 = 2,0) = 4, o = 5, fO) = sin20 
l 3 7  f() — sin66 
= —, 0 = 3, = —, = § 
O1 = 5102 des sin 
3 3x 370 3 
Hess, el is 4 10) = e (= -6) 
5 im sty dng 
i, = =e 3 s lets 
l > c 2. P 
01 = 1,05 = $ = " — sin 
1 2 2 @ 3" 1 


FIGURE 29.4 The Bessel functions 
Jo(x) (solid) and Jj (x) (dotted) 
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Laplace's Equation in a Cylinder 


Problem Statement and Formulation 


Find the steady-state, bounded temperatures inside a solid cylinder of radius o and height h if 
the base is insulated and the curved lateral surface and the top are maintained at temperatures 
of zero and f(r), respectively. 

Because none of the data depends on the angle 0, the temperature will be a function of 
only the height z and radius r. Thus, the temperature function, which can be written as u (r, z) 
in cylindrical coordinates, satisfies Laplace's equation inside the cylinder. The insulation 
condition on the bottom of the cylinder, a homogeneous Neumann condition, is expressed 
by the vanishing of the temperature gradient, a partial derivative in the z-direction, on that 
face. The complete boundary value problem determining u(r, z) therefore consists of the 
partial differential equation 


x l 
V^u(r, z) = Urr (r, z) + -u,(r, z) + uzz(r,z)=0 (29.7) 
F 
and the boundary conditions u (o, z) = 0, u; (r, 0) = 0, u(r, h) = f(r), and u(r, z) bounded. 


Statement and Analysis of the Solution 


The solution is given by 


u(r, Z) = ». Ay Jo (Ayr) cosh(Agz) (29.8a) 
k=1 
So rfG)JoQar) dr 2 fo rf (r)JoQar) dr 


E E = : 29.8b 
i cosh(A4h) fy rJgGur)dr o? cosh(Agh) JE Ako) ( ) 


where Jo(x) is the Bessel function of order zero and A, is the kth zero of Jo(o x). The 
functions J, (x) satisfy Bessel's equation 


x2y" (x) + xy'() + (x? — v?)y(x) 20 (29.9) 


and are called Bessel functions of order v. As seen in Section 16.2, two linearly independent 
solutions of Bessel’s equation are J, (x) and Y, (x). Only one of these solutions, J, (x), is 
bounded at the origin. The Bessel function of the second kind, Y, (x), has a logarithmic 
singularity at x = 0. 

Series expansions for the Bessel functions of order zero and one are, respectively, 


pu s^ Opa 
w= pr "4 aL xamrn 


k=0 ^ k=0 
In Figure 29.4, the solid curve is Jo(x), the dotted, J; (x). It should be recalled from Section 
16.2 thatif Atk = 1,2, ...s are the roots of Jo(o x), then the functions Jo(A,x) are, on the 


interval 0 < x < c, orthogonal with respect to the weight function x. Thus, for A Æ Àj, 
we have fj x JoQx) Jo(.;x) dx = 0. 


For the cylinder described earlier, let o. = 2, h = 3, and f(r) = 1. Then, the first 10 
eigenvalues A, are the first 10 zeros of Jo (2x), listed as ux in Table 16.1 in Section 16.2. 
The coefficients 

i r Jo(Axr) dr 
2 cosh(344) J2 QA4) 


A, = 
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can be evaluated with numeric integration, yielding, for example, A; — 0.08684853220. 
Alternatively, because f(r) = 1, the integral in the numerator can be evaluated exactly via 


the formula 


Í xJo(x) dx = œa Jı (æ) 
0 


if the change of variables Ayr = x is made in the integral in the numerator of Ag, as sum- 


marized by 
A; = 8.68 x 10? 2 
A; = —540 x 107* { r (our) dr} 
A3 = 3.92 x 10-5 Q 
A4 = —3.04 x 10-8 


Consequently, we find 


S [eno 2 QA) 
= — x X)AX = —J|IUZAkK 
x=)yr Àk 0 ° Àk 


As = 2.43 x 10-10 | sech(3Ax) 
Ag = —2.00 x 107? E Janae 
A; = 1.65 x 1074 which we use to compute Ag, k = 1,..., 10, listed in Table 29.1. The coefficients rapidly 


Ag = —1.39 x 10776 
Ag = 1.18 x 10778 
Ajo = —1.99 x 107% 


decrease in magnitude, so the convergence is rapid, and the partial sum 


TABLE 29.1  Coefficients 
Apik = Tessas 10, in Example 29.2 


FIGURE 29.7 Example 29.2: Isothermal 


surface u(r, z) = 0.1 


FIGURE 29.5 Example 29.2: Approximation 
of the solution surface u(r, 2) 


ujo(r, z) = > Ay Jor) cosh(Axz) 
k=l 


is adequate, except on the boundary z = 3 where a much slower convergence is evident, as 
seen in Figure 29.5. 


LLS 
LC. 
LEILA 
LINN 


FIGURE 29.6 Example 29.2: Representation of 
temperatures on the axial cross-section inside the 
cylinder 


Temperatures on the rectangle R = (0 < r < 2,0 < z x 3}, half of a plane section 
through the axis of the cylinder, are represented in Figure 29.5. It is impossible to draw a 
graph of the temperatures inside the cylinder. Every representation of these temperatures 
will require some visual compromise. In Figure 29.6, the temperatures are graphed on the 
rectangle R, shown supporting the temperature surface inside the cylinder. The rectangle 
R rotates about the axis of the cylinder, supporting the same temperatures for all values of 
the angle 0. 

Figure 29.7 gives another view of the temperatures inside the cylinder, the isothermal 
surface on which u(r, z) = 0.1. In fact, the level surfaces u(r, z) = x, x £1:2....49. 
are each bowl-shaped, with the same circle bounding the open top. This corresponds to 
the discontinuity in temperatures at the junction of the top of the cylinder with the curved 
lateral wall of the cylinder. At this juncture, all level surfaces intersect. The accompanying 
Maple worksheet presents this sequence of isothermal surfaces as an animation. E 
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Solution by Separation of Variables 


Assuming a separated solution of the form u(r, z) = R(r)Z(z) and substituting it into the 
boundary data u(o, z) = 0 and u,(r, 0) = 0 lead to 


R(o)Z(z) =0=> R(o) 20 and R(rZ(0202Z(020 


Application of the separation assumption to Laplace's equation, division by u — RZ, re- 
arrangement, and introduction of the Bernoulli separation constant u lead to 
R" (r) R'(r) Z" 
R(r)  rR(r) Z(z) 
Overlooking the abuse of notation whereby primes denote differentiation with respect to 
both r and z, we have the two ODEs 


=p (29.10) 


rR'(r) + R'(r) —urR(r) 0 and Z"(z) - uZ(z) =0 (29.11) 
The r-equation is a modified form of Bessel's equation. In fact, the solution is 
R(r) = ciJo(/ —ur)  e2Yo( —ur) 


The appearance of ,/—,t suggests renaming the separation constant to —4? so that the two 
ordinary differential equations become 


rR'(r) 4- R'(r) -22rR() =O and. Z'(z) - 2Z(z2) 20 (29.12) 
Then, the solution of the r-equation is 
R(r) = ciJo(Àr) + e2Yo(Ar) 


Since we know Yo(x), the zero-order Bessel function of the second kind, is not bounded at 
the origin, the constant c? is taken as zero and the solution for R(r) is a multiple of Jo(Ar). 

To transform the r-equation to Bessel's equation (29.9), make the change of variables 
r = > so that R(r) becomes R(=) = y(x) and the r-equation becomes 


A[xy" (x) + y(x) + xy(x)] = 0 (29.13) 


Except for the factor A, the equation is precisely Bessel’s equation of order zero. 
Incidentally, the change of variables was accomplished by a careful use of the chain 
rule starting with the definitions x = Ar and 


RG) = R (>) =y@) = yan) 
Then, we obtain 
dR dydx dy, 4 R d (2)¢ d'y. y 


A= A 29.14 
dr dx? ( ) 


= =—) an = 
dr dxdr dx dr? dx Ndx 


so that the equation on the left in (29.12) becomes (29.13) when r is replaced by =. 

Since R(r) = Jo(Ar), the boundary condition R(c) = 0 becomes Jo(Ao) = 0, the 
equation whose roots give the eigenvalues Àz. The z-equation on the right in (29.12) now 
inherits the known eigenvalues and becomes 

Zt (z) -Ze = 0 
which has exponential solutions. The solution satisfying the Neumann boundary condition 
Z'(0) = Ois 

Zy(z) = Cy cosh(Agz) 
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EXERCISES 29.2 


Separation of Variables in NonCartesian Coordinates 


Consequently, a single eigensolution is 
uy(r, z) = AgJo(Agr) cosh(A,z) 
and the general solution, a sum over all such eigensolutions, is (29.8a). 


Application of u(r, h) = f (r), the final nonhomogeneous Dirichlet boundary condition 
at the top of the cylinder, leads to the equation 


oo 
f(y = DP Ax Jor) cosh G4 t) (29.15) 
k=l 
from which the coefficients A; are determined via multiplication by r Jo(A jr) and integration 
with respect to r over the interval 0 < r < c. The orthogonality of the eigenfunctions 
Jor) with respect to the weighting function r causes all terms but one on the right side 
to vanish. The one surviving term is the one for which k = j. Hence, what results is the 
equation 


Í rf (r)Jo(Ajr) dr = Aj cosh (ah) f rJo(Ajr) dr (29.16) 
0 0 


from which we obtain (29.8b). 


1. Start with V2u(r, z) = 0 as in (29.7), and show how to obtain 


(29.10) and (29.11). 


2. Make the change of variables r = 7 in (29.12), use (29.14), and 


show that (29.13) results. 


3. Show how (29.15) leads to (29.16). 


In Exercises 4-13: 


4.0 =2,h=3,f(r)=2-r 5.oez2,h-3,f(r)- ;j4-r 
6. 0 =2,h =3, f(r) 2 2cos Sr 
7.0 =3,h=5, f(r) 2 r?(3—r) 
8. o =3,h =5, f(r) 3r(3—rY 
9. ¢=3,h=5, fr) = r*(3—r) 
10.0 =3,h=5, f(r) 2r(3— ry? 


(a) Solve Laplace's equation V?u = 0 for the steady-state 


NU 
temperatures u(r, z) in the cylinder 0 < r «o, 0 <z < hifthe 1. 6 =5,h=4, f(r) = 1Osin —r 


5 


curved wall (r = o) is kept at a temperature of zero, the bottom on 
(z = 0) is insulated, and the top (z = A) is maintained at the 12. o = 5, h = 4, f(r) = 10sin ra 


temperature f(r). 


(b) Graph u(r, z) as a surface over the rectangle 0 < r < c, 


0<z<h. 


(c) Rotate the surface in part (b) so that it stands vertical inside a 
partly open cylinder. Thus, the rectangle 0 <r <0,0<z<h 
should be the right-half of the rectangle exposed if the cylinder 
is cut with a plane passing through the z-axis. 


(d) If p = Umax — Umin, plot the three isothermal surfaces 


U = Umin + to, k = L23 


(e) Treating r and z as Cartesian variables, obtain a contour plot of 
u(r, z) on the rectangle 0 < r < o, 0 < z < h. Each level curve 
is the intersection of an isothermal surface and a vertical plane 


passing through the z-axis. 


(f) For each fixed value of 0 = 6, there is a flow line that starts at 
the point (ro, o, h) and remains in the vertical plane 0 = 65. 
Obtain these flow lines by solving the ODEs r'(r) = —u,, 
z'(t) = —u, and graphing the solutions as Cartesian curves in 
the rectangle 0 <r < 0,0 <z < h,0 =0. 


13. c — 5,h =4, f(r) = 10sin =r 


14. Solve Laplace’s equation V?u = 0 for the steady-state temperatures 
u(r, z) in the cylinder 0 < r < o, 0 < z < h if the curved wall 
(r = c) and the bottom (z = 0) are kept at a temperature of zero 
and the top (z = h) is maintained at the temperature f(r). Thus, 
solve the BVP V?u = 0, u(o, z) = u(r, 0) = 0, u(r, h) = f(r) for 
the bounded temperatures u(r, z) inside the cylinder 0 < r < c, 
0<2z<h. 
(a) Using cylindrical coordinates, write u(r, z) = R(r)Z(z) and 
obtain rR” (r) + R'(r) + 2rR(r) = 0, R(o) = 0 and 
Z"(z) — àZ (z) = 0, Z(0) = 0. 
(b) Obtain the eigenvalues Aj, k = 1,..., where i, is the kth zero 
of the Bessel function Jo(o x). 


(c) Obtain the eigenfunctions R (r) = Jor). 
(d) Obtain Z;(z) = sinh A;z. 


(e) Obtain u(r, z) — Ioa A, Jo (Ar) sinh Ayz, and determine A; 
by the condition u(r, h) = f(r). 


For the data in each of Exercises 15-24: 


(a) Use the results of Exercise 14 to solve Laplace's equation 
V2u = 0 for the steady-state temperatures u(r, z) in the 
cylinder 0 < r < 0,0 < z < h if the curved wall (r = c) and 
the bottom (z = 0) are kept at a temperature of zero and the top 
(z = h) is maintained at the temperature f(r). 


(b) Graph u(r, z) as a surface over the rectangle 0 < r <a, 
O<z<A. 

(c) Rotate the surface in part (b) so that it stands vertical inside a 
partly open cylinder. Thus, the rectangle 0 <r <o,0<z<h 
should be the right-half of the rectangle exposed if the cylinder 
is cut with a plane passing through the z-axis. 


(d) If o = Umax — Umin, plot the three isothermal surfaces 
U = umin + $p, k = 1,2,3. 


(e) Treating r and z as Cartesian variables, obtain a contour plot of 
u(r, z) on the rectangle 0 € r < o, 0 < z < h. Each level curve 
is the intersection of an isothermal surface and a vertical plane 
passing through the z-axis. 


(f) For each fixed value of 0 = 65, there is a flow line that starts at 
the point (ro, 0o, 2) and remains in the vertical plane 0 = 65. 
Obtain these flow lines by solving the ODEs r'(t) = —u,, 

z'(t) = —u, and graphing the solutions as Cartesian curves in 
the rectangle 0 <r xo,0xz x h,0 —0. 


15. the data from Exercise 4 16. the data from Exercise 5 


17. the data from Exercise 6 18. the data from Exercise 7 


19. the data from Exercise 8 20. the data from Exercise 9 


21. the data from Exercise 10 — 22. the data from Exercise 11 


23. the data from Exercise 12 24. the data from Exercise 13 


25. Solve Laplace's equation V?u = 0 for the steady-state temperatures 
u(r, z) in the cylinder 0 < r < 0,0 xz < h if the curved wall 
(r = c) is insulated, the bottom (z = 0) is kept at a temperature of 
zero, and the top (z = h) is maintained at the temperature f(r). 
Thus, solve the BVP V?u = 0, u,(c, z) = u(r, 0) = 0, 
u(r, h) = f(r) for the bounded temperatures u(r, z) inside the 
cylinder 0 <r <0,0<z<h. 


(a) Using cylindrical coordinates, write u(r, z) = R(r)Z(z) and 
obtain (29.12), R’(o) = 0 and Z(0) = 0. 
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(b) Obtain the eigenvalues Àz, k =0,1,..., where A, is the kth 
zero of the Bessel function Jj(ax) = — Ji (o x). Note that 
Ao = O is an eigenvalue. 


(c) Obtain the eigenfunctions R,(r) = Jo(Agr), k = 0, .... Note 
that Ro(r) — Ao, a constant. 

(d) Obtain Z,(z) = sinh A,z, k = 0,..., but obtain Zo(z) by a 
separate calculation. 


(e) Obtain u(r, z) = AoZo + } z; Ax Jo(Axr) sinh Ayz, and 
determine A;,k =0,1,..., by the condition u(r, h) = f(r). 


For the data in each of Exercises 26-35: 


(a) Use the results of Exercise 25 to solve Laplace’s equation 
V’u = 0 for the steady-state temperatures u(r, z) in the 
cylinder 0 < r < ø, 0 < z x h if the curved wall (r = o) is 
insulated, the bottom (z = 0) is kept at a temperature of zero, 
and the top (z = h) is maintained at the temperature f(r). 


(b) Graph u(r, z) as a surface over the rectangle 0 < r < c, 
O<z<h. 

(c) Rotate the surface in part (b) so that it stands vertical inside a 
partly open cylinder. Thus, the rectangle 0 <r <0,0<z<h 
should be the right-half of the rectangle exposed if the cylinder 
is cut with a plane passing through the z-axis. 


(d) If o = Umax — Umin, plot the three isothermal surfaces u = £p, ` 
i= 1,:2, 3: 


(e) Treating r and z as Cartesian variables, obtain a contour plot of 
u(r, z) on the rectangle 0 € r € 0,0 < z < h. Each level curve 
is the intersection of an isothermal surface and a vertical plane 
passing through the z-axis. 


(f) For each fixed value of 0 = 6,, there is a flow line that starts at 
the point (ro, 0o, A) and remains in the vertical plane 0 = 65. 
Obtain these flow lines by solving the ODEs r’(t) = —u,, 

z'(t) = —u, and graphing the solutions as Cartesian curves in 


the rectangle 0 <r <0,0<z<h,0=0. 
26. the data from Exercise 4 — 27. the data from Exercise 5 
28. the data from Exercise 6 29. the data from Exercise 7 
30. the data from Exercise 8 31. the data from Exercise 9 
32. the data from Exercise 10 — 33. the data from Exercise 11 


34. the data from Exercise 12 35. the data from Exercise 13 


_ The Circular Drumhead 


Problem Statement and Formulation 


A circular drumhead consisting of a membrane with radius r = o that is clamped on its 
circumference at time t = 0 is given a radially symmetric displacement and no initial velo- 
city. If the motions of the membrane are governed by the two-dimensional wave equation 
ug = c (Uxx + uyy), formulate an appropriate boundary value problem for this drumhead. 
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EXAMPLE 29.3 
u 
1 
" 
0 1 2 8$ 4 & 
FIGURE 29.8 Initial function f(r) in 
Example 29.3 


FIGURE 29.10 Graph of Jo(5A) whose 
zeros are the eigenvalues A; in Example 
29.3 
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The circular domain suggests the two-dimensional wave equation is best given in polar 
coordinates as 


» 
2 
te = - (r(ru,), + uoo) 
The radial symmetry of the initial disturbance suggests u(r, 0, t) is independent of the angle 


0 and becomes just u(r, t). Thus, the boundary value problem we seek consists of the partial 
differential equation 


5 1 
Uy; (7, t) = c^ (v.c. t) + -u,(r, D) 
F 


the homogeneous Dirichlet condition u(o, t) = 0 that expresses the clamping of the rim 
and the homogeneous initial condition u,(r, 0) = 0 that expresses the zero initial velocity. 
The initial displacement is given by u(r, 0) = f(r), and the physical nature of the system 
requires that the displacement function u(r, t) be continuous and, hence, bounded. 


Solution and Analysis 


The solution is given by the infinite series 


B 

u(r, t) = 2 Ax Jo(Agr) cos(cAgt) 
k=1 

_ Jo. rf (r)Jo(Agr) dr 

(0 fo rJeQar) dr 

where A, are the Fourier-Bessel coefficients for the function f(r). Of course, the func- 


tions Jo(x) and Jı (x) are Bessel functions of order zero and one, respectively, and àz, the 
eigenvalues, are the zeros of Jo(o x). 


(29.172) 


Ax 


9 o 
= —— "f(r)Jo(Gr)dr | (29.17b 
rmi rf(r)JoG,r)dr ( ) 


Let the radius of the membrane be o = 5, the wave speed be c = 1, and the initial displace- 
ment u(r, 0) be the smooth function 


à =r? O<r< i 
fE) = 4 i(4r?— 12r +9) izr«3 (29.18) 
0 sra 


graphed in Figure 29.8, which shows the initial shape's profile along any radius of the 
membrane. The actual shape of the membrane during this initial displacement is shown in 
Figure 29.9. 


FIGURE 29.9 
Example 29.3 


Initial shape of drumhead in 


The eigenvalues A, are the zeros of the Bessel function Jo(54) whose graph appears 
in Figure 29.10. Since, as seen in Section 16.2, Jo (5x) is asymptotic to v E cos(5x — 2). 


A, = 0.481 
ho = 1.104 
A3 = 1.731 
A4 = 2.358 
TABLE 29.2 


A, = 0.0587 
A, = 0.122 
A; = 0.154 
A4 = 0.153 


As = 2.986 
Ae = 3.614 
Ag = 4.870 


As = 0.124 
As = 0.0831 
A; — 0.0442 
As — 0.0171 
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we are guided to the location of the first 24 eigenvalues, which we compute numerically 
and display in Table 29.2. 


àg = 5.499 dug = 80117 Aij = 10.525 Aa = 13.038 
Ato = 6.127 A14 = 8.640 Aig = 11.153 An = 13.666 
Au = 6.755 Ais = 9.268 Aig = 11.781 dog = 14.295 
dg 7385 A16 = 9.897 Ao = 12.410 dog = 14.923 


First 24 eigenvalues in Example 29.3 


Then, with o = 5 and f(r) given by (29.18), numeric integration of (29.17b) provides 
the coefficients listed in Table 29.3. 


Ag = 0.00414 Aj; = 0.000889 A,; = —0.00416 A», = —0.000620 
Ajo = 0.00132 A\4 = —0.00247 Aig = —0.00213 Az = —0.000794 
A, = 0.00252 Ais = —0.00505 Aig = —0.000701 A23 = —0.000397 
A1? = 0.00293 Ajo = —0.00555 A29 = —0.000337 Arn = 0.000454 


TABLE 29.3 Example 29.3: Coefficients Ay, k = 1,..., 24 


"NE" — 


FIGURE 29.11 


u(r, t) fort = 1, 


(c) 


Example 29.3: Graph of 


12, and 32 


In Figure 29.11, the partial sum u»4(r, t) = ET. AxJo(Agr) cos(cA,t) approximat- 
ing u(r, t) is graphed for t = 1, 12, and 32. The companion Maple worksheet provides 
animations for the motion of both the profiles u(r, t) and the drumhead itself. $ 


Solution by Separation of Variables 


Assuming a separated solution of the form u(r, t) = R(r)T (t) and substituting it into the 
boundary data u(o, z) = 0 and initial condition u;(r, 0) = 0 lead to 


R(a)T(t) 20 R(c) 20 and R(r)T'(0 20-2 T'(0-20 
Application of the separation assumption to the wave equation, division by c?RT, mild 
rearrangement, and introduction of the Bernoulli separation constant jz yield 

R'(r)  R'(r) T"(t) 
R(r) rR(r) = c?T (t) Ls 
from which we get the two ODEs 


rR'(r) + R'(r) -urR(r) 20 and. T"(r) - euT) 20 (29.19) 


As in Section 29.2, we replace jz with —4? so that (29.19) becomes 
rR'(r) + R'(r) -A3rR(r) =O and. T"(t) - ?2?T (t0) 20 (29.20) 


Then, the solution of the r-equation in (29.20) is R(r) = cı Jo(àr) + c2Yo(Ar). Since we 
know Yo(x), the zero-order Bessel function of the second kind is not bounded at the origin, 
the constant c» is taken as zero, and the solution for R(r) is a multiple of Jo (Ar). The details 
are precisely the same as in Section 29.2. 

Since R(r) = Jo(Ar), the boundary condition R(o) = 0 becomes Jo(Ao) = 0, the 
equation whose roots give the eigenvalues A,. The t-equation now inherits the known 
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eigenvalues and becomes 
T, (t) + AZT (t) = 0 
and has trigonometric solutions. The solution satisfying the initial condition 7/(0) = 0 is 
T(t) = Cy cos(cAst) 
Consequently, a single eigensolution is 
ug(r, t) = Ag Jo(Agr) cos(cagt) 


and the general solution is given by (29.17a), a sum over all such eigensolutions. 
Application of the final initial condition u(r, 0) = f (r) leads to the equation 


oo 
f(r) = 3 Ag Jo (ur) 

k=l 
The coefficients A; are the Fourier-Bessel coefficients for the function f(r) and are deter- 
mined by multiplying this equation by r Jo(A;r) and integrating with respect to r over the 
interval 0 < r < ø, just as in Section 29.2. The orthogonality of the eigenfunctions Jo.) 
with respect to the weighting function r causes all terms but one on the right side to vanish. 
The one surviving term is the one for which k = j. Hence, what results is the equation 


f rf (r)JoQG. jr) dr = af rJg(ajr) dr 
0 0 


from which we obtain (29.17b). 


EXERCISES 29.3 


1. Verify the entries in Table 29.2. 8. Solve the wave equation on a circular membrane of radius o if the 

2. Verify the entries in Table 29.3. edges are clamped, there is no initial velocity, and the initial 
displacement is a function of both r and 0. Thus, the BVP consists of 

In Exercises 3-7: the wave equation u, = c?V?u(r, 0, t), the boundary condition 


u(c, 0, t) = 0, the initial conditions u,(r, 0, 0) = 0, u(r, 0,0) = 
F (r, 0), and, since —7 < 0 < zt, the requirement that u and up be 
continuous across the negative x-axis. 


(a) Solve the BVP u, = c?V?u(r, t) on the circular domain 
0zxr«o,—z «60 <r fora membrane with clamped edges, 
no initial velocity, and an initial displacement f (r). i 
(b) For t = 1, 2, 3, graph the profile of the membrane along the line (a) m cy undid coordinates, the waveequation is gy Hoe T 
0-0 : zu, + Ug. Write u = R(r)@(6)T (t) and obtain, after 
SUO SUCTUS. f P : 2 
introducing the two separation constants A? and ju, 


(i) £z? R" E rR' + (Xr? + )R 20, R(o) 20; 


(ii) ©” — ®© = 0, with the periodic boundary conditions (from 


(c) Animate the motion of the cross-section 0 — 0. 


(d) Graph the solution surface at times t = 1, 2, 3. 


3.0 =5,c=1, f(r)= | cr OS? Bi continuity) GO(—z) = Oz), O'(—z) = O'(z); 
a 0 l<r< T 
adn (ii) T” + A-c°T = 0, T'(0) = 0. 
1 eral — ‘ , 
: (b) Solve the O-equation (it's a Sturm-Liouville problem solved 
4.o0-4,c—-2,f(rn-i12-r 1zr««2 : : 2 . 
0 dem previously), to obtain y = —n^, n = 0, 1,..., with 
TERS "s ©, = a, cos nO + b, sinn0, n = 1,..., and Oo = ap. 
ic = 8,e= 3, fr) = à Teor Diremn (c) Solve the R-equation, which now reads r? R" + r R' + 
0 m<r<8 Qr? — n?) R = 0, R(o) = 0, a (singular) Sturm-Liouville 
i goi si?r O<r<z problem whose solution is R;(r) = J, (Aner), Bessel functions 
ge RE RO e 0 m<r<9 of order n. The eigenvalue i, is the kth zero of J, (o x). Thus, 
i À4 is a doubly indexed collection of eigenvalues that must be 
toel c=5fr)=1-r7 


computed numerically. 
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(d) Solve the T-equation to obtain 7,;, = cos ,,ct. Hence, there are and 
eigensolutions of the form Ang Jn (Àngr) cos NO cos Ay, CT, 0 =m «0x0 
Bnk Jn(Àngr) sin n0 cos A44ct, and Aok Jo(Aoir) COS Agyct. The (m 2 z 
solution u(r, 0, t) is a sum over all such eigensolutions. Hence, g(0) = 1400" (= s 0) 0<@< 3 
u= Du Aoi Jo(Aoyr) COS Agget + pan Ed Ja (er) " is 3 
COS A, CE (Ang cos nO + B, sin nO). 3 RUSH 
(e) Show that the constants A,, and B,; are determined by the initial (a) Obtain the first four zeros of each of J,(2x), n = 0,...,5. This 
condition F (r, 9) = Y 7 , Ao Joker) + osa osa In Aner) gives A,4 fork = 1,..., 5and n —0,...,5. 
(Ang cos n0 + B, sin n0) and are therefore (b) Obtain Aor, k = 1, .... 5. 
" J, h FG. 0)r Joor) dr d0 (c) Obtain Aj, k = 1,....5,n=1,...,5. 
oe = o S 
22. fy rJ or) dr (d) Obtain B, k =1,...,5,n=1,...,5. 
[ut lo F (r, 0)r J, (Angr) cos n0 dr dO (e) Form U, a partial sum containing the terms for which the 
Ank = T KIA Angr) dr coefficients have just been computed. Compare the plot of 
. U(r, 0, 0) with that of F (r, 0). 
Tof FG.0)r J, Gir) sinn dr dé — 
Buk NE h Get Ir Ja lAr) ste dra (£) Plot U (r, 0, t) att = 1, 2, 3. If possible (it may be 


9. Apply the results of Exercise 8 to a circular membrane with radius 


pos 2 2 ^ . B . 
T Jo rJ; Anker) dr computationally taxing on older computers), animate the 


solution surface as a function of time. 


o —2, taking c = 1, and F(r,0) = f(r)g(@), where 


0 


fi) 


40(r 


ry? 


O<r< 


1 Laplace's Equation in a Sphere 


Problem Statement and Formulation 


Find u, the steady-state temperature inside a sphere of radius p — o if the temperature on 
the boundary, the surface of the sphere, is prescribed. 

Steady-state temperatures satisfy Laplace's equation, and in a sphere, it makes most 
sense to work in spherical coordinates. Using the definitions in the middle column of Table 
22.3, Section 22.3, and assuming the prescribed temperatures on the surface of the sphere 
are given by f (à), then they are constant on latitudes and u (o, $, 0) = f ($) on the surface. 
Hence, u is independent of the angle 0, the boundary condition is the homogeneous Dirichlet 
condition u(o, $) = f ($), and Laplace's equation in the sphere gives 


pN?u- p upp(p, $) + 2pu5(p, $) + ugs (p, $) + cot(Q)ug (p, $) = 0 (29.21) 
The only other condition on u(p, $) is boundedness, as dictated by the physics of the 
problem. 
Solution 


The solution is given by 


u(p,Q)— X Ax. p* Pr(cos $) (29.22a) 
k=0 
2k+1 f! 2k+1 [7 
Ap- T f (arccos z) B, (z) dz = ta f (6$) Px (cos ġ) sin $ do 
2g* =l 2g* 0 


(29.22b) 
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EXAMPLE 29.4 


Ao = i 
Ai=-% 

A3 = -u 
As =a 
Ay = — ant 
Ao = — gross 


TABLE 29.4 Coefficients A; in 
Example 29.4 


— t | ó 
0 1 2 3 
FIGURE 29.12 Example 29.4: 


Approximation of f ($) by uio, $) 


0 


FIGURE 29.13 In Example 29.4, 
temperatures along the z-axis; for z > 0, 
they are given by the dotted curve, and for 
z « 0, by the solid. 
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where P;(x) is the kth Legendre polynomial. The Legendre polynomials are detailed in 
Section 16.3. Incidentally, the solution to the exterior problem in which the temperature is 
again prescribed on the surface of a sphere but the domain of interest is the region outside 
the sphere is similar, being given by 


u(p, p) = >> Arp ™ Py(cos d) (29.23a) 
k=0 
2k+1 2k+1 
p ^ fascos: )P.(z) dz E PX (cos ġ) sing dd 
2g k= 20 k-1) 
(29.23b) 


Consider a sphere of radius ø = 2, on the surface of which the temperatures are prescribed 
by the function f($) — z . Thus, dt the sphere were the earth, the temperatures would vary 
linearly from zero at the North Pole, to 1 at the South Pole. To find the temperatures inside 
the "earth," use (29.22b) to compute the first 11 coefficients, listing the nonzero coefficients 
in Table 29.4. The even-indexed coefficients A24, k > 1, vanish (P»,(cos $) is even and 
f (4) is odd), and the surviving odd-indexed coefficients clearly go to zero rapidly. Hence, 
the series for u(p, $) will converge rapidly. A finite approximation to the solution is then 


the partial sum 
10 


uio, $) = 9 Arr" Px(cos o) 
k=0 
for which u10(2, $) should reproduce f (¢) = 2 
and $ = zt, this approximation is good. 

The temperatures inside the solid sphere cannot be "seen" and cannot be readily plotted. 
The rest of this example demonstrates a variety of techniques for visualizing and interpreting 
the temperatures inside the sphere. 

To begin, we first ask for the level surfaces inside the sphere. These are the isothermal 
surfaces, the surfaces on which the temperature remains constant inside the sphere. Because 
of the symmetry with respect to the angle 6, any vertical plane section through the z-axis 
supports the same temperature profile. In particular, right along the z-axis, the tempera- 
tures are a function of p, and these temperatures are plotted in Figure 29.13. The dotted 
curve represents temperatures along the positive z-axis, while the solid curve represents 
temperatures along the negative z-axis. 

Is it possible that for each plane section z — constant, the temperatures in the sphere 
are just the boundary temperatures at that height? If so, the isothermal surfaces would be 
disks, slices of the sphere parallel to the xy-plane. To test this hypothesis, compute the 
temperature on the z-axis at height z — 1.9, obtaining 0.068, and compare this value to the 
temperature on the DD at the same height. Since the temperatures on the nj cand 
are given by f ($) = Ê, the appropriate angle $ is given by $ = arccos : = arccos +2, The 
corresponding temperature is then f (arccos 0.95) = 0.101, and the hypothesis of ‘ dios 
is ruled out. The isothermal surfaces are not simply disks. 

Exploiting the solution's symmetry with respect to angle 0, a vertical plane section 
through the z-axis slices an isothermal surface in a curve. Imagine the sphere sliced by the 
yz "plane, exposing the circle of radius 2 shown in Pi gure 29.14. As angle $ varies from 0 
to 7, angle c varies from 5 to 0. Hence, set  — 5 — w and interpret o as the polar angle 
in the yz-plane. The curves in which this plane auis the isothermal surfaces are shown in 
Figure 29.15. 

If the graph in Figure 29.15 were rotated about the z-axis, the isothermal surfaces 
inside the sphere would be generated as surfaces of revolution. The isothermal surface 


. Figure 29.12 shows that except near @ = 0 


>y 


FIGURE 29.14 Example 29.4: Geometry 
of a cross-section that contains the z-axis 


0.4 Heat flux 


0 $ 


—0.4 


FIGURE 29.17 Example 29.4: Heat flux 
across the surface of the sphere 


FIGURE 29.18 Example 29.4: The field 
— Vu in the cross-section from Figure 
29.14 
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u(p, $) = 0.3is graphed, but not to scale, in Figure 29.16. Inside the sphere the temperatures 
can be represented as a stack of nested isothermal surfaces of a similar type, as an animation 
in the accompanying Maple worksheet shows. 


= y 


FIGURE 29.16 Example 29.4: A magnified 
view of the isothermal surface u(p, $) = 0.3 


FIGURE 29.15 Example 
29.4: Intersection of 
isothermal surfaces and 
cross-section in Figure 29.14 


The gradient field 
1 
Vu(p, $) = Upp + —ugeo 
p 


indicates how heat is transported across the level surfaces of u(p, $). In particular, —u p, the 
normal component of — Vu, indicates the heat flux across the surface p = o = 2. Figure 
29.17 shows a graph of —u,(2, $), the heat flux across the surface of the sphere. It was 
computed from the partial sum u»s(r, $) since computing a gradient involves differentiation, 
and the termwise derivative of a series generally converges more slowly than the series itself. 
The graph agrees with our intuition. At the North Pole, in the vicinity of ø = 0, the heat 
flow is out of the sphere since the temperature is lowest there. The graph shows a positive 
flux, indicating the heat flow is along the outward normal. At the South Pole, in the vicinity 
of $ = 7, the heat flow is into the sphere since that is the warmest part of the sphere. The 
graph shows a negative flux, indicating the heat flow is into the sphere and against the 
outward normal. 

To visualize the flow of heat inside the sphere, look at the plane section x = 0, the 
yz-plane inside the sphere. Figure 29.18 shows arrows of the field — Vu for y > 0. The 
flow of heat in the fourth quadrant is upward and to the right, whereas in the first quadrant 
it is upward and to the left. Clearly, heat flows from the warmer southern hemisphere to 
the cooler northern hemisphere. Above the equator there is also a component of heat flow 
through the boundary and out of the sphere, while below the equator there is a component 
of the heat flow into the sphere through the boundary. Ed 


Solution by Separation of Variables 


Apply the separation assumption u(p,$) = R(p)®(¢) to Equation (29.21), divide by 
u = RỌ, rearrange, and introduce the Bernoulli separation constant A to obtain 
,R'(p) R'(p) $"(9) $'(9) 
R(p) R(p) ($) $(9) 


cot(¢) A (29.24) 
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yielding the two ODEs 
p^ R” (p) + 2pR'(p) — AR(p) 20 (29.25a) 
sin($) $" (p) + cos($) 9'($) + Asin($)($) = 0 (29.25b) 
The p-equation is an Euler equation, solvable when 4 is known. The $-equation becomes 
(1 — x2)y" (x) — 2xy'(x) + Ay(x) 20 (29.26) 


Legendre's equation, upon making the change of variables x = cos(@). 
The change of variables is performed analytically by setting x — x($) — cos $ so that 


(p) = (arccos x) = y(x) = y(cos p) 
Then, starting with ®(¢) = y(x(@)), the chain rule gives 
db dydx dy 


= dp  dxd$ó dx aa 
and 
p” = S p = a yds [^ sin $] + EA [^ sin 9] 
do dx? do | dx dob | 


= — [-sin 4] [- sin $] + e cos $] 
dx? dx 


= y" sin? $ — y' cos ó 
— [1 — cos? 9]y" — y' cos ó 
= (1 —x*)y” — xy’ 
Then (29.25b) becomes 
sin(p)[(1 — x*)y” — xy'] + cos($)[- sin(@)y'] + Asin($)y = 0 
Factoring sin ġ and grouping the first-derivative terms, we finally have 
sin($)[(1 — x”) y” — 2xy’ + Ay] 20 


and therefore Legendre’s equation (29.26). 

The interval 0 < $ < z becomes —1 < x < 1 under the change of variables x = cos $. 
We saw in Section 16.3 that the condition of boundedness on the interval [—1, 1] leads to 
the eigenvalues A, = k(k + 1),k = 0,1,..., and to the corresponding eigenfunctions 
P, (x), the Legendre polynomials 1, x, 3x? — 1, 2x? o iosa If [x] is the greatest integer 
function, then the Legendre polynomials can be represented as 


[k/2] 


(—1)" (2k — 2n)!x*? 
Py (x) = 29.27 
k(x) 2 2kn!(k — 2n)'(k — n)! ( ) 


We also saw in Section 10.7 that the Legendre polynomials are orthogonal on the interval 
[—1, 1]. In fact, 


0 k£zj 


2 


2k + 1 


1 
/ Py (x) Pj (x) dx = 
=1 k= J 
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The solution of the p-equation (29.25a) is much more straightforward, since it is just 
an Euler equation (see Section 5.12). Restricting A to the eigenvalues, the equation becomes 


p^ Rt (o) + 2pR,(p) — k(k + 1) Re(p) = 0 (29.28) 


with solution Ry(p) = cio* +c2p *—!. Boundedness on the interior of the sphere demands 
c2 = 0, giving Ri(o) = p*,k =0,1,..., in the interior. Obviously, if solving Laplace’s 
equation on the exterior of the sphere, we would set c; = 0, giving Ry(p) = p™7!, k = 
0, 1, ..., in the region exterior to the sphere. 

We can now write a single eigensolution as 


uo, $) = p* P(cos $) 


and the general solution as the infinite sum (29.22a). The final boundary condition, the 
Dirichlet condition u(o, 6) = f ($), leads to 


f (4) = Y Axo P (coso) 


k=0 


Since f (à) has the Fourier-Legendre series 


f) = Yi ax P,(cosó) where o, = 


k=0 


5 JE. 
HELS Fg Picoso sinoap 
xd 0 


we conclude that Azo* = o, so A, is given by (29.22b). 


EXERCISES 29.4—Part A 


A]. Show the two integrals in (29.22b) are equivalent. 


A2. Show that the composition of an even function with an even 
function is again an even function. Hence, verify that Ax, k > 1, 
vanish, in Example 29.4. 


EXERCISES 29.4-Part B 


A3. Setu(p, 6) = R(p)P(¢) in (29.21), and verify that (29.24) results. 
A4. Obtain (29.252) and (29.25b) from (29.24). 
A5. Solve (29.28). 


B1. Verify the entries in Table 29.4. 
B2. Verify that (29.27) reproduces P(x), k =0,..., 10. 


In Exercises 3-12: 


(a) Solve the Dirichlet problem on the sphere of radius p — o if 
ulo, $) = f(g). 

(b) Obtain graphs of the level surfaces u = fmin + 
£ (fmax — fmin), k = 1, 2, 3. 

(c) Obtain graphs of the curves in which the yz-plane intersects 
the level surfaces obtained in part (b). 


(d) Obtain a graph of the normal component of the surface flux 
of u. 


(e) Obtain, in the yz-plane, a plot of the arrows of Vu, the 
gradient field inside the sphere. 


5 


B3. o —3, f(¢) = (£) B4. o = 1, f($) = sing 


B5. o = 1, f(¢) =sin2@ B6. o —2, f ($) = cos? à 

B7. o =5, f(¢) =m —¢)? B8. o = 5, f($) = pr —4) 
5 

B9. o = 4, f(¢) = GP — 9^) 


3 


B10. c = 4, f ($) = 89?e 7? 


B11. o =6, f(¢) = A 
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a < (e) Obtain, in the yz-plane, a plot of the arrows of Vu, the 
B12. 6 =6, f(¢) = 2 gradient field outside the sphere. 
T 2 
E B13. o =3, f($) = (2) B14. o = 1, f ($) = cos ó 
X 


In Ezereises 14-20; B15. o =1, f(d) =cos2@ B16. o = 2, f ($) = sin? à 
(a) Use (29.23a) and (29.23b) to solve the Dirichlet problem on Bl7.0—5,f(j)2-ó(x—4) B18. o =5, f(¢) = ó(x — ¢) 
the exterior of the sphere of radius p = o if u(o, @) = f (9). 


9 
- — o -—Á = — (r? — 
(b) Obtain graphs of the level surfaces u = E fmax — fmin), B19. o = 5, fF) - 6 (z -¢) B20. o = 5, f(b) = zx ee) 


k = 1,2,3. B21. o = 4, f ($) = 89e 7? 
(c) Obtain graphs of the curves in which the yz-plane intersects TA 0< m 
the level surfaces obtained in part (b). — *Y (o Ex =) << 2 
. 0 = " = 
(d) Obtain a graph of the normal component of the surface flux = ul A T 
of u, interpreting u as temperature, and flux, as heat flow. 2 2 = 


The Spherical Dielectric 


Problem Statement and Formulation 


A dielectric (nonconductor of electricity) in the shape of a sphere of radius c is placed in 
a uniform electric field E = nk, where k is the unit vector in the z-direction. Determine 
v(p, $), the potential both inside and outside the sphere. 

The potentials inside and outside of the sphere, u (p, $) and U (p, $), respectively, must 
each satisfy Laplace's equation and, in addition, the continuity conditions 


u(c,Q) — U(o, 0) and ku,(o,¢) = U,(o, >) 


for the positive constant x. The second condition expresses the equality of the normal 
components of the electric displacement vector D = £E across the dielectric surface. Far 
from the dielectric, the exterior potential must approach the potential for the uniform field 
E, so that limp... U (o, $) = —nz = —np cos(Q). 


Solution 
The solution, derived later in this section, is given by 


u(p,$) — — 2l peosd O<p<o 
K 
v(p, $) = (29.29) 


k — 1 cos 
U(p, ¢) = —np cos ó + no? = oO X p « oo 
K+2 p* 


EXAMPLE 29.5 Setting n = 1, o = 1, and x = 4, the solution becomes 


1 
uilo: 9) = —7,pcos 0xpzl 


cos ġ 


v(o,Q) = 1 
Ui(p,$) = —pcos¢ + = l<p<o 
2 p 


a solution we will now proceed to interpret graphically. As in Section 29.4, slicing the 
sphere through the yz-plane allows us to change to polar coordinates with the polar angle 
taken as w = 5 — $, as shown in Figure 29.14. 


FIGURE 29.20 Example 29.5: Flow 
lines (in black) superimposed on 
equipotentials (in color) in the yz-plane 
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The solution, with respect to the polar variables o and c, is then 


V(p,@) = 


A graph of the equipotentials for the solution would consist of a set of surfaces. The inter- 
section of these surfaces with the yz-plane is the set of curves shown in Figure 29.19. 


FIGURE 29.19 Example 29.5: Intersection of 
equipotential surfaces with the yz-plane 


The flow lines of the electric field are generally called the lines of force, or field lines. 
We can obtain a graph of these lines by integrating the gradient field for the exterior potential. 
Since this will be easier in Cartesian coordinates, convert the polar coordinates on the yz- 
plane back to the Cartesian variables y and z using the transformations p = y y? + z? and 
c) = arctan <. Thus, the exterior potential, restricted to the yz-plane, becomes 


(y + 2) -— 


and the differential equations for the flow lines are then 


NIN 


OP? and z'(t)=1+ m sar an 

2 (y? + 2?) e 
The resulting flow lines are shown in Figure 29.20, superimposed on the equipotentials of 
Figure 29.19. Of course, inside the circle, the flow lines (not shown) are just vertical line 
segments. Under the symmetry in the angle 6, the diagram can be rotated about the z-axis. 
Inside the circle, the vertical field lines become cylinders with axis parallel the z-axis, and 
the equipotentials become segments of planes parallel to the xy-plane. $ 


y(t) = fyz (y? +2’) 


Derivation of the Solution 


From Section 29.4, the interior solution to Laplace’s equation in a sphere is of the form 
oo 


u(p, $) = Y axp* Pk (cos d) 


k=0 
while the exterior solution is of the form 


U(p, à) = 3 (arp + Bro  ) Pi (cos d) 


k=0 
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Because the electric field does not vanish at infinity, we did not take a, = 0, k = 0, 1,.... 
In fact, for p large, U (p, 9) must tend to —7p cos $. Since Pj (x) = x, we recognize cos @ 
as Pj (cos $) and realize we should take «9 = 0, a) = —5, a, = 0, k —2,3,.... Thus, the 
exterior solution reduces to 


U(p,Q) = —np Pi (cos) + »» 07 P, (cos $) 


k=0 
The coefficients a, and fj, are determined by the continuity conditions on the surface 
of the sphere. The condition u(o, $) = U (øo, $) requires the coefficients satisfy 


oo (e0) 
X aco" Py =—noP, + >. fio | P, (29.30) 
= k=0 


If the sums in (29.30) are truncated at k = 5, we obtain 
u(o, $) = ao Pp + ajo Pi + mo? P» + a30° P + a40^ P4 + ds? Ps 


P, P > P» P 4P. P 
Ulo, p) = -no P, + P PR LP B PER, P EM 


c? o^ o 
Coefficients of like Legendre polynomials must match on the left and right sides of the 
equation u (o, $) = U (c, ġ), so subtract and group terms according to 


(a - f) Po + CL = £) Pi + («e - £) Pa + (a g?— A) P; 
o Oo oO c^ 
— C — A) Pat c — E) Ps =0 
o oê 


Thus, each coefficient of a Legendre polynomial must vanish identically, giving rise to the 


fi 
5 T 


o 


equations 
Bo Pi , É 
dyj— — —0 aj0ct540———0 aot- =O 
o o? o` 
3 Ba s Bs 
dg? — = =0 ayot — — =0 aso” — — =0 
o o o 


Except for the case k = 1, each equation appears to be of the form a,o" — f, /o"*! = 0. 
The second continuity condition, xu, (0, $) = U, (0, $), requires that we differentiate 
with respect to p and, then evaluate on the surface. Truncating as earlier, we obtain 


un =a, Pi + 2a50 P; + 3a30? P + 4a40? Py + 5asc? Ps 
BoPo ByPi _4B2P2_ ,BaPs _ BaPa —QPsPs 


=) ^" o? g^ 6 7 
Again, to match like-coefficients of Legendre polynomials we subtract to form the equation 


BoP 0 
o? 


Un = nP: g5 - o 


d ( + Ka, +261) Pi (2x20 + 35) Pa + (ayo? +45) P3 
o o? 


E (saso + s$s) P4 + (kaso + 2) Ps 0 
o o 


The identical vanishing of each coefficient of a Legendre polynomial leads to the equations 


Bb g rap =p wao +322 =0 
o o 


3kaz0o? + 48 =0 4ka40? + a 


A =0 5kaso*+ e = 
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Except for the case k — 1, it appears the general equation is of the form nka,0"-! + 


(n + 1)B,/o"*? = 0. 


Now, consider the equations in pairs, the first pair being 


Bo 


ay—— —-0 and ~=0 
[03 oO 


Being homogeneous, the equations indicate ao = 0, By = 0. However, the next pair, 


ao 4- go — Pi =0 and n+Kka, pafi ex 
ag? g 


is not homogeneous and need not have the trivial solution. The remaining pairs are again 
homogeneous, as we can see from, for example, 


The general pair is 


ano” — 


ott! 


Po 
3 


ao“ — — —0 and 2kao + gha =0 
o 


(n + Ds 
ne E n )B —0 


=0 and nka,o 3 
ott 


with solution a, = 0, Bn = 0. These equations are homogeneous with nonzero determinant, 


as can be seen from 


g* t. 
ott n+1l+kn 
„i fel o? 
KNO g"+2 


Hence, it seems as though only a; and £; are nonzero, with all the remaining coefficients 


equal to zero. 


Thus, the interior and exterior solutions, inheriting this information about the coeffi- 
cients, indeed become (29.29). 


EXERCISES 29.5 


1. The BVP of this lesson prescribes at infinity, the potential exterior 


to a spherical dielectric. Alternatively, suppose the exterior 


potential were prescribed on a surrounding sphere of radius p — S. 


Then, the Dirichlet problem would be V?^u = 0 inside p =o , 

V?U — 0 foro < p < S, and U(S, $) = F(@), 

ulo, ġ) = U(o, $), Ku, (a, $) = U,(o, Q). Solve this BVP by 

completing the following steps. 

(a) Write u(p, $) = Yo acp Px (cos 6) and U (p, 9) = 
Tolar + Bp *-!) P; (cos $) for the interior and exterior 
potentials, respectively. Compute F ($) = Yo fi Picos à). 
the Fourier-Legendre expansion of F(¢). Hence, obtain 
fe = PER f FO) Pk (cos 9) sing dg, k — 0, 1, .... 

(b) Form Equation 1 by equating coefficients of Legendre 
polynomials in U ($, 9) = F(9). 

(c) Form Equation 2 by equating coefficients of Legendre 
polynomials in u(o, $) = U (ø, $). 

(d) Form Equation 3 by equating coefficients of Legendre 
polynomials in ku,(o, $) = U,(oc, $). 


(e) Solve Equations 1-3 for ax, o, and By. 


. u(p,Q) O<p< i ! 
(f) Write v(p, $) — p. MINE as the solution of 
U(p,$) ozxpzS 


the BVP. 


In Exercises 2-13: 


(a) Obtain, by the results of Exercise 1, v(p, @). 

(b) For the series in part (a), let V (p, $) bea partial sum for which 
V(S, $) is a reasonable approximation to F (9). This 
approximation can be checked graphically by plotting both 
V(S, p) and F(@) as functions of ¢. 


(c) In the polar coordinates p, w, =T < o < T, obtain (in the 
yz-plane) level curves (equipotentials) of 
ps 


V(op, o) = V(p, Z — o). 


(d) Obtain Y (y, z= V( y? + 2’, arctan =), and solve the 
differential equations y'(t) = —Ŷ, (y, z), z(t) = ~V.(y, z) for 
the flow lines between the two spheres. Take initial points 
around the dielectric sphere and produce a graph of flow (field) 
lines superimposed on the equipotentials. (If you have access to 
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software that will numerically generate a phase portrait in polar 


coordinates, it would certainly be easier to work in the 
coordinates p and o.) 


2.0 =1,5=5,«=3,F(6) = 10(2) 
3. =1,$=5,«=3,F6)=10(2) 
4.0 = Sese re) = 10(2) 
5.0 =2,S=4,« = 5, F(Q) = 10sing 
6.0 22,8 —4,k = 5, F ($) = 10cos?¢ 
7.0 =2, S = 4,k = 5, F(¢) = 10sin2¢ 
8. o = }, S =2, K = 5, F ($) =8¢e* 
9. o =}, S —2,k = 1, F(9) = 86e” 
10. o = 4, S =2,« = i F(¢) = 5ġ (7 — 4) 
11. o = 4, S =2,K = i, F ($) = 5% — $) 
12. o = }, S =2,K =}, F ($) = $r — $» 
13. o = }, S =2,K = }, F ($) = pr — 6)? 
14. Repeat Exercise 1 for the case in which F (¢) is the normal 


In 


C 


1. 


component of VU on the surface p = S. The condition 

U,(S, $) = F(@) means ag and œo are indeterminate. Thus, the 

potential v(p, $) is determined up to an additive constant for the 
Neumann problem. Show, in fact, that if fọ = 0, then Bo = 0 and 
ag = o and that otherwise, there is no solution to the problem. 


Exercises 15-22: 


(a) Obtain, by the results of Exercise 14, v(p, à). 


hapter Review 


Working in polar coordinates, obtain the separation of variables 
solution for the Dirichlet problem on a disk of radius o. The 
Dirichlet problem consists of Laplace's equation on the disk, and the 
prescription of u(o, 0) = f (0) on the circumference of the disk. 


(a) State the appropriate BVP. Show how the requirement of 
smoothness leads to the periodic boundary conditions. 


(b) Write Laplace's equation in polar coordinates, and carry out the 
separation of variables. Show how the separated boundary 
conditions lead to the eigenvalues and eigenfunctions. 


(c) Show how the coefficients in the infinite series solution are 
determined through the medium of a Fourier series for the 
boundary function. 


. Interpreting the Dirichlet problem in Question 1 as determining the 
steady-state temperatures on the disk, what is the solution if 
f (8) = 1? Before doing any computing, think of the physics! 
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(b) For the series in part (a), let V (p, @) be a partial sum for which 
V,(S, @) is a reasonable approximation to F(@). This 
approximation can be checked graphically by plotting both 
V (S, $) and F(@) as functions of $. 

(c) In the polar coordinates p, w, =m < w < 7, obtain (in the 
yz-plane) level curves (equipotentials) of V(p,o) = 


V(p, 5 — o). 

(d) Obtain V (y, ge V(/y? + z?, arctan €), and solve the 
differential equations y'(t) = -V,(y, z),z'(t)- — Y. (y, z) for 
the flow lines between the two spheres. Take initial points 
around the dielectric sphere and produce a graph of flow (field) 
lines superimposed on the equipotentials. (See the comment in 
part (d) for Exercises B2-13.) 

15. o = 1, § = 4, xk =2, F(ġ) = 3sin2¢ 
16.0 = 1, S = 4,x = 2, F($) = 3 cos 
2 . | SS 3 - 
7.0 = =,5=3,0= 7, F@) =! (o- ;) 
2 | mA 
18. 6 = 5,5=3,« = 7, FG) -3(9— 7) 
19. o =2, S = 5,k =3, F(9) = 39? +26 +6 — n(3z + 1) 
12, 10 24 
20.0 22,8—5,k 23, F(¢) = —¢° — —ó ;—1 
m? T n? 
21.0 :—2,$ —5,ie —3, 
j 6 R +. 6 12 
F$) =2¢ t|—5-32]ó —|7 ——]6 t — 
n? 7c 
22.0 =2, 8S 25,k —3, 
P 2 5 5 10 24 

F(¢) =2¢°+ | 5-31) @ +(x Ota! 

z? m? 


. Solve the problem in Question 1 if ø = 2 and f (0) = x? 


— 6, 


4. Use separation of variables to solve the Dirichlet problem for the 


exterior of the disk of radius o wherein the value of u is prescribed 
on the circumference of the disk and Laplace’s equation is to hold 
outside the disk. 


. Answer Question 4 if o = 2 and f (8) = x? — 0? on the 


circumference of the disk. 


. Working in polar coordinates, obtain the separation of variables 


solution for the Neumann problem on a disk of radius o. The 
Neumann problem consists of Laplace's equation on the disk, and 
the prescription of the directional derivative normal to the boundary. 
The geometry of a disk renders u,(o, 0) = F(0) as the appropriate 
Neumann condition. Explain the physical meaning of the additional 
condition [adl F(0)d0 = 0, which must be imposed in order for the 
Neumann problem to have a solution. 


7; 


Working in cylindrical coordinates, obtain the separation of variables 
solution to the Dirichlet problem in a cylinder of height / and radius 
c, with u prescribed as a function of r on top of the cylinder and zero 
on all other surfaces of the cylinder. Show how separation of 
variables leads to Bessel's equation as part of a singular 
Sturm-Liouville eigenvalue problem. Show how the coefficients in 
the infinite series solution are determined via the medium of a 
Fourier-Bessel expansion of f (r), the function giving the values on 
the top surface of the cylinder. 

Sketch the separation of variables solution for the wave equation on 
the disk of radius ø having a clamped circumference and an initial 
displacement that is just a function of the radius r. 
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9. Sketch the separation of variables solution for the Dirichlet problem 
in a sphere of radius o if the value of u prescribed on the surface of 
the sphere is a function only of the angle between the z-axis and the 
radius vector. Show how separation of variables leads to Legendre's 
equation as part of a singular Sturm-Liouville eigenvalue problem. 
Describe how the eigenvalues and eigenfunctions are determined by 
Legendre's equation and the requirement of boundedness. Show how 
the coefficients in the infinite series representing the solution are 
determined from the Fourier-Legendre expansion of the function 
giving the surface values. 
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Chapter 30 


Transform Techniques 


INTRODUCTION Boundary value problems posed on infinite domains cannot 
be solved with series techniques. For such problems, we use integral transforms such as the 
Laplace or Fourier transform. For example, we use the Laplace transform to solve the heat 
equation in a semi-infinite rod. It is here that the notion of a partial transform of a function 
of several variables is developed. And it is here that the roles played by the data and the 
PDE are examined. 

We then introduce the Fourier transform for problems whose spatial domain is the whole 
real line. The theoretical basis for the Fourier transform is the Fourier integral theorem by 
which a function is represented as a double integral of itself. The inner integral defines the 
transform, and the outer, the inverse transform. The operational properties of the Fourier 
transform and its inverse, as well as convolution, are important here. 

The Fourier transform is used to solve the one-dimensional wave equation on an in- 
finite domain, the outcome being D'Alembert's solution. It is also used to solve the one- 
dimensional heat equation on the infinite rod and Laplace's equation on the infinite strip. 

Restricted to odd functions, the Fourier transform becomes the Fourier sine transform, 
which can be used to solve such problems as Laplace's equation on the quarter-plane. 
Restricted to even functions, the Fourier transform becomes the Fourier cosine transform, 
which can be used to solve such problems as Laplace's equation on the semi-infinite strip. 


Solution by Laplace Transform 


Partial Laplace Transforms 


We call the Laplace transform with respect to one of the variables in u(x, y) or u(x, t) 
the partial Laplace transform [43]. To indicate which variable has been “transformed,” we 
adopt the notation 


Lua, y o UG y) o f uie dx 
0 
for the partial transform with respect to x and 
oo 
Ly[u(x, y)] = U(x, s) = Í u(x, ye? dy 
0 


for the partial transform with respect to y. In the first case, the variable y is held constant; 
while in the second, x is held fixed. Of course, the notation would change accordingly, if 
instead of y, the second variable were f. 


EXAMPLE 30.1 


EXAMPLE 30.2 
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The partial Laplace transforms of the function u(x, y) = x? + 2y can both be obtained 
using the linearity and ordinary operational rules of the Laplace transform. The results are 


2 ) x? 2 
Ly[u(x, y)) = U (s, y) = — + 22 and L,[u(x, y)] =U(x,s) = a +> 
4 s ' s 4 


S 


:$. 
«s 


a 


PARTIAL LAPLACE TRANSFORM OF PARTIAL DERIVATIVES Since our intent is the use of the 
Laplace transform to solve partial differential equations, it behooves us to determine how 
partial derivatives transform under the partial Laplace transform. In a differential equation 
containing both u,, (x, y) and u,, (x, y), the partial transform, with respect to x or y, and 
of either derivative, may occur. Hence, 


Ly|[ux(x, y)] 2 sU(s, y) — u(0, y) 
Ly[ux (x, y)] 2 5?U (s, y) — su(0, y) — ux (0, y) 
and 
Ly[uy(x, y)] =sU(x, s) — u(x, 0) 
Ly|[uyy(x, y)] 9 s2U (x, s) — su(x, 0) — uy (x, 0) 
but 
oa i ae a 
Lx[uy(x, y)] =f uy(x, yje " dx = >f u(x, ye dx = —U (s, y) 
0 | dy Jo dy 


oo B a? oo ] 32 
L luy (x, y)] af uyy (x, y)e “dx = — f u(x, y)e ^ dx = — U (s, y) 
i 8y^ Jo dy* i 


and 
o e a [* = ð 
Ly[ux(x, y)] = ux(x, ye "dy = — u(x, ye dy = —U (x, s) 
Š 0 Ox 0 Ox 


y F 


oo oo 90^ 
Ly [ux (x, y)] =i Uxx(x, y)e "dy = =| u(x, y)e ? dy = — U (x, s) 
: 0 ax? Jo Ox? 


Applying the partial Laplace transform to a partial differential equation may convert the 
partial differential equation into an ordinary differential equation in the unknown transform. 
It may also lead to a more difficult equation! 


The Laplace transform can be used to solve the boundary value problem consisting of the 
partial differential equation u, (x, y) + xux(x, y) = x on the first quadrant (0 € x < oo, 
0 < y < oo) subject to the boundary conditions u(x, 0) = 0 and u(0, y) = 0. 

If x is held fixed, the term xu, (x, y) will transform most simply as a constant multiple 
of a derivative. The less desirable alternative is the transform of a derivative multiplied by 
a variable. Taking the partial Laplace transform with respect to y gives 


sU(x,s) —u(x, 0) + xU,(x, s) = E (30.1) 
S 
The first boundary condition gives u(x, 0) = 0, so (30.1) becomes 
sU(x,s) -xU,(x,s) = = (30.2) 
s 


This is an ordinary differential equation in the function U (x, s), where s is simply a 
parameter. The independent variable is x and the dependent variable U . Hence, let U(x, s) = 
F (x), and rewrite (30.2) as 


xF'(x) -sF(x) = - (30.3) 
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FIGURE 30.1 Solution surface for 
Example 30.2 


EXAMPLE 30.3 


The other boundary condition contains u(0, y), so take the partial Laplace transform to 
obtain U (0, s) = 0, equivalent to the initial condition F(0) = 0. The differential equation 
(30.3) is a first-order linear equation, but the initial condition is prescribed at x — 0, a 
singular point for the differential equation. Hence, the general solution, after invocation of 


the integrating factor e/ 6/9 4* = x°, is 


x**! 4 eys(s +1) 
JO 30.4 
p Pun s(s +1) ( ) 


Applying the initial condition leads to c; = 0 and F(x) = 7; so that U(x, s) = F(x) 
and u(x, y) = x(1 — e ?),a portion of which is shown in Figure 30.1. 


Finally, note that taking the partial Laplace transform with respect to x yields 


ð 0 
: U(s, y) —U(s, y) —s—U(s, y) => 
dy ðs s? 
still a partial differential equation! e 


THEOREM 30.1 


If the transformable function f (t) is bounded (| f (t)| < M),thenlim; ,s; |F (s)| = 0. 


This follows easily upon the obvious estimate 


oo i oo . S oo m M 
f (De ^ dt aj Lf (0e ldt < mf e "dt = — 
0 0 0 


S 

Thus, the Laplace transforms of bounded functions will go to zero as s goes to infinity. 
For example, f(t) = sint is bounded by M = 1, and L[f] = zu clearly goes to zero as 
s goes to infinity. 

Equivalently, if a Laplace transform does not go to zero as s goes to infinity, then the 
function from which it came is not bounded. However, avoid the temptation to argue that 
since L[5(t)] = 1, which certainly does not go to zero as s goes to infinity, the Dirac delta 
function ô(t) is not bounded. The Dirac delta is not a “function,” and Theorem 30.1 really 
does not apply to it. 


|F(s)| = 


Solve the heat equation for a semi-infinite rod if the rod is initially cold, the left end 
remains warm, and the solution remains bounded. Thus, we pose the boundary value problem 
consisting of the one-dimensional heat equation u; (x, t) = KU, x(x, t) on the first quadrant 
(0 « x < œ,0 « t < oo) of the xt-plane, the boundary condition u(0, t) = A, and the 
initial condition u(x, 0) = 0. Boundedness of the solution plays a vital role because of 
Theorem 30.1. 

The partial Laplace transform with respect to t gives 


SU (x, s) — u(x, 0) = kU,,(x,s) 


which the initial condition u(x, 0) — 0 simplifies to 
SU (x,$) = KU (x, 5) 
Again writing F(x) — U(x, s), we have the ODE 
sF(x) 2kF'(x) 


The error function, erf(z) 


Shaded area represents 
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with general solution 
F(x) = cje” ysi“ 4 oe s/k 


For F(x) = U(x, s) to invert back to a bounded function u(x, t), the transform must vanish 
as s goes to infinity. This suggests setting c; = 0, giving F(x) = ce V5/* The boundary 


condition u(0, t) = A transforms to U (0, s) = 4 = F(0). Hence, cz = 4, so we have 
A ss 
U(x,s) = —e *v5/* 
s 
and using a sufficiently robust table of transforms (or using a suitable computer algebra 


system), we find 
X 
i.n - (1 t ( )) 
2 kt 


where erf (z), the error function, is defined as 


9 E » 
erf(z) = ai e^? do 
0 


Since erf(—z) = —erf(z), the error function is odd and lim,_,.,erf(z) = 1, as seen in 
Figure 30.2. For z > 0, the value of erf(z) is the shaded area in Figure 30.3, a graph of 
fo) = 2e 


Finally, if in u(x, t) we set A = 2 and x = 1, we get the function 


u(x,t) =2 (: — erf (25) (30.5) 


graphed as the surface in Figure 30.4. The instantaneous rise in temperature everywhere is 
suggested both in the graph of the solution surface and in the animation of the plane sections 
t — constant available in the accompanying Maple worksheet. 
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FIGURE 30.4 Solution surface for Example 30.3 


For every x, the temperature instantly rises, no matter how small t might be. For fixed x 
and small enough ż the argument of the error function in u(x, t) is large. In (30.5), replacing 
with z and expanding for large z gives 


x 


2t 


e F2 1 E 
2(1 — erf(z)) = n (- — 5) + o (ze ) (30.6) 
If x 210, thenz — 3 and (30.6) becomes 
JieW5/* 


t g 
10, t) = 2 ge 30.7 
u(10, t) we ( =) +0 e ) (30.7) 
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At t = 0.01, the first term on the right in (30.7) evaluates to 0.414 x 1071057, a small but 


positive temperature. 


The limiting temperature at any given x is u = 2 since lim;.,5,2(1 — erf (;57:)) 22, 
Every point in the rod experiences an instantaneous rise in temperature, and the whole rod 


will eventually be at temperature u — 2. 36 


EXERCISES 30.1—Part A 


PX 


A1. Verify that (30.4) is the general solution of (30.3). 
If, in Exercises A2—6, a and b are constants: 


(a) Show that L,.[f.(x, y)] =sF(s, y) — f(0, y). 
(b) Show that L,[ f. (x, y)] = Fix, s). 
(c) Show that L,[f, (x. y)] = F(s, y). 


(d) Show that L [fy Œ, y)] = sF (x, s) — f(x, 0). 
(e) Show that L,[ f. (x, y)] = s? F (s, y) — sf(0, y) — f.(0, y). 


EXERCISES 30.1-Part B 


(f) Show that L,[ f, (x. y)] = FG, y). 

(g) Show that Ly [fer (x. y)] = Fux (x, s). 

(h) Show that L,[ fyy (x, y)] = s?F(x,s) — sf(x, 0) — f(x, 0). 
A3. f(x, y) = ae? sin by 

AS. f(x, y) = a y? — be” 


A6. f(x, y) = g(ax — by), where g(x) is twice differentiable 


A2. f(x, y) =asinx + be^? 


A4. f(x, y) = ax sin y + by? cos x 


B1. How accurate is (30.7) when it is used to make the approximation 
u(10, 0.01) = 0.414 x 1077957? Hint: In the error term in (30.6), 
5 


substitute z — X» 


In Exercises B2-11: 


(a) Solve by Laplace transform. 
(b) Graph the solution surface. 
B2. xu, 4-3u, 20,u(x,0) = 0, u(0, y) = y? 
B3. xu, + ux = 0, u(x, 0) = 1, u(0, y) = y? 
B4. xu, + 5ux = 0, u(x, 0) = 7, u (0, y) = sin y 
B5. xu, + 2u, = 0, u(x, 0) = 4, u(0, y) = cos y 
B6. 2xu, + Tux = 3x, u(x, 0) = 2, u(0, y) = y 
B7. 2xu, + 3u, = 5x, u(x, 0) = 4, u (0, y) = sin y 
B8. 5xuy + 2u, = 4x, u(x, 0) = 1, u(0, y) = cos y 
BY. 3u, + yu, = 0, u (0, y) = 1, u(x, 0) = e™ 
B10. 5u, + yux = 0, u (0, y) = 2, u(x, 0) = x sinx 
B11. 4u, + yu, = 0, u (0, y) = 3, u(x, 0) = e* cos 2x 


B12. For the BVP u, = ux, 0 < x < œ, t > 0, u(x,0) = 0, 
u(0, t) = 1, the heat equation on a semi-infinite rod: 


(a) Use the Laplace transform to obtain a bounded solution. 
(b) Plot the solution surface. 


(c) Plot temperature profiles at several increasing times, or create 
an animation if suitable software is available. 


B13. 


For the BVP u, = 2u,,,0 < x < œo, t > 0, u(x, 0) = 0, 
u(0, t) = 10sinż, the heat equation on a semi-infinite rod, 


use the Laplace transform and the following steps to obtain the 
z a i=, OK t —x?/8r o E —3/2 
solution u(x,t) = ox Jo € sin(f — T)T dt. 


(a) Apply L, to the heat equation, taking the initial data as 
u(x, 0) = 0, obtaining an ODE in U (x, s). 

(b) Solve the ODE along with the boundary conditions 
U(0,s) 20, U(p, s) 20, p > 0. 

(c) Obtain u(x, t) by letting p — oo in U(x, s) and inverting. 

(d) Numerically evaluate u(5, t) for a sequence of times t in an 
attempt to discover if the temperatures at x — 5 oscillate, 
increase, or remain zero. 

For the BVP u, —u,,,0xx-«oo,t»0,u(x,0) 20, 

u, (0, t) = —1, the heat equation on a semi-infinite rod: 


B14. 


(a) Apply L, to the heat equation, taking the initial data as 
u(x, 0) = 0, obtaining an ODE in U(x, s). 

(b) Solve the ODE along with the boundary conditions 
U'(0, s) = —1, U(p,s) =0,p > 0. 

(c) Obtain u(x, t) by letting p — oo in U(x, s) and inverting. 

(d) Plot the solution surface. 

(e) Plot temperature profiles at several increasing times, or create 
an animation if suitable software is available. 

(f) Since heat is being continuously pumped into the left end of 
the rod, what is the ultimate fate of the rod’s temperature? 


B15. Repeat Exercise B14 for the boundary condition u(x, 0) = 1, 
u,(0, t) = 1. 
B16. For the BVP u; = u,,,0 < x < c,t > 0,u(x,0) = 1, 


u,(0,t) = 1u(0, t), the heat equation on a semi-infinite rod 


B17. 


B18. 


B19. 


B20. 


whose left end is subject to a homogeneous Robin condition (after 
the French mathematician Victor G. Robin, 1855-1897): 
(a) Apply L, to the heat equation, taking the initial data as 
u(x, 0) = 1, obtaining an ODE in U(x, s). 
(b) Solve the ODE along with the boundary condition 
U(p,s) 20, p> 0. 
(c) Let p — oo in U (x, s), leaving one constant of integration 
that is determined by applying L,[u, (0, t) = iu(0, t)]. 
(d) Invert U (x, s) using L^! [ae /s (a + J/5)] = 
ee erfc (avi + zx) 4- erfc where 
erfc(z) = 1 — erf(z). (This transform is entry 29.3.89, 
p. 1027, in [1].) 
(e) Plot the solution surface. 


(f) Plot temperature profiles at several increasing times, or create 
an animation if suitable software is available. 


For the BVP u, = uxx, 0 < x < œ, t > 0, u(x, 0) = 0, 

u(0, t) = e™ , the heat equation on a semi-infinite rod, use the 

Laplace transform and numeric evaluation of the convolution 

integral to obtain a graph of u(1, t). 

For the BVP u, = Lus. 0x «oo,t -0,u(x, 0) 20, 

1, (0, t) = —106(t), the heat equation on a semi-infinite rod with 

an impulsive flow of heat at the left end: 

(a) Use the Laplace transform to obtain a bounded solution. 

(b) Plot the solution surface. 

(c) Plot temperature profiles at several increasing times, or create 
an animation if suitable software is available. Note that the 
initial bulge of raised temperatures disperses as the heat 
progresses along the rod. 

For the BVP u, — ies 0O<x<1,t>0,u(x,0) =0, 

u(0, t) = u(1, t) = 1, the heat equation on a finite rod with both 

ends kept at the same temperature: 

(a) Apply L, to the heat equation and solve the resulting ODE to 
obtain U (x, s). 

(b) Expand U(x, s) in powers of 7^5, and invert termwise to 
obtain a partial sum of a series solution to the BVP. 

(c) Plot the solution surface. Note that the initial region of 
lowered temperatures disperses as the heat progresses along 
the rod. 

(d) Determine the time at which the lowest temperature in the rod 
(clearly at x = +) is within 10% of the steady-state 
temperature of 1. 


For the BVP u,, = u,,,0 x «oo,t > 0,u(x, 0) = 
sint O<t<zZ , 
u;(x, 0) = 0, u(0, t) = = , the wave equation 
0 [tm 
on a semi-infinite string: 
(a) Use the Laplace transform to obtain a bounded solution. 


(b) Take c — 1 and plot the solution surface. 
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(c) Animate the motion in the string, or graph snapshots of the 
solution for a succession of times f. 
In Exercises B21—23, use the Laplace transform to obtain a bounded so- 
lution of ur = u44,,0 € x < oo, t > 0,u(x, 0) = f(x), u,(x, 0) = 0, 
u(0, t) = 0, lim, s u(x, t) = 0, the BVP for the wave equation on a 
semi-infinite string. In particular: 
(a) Apply L; to the wave equation, using u(x, 0) = f(x) and 
u(x, 0) = 0 as the initial data. 
(b) Solve the resulting ODE, using U (0, s) = 0 and 
U(p, s) — 0, p > 0, as boundary data. 
(c) Obtain U (x, s) by letting p — oo. 
(d) Invert to obtain u(x, t). 
(e) Plot the solution surface. 
(f) Graph the solution for several increasing values of t, or 


animate the displacements in the string if suitable software is 
available. 


B21. f(x) 2e* B22. f(x) =xe* B23. f(x) = xe 

B24. For the BVP u, = u,,,0 < x < 1,t > 0,u(x,0) =u, (x, 0) = 0, 
u,(1, t) = 1, modeling an elastic bar of length 1 with left end 
fixed and right end pulled by a constant force: 


(a) Obtain U(x, s), the Laplace transform L,[u(x, t)]. 


(b) Expand U (x, s) in powers of e7% 


a partial sum of a series solution. 


, invert termwise, and obtain 


(c) Plot the solution surface. 


(d) If appropriate software is available, animate the displacements 
in the bar. 


(e) If appropriate software is available, animate the actual motion 
of the bar. 


(f) Explain why the bar supports oscillations if there is a constant 
force pulling on the right end. 


B25. For the BVP u,, —u,,0xxzxl,t-0,u(x, 0) = u,(x, 0) 20, 
u,(1, t) = i sin 5t, modeling an elastic bar of length 1 with left 
end fixed and right end subjected to a periodic force: 


(a) Obtain U (x, s), the Laplace transform L,[u(x, t)]. 

(b) Expand U (x, s) in powers of €^? , invert termwise, and 
obtain a partial sum of a series solution. 

(c) Plot the solution surface. 


(d) If appropriate software is available, animate the 
displacements in the bar. 


(e) Plot 1 + u, t) to visualize the actual motion of the center of 


the bar. 
B26. For the BVP u, = uxx, 0 < x < 1,t > 0, u(x, 0) = u,(x, 0) = 0, 
ux(1,t) = —158(0), modeling an elastic bar of length 1 with left 


end fixed and right end subjected to an impulsive force: 
(a) Obtain U (x, s), the Laplace transform L, [u(x, t)]. 


(b) Expand U (x, s) in powers of e 7^, invert termwise, and obtain 
a partial sum of a series solution. 


676 Chapter 30 Transform Techniques 


(c) Plot the solution surface. (b) Solve the resulting ODE, using U (0, s) = 0 and 
(d) If appropriate software is available, animate the displacements U'(p, s) = 0, p > 0, as boundary data. 
in the bar. (c) Obtain U(x, s) by letting p > oo. 
(e) Plot 1 E u(s, t) to visualize the actual motion of the center of (d) Invert to obtain u(x, f). 
the bar. (e) Plot the solution surface. 
B27. The BVP u, 3 us,,0xx«oo,t > 0,u(x, 0) = 0, (f) Plot x + u(x, t) for several values of x. 
u(x, 0) = —5, lim, ss Ux (x, t) = 0 models the motion of a mx shi : i : 
semi-infinite elastic bar moving right to left with velocity — + and Spp Eine Qaod rhat happensito thie D 
hitting a solid wall at x — 0. To solve this problem: j (h) Change the initial velocity to —1 and again solve, describing 
- i s what now happens to the bar. Is this physicall 
(a) Apply L, to the wave equation, using u(x, 0) = 0 and -a a a ee ee eae 


ux, 0) = -i as the initial data. 


. The Fourier Integral Theorem 


Exponential Form of the Fourier Integral Theorem 


The remarkable Fourier integral theorem expresses, under suitable conditions, the function 
f (x) asadouble integral with itself. There are two equivalent ways of writing the exponential 
form of this double integral and several ways of writing the trigonometric forms. With 
i = 4/—1, we have, for the exponential form of the theorem, 


THEOREM 30.2 


1. f(x) and f'(x) are piecewise continuous in every finite interval 


2. 2 | f(x)|dx < oo 


oo 


[opem ne 
= f(x) = x] ji el f (Be dB da 


The outer integral is really a Cauchy principal value (for further background, see [65]), 
and should be interpreted as 


lim / eie | J fB ap| da (30.8) 


The inner integral, that performed first in (30.8), contains the exponential with the minus 
sign, a convention followed by texts such as [51] and [66]. Texts such as [87], [84], and 
[100] reverse the signs on the exponential terms, so an alternate but equivalent statement of 
the Fourier integral theorem reads 


|] yere _.. | 
foe x] Í e '** f(B)e'"? dB da (30.9) 


where now, the outer integral has the exponential term with the minus sign. Some texts such 
as [51] combine the exponentials, so the theorem reads 


L| al eee 
fe) | / f (Byei*-P dp da 


2x 
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-2 0 2 


FIGURE 30.5 The function f (x) in 
Example 30.4 
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At points of discontinuity, the double integral converges to 3Lf (x 40) + f(x —0)], 
the average of the left-hand and right-hand limits at x. Finally, a function f(x) satisfying 
the second hypothesis is generally called an absolutely integrable function. 


Using the function 


x <0 
g= qx 


whose graph is given in Figure 30.5, verify the Fourier integral theorem. 
The function is continuous, and its derivative is piecewise continuous. It is also abso- 
lutely integrable, since 


J le P em J e™l dx = af e* dx =2 
—oo —oo 0 


The inner integral in the Fourier integral theorem is 


oo 2 
olBle-ie8 ag — ^ 30.10 
f ema - (30.10) 
The outer integral is 
1 oo iax X 
c] $e Te (30.11) 
27 Jin l+? e* xu 


after an appropriate tussle with a table of integrals or a consultation with a computer algebra 
system. 4 


EQUIVALENCE OF EXPONENTIAL Forms The two forms of the Fourier integral theorem 
found in the literature are equivalent under the change of variables a = —o. Indeed, writing 
the inner integral as 


IL f (Bye? dp 


and applying this change of variables, we get 


F(B) = [ | f (oe? ap 


The outer integral is then 


[ F (p)e'™ da 


oo 


Making the same change of variables in the outer integral gives 


[ F(B)e "^ da 


oo 


Since a is just a “dummy” variable of integration, it can be replaced with the letter œ, so 


the outer integral reads 
eo H 
Í F(B)e '* da 


co 


Inserting the inner integral for F (£) (with a replaced by o), we get 


f. J f (B)e*? dp e™®™ da 
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which, except for some simple rearrangement and a factor of Le is (30.9), the alternate 
exponential form of the Fourier integral theorem. 


Trigonometric Form of the Fourier Integral Theorem 
The trigonometric equivalent of f(x) = + f^, f° e^" f (B)e ""? dB da is 


1 oo co 
fe) = = f / f (B) cos(a(B — x)) dB da (30.12) 
0 —0o 


obtained by writing the Cauchy principal value in the exponential form 


— -tim f [. f (Byel**-P dp da 

2m À— oo 
1 0 oo ' A co . 
= lim (/ / f (pei) apaa+ f y f (B)ei*-P dp da ) 
IT 4-00 —À J —oo 0 4—oo 


In the first integral, changing variables from o to —o gives 


zm f f. f (poe tee Papaas f L f (Byei*? D 


which can be written as 


À poo ia(x—B) —ia(x—B) 
J] re) |* Lt | a0 
T Jo J—oo 2 


1 oo oo oo oo 
Ji J f(B)cos(æ(x — B)) dB da = zf y f(B)cos(a(B — x)) dB da 
T Jo —co T Jo —oo 


as 


and, hence, as 


If, in addition, the cosine is expanded to cos œ $ cos ox + sin f sin ox, then an alternate 
trigonometric form is 


(o-r[ (E f(B)cosa dp) cos ax da 
+ ZH (n FB) sinap dB sin gx da 
X Jo » 


which is typically written as 


fix)2— Í A(a) cos ax da + Ji B(a) sinax da (30.13) 
m Jo T Jo 
where 


co oo 
A(a) =| f(x)cosaxdx and B(a) zi f(x) sinax dx (30.14) 


Notice how £, the variable of integration in A(o) and B(q@), Mi been switched to x. Note, 
too, that there is no uniformity on the placement of the factor + . Texts such as [100] and 
[66] follow our usage, whereas texts such as [84] and [51] put the factor with A(o) and 
Bia). 


= Ææ 


f(x) 


0 


1 
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2 3 


FIGURE 30.6 The function f (x) in 


Example 30.5 


EXAMPLE 30.6 
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Use the function 
0 x«-1 
f(x)211 -Isx<1 
0 x-1 
graphed in Figure 30.6, to verify (30.12). Since f (x) is nonzero only in the interval [—1, 1], 
we obtain 


LPP I $1 
Ji / cos(a(B — x))dBda = Ji — [sin(a (1 + x)) + sin(a(1 — x))] dæ 
T Jo =| N Jo Q 
(30.15) 
The tabulated integral 
Um 
{ sin Au So = 0 A20 (30.16) 
0 u 
a A0 
2 


can be used to evaluate the remaining integral in (30.15). If x # £1, then (30.15) is = = 1. 


At x = +1, the integrand on the right in (30.15) is mom so the Fourier integral converges 


to i the average value across each of the jumps at those points. $ 


Compute A(ao) and B(a) for the function f(x) in Example 30.5. 
Since f (x) is nonzero only in the interval [—1, 1], we obtain 


1 9 1 
A =f cosaf dB = —sina and B =] sinaBdp =0 (30.17) 
xl a | 


The Fourier integral representation of f(x) is then 
1 oo oo 
fix)2— p A(a) cos «x da + Í B(a) sinax da 
7T LJo 0 


1 oo 
=— — sina cosax da 
T Jo a 


"ST 
= zf — [sin(a (1 + x)) + sin(a(1 — x))] dæ 
T Jo a 


the integral obtained in Example 30.5. ~ 


Solving BVPs with the Fourier Integral Theorem 


Heuristic reasoning and the Fourier integral theorem lead to a solution of Laplace’s equation 
on the upper half-plane if the potential, prescribed on the x-axis, remains bounded. Thus, 
Laplace's equation holds for y > 0, u(x, y) is bounded, and u(x, 0) = f(x). 

Were the partial Laplace transform taken with respect to y, the result would be 


5 


d 
qn s) + s?U (x, s) — su(x, 0) —uy(x, 0) 20 (30.18) 
x^ i 


The boundary condition u(x, 0) = 0 eliminates the third term on the left, but the fourth 
brings this idea up short. Knowing the potential function on the x-axis is not enough infor- 
mation for us to determine the normal derivative along the boundary. That would require 
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knowledge of the potential inside the region, but we don't have that. Hence, we cannot solve 
this problem with the Laplace transform. 

Instead, we seek solutions of the form u(x, y) = e?*e?. The laplacian of such a 
solution, set equal to zero, is (p? + q?)e?*e*? = 0 or p? -- q? = 0, from which we conclude 
p = ciq. Thus, u will be either e/4*e?" or e7/4*e?*, Boundedness for y > 0 suggests 
we take q < 0, which we accomplish by writing q = —a, witha > 0. Then, u will be 
either of the forms e/^*e-** or e7/^* e-*», which we choose to write as cos(ox)e *" and 
sin(ax)e *". The most general potential u(x, y) we can construct from these functions 
would be the linear combination 


Ug (x, y) = A(a) cos(ax)e " + B(a)sin(ax)e ^ 


The sum of all such solutions uj; (x, y) is achieved by integrating over o, resulting in 


u(x, y) = 1f A(a) cos(ax)e ® dæ + JI B(a) sin(ax)e ^ da 
T Jo IT 


0 
Applying the boundary condition u(x, 0) = f(x) means we must have 


1 co 1 co 

F(x) = Ji A (a) cos ax da + Ji B(a)sinax da 
7T Jo 7T Jo 

which, by the Fourier integral theorem, we can have if we set 


oo 


w= f f(x)cosaxdx and Be) = f f(x) sinax dx 


oo oo 


We can then write 


| ps9 oo 
Eh ye i (/ f(B) cosap ap) cos(ax)e “da 
T Jo — 
] 4*9 oo 
"x f (J J(B)sinap ap) sin(ax)e ^ da 
T Jo = 


1 oo [e0] 
=— f / f(B)[cosaB cosax — sin æf sinox]e df da 
T Jo —oo 


1 oo oo 
= - / f (B) cos(a(B —x))e dB da 
T Jo —oo 


thereby achieving a closed-form solution for this boundary value problem! 


(30.19) 


It is possible to evaluate (30.19) and determine the behavior of the potential u(x, y) when 
f (x) is the function 


x <0 
x>0 


ftm 
Since f (x) is nonzero only when x > 0, we obtain 
u(x, y) = Ji : cos(a(B — x)e ® dB da 
0 


A change of variables from £ too = f — x in the inner integral leads to 


[ L cos(&o)e ® do da T L cos(ao )e ? dado 


(30.20) 


i 1 1 x 
= do = = + — arctan 
Pte 73*g y 


where reversing the order of integration gives the middle integral. 
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To verify that u(x, y) satisfies the boundary condition u(x, 0) = f (x), approach the x- 
axis by a limiting processes from above, first, on the positive x-axis, obtaining lim, ,9« u = 
1, and then on the negative x-axis, obtaining lim,_.9+ u = 0. 

The equipotentials, radial lines emanating from the origin, are shown in Figure 30.7. 
The electric field is 


1 
—Vu = E = —————-(—yi-4 xj) 
m(x + 35 : J 
The field lines, the flow lines for the gradient field, are the solution of the differential 
equations 
9 
x'(t) = —— 5 7 oe and yl t) = =. CoN, 
a(x? + y^) di m(x* + y?) 
An exact solution for the field lines can be obtained using the derivative formula 
dy _ E | E» x 
dx & E y 


leading to x? + y? = r°, the equation of a circle having radius r and center at the origin. In 


Figure 30.7, the field arrows and the flow lines are superimposed on the equipotentials. ** 


FIGURE 30.7 Example 30.7: Equipotentials 
(in black), field lines (in color), and electric 
field vectors 


EXERCISES 30.2—Part A 


Al. Verify the integration in (30.10). A4. Verify the integrations in (30.17). 

A2. Verify the integration in (30.15). AS. Verify the Laplace transform in (30.18). 
© ilsi A6. Verify the integration in (30.20). 

A3. Use (30.16) to verify that (30.15) converges to i stl 
t |x| «1 


EXERCISES 30.2—Part B 


B1. Verify the integration in (30.11). (c) At xo verify (30.12), the trigonometric form of the Fourier 
integral theorem. 

(d) Compute A(q@) and Bia) as defined in (30.14), then at xo 

(a) Sketch f(x) and select xo, an x for which f(xo) 4 0. verify f(x) — i dr A(a) cos ox da + 

4 i B(a) sinax da. 


In Exercises B2-13, where H(x) is the function Heaviside(x): 


(b) At xo verify the exponential form of the Fourier integral 
theorem. 
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B2. f(x) 2 xe^H(x) B3. f(x) = x?'e^H(x) 
B4. f(x) 2e? cosxH(x) B5. f(x) = sinx(H(x) — H(x — x)) 
B6. f(x) = cos x(H(x) — H(x — 2zx)) 
B7. f(x) = x(H(x) — H(x — 1)) 
B8. f(x) = x (Hx) — H(x — D) 
B9. f(x) = (1 — x)(H(x) — H(x — 1)) 
B10. f(x) = H(x + 1) - H(x —2) 
B11. f(x) = (Hx + D — Hx — 1) 
B12. f(x) = (1 — |x (GIG + 1) - Hx — 0) 
B13. f(x) = (1 — xx) (RH + 1) - H(x — 1)) 
In Exercises B14—23, f(x) is given, thereby determining the BVP con- 
sisting of V^u = 0 on the upper half-plane, where u(x, y) is bounded 
and satisfies u(x, 0) = f(x). For each such BVP: 
(a) Sketch f(x). 


(b) Obtain the solution using the Fourier integral theorem and 


(30.19). 
(c) Interchange the order of integration and evaluate the resulting 
integrals. 


(d) Plot the solution surface. 

(e) Obtain a contour plot. 

(f) Obtain, and superimpose on the contour plot, a graph of the 
flow lines. 

f(x) = x(H(x) — Hx — 1)) 

fG) = x*(Ha) -H — 1) 

fœ) — x(d — x)(H(x) — Hx — 0) 

f(x) =x — xy (Hx) - H(x — 1) 

f(x) 2 x*(0 — x)(HG) - Hx — 0) 


B14. 
B15. 
B16. 
B17. 
B18. 


B19. f(x) = (1 — )(H() — H(x — 0) 
B20. f(x) = (1 — x2)(H(x + 1) - Hx — 0) 
B21. f(x) = (1 — |x) (H( + 1) - H(x — 0) 
B22. f(x) = H(x + 1) - Hx —3) 
0 x«-l 
x+1 —-l<x<0O 
B23. f(x) = 1 O<x <2 
3—x 22% «3 
0 x >3 
B24. Use the Fourier integral theorem to solve Laplace’s equation on 


the infinite horizontal strip —oo < x < oo, 0 < y < b, where 

u(x, b) = f (x) on the top of the strip, u(x, 0) = 0 on the bottom, 

and u remains bounded for |x| large. 

(a) Assume u(x, y) = e?***" and use physical reasoning to arrive 
at the possible solutions {sinh oy cos ox, sinh ay sin ox], 
where a > 0. 


(b) Write u(x, y) as the most general linear combination of these 
two solutions, obtaining u(x, y) — i i A(a) sinh ay 


oo . . 
cos ox da + i Jy Bla) sinh æy sin wx do. 


(c) Apply the boundary condition u(x, b) = f(x) to determine 
A(a) and B(o) via the Fourier integral theorem, and obtain 
ux.» - if. f (p) 82» cos a(B — x) dB da. 


sinh ab 


In Exercises B25—34, take b = 1. For each f(x) given: 


(a) Sketch f(x). 


(b) Evaluate the inner integral in the solution for u(x, y) obtained 
in Exercise B24. 


(c) Show that u(x, 1) evaluates to f (x). 


(d) Evaluate u (0, i) by integrating numerically, after having 
graphed the integrand. 


Evaluate u(5, +) by integrating numerically, after having 
graphed the integrand. 


. f(x) =H +1) - H(x - 1) 
. f(x) = x(H(x) - Hx — 1) 


(e 


B27. f(x) = (1 — x(H(x + 1) - H(x — 1)) 
B28. f(x) = x(1 — x)(H(x) — H(x — 1)) 
B29. f(x) 2 x(1— x) (H(x) — H(x — 1)) 
B30. f(x) = x(1 — x) (H(x) — H(x — 1)) 
B31. f(x) = x?(1 — x)(H(x) - H(x — 1)) 
B32. f(x) = x3(1 — x)(H(x) — H(x — 1)) 
B33. f(x) = (A(x) — H(x — 1)) sinzx 


. f(x) = (cosmx + D(H(x + 1) - H(x — 1)) 

B35. Use the Fourier integral theorem to solve Laplace’s equation 

on the infinite horizontal strip —co < x < oo,0 € y < b, 
where u(x, b) = 0 on the top of the strip, u(x, 0) = g(x) on 

the bottom, and u remains bounded for |x| large. A construction 
similar to that in Exercise B24 leads to u(x, y) = 

an g(B) 20) cos (8 — x) dB da. 


sinh(—ab) 


B36. Use the Fourier integral theorem to solve Laplace’s equation 

on the infinite horizontal strip —co < x < 00,0<y < b, 

where u(x, b) = f(x) on the top of the strip, u(x, 0) = 0 

on the bottom, and u remains bounded for |x| large. A 
construction similar to that in Exercise B24 leads to u(x, y) = 

+ > [S FB) LZ cos a(B — x) df do for the steady-state 
temperatures on the infinite strip with prescribed temperatures on 


top and insulation on the bottom. 


In Exercises B37—46, set b = 1 in Exercise B36. For each f(x) given: 


(a) Sketch f(x). 

(b) Evaluate the inner integral in the solution for u(x, y). 

(c) Show that u(x, 1) evaluates to f(x). 

(d) Evaluate u(0, D by integrating numerically, after having 
graphed the integrand. 

(e) Evaluate u(5, i) by integrating numerically, after having 
graphed the integrand. 

(f) By integrating numerically, obtain a graph of u(x, 0), the 
temperatures on the insulated (bottom) edge. 


B37. f(x) = H(x) - H(x — 1) 

B38. f(x) = x'(H(x) — H(x — 1)) 

B39. f(x) = x(1 — x! (Hx) - H(x — 1)) 
B40. f(x) = x(1 — x (H(x) - H(x — 1)) 
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B41. f(x) 2 x'*(1 — x)(H(x) — H(x — 1)) 
B42. f(x) = x? (1 — x)(H(x) — H(x — 1)) 
B43. f(x) = (cosmx + 1D)(H(x + 1) — H(x — 1)) 


» The Fourier Transform 


DEFINITION 30.1 


The Fourier integral theorem 


I qe qe ; 
f= zl | e'"* f (Bye 1"? dB da (30.21) 
2m —oo J —00 
suggests defining the inner integral as the Fourier transform 
F(a) = J — f(De^*? ap (30.22) 


eco 


so that the outer integral supplies the inversion formula 


pop a 
f(x)-2z-— Í F (a)e'* da (30.23) 
DIC I oa 


The integral in (30.22) exists for absolutely integrable functions f(x) that are piecewise 
continuous on every interval of the form [—L, L]. Corresponding to the alternate form of 
the Fourier integral theorem, there is an alternate definition of the Fourier transform. 


Show that the Fourier transform of the function f(x) = e^"! is F(a) = Bu 
In Example 30.4, Section 30.2, the Fourier integral theorem was illustrated for this 
function. The inner integral, the one equivalent to the Fourier transform, was found to be 
oc 2 
/ e |Ble—iaB dp = E - 
26 1+a- 


The inversion integral can be evaluated as 


| e 2 


I— -e"* da = e *H(x) + e'H(-x) 

2z Joo 1+ a4 
where H(x) is the Heaviside function. When x is negative, H(x) = 0, H(—x) = 1, and the 
inverse is e*; but when x is positive, H(x) = 1, H(—x) = 0, and the inverse is e^. On 
rare occasions it is possible to evaluate the inversion integral directly. Most computations 
of the inversion integral are done as contour integrals in the complex plane, as we will see 
in Section 36.3. $ 


Operational Properties of the Fourier Transform 


Just as with the Laplace transform, the operational properties of the Fourier transform are 
useful. 
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EXAMPLE 30.10 


EXAMPLE 30.11 


EXAMPLE 30.12 


DIFFERENTIATION Letting F represent the Fourier transform operator, the operational 
rule for derivatives is 


FLA (x)] = Go)" F(a) 


where F (a) is the Fourier transform of f (x). In particular, for the cases n = 1 and 2, we 
have 


FLf'G))]2ieF(e) and F[f'Q)]- (Go)! F(a) = —o? F(a) 
Conditions under which this result is valid are: 
1. f(x) is piecewise continuous on every interval of the form [—L, L]. 
2. f(x) is absolutely integrable. 
3. lim,,45, f(x) = 0 fork =0,1,2,...,n—1. 


is Fie) = = e“nrH(—a) +e *zH(a). 
qa related to F(a) through the 
multiplication by the factor ia, is F[ f’(x)] = iam (e? H(—a) + H(a)e ?). $ 


The Fourier transform of the function f(x) = >> + 


The Fourier transform of the derivative f'(x) = 


MurriPLICATION Differentiation of a function maps to multiplication of the transform by 
ia. Multiplication of the function by x maps to differentiation of the transform, much like 
the duality found for the Laplace transform. In particular, if f (x) is piecewise continuous 
on every interval [—L, L], and x" f (x) is absolutely integrable, we have the operational 
rule 


Fx" f ()] = i" F” (æ) 
which, in the case n = 1, becomes F[xf (x)] = i F'(a), or F[—ixf (x)] = F'(a). 


The Fourier transform of the function f(x) = > is F(a) = x(e*H(—a) + e *H(a)). 
Computation then shows Z[—ixf (x)] = F’ iac: = m(e“H(—a) — e *H(a)). $ 


INTEGRATION If f(x) is piecewise continuous on every interval [—L, L], is absolutely 
integrable, and has a transform F (o) for which F(0) = 0, then, as with the Laplace trans- 
form, integration on f (x) maps to division in the frequency domain. In particular, we have 


[fso] 


The Fourier transform of the function f (x) = E is F(a) = ma(H(—a)—H(a@)). Integrating 


f(x) we get [d do — -i whose Fourier transform is —iz (H(—o) — H(a)) = De. 


E 


First SHIFTING Law Just like for the Laplace transform, multiplication by an exponential 


maps to shifting in the frequency domain. Formally, we have 


Fle’ f(x)] = F(a — a) 


For the function f(x) = += with Fourier transform F(a) = z(e*H(—a) +e *H(a)), 


S 


multiplication by an exponential creates a function whose Fourier transform is now 
m(e* ^H(—a +a) -- e **?H(ao — a)). Clearly, this is just shifting in the frequency domain, 
as seen by direct substitution. $ 


EXAMPLE 30.13 


EXAMPLE 30.14 


EXAMPLE 30.15 
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SECOND SHIFTING Law Again, in analogy with the Laplace transform, there is a “dual” 
shifting law for multiplication by an exponential in the frequency domain. The formal result 
is 

FLf(x —a)] = e 1 F(a) 


Thus, the transform of a shifted function is the transform of the unshifted function but 
multiplied by an exponential, provided the shift is by a real constant a. 


1 


If the function f(x) = TuS with Fourier transform F (o) = z(e*H(—a) + e *H(a)) is 
shifted to qzzy. then the Fourier transform of the shifted function is e!" 7r (e*H(—a) + 
e-* H(a)), which is clearly just the product of e^!^* and F(a). ka 


MopnurarioN Fora real, the Fourier transforms of f(x) multiplied by either cos ao or 
sin ag are given by 


pà 


F[f(x)cosax]= -[F(&« +a) + F(a — a)] 


z! 
FIf@Œ)sinax] = [F(a + a) — F(a — a)] 
Both results are a consequence of the first shifting law if we write cos ax as (e/^* + e7/*)/2 


and sin ax as (e/^* — e7/**) /2i and recall that + = —i. 
L 


The function f(x) = E has the Fourier transform F(a) = im(H(—a) — H(a)), whereas 
the function g(x) = — has Fourier transform G(o) = E (H(—a + a) — H(a — a) + 
H(—a — a) — H(@ + a)), which is just 3[F (o + a) + F(a — a)]. o 


Symmetry The transform of a transform is “almost” the original function, a result not 
seen for the Laplace transform. In particular, if [f (x)] = F (æ), then 


FIF (x)] = 2 f (-a) (30.24) 


The function f (x) is not quite recovered; there is a factor of 277,and the argument has been 
negated. 


The function f(x) — 1 has the transform F(a) = iz(H(—a) — H(a)). The Fourier 


transform of F(x) = iz (H(—x) — H(x)) is € which is just 27 f (—a). 4 


CowvoLUurION In the context of the Laplace transform, the convolution of two functions 
f (t) and g(t) was defined (Section 6.8) as 


t t 
f(t) * g(t) =f fosa — dx = | f(t —x)g(x) dx 
0 0 


In the context of the Fourier transform, the convolution of two functions f(x) and g(x) is 
defined as 


f(x) * g(x) = f. f(o)g(x —a)do = [ f(x —o)g(o)do 


The difference in the definition of convolution for functions with Fourier transforms 
means that in addition to an analog for the convolution theorem for Laplace transforms, there 
is a second convolution theorem unique to the Fourier transform. Thus, if two functions 
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EXAMPLE 30.16 


EXAMPLE 30.17 


EXAMPLE 30.18 


f (x) and g(x) have Fourier transforms F (œ) and G (a), respectively, then 


1 
Ff (x) * g(x)] = F(a)G(a) and F[f(x)g(x)] = zT O * G (æ) 


The first theorem says the Fourier transform of the convolution is the (expected) product 
of the transforms. The second theorem says the Fourier transform of an ordinary product is 
the (unexpected) convolution of the transforms, divided by 277. 


To demonstrate F[ f(x) * g(x)] = F(a)G(a), the first convolution theorem, let f(x) be 


the function f(x) — ns and take g(x) = f(x). Then, we have the convolution 
om | 27 
(x)*g(x)-2 > ; do = ——~ 
f S ee cere 4 4 x* 


obtained from a table or a computer algebra system. The Fourier transform of this convo- 
lution is then 


20 2,9 2 9 9 

F[f(x)*g(x)] = r| ; = z?^(e"H(—a) + e?*H(a)) = re”. 
4 4 x* 

Next, obtain F (&)G (œ) = F(a), the square of the Fourier transform of f (x) = nz Then, 

compute 


F(a) = x (e*H(—a) + e" *H(a)) = xe"! 


2 2 


=> F’ (a) = (xe lal) = m eel = FL f(x) * g(x)] 


Z 
Sd 


demonstrating the convolution theorem F[ f(x) x g(x)] = F(a)G(q@). 


To demonstrate F[ f (x)g(x)] = x F(a) * G(a), the second convolution theorem, again 
use f(x) = g(x) = im and obtain the Fourier transform 


" 


TU GOg(x)] = L7 ^] = Zia — e)HC-a)Je* + (1 + eee =] = 5a + Jae 
To obtain + F(a) * G(a) = + F(a) x F (æ), evaluate the integral 


oco 
a f (e? H(—0) +e ^H(o))(e* ^H(—a +0) +e *** H(a — o)) de 
—o0o0 
and divide by 2x. For a negative, get — 5e" (æ — 1) and for æ positive, get (1 + ae, 


equivalent to 5(1+|a| )e ||, Hence, we have demonstrated the second convolution theorem, 
Ff G)80)] = 3- F(o) * Ga). E 


The convolution of f(x) = (H(x) — H(x — 3))x and g(x) = (A(x — 1) — H(x — 5))x? is 
given by the integral 


Í (H(c) - Ho — 3))(H(x — o — D - Hx ^o —5)o (x — o)? do 
—0o 


the integrand of which is nonzero over the shaded region in Figure 30.8. Corresponding to 
the three intervals 1 < x < 4,4 < x < 5,5 < x < 8, we therefore have the three integrals 


t t 
=ą 0 l 2 3 4 


FIGURE 30.8 Domain of integration in 
Example 30.18 


N 
e 


ol tI 
123 4 5 67 8 9 10 


FIGURE 30.9 Amplitude spectrum for 
f@=t 


= 10 


FIGURE 30.10 The function 
f(x) = sin(x)(H(x) — H(x —2z)) 


[FI 


FIGURE 30.11 Amplitude spectrum for 
the function in Figure 30.10 
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fe o (x a). do, f; o (x —o)! do, f? ,o(x —o). do and, hence, the piecewise-defined 


0 ya] 
bat — 4x +3) E TI T 
fxg= 9 (2x? — 8x + 9) 4<x<5 (30.25) 
—136+ x + $x- xt Sax<8 
0 x8 Ex 


Amplitude Spectrum 


The Fourier (sine) series for f (t) = t, 0 € t < x, has coefficients b, = 2 t sinnt dt = 
—2( — 1)”, whose magnitudes are graphed in Figure 30.9. The graph represents the contri- 
bution of each harmonic sin nt in the complete series expansion for the function f(t) = t. 
Such a graph represents the discrete amplitude spectrum for the function f (t) and gives an 
idea of the contribution made by each frequency n. 

The Fourier transform of f (x) = sin(x)(H(x) — H(x — 27 )), the function whose graph 
is shown in Figure 30.10, is 


F(o) — Í ! sin(f)e'*? dg = £— —- (30.26) 
0 a 


Incidentally, the expression for F(a) is not defined at « = +1. However, the singularities 
are removable since the limits at these points are Fri, respectively, matching the values of 
the integrals 

27 


f sin(£)e dB = ri and a sin(B)e "? dB = —zi 
0 


0 


(30.27) 


The Fourier transform is typically a complex-valued function of the real variable o, as 
this example shows. A complex number z = u + iv has magnitude |z| = vu? + v?. The 
magnitude of the Fourier transform is called the amplitude spectrum for f (x) and shows 
the contributions of the continuous spectrum of frequencies o. For the present example, the 
frequency spectrum, graphed in Figure 30.11, is 


2(1 — cos2za) 
(a? — 1)? 


|F(a)| = (30.28) 


A1. In Example 30.11, verify the transforms of f(x) = + and its 


; 1 
integral, = 


A4. In Example 30.14, verify the transform of g(x) = == 


x 


AS. Verify the integrations leading to (30.25). 
l 


A2. In Example 30.12, verify the transform of f(x) = yz- A6. Verify the integration in (30.26). 


A3. In Example 30.13, verify the transform of f(x — a) — 


i 
1+(x—a)? ` 


AT. Verify the integrations in (30.27). 
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EXERCISES 30.3—Part B 


Throughout these exercises, H(x) is the Heaviside function. 
B1. For F(a) in (30.26), show that |F (o)| is given by (30.28). Why is 
it incorrect to simplify (30.28) to ue What is the correct 
simplification? 


In Exercises B2-11: 


(a) Sketch f (x). 
(b) Compute F[ f (x)] by the definition of the Fourier transform. 


(c) Obtain 7T f (x)] by an appropriate software tool such as 
Maple's fourier command. 


(d) Recover f (x) from its transform by evaluating the inversion 
integral. 


(e) Recover f (x) from its transform by an appropriate software 
tool such as Maple's invfourier command. 


(f) Plot the amplitude spectrum of f (x). 
B2. f(x) 2H(x) - Hx 1) B3. f(x) = (A(x) - H(x — D)x 
B4. f(x) = (H(x) - Hà — 1))x3 


B5. f(x) = (H(x) - H( — 1))(1 — x) 
B6. f(x) = (AQ) - H( — D)x(1 — x) 
B7. f(x) = (HG) — Hx — D)x( — x)? 


B8. f(x) = (H(x) - Hx — D)x?(1 — x) 
B9. f(x) = (H(x) — H(x — 1)coszx 
B10. f(x) 2 H()e? B11. f(x) = HG)xe^* 
In Exercises B12-21: 
(a) Obtain F(a) = F[f(x)] and F[f’(x)], either by a software 
tool or by looking up the transforms in a table. 
(b) Verify FI f'(x)] = ia F (æ), the rule for the transforms of 
derivatives. 
f(x) = (Hx) — Hx — 2)x 
f(x) = (A(x) - Hx — 252 
f(x) = (A(x) - H(x - 2))x3 
f(x) = (H(x) - H(x - 2)e7* 
f(x) = (A(x) - Hx — 2)) sin zx 
f(x) = (A(x) — H(x — 2)) cos? xx 
f(x) = (Hx) - Hx — 2))x(2 - x) 
f(x) = (Hx) - H(x — 2)x?(2 — x) 
fœ) = H(x)xe™  B21. f(x) = H(x)x?e* 


B12. 
B13. 
B14. 
B15. 
B16. 
B17. 
B18. 
B19. 
B20. 


In Exercises B22—29: 


(a) Obtain F (œ) = F[ f (x)] and F[xf (x)], either by a software 
tool or by use of a table of transforms. 


(b) Verify [xf (x)] = i F'(a), the rule for differentiating 
transforms. 


B22. f(x) = (H(x) — H(x —z))xsinx 

B23. f(x) = (H(x) — H(x — z))x cos x 

B24. f(x) = (H(x) — H(x — z))x sin? x 
B25. f(x) = (H(x) — H(x — z1))x cos? x 
B26. f(x) = (H(x) — H(x — 3))x 

B27. f(x) = (H(x) - H(x — 3))x? 


B28. f(x) = (A(x) -H(x —3))x?  B29. f(x) = H(x)e™ 


In Exercises B30—39: 


(a) Obtain F(a) = Ff (x). 
(b) Obtain g(x) = f"... f (o) do. 
(c) Obtain F[g(x)]. 
(d) Verify PLI. f(o)do]— i F(a), the rule for Fourier 
transforms of integrals. 
B30. f(x) = (H(x) — H(x —7z))sin2x 
B31. f(x) = (H(x) — H(x — z)) cos2x 
B32. f(x) = (H(x) — H(x — z)) sin? 2x 
B33. f(x) = (H(x) — H(x — x)) cos? 2x 
B34. f(x) 2H(x) - Hx —5) B35. f(x) = (A(x) - H(x — 5)x 
B36. f(x) = (H(x) - Hx — 5x? 
B37. f(x) = (H(x) - H(x — 5)? 
B38. f(x) = HG)e? B39. f(x) = H(x)xe™* 
In Exercises B40—49: 
(a) If a > 0, obtain F (œ) = FI f (x)], Fle’ f (x)], and 
F[f(x —a)]. 


(b) Verify [e/^* f (x)] = F(o — a), the first shifting rule for 
Fourier transforms. 


(c) Verify F[ f (x — a)] = e™'* F(a), the second shifting rule for 
Fourier transforms. 


(d) Obtain F[ f (x) cos ax] and verify F[ f(x) cosax] = 
i[F(o +a) + F(a — a)]. 

(e) Obtain F[ f (x) sin ax] and verify [f (x)sinax] = 
Z[F(o +a) — F(a — a)]. 

(f) Obtain F[ F (a)] and verify (30.24), the symmetry law for 
Fourier transforms. 

f(x) =H) — H@ — 4) 

f(x) = (A(x) - Hà — 4))x? 

f) = (A(x) — H(x — 4)) sin T 


B40. 
B42. 


B43. 


B41. f(x) = (H(x) — H(x — 4)x 


B44. f(x) = (H(x) — H(x — 4)) cos? 7 


B45. f(x) = (H(x) — H(x — 4))x sin A 


B46. f(x) = (HG) — H(x — 4))x? cos Zx 


B47. f(x) = (HQ) — Hà — 4)? sin? Cx 

B48. f(x) = H(x)e * B49. f(x) = H(x)xe? 

In Exercises B50—54, obtain F[F (o)] and verify (30.24), the symmetry 
law for Fourier transforms. 

B51. f(x) = e~ sin x 

B53. f(x) = xe sinx 


B50. f(x) = e-* 
B52. 
B54. 
B55. 


f(x) 2 e7* cosx 
fix) xe? COS X 
If f(x) = g(x) = e: 

(a) Obtain F (&) = G(a) = FI f (x)]. 

(b) Obtain f * g, the convolution of f(x) with itself. 


(c) Obtain 7T f * g], the transform of the convolution, and show 
that it equals F (v) G (a). This verifies the convolution 
theorem for the time domain. 

(d) Obtain Ff (x)g(x)]. the convolution of the product 
fg=f?. 

(e) Obtain iF *G= £F * F, the convolution of the transform 
with itself (divided by 27r), and show it equals F[ f (x)g(x)]. 
This verifies the convolution for the frequency domain. 


In Exercises B56-61: 
(a) Obtain F (œ) = F[ f (x)] and G(a) = F[f (x)], the 
transforms of f (x) and g(x). 
(b) Obtain the convolution f * g and draw its graph. 


(c) Obtain Tf * g], the transform of the convolution, and show 
that it equals F (o) G (a), thus verifying the convolution 
theorem for the time domain. 


(d) Graph the product f (x)g(x). and obtain FT f (x)g(x)], its 
Fourier transform. 


(e) Obtain F x G, the convolution of the transforms, using, for 
example, F * G = £^! LF[F]J[G]]. 
(f) Show F[f(x)g(x)] = +F * G, thereby verifying the 
convolution for the frequency domain. 
B56. 
B57. 
B58. 
B59. 
B60. 


f(x) = (A(x) — H@ — 1))x, g(x) = H(x)e™ 

f(x) = (H(x) - H(x — 1))x?, g(x) = H(x)e™* 

f(x) = (H(x) - Hx — D)sinzx, g(x) = H(x)e? 
f(x) = (Hx) - Hx — 1)coszx, g(x) = H(x)e * 
f(x)=g(x) =H(x)je™ B61. f(x) = g(x) 2e 
In Exercises B62-81: 


(a) Sketch f(x) and g(x). 


(b) Obtain F (œ) = F[f (x)] and G(a) = Tf (x)], the 
transforms of f (x) and g(x). 


B62. 
B63. 
B64. 
B65. 
B66. 
B67. 
B68. 
B69. 
B70. 
B71. 


B72. 
B73. 
B74. 
B75. 
B76. 
B77. 
B78. 
B79. 


B80. 


B81. 
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(c) Obtain the convolution f * g and draw its graph. 


(d) Obtain F[ f * g], the transform of the convolution, and show 
that it equals F(o)G(a), thus verifying the convolution 
theorem for the time domain. 

(e) Use the frequency domain convolution theorem to obtain the 
convolution of the transforms by computing F  G = 
2z F[f (x)g(x)]. 

(f) Use the time domain convolution theorem to obtain the 
convolution of the transforms by treating F(o) and G(q@) as 
“functions,” and inverting the product of their transforms. 
Thus, compute F « G = F !(7[F(o)]J [G(o)]]. 

(g) In part (f), use the symmetry relation to transform the 
transforms, thus computing the convolution as F x G = 
F~ [27 f (-a)21g(—o)]. 


f(x) = Hx) — H@ — 2), g(x) Hx — 1) - H(x — 3) 


f(x) = Hx) — Hx — 2), g(x) Hx — 3) - H(x — 5) 

f(x) = (Hx) - Hx — 3))x, g(x) = (H(x — 2) - H(x — 5x? 
f(x) = (H(x—1) - Hx -3)x, g(x) = (H(x-2) - Hx —4))e* 
f(x) = (Hi - 1) -H(x -3))x?, g(x) = (Hx -2) -H(x -4))e^* 
f(x) = (H—-1) -H(x-3))x?, g(x) = (Hx -2) -H(x—-4))e* 


f(x) = (H(x) - H(x — 3)x, g(x) = (H(x —2) - H(x —4)) sin x 
f(x) = (Hà) - Hà -3)x?, g(x) = (A(x — 2) - Hà —4)) sin x 
f(x) = (A(x) - Hx —3))x3, g(x) = (H(x — 2) —H(x —4)) sin x 
f(x) = (Hà — 2) - Hx —4))e™, 


g(x) = (H(x — 3)  H(x — 5)) sin x 
fx)-H(x—-1)-—H(x—5),g(x) = H(x — 2) - Hx —3) 
f(x) = (Hx-1) - Hx —5))x, g(x) = (Hx -22 - Hx —3))x? 


f(x) = (A(x — D - Hx —5))x, g(x) = (H(x — 2) - H(x 2 3))x? 
f(x) = (Hx) - H@ — 4))x, g(x) = (A(x — 1) - Hx - 3)e* 
f(x) = (HG) - H@ — 4)x?, g(x) = (Hx — 1) - Hx — 3)e* 
f(x) = (A(x) — H(x — 45x), g(x) = (Hx — 1) - H(x — 3)e^* 
f(x) = (H(x-2) -H(x—6))x, g(x) = (A(x -3) -H(x—4)) sin x 
f(x) = (H(x —2) - H@ — 6)’, 

g(x) = (H(x — 3) — H(x — 4)) sin x 

f(x) = (Hx — 2) - Hx — 6x2, 

g(x) = (H(x — 3) — H(x — 4) sin x 

f(x) = (H(x — 2) - H(x — 6)) cosx, 

g(x) = (H(x — 3)  H(x —4))sinx 


690 


-2 -1 


FIGURE 30.12 
Example 30.19 
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EXAMPLE 30.19 


u(x, 0) 


0 1 2 


Initial disturbance in 


: Wave Equation on the Infinite String—Solution 


by Fourier Transform 


Problem Statement 


The BVP consisting of the one-dimensional wave equation u;; (x, t) = cu, (x, t) on the 
infinite domain —oo < x < œ, the initial conditions u(x, 0) = f(x), u;(x, 0) = g(x), and 
the boundary conditions lim, , «5; u(x,t) = 0 models the loss-less propagation of a dis- 
turbance along the real axis. We call this the propagation of a wave along an infinitely long 
string. 


D'Alembert's Solution 


Momentarily, we will use the Fourier transform to derive (30.29), D' Alembert's solution 
to this BVP. 

1 l x-ct 
u(x,t) = alfa —ct)+ f(x -ct)] + F Í g(c)do (30.29) 


x—ct 


Consider the particular initial shape 


0 x«-1 
fia) =4l—x? -1xxx1 
0 gsl 


and the initial velocity u, (x, 0) = 0. The Fourier transform of the initial conditions gives 
U (o, 0) = Fi (œ) and U,(a, 0) = 0, where 


1 
4 
F\(a) = J (1— phe dp = paina — æ cosa) (30.30) 
-1 


is the Fourier transform of f; (x). The function f; (x) is the localized disturbance shown in 
Figure 30.12. The partial Fourier transform of the wave equation, taken with respect to x, 
yields 


U, (o, t) = —c^o?U(a, t) 


If Y (t) = U (a, t), the IVP to solve becomes Y"(t) = —c?o2Y (t), Y (0) = Fi(a), Y'(0) = 
0, for which the solution is Y(t) = U(a, t) = Fı (œ) cos ct. Inverting, we find u(x, t) = 
i YT hi, where 


hi =(x+1+4+ct)(x — 1 + ct) H(x — 1 + ct) - H(—x 1 — ct)] 
h = (—x — 1 + ct)(—x + 1 + ct)[H( — 1 — ct) - H(—x + 14 ct)] 
h3 = (—x — 1 + ct)(—x + 1 + ct)[H(—x — 1 + et) - H(x +1 -— ct)] 
h4 = (x +1 +ct)(x — 1 + ct)[H(—x —1— ct)—H(x +1 +ct)] 


and H(x) is the Heaviside function. 


Figure 30.13, showing the solution surface for c = 1, suggests that the initial distur- 
bance splits into two equal parts, each part traveling in opposite directions along the string. 
Figure 30.14 shows u(x, 2), the shape of the string (in color), and u; (x, 2), the velocity 
profile (in black). The velocity decreases linearly from the front of the traveling wave to the 
rear. Figure 30.15 shows the shape and velocity at times t = d 1, and z, When the wave 
traveling to the right hits an x > 0, the vertical velocity of that point jumps to 1. The veloc- 
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SSS 


FIGURE 30.13 Solution surface for Example 30.19 FIGURE 30.14 Example 30.19: Shape 
(in color) and velocity (in black) of the 
string at time t = 2 


ities of points to the left of that x decrease linearly since the wave has already passed over 
them. Where the displacement is a maximum, the velocity is zero. At the rear of the wave, 
the velocity is negative, since back there, the string is on its way back toward equilibrium. 


See the accompanying Maple worksheet for a complete animation of this motion. $ 


EXAMPLE 30.20 We find the velocity profile induced in Example 30.19 to be sufficiently interesting that 
we next solve another special case of the wave equation. This time, we take the initial 
shape to be u(x, 0) = O and set the string into motion by imposing the initial velocity 
u;(x,0) = fi(x). Thus, U (a, t), the Fourier transform of u(x,t), is Y (t) = Fi (or) Bact 


the solution of the initial value problem Y"(r) = —c^a?y (t), Y(0) = 0, Y'(0) = Fi(a). 
Inversion of this transform yields u(x, t) = iz cem nk, Where 


m = (ct +x +2)(x —1+ct)*[H@ — 1 4- ct) —H(—x 4-1 — ct)] 
No = (ct — x — 2)(—x + 1+ ct [H(x — 1 — ct) - H(—x + 1+ ct)] 
n3 = (ct — x +2)(—x — 1 + ct) [H(—x —l+ct)—H(x+1-—-ct)] 
14 — (ct -x —2)(x -1-4 ct [H(—x —]1—ct) - Hx-- 1-4 ct)] 


x Figure 30.16 shows the solution surface for the shape of the string when c — 1. The 
shape of the string is arresting, being displaced a uniform amount and remaining displaced. 
This certainly does not fit with our intuition of rubber-bands, guitar strings, and piano strings 
subjected to a tap that imparts an initial velocity. 


(c) 


a a9 e 
FIGURE 30.15 Example 30.19: In color $ = b P l = 8 
and black, respectively, the shape and FIGURE 30.16 Solution surface for Example 30.20 FIGURE 30.17 Example 30.20: Shape 
velocity of the string at times t — 0.2, (in color) and velocity (in black) of the 
1.0, 1.6 string at time f = 2 


Figure 30.17 shows, for t — 2, the velocity wave as a thin curve and the displacement 
as a thick curve. Indeed, the initial velocity splits and travels in both directions as a wave. 
The displacement of the string becomes u = i after the velocity wave has passed. The 
companion Maple worksheet provides a complete animation for this motion. $ 
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EXAMPLE 30.21 


8 


Initial 
velocity 


0 1 2 3 


FIGURE 30.18 Initial velocity profile for 
the finite string in Example 30.21 


0.5 


0 1 2 3 


FIGURE 30.19 Example 30.21: In color 
and black, respectively, the shape and 
velocity of the string at time t — 0.4 


EXAMPLE 30.22 


0.3 
t te > Xx 
0 1 2 3 
FIGURE 30.20 Initial velocity profile for 


the finite string in Example 30.22 


u 


0.3 
x 
0 1 2 3 
FIGURE 30.21 Example 30.22: At time 


t > 0, shape and velocity of the finite 
string in Example 30.22 
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Do we see the same behavior in the finite string? To find out, consider an undisturbed string 
of length zr, set into motion with an initial velocity described by 


T 1 
0 C imr 
g(x) = 100 ( s+ a) G* J M T A 
2 10 2 10 2 10 2 10 
0 Aw -— 
2 10 = 


and graphed in Figure 30.18. If we take the wave speed to be c = 1, the solution to the 


wave equation on the finite string is the infinite series 


oo 
u(x,y)— J B, sin nx sin nt 
nzl 


9 m 


(30.31a) 


ATA Jo 


80 
g(x)sinnx dx — at (10 sin " n cos A sin T (30.31b) 


Approximating u(x,t) with the partial sum u1oo(x, t) = ew" B, sinnx sinnt we obtain 


Figure 30.19, which shows, for t = 2, the velocity wave (in black) and the string itself 
(in color). Indeed, until the traveling waves (see the accompanying Maple worksheet for 
an animation) reach the fixed endpoints, the same behavior in the shape of the string is 
observed. If that's true, then why does our intuition, derived from finite strings, not reflect 
this insight? Perhaps it is because we are never able to set a string into motion with a 
localized velocity profile. $ 


Typically, striking a string with a sharp instrument gives an initial velocity to the whole 
string, as modeled by the function g(x) = ix — x), graphed in Figure 30.20. Again, the 
solution has the form (30.312) with 


ek me 


2xn* 


2 T 
B, = Zf g(x) sinnx dx = (30.32) 
ni Jo 


The partial sum ee B, sinnx sinnt yields Figure 30.21, the shape (in color) and velocity 
(in black) at a typical time t > 0. Imparting a nonzero initial velocity to the whole string 


results in a “familiar” motion for the finite string. $ 


Derivation of D'Alembert's Solution 


The Fourier transform of u;, (x, t) = ux, (x, t) is Un (o, t) = —c?a?U (a, t), written as 
the ODE Y"(r) = —c?o?Y (t). The initial conditions u(x, 0) = f(x) and u,(x, 0) = g(x) 
transform to Y (0) = U (a, 0) = F(a) and Y'(0) = U, (œ, 0) = G(a). The solution is 
1 
Y(t) = U (æ, t) = F (œ) cosact + —G(a)sinact (30.33) 
ac 


and if written in exponential form 


2 


1 j - 1 ; u 
U (a, t) = = (Fe - Lcw) grac + x (ræ 4 Pid) e "c 


inverts to (30.29), D' Alembert's solution of the wave equation. 
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Inversion by Convolution 


The reader may have seen in (30.33) the opportunity to invert a Fourier transform by 
applying a convolution result, namely, the product of two transforms inverts back to the 
convolution of the inverses. There are two products in (30.33), one involving F(o) and 
one involving G (o). The companion factors are cos act and mes: , respectively. We know 


that the inverses of F(a) and G(o) are f(x) and g(x), respectively. The inverses of the 
corresponding companion factors are, respectively, 


$[8(—x — ct) + ó6(—x + ct)] 


1 
rei (x + ct) 


The inverse of the first product is the convolution 


H(—x — ct) — H(x — ct) + H(—x + ct)] 


i I [Bx — ct) -ó(—x + ct)]f(x —o)do = SU f(x + ct) + f (x — ct)] 


oo 


The inverse of the second product is the convolution 


1 oo 
in / [H(x + ct) - H(—x — ct) - H(x — ct) + H(—x + ct)]g(x — p) dp 


1 x-Fct 
=— g(a) do 
2c i 


EXERCISES 30.4—Part A 


(30.34) 


Al. Verify the integration in (30.30). 
A2. Verify the integration in (30.31b). 


EXERCISES 30.4—Part B 


A3. Verify the integration in (30.32). 


Throughout these exercises, H(x) is the Heaviside function. 
B1. Verify the calculation in (30.34). 


In Exercises B2-9: 


(a) Use the Fourier transform to solve u, = C7Uyy, 
—oo«x < œ, u(x, 0) = f(x), u;(x, 0) = 0, the wave 
equation on an infinite string for which the initial shape is 
prescribed. 

(b) Obtain D' Alembert's solution for the same problem. 

(c) Graph the solution surface. 


(d) Where possible, animate the deformations in the string, or at 
least graph the shape of the string at a succession of three 
moments in time. 


B2. c = 1, f(x) H(x4-1)—-H(x-1) 


B3. c =2, f(x) = (Hx + 1) - H(x — D)x 

B4. c = 3, f(x) = (Hx + 1) - Hx — 1))x? 

B5. c 23, f(x) = (H(x + 1) - H(x — D)(x +1) — x) 
B6. c = 2, f (X) = (Hx + 1) - Hx — D) + D — x»? 
B7. c = 2, f(x) = (HG + 1) - HG — 1)) sin xx 

B8. c = $, f(x) = (HG +1) - HG — 1) sin? Zx 

B9. c = $, f(x) = (HG + 1) - Hx — 1) — x?) 


In Exercises B10—21: 


(a) Use the Fourier transform to solve t; = C7Uyy, 
—oo «x < œ, u(x, 0) = 0, u(x, 0) = g(x), the wave 
equation on an infinite string for which the initial velocity is 
prescribed. 


(b) Obtain D’Alembert’s solution for the same problem. 
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(c) Graph the solution surface. 

(d) Where possible, animate the deformations in the string, or at 
least graph the shape of the string at a succession of three 
moments in time. 


B10. c=1, g(x) =e" BI. c = 2, g(x) = e™! 


B12. c = 3, g(x) = H(x) — H(x — 1) 

B13. c = 1, g(x) = (Hx) - Hx — D)x(1 — x) 
B14. c = 2, g(x) = (H(x) - Hx — D)x( xy 
B15. c = 3, g(x) = (HG) - H(x — D)x?( — x) 


B16. c = 42, g(x) = (H(x + 1) - H(x — D)(x + D(1 — x) 
B17. c = $, g(x) = (Hc + 1) - Hx — D) + D — x» 
B18. c = 2, g(x) = (H(x) — H@ — 1)) sinzx 


B19. c = 1, g(x) = (H(x + 1) - H(x — D)sinzx 
0 x<-l 
= -l<x<0 
B20. c = V3, g(x) = k paya] 
0 x 
0 x«-—2 
—2—x -2xx«-1l 
B21. c=}, gœ) = x -l<x<l 
2—x D «32 
0 Xx» 


In Exercises B22—28, use the Fourier transform to solve the BVP u;, = 
Uxx + Ux, —CO <x < oo, u(x, 0) = f (x), u; (x, 0) = 0, expressing the 
solution as an integral, the inversion integral for the Fourier transform. 
B22. f(x) = H(x - 1) - H(x — 1) 

B23. f(x) = (H(x + 1) - H(x — D)x 

B24. f(x) = (A(x + 1) - H(x — D)sinzx 

B25. f(x) = (H(x + D - H(x - 1))(1 — x?) 


B26. f(x) =e"  B27.f()—e!  B28. f(x) = 


1+ x? 


In Exercises B29—35, use the Fourier transform to solve the BVP u, + 
Uy = uy,,—00 < x < oo, u(x, 0) = f(x), u, (x, 0) = 0, expressing the 
solution as an integral, the inversion integral for the Fourier transform. 


B29. f(x) from Exercise B22 B30. f(x) from Exercise B23 


B31. f(x) from Exercise B24 
B33. f(x) from Exercise B26 
B35. f(x) from Exercise B28 


B36. Use the Fourier transform to solve Laplace’s equation on the 
upper half-plane. In particular, the BVP is uxx + uy, = 0, 
—00 <x < œ, y > 0, u(x, 0) = f(x), u(x, y) > O as y > oo. 
It can be solved as follows. 


B32. f(x) from Exercise B25 
B34. f(x) from Exercise B27 


(a) Compute the Fourier transform (with respect to x) of 
Laplace's equation, obtaining an ODE in U (o, y) = 
Flu(x, y)]. 

(b) Solve the ODE along with the boundary conditions 
U (a, 0) = F(a) = F[ f (x)] and U (a, R) = 0, R > 0. 
Obtain Ug(a, y). 

(c) Obtain lim; ,5; Ur(a, y) for the two cases œ > 0 anda < 0. 
This gives U (œ, y) = F(o)e- ^, 

(d) Invert e7! and obtain u(x, y) = + Lund E m do by 
convolution. This is known as the Poisson integral formula 
for the half-plane y > 0 or the Schwarz integral formula. 


In Exercises B37—46: 


(a) Evaluate the Schwarz integral formula in Exercise B36. 
(b) Obtain a graph of the solution surface. 


(c) Obtain a contour plot showing the equipotentials (level 
curves) of u(x, y). 


(d) Obtain, and superimpose on the contour plot, a graph of the 
flow lines of u(x, y). 


1 
B37. f(x) 2 Hx) B38. f(x) = ——H(x) 
x41 


f(x) -Hx-c-D-H(x-1) 

fœ) = (H@ + 1) - Hx — 1))x 

f(x) = (Hx + 1) - Hà -= 1))x? 

f(x) = (Hx + 1) - Hx - 1))(1 — x?) 

f(x) = (Hx +1) - Hx — D) + DO —x) 


B39. 
B40. 
B41. 
B42. 
B43. 


B44. f(x) = (H(x + 1) - Hx — 1))@4 Dd - x) 
B45. f(x) = (H+ 1) - H(x — 1) (x 4- D?(1 — x) 
B46. f(x) = 


1+ x? 


' Heat Equation on the Infinite Rod—Solution 


by Fourier Transform 


Statement of the Problem and Its Solution 


The heat equation u; (x, t) = kus, (x, t) = Oontheinfiniterod( —oo < x < oo), along with 
the initial condition u(x, 0) = f(x) and the boundary conditions lim,., o5 u(x, t) = 0, is 
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EXAMPLE 30.23 


satisfied by the function 


u(x,t) = os)" At do (30.35) 


as we derive in this section. 


Solution by Fourier Transform 


The partial Fourier transform of the heat equation, taken with respect to x, yields U, (o, t) = 
—ka?U (a, t), which we write as the ODE Y'(t) = —ko?Y (t) through the definition Y (t) = 
U (o, t). The initial condition u(x, 0) = f(x) transforms to Y(0) = U(a, 0) = F(a), so 
Y() = e Ket F(a). The inverse of Y(t) = U (a, t) is (30.35), as a table of transforms or 
computer algebra system will reveal. 

Alternatively, seeing a product of two Fourier transforms on the right side of Y(t) = 
e **^ F (œ), we reach for the convolution theorem whereby the inverse of a product of two 
transforms is the convolution of the inverses of the individual factors. The inverse of the 
factor F(a) is clearly f(x). Its companion factor e *^ *t has inverse h(x) = a= e It 


Tkt 
so u(x, t) in (30.35) is the convolution f (x) x h(x). 


If f(x) = 3(H(x + 1) — H(x — 1)) and x = 1, then (30.35) gives 


9 x41 x—1 
u(x,t) = 5 (s«( ii ) -ert ( NS )) (30.36) 


where erfz = a i e^. do. The solution surface is seen in Figure 30.22. 


9. 
d 


NRS 
IER 


NN 


FIGURE 30.22 Solution surface in Example 30.23 


EXERCISES 30.5 
Throughout these exercises, H(x) is the Heaviside function. (b) Plot the solution surface. 
1. Obtain the solution in (30.36). Show lim; o+ u(x, t) = f (x). (c) Obtain a contour plot showing the isotherms. 


In Exercises 2-11: 


(a) Solve the BVP u, = ku,4, —CO < x < oo, t > 0, 
u(x,0) = f (x), liM u(x, t) = 0, for the heat equation on 


an infinite rod. 


(d) Either animate the temperature profiles as they vary in time or 
graph the temperature at a succession of times. 


2. k — 2, f(x) = (H(x + 1) - Hx — 1)x 
3. k =3, f (x) = (H(x + 1) - Hx — 1) (1 — x?) 
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4. k 2 i, fœ) = (HG 1) - Hx — D) ++ D — x) 

5. k = 2, f(x) 2 (HG + 1) - Hx — D)G + D — x»? 

6. « = 72, f(x) = (Hx + D - H — D) + DAU — x) 

7. k = 4/3, f (x) = (A(x) - H(x — 1))e™*/"9 

8. « = 1, f(x) = (A(x) - H(x — D)IOx(1 — x) 

9. kem B, fi) e" B1O0.K = 3. f(x) eet 
e=, f@)=s@) 
12. For u, = rux, —©0 < x < œ, t > 0,u(x,0) = f(x), r > 0: 


(a) Verify that f(x + rt) is the solution. 


(b) Use the Fourier transform to obtain u(x, t) = f(x + rt) as the 
solution. 


In Exercises 13-20: 


13. 
14. 
15. 
16. 
17. 
18. 


19. 


(a) Solve 
üt —rU,,—o00 «x < o0,t > 0, im; or u(x, t) = f(x). 
(b) With r — 1, plot the solution surface. 


(c) With r = 1, use either an animation or a succession of plots to 


show that f (x), the initial disturbance, is propagated to the left, 


without distortion and with “speed” r, by u(x, t). 
f(x) = (H(x + 1) - Hx — D)sinzx 
f(x) = (Hx + 1) - Hx — D)sin? zx 
f) = (HG + 1) - H(x - D) — x2) 


f) = (Hx) - Hx — D)x(1 — x) 
f(x) = (A(x) - Hx — D)x(1 — x)? 
f(x) = (HG) — H(x — D)x(1 — x»? 
fase" 20. f(x)= TI 


E, 
» 


In Exercise 21, do all parts. In Exercises 22-30, do parts (a)-(d). 


(a) Solve the BVP u, = Kyy +ruy, —oo < x < oo, t > 0, r real, 
u(x,0) = f(x), lim, , as; u(x, t) = 0, which for r = 0 is the 
heat equation on the infinite rod. 


(b) Plot the solution surfaces corresponding to r = 0 andr = 1. 
(c) For r = 1, obtain a contour plot showing the isotherms. 


(d) For r = 1, animate the temperature profiles as they vary in time 
or plot a succession of temperature profiles at increasing times. 


(e) For r = 1, determine the location of the maximum temperature 
in the rod. 


(f) Plot the maximum temperature as a function of time. 


(g) Describe how the term u, changes the behavior of the solution 
of the heat equation. Hint: Consider Exercise 12. 


(h) What happens when r « 0? 


K 1, fœ) =H(x+1)—- H-2) 
p= 2, f(x) = (Hx + 1) — Hx —2)x 
k = 4, f(x) = (Hx + 1) - Hx — 2))x? 
k = 2, f(x) = (H(x + 1) - H(x — 2))@ +:1)(2 — x) 
k = 3, f(x) = (Hx + 1) - Hx -2)(x - D —x» 
k = 4/2, f(x) = (HG) — H(x — 3))e7* 
k = 1, f(x) = (A(x) - Hx — 2)10x?(2 — x) 
K 3, FOS e? WK = 2, f(x) =e"! 
ne = 2, f(x) = d@) 


. The time-dependent heat equation in two spatial variables can be 


solved by repeated use of the Fourier transform. Solve the BVP 

Us = K (Uxx + Uyy), —©O < x, y < oo, u(x, y,0) = f(x, y), by 

implementing the following steps. 

(a) Let F, and F, represent Fourier transforms with respect to x 
and y, respectively, so that F (œ, 8) = F,[F.[ f(x, y)]] is the 
y-transform of the x-transform of f(x, y). Apply Fy to the 
PDE, obtaining U,(a, y, t) = k(—o?U (a, y, t) + Uy, (a, y, t)). 

(b) Apply 7, to the PDE obtain in part (a), obtaining the ODE 
U, (a, B, t) = k(—o?U (a, B, t) — B?U (a, B, t). 

(c) The ODE from part (b), along with the initial condition from 
part (a), is solved for U (o, B, t) = F(a, Bye = 
eke t KBr 

(d) Apply E^ using the convolution theorem. 


(e) Apply F7’ again using the convolution theorem, so that 
u(x, y, f) = 


eo co 2 2 
/ Í f (oi . 05)e V TO Hat S7 (y7o2y Aet do, dos 
—o0 J —oo 


Az kt 


In Exercises 32-41: 


«f Os y) -— ey 
. f(x,y) = [HG + 1) -He — DIHGQ +) — H(y — 0] 

. f(x, y) = IHG ++ 1) - H(x — DI[HC + 1) —- AG — D]x 
. fo, y) = [Hx +1) - Hx — DIA + D — HCy — D]xy 
«fo, y) = IHG + 1) - Hx — DIAG + 10) 


. f, y) = HG + 1) -He — DIEGO + 1) 
(1 — y’) 


(a) Sketch f(x, y). 

(b) Solve u; = K (Uxx + Uyy), -co «x, y «oo, 
u(x, y, 0) = f(x, y) by evaluating the integral obtained in 
part (e) of Exercise 31. 

(c) With x = 1, draw the solution surface at several instants in 
time, or animate the time-dependent temperature surfaces using 
an appropriate software tool. 


33. f(x, y) = ô(x)ô (y) 


H(y 


DIG — x?) 
H(y - 1)] 


(1 — x2) 
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EXAMPLE 30.24 


-0.54 ii 


FIGURE 30.23 Example 30.24: 
Integrands (o, +, +) (solid) and 
(a, 3, 4) (dotted) 


Laplace’s Equation on the Infinite Strip—Solution 
by Fourier Transform 


Problem Statement 


In this section we will consider the Dirichlet problem consisting of Laplace’s equation 
Uxx(X, y) + uyy x, y) = O in the infinite (horizontal) strip -co < x < ~,0< y < b, 
0 < b, and the boundary conditions u(x, 0) = 0, u(x, b) = f(x), limy+4.0 u(x, y) < oo. 
The conditions at x = +œ simply require u(x, y) to remain bounded. 


Solution 
The solution of this Dirichlet problem, derived later in this section, is 


1 oo oo `] ; 
u(x, y) = — Í Í ro cos(a(B — x)) dB da 
SJ d-a sinh ab 


For even the simplest of functions f (x), the integrals in the solution given previously are 
difficult to evaluate. For example, with b = 1 and 


1 |x| <1 


Tes n Ix| > 1 


the inner integral becomes 


in och [ sinh ay cata — x)) j sinh o^ 
-1 sinh a "T 


B Y [sin(o(x4-1)) — sina (x — 1))] 
ha 


and the outer integral is then the intractable u(x, y) = i do o(a, x, y) da. 

Evaluating u(x, y) at specific points is still a challenge, since for every such point 
a finite approximation for œ = oo must be determined. The integrand oscillates, adding 
to the difficulty of numeric evaluation. Figure 30.23 shows the integrands $ (c, i 5) and 
#(a, 3, 1) as the solid and dotted curves, respectively. As x increases, the integrand oscil- 
lates more rapidly. Numerically evaluating the integral gives, for example, u(0.5, 0.5) = 
0.4318996631, a computation still in need of an error analysis. Although this was a simply 
stated boundary value problem, its solution, either exact or approximate, involves more than 
naive mathematics. e 


Solution by Fourier Transform 
The partial Fourier transform of Laplace's equation, taken with respect to x, yields 
—a?U (a, y) + Uy, (o, y) = 0 
which we write, with the definition V (y) = U (a, y), as the ODE 
—o? V (y) + V'(y) 20 
The boundary conditions u(x, 0) = 0 and u(x, b) = f (x) transform to 
V(O)=U(a,0)=0 and V(b) =U(a,b) = F(a) 


The solution is 
sinhay 
sinh ab 


Y(y) = U (æ, y) = F(a) 
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and the Fourier inversion integral s 


Recognizing that F(a) = T. 


u(x, »-x[. f r 


3 ee Qe d 
== * da 
iiia O hat ab 
. f(üp iin. d p is the Fourier transform of f (x), we have 
h 
tai ay gi 6o dB do 
P dh sinhab 


where the outer integral is a Cauchy principal value. 


The exponential form of what is essentially the Fourier integral theorem can be brought 


into the trigonometric form as follows. Write the inner integral as 


sinh ay 


se. =f fb) Pee ap 
sinh ab 
so that 
1 9 d 
u(x, y) = — lim (f g(a, P) da «f sa. f) da) 
2x p —p 0 
Make the change of variables æ = —o in the first integral and œ = o in the second, obtaining 


1 0 p 
u(x, y) = = H3 (f —g(—o, B) de «f g(o, pde) 
Zz o p 0 


Renaming o as o, we actually have 


h ; 
u(x, y) = =f f. f(f) — —. sinh ary e «6-9» 
sinh ob 


dB do 


Hel [. f (g) ia 45 da 


B =f f. Fyne sinh e, 
B sinh T 
F [in j ab cos(a (B — x)) dB da 


EXERCISES 30.6 


sinh(—ob) 
e ia(B—x) + gi (B—9) dp da 


gb ay 


1. 


—]psinhoy] _ 1 sin(ty/b) 
If Fy [ sisi ab ] 2b cosh(zt x /b)--cos(zt y/b) * 


using the convolution theorem. 


invert U (o, y) = OL F(a) 


. If the boundary conditions on the infinite strip —oo < x < oo, 


O0<y<b,b>0, are u(x, b) = 0, u(x, 0) = g(x), 
lim,.+00 U(x, y) < oo, solve the Dirichlet problem by the Fourier 
transform and 


(a) the technique leading to (30.37). 
(b) the convolution theorem. (Hint: See Exercise 1.) 


(c) explain where limiy} u(x, y) < oo, the boundary conditions 
at infinity, are used in the solution process. 


. If the boundary conditions on the infinite strip —oo < x < oo, 
O0<y<b,b>0, are uy(x,0) = 0, u(x, b) = f(x) 


(30.37) 


lim,.400 U(x, y) < oo, solve Laplace’s equation by the Fourier 
transform and 
(a) the technique leading to (30.37). 


(b) the convolution theorem, given that F' [| 
1 cos(ry/2b) cosh(zt x /2b) 
b cosh(zx/b)+cos(zy/b) ` 


cosh ay ] ven 
cosh gb 


. If the boundary conditions on the infinite strip —oo < x < oo, 


0<y<b,b>0, are u(x, 0) = g(x), uy(x, b) = 0, 

liM} U(x, y) < oo, solve Laplace's equation by the Fourier 
transform and 

(a) the technique leading to (30.37). 

(b) the convolution theorem. (Hint: See Exercise 3.) 


(c) give a physical interpretation of this BVP. 


5. If the boundary conditions on the infinite strip —co < x < oo, 
Ozxyzb,b-0,areu(x, 0) 20, u,(x, b) = f(x), 
lim, 4o; U(X, y) < oo, solve Laplace's equation by the Fourier 
transform and 
(a) the technique leading to (30.37). 


(b 


sinhay ] - 
acoshab] ^. 


— 


the convolution theorem, given that 7; ! [| 


1 In cosh(zx /2b)+sin(z y/2b) 
c cosh(zx/2b)—sin( y/25) |^ 


(c) give a physical interpretation of this BVP. 

6. If the boundary conditions on the infinite strip —oo < x < oo, 
O<y<b,b>0, are u(x, b) = 0, u(x, 0) = g(x), 
lim, s; u(x, y) < oo, solve Laplace’s equation by the Fourier 
transform and 
(a) the technique leading to (30.37). 
(b) the convolution theorem. (Hint: See Exercise 5.) 


(c) give a physical interpretation of this BVP. 
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7. If the boundary conditions on the infinite strip —oo < x < oo, 


O<y<b,b>0, are u,(x, b) = f(x), uy (x, 0) = 0, 
lim,—++00 U(X, y) < oo, solve Laplace's equation by the Fourier 
transform and 


(a) the technique leading to (30.37). 


cosh ay ] - 
asinhab] ~~ 


(b) the convolution theorem, given that F7! [ 
—— L In(cosh 4 Zt + cos T 


(c) give a fastest interpretation of this BVP. 


. If the boundary conditions on the infinite strip —oo < x < oo, 


O0<y<b,b>0, are u(x, b) 20,u,(x, 0) = g(x), 
lim,,400 U(x, y) < oo, solve Laplace’s equation by the Fourier 
transform and 


(a) the technique leading to (30.37). 
(b) the convolution theorem. (Hint: See Exercise 7.) 


(c) give a physical interpretation of this BVP. 


| The Fourier Sine Transform 


The Fourier Integral Theorem for Odd Functions 


If f (x) is an odd function whereby f(—x) = — f (x), then (30.13) and (30.14), the trigono- 
metric form of the Fourier integral theorem, reduces to 


9 Co foo 
= = | Í f (B) sina sinax dB da (30.38) 
T Jo 0 
because A(o) = 0 and B(o) = ie f(B)sinap dB = 2h f f (B) sina dp. 


The Fourier Sine Transform 


The form (30.38) taken by the Fourier integral theorem for odd functions inspires the 
definition of the self-inverting Fourier sine transform 


FfG)] = F(a) = 2 Í  f(f)sinaf dB (30.39) 
0 


for which the inversion integral is f(x) = v i do F,(a) sin x da, the same integral as 


for the transform. 


EXAMPLE 30.25 The Fourier sine transform of f(x) = e~* with domain [0, co) is 


x 0. 


ree 2 e 


The inversion integral for this Fourier sine transform is f(x) = = 


d deos 30.40 

f sinap dB = (i+ a3) ( ) 
2 (sg da =e, 

eo 
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EXAMPLE 30.26 


THEOREM 30.3 OPERATIONAL PROPERTY OF THE FOURIER 
SINE TRANSFORM 


The one operational property of consequence in applying the Fourier sine transform 
to differential equations is the derivative rule, stated in the following theorem. 


1. f, f', f" are all continuous on the interval [0, oo). 
2. f and f' both go to zero as x approaches oo. 
3. f is absolutely integrable, that is, d |f (x)| dx < oo. 


9 
=> F,[f"(x)] = -e*4UfG)] + «Jo 


Notice that the operational law for derivatives is stated in terms of the second derivative. 
The Fourier sine transform of the first derivative cannot be expressed in terms of the sine 
transform itself, so it is not useful to consider an operational law for first derivatives. 


Since f(x) = e^* = f"(x), the operational rule gives 


Ate Gye ( [2 * taf? =f —.=Fle“] 30.41) 
sly F= ag VIJE ý x V\ri+a? Ue : 


In fact, F, [e^* | can be obtained from the operational rule by solving [e *] = ,[(e *)"] 


e^ Fe] «V2 for [e] = V2.2 


z Lot 


>, 
kS 


PROOF OF THEOREM 30.3 The operational rule for derivatives is established via integration 
by parts. Integrating to a finite upper limit and taking u = sin of in the integration-by-parts 
formula f u dv = uv — f v du, the transform F,[ f" (x)] becomes 


jx á n : [2 . / 2 d / 
y =| f (8B) sinaB dp = V —sinaof'(a)—a Ji f(B)cosaBdp X (30.42) 
T Jo m T Jo 


Integrating by parts a second time with u = cos œf, we then obtain for the terms on the 
right in (30.42) 


E = «| ro) cose + "E = «e? f° f(B)sinap df 
T 1 x x Jo 


(30.43) 


Now let c become infinite. The first term in (30.43) goes to zero because f’ does. The 
second term in (30.43) goes to zero because f does. The remaining two terms in (30.43) 
then become the operational rule we set out to derive. 


Solving the Dirichlet Problem with the Fourier Sine Transform 


The Fourier sine transform, applied to the Dirichlet problem on the first quadrant (0 < x < 
00,0 < y < co) with boundary conditions u(0, y) = 0, u(x, 0) = f(x), limy% u(x, y) = 
0, gives the solution 


u(x, y) = JN ne — : Jas (30.44) 
T Jo 


y HU-s PEEHI 


EXAMPLE 30.27 


FIGURE 30.24 Solution surface in 
Example 30.27 


0 1 


FIGURE 30.25 Example 30.27: 
Equipotentials (in color), field lines (in 
black), and electric field vectors 
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For the pulse 
f(x)21—H(x-1D-H(I-x) xz0 (30.45) 
where H(x) is the Heaviside function, the solution given by (30.44) and graphed in Figure 
30.24 is 
x—1 


1 x 5 x+1 
u(x, y) = — (2 arctan : arctan arctan ica ) (30.46) 
T y y y 


If u(x, y) is interpreted as a potential, the equipotentials are then the level curves shown 
in color in Figure 30.25. The field lines, shown in black in Figure 30.25, are the integral 


curves for the differential equations r’ = —Vu, which, in component form, are x'(t) = 
—uy(x(t), y(t)) and y'(r) = —uy(x(t), y(t)). The arrows in Figure 30.25 represent the 
electric field E = —Vu. 4 


DERIVATION OF THE SOLUTION (30.44) For Laplace’s equation, the Fourier sine transform, 
taken with respect to x, yields 


5 
a,/—u(0, y) — aU (a, y) + Uyy (a, y) 20 
te 


and for the boundary condition on the x-axis, yields U (o, 0) = F(a). Then, since u(0, y) = 
0, the transformed differential equation, with V (y) = U (œ, y), becomes 
V'"(y) - aà?V(y) 20 
The solution is V (y) = cje™ + coe %. 
For u(x, y) to go to zero far from the origin, the unbounded positive exponential must 
not appear in V (y) = U (œ, y). This determines c; = 0. Then, apply the boundary condition 
V(0) = U (œ, 0) = F(a) to determine that c2 = F (o). Hence, we have 


^? oo 
V(y) 2U(a, y) = F(a)e " and u(x,y)— FN F(a)e ™ sinax da 
T Jo 


Replacing F (o), the Fourier sine transform of f (x), with its defining integral from (30.39), 
the solution becomes 


J oo oo 
u(x, y) = — i { f(B)sinafge ?" sinax dB da 
T Jo Jo 


Since sin œf sinax = i[cos(o (B — x)) — cos(a (B + x))], we can reverse the order of 

integration, obtaining for the new inner integral, 

JT — x)) — cos(a ($ + x))] da = : ( 5 2 - = 7 :) 

2 Jo 2X3^-c-(B—x) y +E 
(30.47) 


so the solution can be represented as 


2, ur 1 y y 
moe] f a 
nen a fh esum gp] 
which is just (30.44). 
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EXERCISES 30.7—Part A 


Throughout these exercises, H(x) is the Heaviside function. 
A1. Verify the integration in (30.40). 

A2. Verify the transform in (30.41). 

A3. Verify the calculation in (30.42). 


EXERCISES 30.7—Part B 


A4. Verify the calculation in (30.43). 

AS. Verify that 1 — H(x — 1) = H(1 — x). 

A6. Verify that (30.44) applied to f(x) = H(1 — x) gives (30.46). 
AT. Verify the integration in (30.47). 


B1. 


Show that the Fourier sine transform of f (x) is given by 
F,(a) = FF Uf E) when / (x) is odd. 


If a > O, in Exercises B2-16: 


B2. 


B5. 


B7. 


B10. 


B12. 
B13. 
B14. 


B16. 


(a) Use a software tool with a built-in Fourier sine transform to 
obtain F,(a). 

(b) Where possible, obtain the Fourier sine transform by 
integration. 


(c) Where possible, obtain the Fourier sine transform from 
F[f (x)]. the exponential Fourier transform. (See Exercise 
B1.) 


1 1 
x)2— B3. f(x) = — BA. f(x) = x! 
f(x) = 3. f(x) T fü x 
X x 
x)= B6. f(x) = ———— 
dada". +x? Pen (a? + x?)? 


1 
f(x) = ———- | B8. f(x) =e”  B9.f(x)—xe * 
x(a? 


+ x?) 


1 : 2.2 
f@)=-e™ BU. f(x) =xe** 
x 


f (x) = arctan E 
x 
f(x) 2 H(a — x) 
x 
TO = Ta 
f(x) = erfc(ax) = 1 — erf (ax) 


B15. f(x) =e ™ sinax 


In Exercises B17—28: 


(a) Sketch f (x). 


(b) Obtain the solution of the BVP u,» + uyy = 0, in the first 
quadrant, 0 < x, y < oo, u(0, y) = 0, u(x, 0) = f(x). 


(c) Plot the solution surface. 

(d) Obtain a contour plot showing the level curves (isotherms or 
equipotentials). 

(e) Obtain, and superimpose on the contour plot, a graph of the 
flow lines. 


(f) Show that u — O as either x or y become infinite. 


B17. 


B18. | 


B19. - 


B20. f(x) = 


B21. 
B23. 
B24. 
B25. 
B26. 
B27. 
B28. 
B29. 


x 0<x<l 
fM={2—x 1lsx=2 

0 x>2 

x O<x <I 

1 (xyz 
fa)= 3—-x 2<x <3 

0 X =3 

x? 0x-«l 

1 l<x <2 
f= 3-x 2<x<3 

0 x28 

x 

= 0 €x5 

5 
A, $226 

0 x 2-6 
fx)-00-Hx-1)x B22 f(x) = (1 — H(x — 1px? 
f(x) = 0 -—H(x-1)(1-—x) 
f(x) =(-—H@ —D)(1 — x?) 
f(x) = 0 —-H(x — 10)x(1- x) 
fQ)20-H-1D)Xx( - x)? 
fœ) = (A -He -1)x* - x) 
f(x) = (1-H — 1)? — x) 
Use the Fourier sine transform (taken with respect to y) to solve 


the BVP uxx + uyy =0,0 < x, y < œ, u(0, y) = g(y), 
u(x, 0) = 0. 


In Exercises B30—35: 


B30. 


(a) Using superposition, solve the BVP uy» + uyy = 0, in the first 
quadrant, 0 < x, y < oo. u(0, y) = g(y), u(x, 0) = f(x). 


(b) Plot the solution surface. 


(c) Obtain a contour plot showing the level curves (isotherms or 


equipotentials). 
(d) Obtain, and overlay on the contour plot, a graph of the flow 
lines. 
y 
X 0<x<1 = O<y<5 
F=- 122<% 30)—16-5 Sayat 
0 x>2 j 


X 04% <1 X eya 
, l l<x<2 5 n 
B3. fœ) = j3 y 2zx«» £07]6-y 5xy«6 
0 x23 0 y>6 


B32. f(x) = (I — H( — 1))x, g(y) = (1 — Hy — 0)y?(1 — y) 
B33. f(x) = (1 Hà — 1))x?, g(y) = (1 — H(y — D)y?(1 — y) 
B34. f(x) = (1- Hx — D)(1 x), g(y) = A -H — D)y(1 — y» 
B35. f(x) = (1 — H(x — D)(1 — x”), g(y) = (1 - H(y — 1)) yd. — y) 


B36. Use the Fourier sine transform (taken with respect to x) to solve 
the BVP uxx + uyy 20,0«x < œ,0 < y < b, u(0, y) = 0, 
u(x,0) = d: Vh b) = 0, obtaining 


a a(b — sinh o(b — y) 
u(x, y) = ———ÀÀ sinox do 


2 sinh a (b — y) 


rr E p) nO Y sinap sinar df do 
o Jo 


m 


T sinh ab 
Show that, in the limit as b — oo, the second form of the solution 


approaches that in (30.44). 

B37. Use the Fourier sine transform (taken with respect to x) to solve 
the BVP uxx + uyy =0,0<x < œ,0 < y < b, u(0, y) = 0, 
u(x, 0) = 0, u(x, b) = g(x). What additional conditions must 
u(x, y) and g(x) satisfy in order for the solution to exist? 

B38. Use the Fourier sine transform (taken with respect to y) to solve 
the BVP uxx + uyy 20,0«y«oo,0«x«b,u(0, y) = f(y), 
u(x, 0) = 0, u(b, y) = 0. What additional conditions must 
u(x, y) and f(y) satisfy in order for the solution to exist? 

B39. Use the Fourier sine transform (taken with respect to y) to solve 
the BVP uxx + uyy =0,0<y<w,0<x <b, u(0, y) = 0, 
u(x, 0) = 0, u(b, y) = g(y). What additional conditions must 
u(x, y) and g(y) satisfy in order for the solution to exist? 


In Exercises B40—42: 


(a) Use the Fourier sine transform (taken with respect to y) to 
obtain a formal solution of the BVP u,, + uy, = 0, 
0«y«oo,0«x «z,u(0, y) = 0, u(x, 0) = f(x), 
u(z, y) — 0. 

(b) If possible, obtain an approximate value for u(1, 1) via 
numeric integration. 


B40. f(x) 21 B4. f(x) 2 sinx 

B42. f(x) 2 x(x — x) 

In Exercises B43—45, use the Fourier sine transform (taken with respect 
to y) to obtain a formal solution to the BVP uxx + uyy — 0,0 < y < oo, 
O0<x <1,u(0, y) 20,u(x, 0) = f(x). ud, y) 2 O. 

B43. f(x) 2x(1—x) B44. f(x) 2e? B45. f(x) = 1 


In Exercises B46—48, obtain a finite-difference solution. The numerical 
solution requires imposing a boundary condition at y — oo, which can be 
approximated using u(x, b) = 0 for a suitable value of b such as b = 10 
or b — 20. 


B46. the BVP of Exercise B40 B47. the BVP of Exercise B41 
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B48. the BVP of Exercise B42 


B49. Use the Fourier sine transform (taken with respect to x) to obtain 
a formal solution to the BVP u,, + uy, =0,0 < x < oo, 
0<y<1,u(0, y) = y?, u(x, 0) = 0, u(1, y) = 0. 

B50. For the BVP ux, 4-4, =0,0 < x < œ,0 < y «b, 

u(0, y) = A, u(x, 0) = f(x), uyGx, b) = g(x): 


(a) Give a physical interpretation. 


(b) Use the Fourier sine transform (taken with respect to x) to 
obtain a formal solution. 


In Exercises B51—55, use the Fourier sine transform (taken with respect 
to x) to obtain a formal solution of the BVP u,, +u,, = 0,0 < x < oo, 
0 < y < 1,u(0, y) = h(y)u,(x,0) = f(x), u,(x, 1) = g(x). Inter- 
pret each BVP in terms of the steady-state temperatures in a semi-infinite 
strip. 


B51. h(y) = 1. f(x) = 1 — A(x — 1, g(x) = A(x — 1) — A(x — 2) 


B52. h(y) = y(1— y), f(x) = (A(x — 1) — A(x —2)(x — 1) 
2—x), g(x) =0 


I 
B53. h(y) = sinzy, f(x) =e“, g(x) = arctan — 
x 


B54. h(y) = 0, f(x) = (A(x — 1) — A(x — 2))(x — 1)(2 — x), 
g(x) = (A(x — 3) — A(x —4))(x — 3(4 — x) 


x 
B55. h(y) = 0, f(x) 2 xe™, g(x) = ——s 
(y) fie) Ke, AE E 
B56. For the BVP u,, + uyy = 0, 7 <x<w,0<y<b, 
u(0, y) = A, u(x, 0) = f(x (x, b) = g(x): 


(a) Give a physical interpretation. 
(b) Use the Fourier sine transform (taken with respect to x) to 
obtain a formal solution. 
In Exercises B57—61, use the Fourier sine transform (taken with respect to 
x) to obtain a formal solution of the BVP u,,+u,, = 0,0 < x < 00,0 < 
y«l.u(0, y) =h(y), u(x, 0) = f(x), uy(x, 1) = g(x). Interpret each 
BVP in terms of the steady-state temperatures in a semi-infinite strip. 


B57. h(y) = 1, f(x) = 1 - Hx — 1), g(x) = 1 —H( — 2) 


B58. h(y) = y(1— y), f GQ = (1 Hx — D)x(1—x),g(x) = e™ 
x 


14x? 


B59. h(y) = sinzy, f(x) 20, g(x) = 
B60. h(y) = 0, f(x) 2 xe™, g(x) 20 


x 
B61. h(y) = sin2zy, f(x) = ——,, g(x) = xe 
1(y) = sin2zy, f(x) i g(x) = xe 


B62. Use the Fourier sine transform (taken with respect to x) to obtain 


fo fo " 
u(x,t)— Ji F,(a)e * *' sinax da 
T Jo 


2 oo oo : 
= Jl f (B) sinaBe"* * sinax dB da 
T: 0 


as the formal solution of the BVP u, = ku,,, 0 < x < oo, 
u(0, t) = 0, u(x, 0) = f (x). The solution represents the 
time-dependent Bum in a semi-infinite rod. 
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In Exercises B63 and 64, use numeric integration and the results of Ex- 
ercise B62 to approximate u(0.5, 0.1) when « = 1. 


B63. f(x) 21—H(x —1) B64. f(x) 2 e^ 


B65. Use the Fourier sine transform (taken with respect to x) to obtain 


2 P5 da 2 * 
u(x,t) -.|— Í F,(a)e * *-* ? sin ax da 
T Jo 


2 pee pee ji 8s 
EE f f f(B) sina pe * * * sinax dB da 
7T Jo Jo 


as the formal solution of the BVP u, + tu = kus,,0 <x < oo, 
u(0, t) 20,u(x, 0) = f(x). 


In Exercises B66 and 67, use numeric integration and the results of Ex- 
ercise B65 to approximate u(0.1, 0.5) when x = 1. 


B66. f(x) = 1—H(x — 1) B67. f(x) = H(x — 1) — H(x — 2) 
In Exercises B68 and 69: 


(a) Use the Fourier sine transform (taken with respect to x) to 
obtain a formal solution of the BVP u, + hu = üy, 
0 «x «oo, u(0, t) = 0, u(x, 0) = f(x). 


(b) With h = 1, and using numeric integration, compute and plot 
temperature profiles for t = 1, 1, 


3 
2 


(c) Repeat part (b) with h = —1. 


B69. f(x) = Hx — 1) 


B68. f(x) 21—H(x — 1) H(x —2) 


In Exercises B70-72: 


(a) Use the Fourier sine transform (taken with respect to x) to 
obtain a formal solution of the BVP u;, = uxx, 0 < x < oo, 
u(O,t) = f(t), u(x, 0) = 0, u(x, 0) = 0. 


(b) Give a physical interpretation of the BVP. 

(c) Obtain a graph of u(3, t) for 0 < t < 3. 

f@=1-H@-1) B71. f(t) 2 (1 — H(t — D)r(1 — 0) 
t O0zxt«l 


B70. 


B72. f(t) 212-1 1<t<2 
0 eo 
B73. Give a physical interpretation of the BVP un + u, = Uyy, 


0 < x < oo, u(0, t) = 0, u(x, 0) = f(x), uj (x, 0) = 0, and then 
use the Fourier sine transform (taken with respect to x) to obtain a 
formal solution. 


B74. Give a physical interpretation of the BVP up + u, = us, 

0 «x < œ, u(0, t) = f(t), u(x, 0) = 0, u, (x, 0) = 0, then take 
f(t) = te” and use the Fourier sine transform (taken with 
respect to x) to obtain a formal solution. Don't be surprised at the 


algebraic complexity of the solution. 


The Fourier Cosine Transform 


The Fourier Integral Theorem for Even Functions 


If f (x) has the even symmetry f(—x) = f(x), then (30.13) and (30.14), the trigonometric 
form of the Fourier integral theorem, reduces to 


fx)-2 =f a f (B) cosaB cosax dB da 
T Jo Jo 


7} 
= (30.48) 


because B(a) = 0 and A(a) = f^, f(B) cosaB dB = 2 f," f(B) cosa dB. 


The Fourier Cosine Transform 


The form (30.48) taken by the Fourier integral theorem for even functions inspires the 
definition of the self-inverting Fourier cosine transform 


5 oo 
F Lf (x)] = F(a) = "E f(B)cosoaf dp 
0 


Inversion is by the same integral, namely, f(x) = VŽ 


(30.49) 


Av F.(a) cos ax da. 


m J0 


EXAMPLE 30.28 The Fourier cosine transform of f (x) = e~* with domain [0, oo) is 


2 [7 [2 1 
ra= 42 | e * cosa dB = pm 
0 2 


EXAMPLE 30.29 
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2 f99cosox 
z40 14a? 
ex 0. $ 


The inversion integral for this Fourier cosine transform is then f(x) — da — 


THEOREM 30.4 OPERATIONAL PROPERTY OF THE FOURIER COSINE 
TRANSFORM 


The one operational property of consequence in applying the Fourier cosine transform 
to differential equations is the derivative rule, stated in the following theorem. 


l. f, f', f" are all continuous on the interval [0, oo). 
2. f and f' both go to zero as x approaches oc. 


3. f is absolutely integrable, that is, fj" | f (x)| dx < oo. 


p) 
= Ff" (x)] - —a E Lf) — [Zro 


Notice that the operational law for derivatives is stated in terms of the second derivative. 
The Fourier cosine transform of the first derivative cannot be expressed in terms of the cosine 
transform itself, so it is not useful to consider an operational law for first derivatives. 


Since f(x) = e^* = f"(x), the operational rule gives £,[f"(x)] = —o? (v2 ) — 


x 1+a2 
v2 = v2 on = F.[e~ ]. As in Example 30.26, F[e~*] can be obtained from the opera- 
tional rule by solving F,[e* ] = £.[(e *)"] = —o? £F, [e7*]4- VÈ for Fele*] = TEE 

Se 


PROOF OF THEOREM 30.4 The operational rule for derivatives is established via integration 
by parts. Integrating to a finite upper limit and taking u = cos w in the integration-by-parts 
formula f udv = uv — f v du, the transform F,[f”(x)] becomes 


[roosa — [ro ral? f° f'(B) sina f dp 
T T T Jo 


Integrating by parts a second time with u = sino f, we then obtain 


9) pÀ 2 e 
I Playa we — 4| — f (0) +a] — f (o) singe — EI f(B) cosa dp 
T T T mx Jo 


(30.50) 


Now let o become infinite. The first term in (30.50) goes to zero because f’ does. The 
third term in (30.50) goes to zero because f does. The remaining two terms in (30.50) then 
become the operational rule we set out to prove. 


Solving Boundary Value Problems with the Fourier Cosine Transform 


The Fourier cosine transform, applied to the boundary value problem consisting of Laplace's 
equation 4, (x, y) + uy, (x, y) — 0 in the semi-infinite (horizontal) strip 0 < x < oo, 
0 < y < b and the boundary conditions u,(0, y) = 0, u(x, 0) = f(x), u(x, b) = 0, gives 
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EXAMPLE 30.30 


-0.54- 


FIGURE 30.26 Example 30.30: 
Integrands $ (o, 5, +) (solid) and 
o(a, 3, D (dotted) 


0.6 


0| | ) 


FIGURE 30.27 Example 30.30: Graphs 
of u(x, D, u(x, 1), and u(x, 3) are solid, 
dotted, and dashed curves, respectively 


the solution in the form 


[2 [9 . sinh(a(y —1 
u(x, y)=—,/— i pp n= cos ax da (30.51a) 
i 7T Jo sinh ab 


2 oo oo inh JEEP, 
--:f i pple) cosaBcosaxdBda (30.51b) 
T Jo Jo sinh ab 


The homogeneous Neumann boundary condition u, (0, y) = 0 represents insulation, either 
thermal or electrical, on the left edge. 


The pulse (30.45) has the Fourier cosine transform F(o) — sna, With b = 1, the inte- 
grand in (30.51a) becomes 
sin æ sinh(a(y — 1)) 


o(a, x, y) — - COS ax 
a sinh o 


and the solution itself becomes the intractable u(x, y) — -2 [^w $ (a, x, y) da. Explicit 
evaluation must yield to numeric computation, but because of the oscillatory nature of the 
integrand and the infinite upper limit of integration, even this task is not simple. Figure 30.26 
shows $ (o, 1, 1) as the solid curve and ¢ (o, 3, +) as the dotted curve. As x increases, the 
integrand oscillates more rapidly, making numeric integration even more difficult. 

Graphs of u(x, 1), u(x, 1), and u(x, 3), computed numerically, are shown as solid, 
dotted, and dashed curves, respectively, in Figure 30.27. The solution surface corresponding 
to u(x, y) is given in Figure 30.28. kd 


FIGURE 30.28 Solution surface in Example 30.30 


DERIVATION OF FORMULAS (30.51a) AND (30.51b) The Fourier cosine transform, taken 
with respect to x, yields 


2 j 
-JZu0, y)— a U(«, y) + U, (œ, y) - 0 


for Laplace's equation and U (a, 0) = F (œ) for the boundary condition on the x-axis. Then, 
since ux (0, y) = 0, the transformed differential equation becomes, with V (y) = U (a, y), 
V"(y) - o? V(y) 20 
This equation, along with the boundary conditions V(0) = F(a), V(b) = 0, has solution 
sinh(a(y — b)) 


V(y) = U(a, y) = —F(a) 


sinh ab 
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Applying the inversion integral for the Fourier cosine transform then gives the solution 
as (30.51a). Replacing F (œ), the Fourier cosine transform of f (x), with (30.49), the solution 
then becomes (30.51b). Writing 


cosaB cosax = 5[cos(a(B — x)) + cos(a(B + x))] 


does not lead to a simplification because reversing the order of integration just gives the 


intractable integrals 


oo 
| 


sinh ab 


sinh(a(y — b)) 


oo 
cos(a(x — B)) da and { 


for the new inner integral. 


EXERCISES 30.8 


sinh(oa (y — b)) 
——— — — cos(a (x + B)) da 
0 sinh ab 


Throughout these exercises, H(x) is the Heaviside function. 
1. Show that the Fourier cosine transform of f (x) is given by 
F.(a) = M—-F[f(x)] when f (x) is even. 


V 2x 


2. Verify the transform and its inversion in Example 30.28. 


If a, b > 0 in Exercises 3-22: 


(a) Use a software tool with a built-in Fourier cosine transform to 
obtain F.(a). 

(b) Where possible, obtain the Fourier cosine transform by 
integration. 

(c) Where possible, obtain the Fourier cosine transform from 
F[f (x)]. the exponential Fourier transform. 

(d) Where possible, verify the differentiation rule 
F.[f"] = —o?*F.(a) — V2 f^(0); where 7, [ f"] cannot be 
computed directly, use the differentiation rule to obtain its 
value. 

(e) Where possible, verify the differentiation rule 7,[f"] = 
—a? F, (æ) + av2 f (0); where 7, [ f"] cannot be computed 
directly, use the differentiation rule to obtain its value. 

(f) Where possible, verify the scaling rules F.[ f (2)] = à F.a) 
and [f (2)] = ÀF, (a), both subject to the restriction A > 0. 

(g) Where possible, verify the multiplication rules [xf (x)] = 
F! (æ) and F,[xf (x)] = — F! (æ); where the transform of the 
product cannot be computed directly, use the appropriate 
multiplication rule to obtain its value. 

(h) Where possible, verify the shifting rules [f (x) cos wx] = 

SLE; (o +w) + F.(a — o)] and F,[ f(x) cos œx] = 

LIF, (v +w) + F(a — o)]. 

Where possible, verify the shifting rules F.[ f(x) sin ox] = 

[F(a +w) — F,(a — @)] and F,[ f(x) sin ox] = 

7LFe(a — w) — F.( + e]. 

Where possible, verify the integration rule J^. [E fo) do] = 

+ F, (æ). 


(i 


— 


© 


G 


p w 


18. 


20. 
21. 


.f(ix)-2e"cosbx 12. 


. f(x) 2 H(a — x) 


(k) Where possible, verify the differentiation rule F,[ f'(x)] = 
- V2 f(0) + aF,(a); where F.[ f'(x)] cannot be obtained 
directly, use the differentiation rule to obtain its value. 

f(x) = e 

f= =z 


4. f(x) 2 xe" 
6. f(x) 2 xe 


. f(x) = Hx) - H(x — 1) 2? —3x? + 1) 


9. f(x) 2x-1^ 10. f(x) 2 x?? 


f(x) =e™ sin bx 
1 


14. f(x) = ——— 
fe) a? + x? 


. f(x) = (Hx) — Hx - D)? 
. f(x) 2 cosa?x? 


. f(x) = (A(x) - H(x — 1))x3 


f(x) =H(a-x)(a@ —x?) 19. f(x) =In (1 + =) 
x 
f(x) = (HQ) — H — 1))x* 


. a 4 
f(x) =aretan— 22. f(x) = arctan — 
x xe 


In Exercises 23-31: 


23. 
25. 


(a) Obtain the formal solution of the BVP u,, + tyy = 0, 
0<x<w,0<y<1,u,(0, y) 20,u(x,0) = f(x), 
u(x, 1) =0. 

(b) By integrating numerically over the finite domain 0 < o < 20, 
obtain a graph of the solution surface. 

(c) From the graph of the solution surface, obtain a contour plot of 


the level curves (isotherms or equipotentials) determined by the 
BVP. 


(d) Estimate the error made when computing u(2, +) through 
integration over 0 < o < 20 instead of over 0 < œ < oo. 


f(x) =H =x) 24. f(x) 2 H(1 — x)x(1 — x) 
f(x) = HU — x)x(1 — xy? 26. f(x) = H(1 — x)sinzx 
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27. f(x) = H(1 — x) sin2zx 28. f(x) = er 


1 
29. f(x) = (2x3 — 3x? + DH( — x) 30. f(x) = arctan — 
E lad 


31. For the BVP uxx + uyy = 0,0 < x «oo, 0c y < b, ux(0, y) = 0, 
u(x,0) 20,u(x, b) = f(x): 
(a) Give a physical interpretation. 
(b) Use the Fourier cosine transform (taken with respect to x) to 
obtain the formal solution u(x, y) — V2 f F.. (or) Sx 


sinh wb 
cosax da = 2 z ho f(B) cos ap Nus cos ax dB da, where 
F(a) = Lf œ). 


In Exercises 32-39: 


(a) Obtain the formal solution of the BVP uyy + Uyy = 0, 
0<x<œ,0< y< 1, ux(0, y) 20,u(x, 0) = 0, 
u D = f(x). 

(b) By integrating numerically over the finite domain 0 < œ < 20, 
obtain a graph of the solution surface. 


(c) From the graph of the solution surface, obtain a contour plot of 
the level curves (isotherms or equipotentials) determined by the 
BVP. 


(d) Estimate the error made when computing u (2, 1) through 
integration over 0 < œ < 20 instead of over 0 <a < oc. 


32. f(x) = H(1 — x) 33. f(x) = H(1 — x)x(1 — x) 
34. f(x) 3H(1— x)? (1—x) | 35. f(x) = H(1 — x) sinzx 
36. f(x) = H(1 — x)sin2zx 37. f(x) =e" 


38. f(x) 2xe* 39. f(x) = 


l +x? 
40. For the BVP uyy + uyy = 0,0 < x < œ,0 < y < b, 
ux(0, y) = A, u(x, 0) = 0, u(x, b) = f(x), where A is a positive 
constant: 
(a) Give a physical interpretation. 
(b) Use the Fourier cosine transform (taken with respect to x) to 
obtain the formal solution u(x, y) = V2 (PF, (or) $9 4 
2A sinh e y—sinh wb—sinh a(y—b) )cosox da, where 


m a? sinh ab 


F(a) = FL f œ). 


In Exercises 41—50: 


(a) Obtain the formal solution of the BVP uxx + uyy = 0, 
0<x<0w,0<y<1,u,(0,y)= J= u(x, 0) = 0, 
u(x, 1) = f(x). 

(b) By integrating numerically over the finite domain 0 < a < 20, 
obtain a graph of the solution surface. 


(c) From the graph of the solution surface, obtain a contour plot of 
the level curves (isotherms or equipotentials) determined by the 
BVP. 


(d) Estimate the error made when computing u(2, i through 
integration over 0 < o < 20 instead of over 0 < œ < oo. 


42. f(x) 2 (1 — x)H(1 — x) 


41. f(x) 2 H(1 — x) 


43. f(x) 2 x(1 —4)H(1—x) 44. f(x) = x?(1 — x)H(1 — x) 


45. f(x) = xx - 12 — x)HQ — x) 

46. f(x) = H(x — 1) — H(x — 2) 

47. f(x) = (Hx — D - Hx - 2))(x — DQ - x) 
48. f(x) = (Hx - 1) - Hx - 2) (x — D?(2 — x) 


49. f(x) 2 —sinzxH(2—x) 50. f(x) 2 xe? 


In Exercises 51—55: 


(a) Use the Fourier cosine transform (taken with respect to x) to 
solve the BVP uxx + uyy =0,0 <x «oo, 0«y«l, 
ux(O, y) = hy), uy(x, 0) = 0, u(x, 1) 2 f(x). 
(b) Give a physical interpretation of the BVP. 
(c) By integrating numerically over the finite domain 0 < o < 20, 
obtain a graph of the solution surface. 
(d) From the graph of the solution surface, obtain a contour plot of 
the level curves (isotherms or equipotentials) determined by the 
BVP. 
51. f(x) = H@ — 1) - Hx — 2), h(y) = yd — y) 
52. f(x) = (A@ — 1) - Hx -25(x - DQ 
53. f(x) = sinzx H(1 — x), h(y) = y?(1 — y) 
54. f(x) = (H@ — 1) - Hx -3)(x - (x — 2)(3 — x), h(y) = y 
55. f(x) = (H(x — 1) - Hx -3)(x - (x — 2)(3 — x), h(y) = 1 — y 


56. For the BVP u,, + uy, =0,0<x < œ,0 < y < b, u(0, y) = 0, 
uy(x,0) = 0, u(x, b) = f(x): 


x), h(y) = sin Ty 


(a) Give a physical interpretation. 

(b) Use the Fourier cosine transform (taken with respect to x) to 
obtain the formal solution u(x, y) = Jz pe F.(a) —. 
cos ox da, where F.(a) = FL f (x)]. 


In Exercises 57-61: 


(a) Obtain the formal solution of the BVP uyy + uyy = 0, 
0<x<0,0<y<1,u,(0, y) 20,u,(x, 0) 2 0, 
u(x, 1) 2 f(x). 

(b) By integrating numerically over the finite domain 0 < a < 20, 
obtain a graph of the solution surface. 

(c) From the graph of the solution surface, obtain a contour plot of 


the level curves (isotherms or equipotentials) determined by the 
BVP. 


(d) Estimate the error made when computing u(2, 1) through 
integration over 0 < a < 20 instead of over 0 <a < oo. 


57. f(x) = HU — x) 58. f(x) = H(x — 1) - H(x — 2) 


59. f(x) = (H(x — 1) - Hx -2)(x — D(Q — x) 
60. f(x) = (Hx — D - Hx — 2))(x — D(2 — x)? 
0 sS xc] 
x=] 1<x<2 
61. peg J= Dey <3 
0 x3 


62. For the BVP uyy + uyy =0,0<x < œ,0 < y «b, 
ux(0, y) = 0, uy(x, 0) = g(x), u(x, b) = f(x): 


(a) Give a physical interpretation. 


(b) Use the Fourier cosine transform (taken with respect to x) to 
obtain the formal solution u(x, y) = vZ Je F(a) shes 


cosh ab 


2 eo si y—b 
cos ox da + v f G.(a) sinha) cos x dx where 


a cosh ab 


F.(a) = Lf (x)] and G«(o) = F,[g(x)]. 


In Exercises 63-70: 


(a) Obtain the formal solution of the BVP uxx + uyy = 0, 
0<x<0,0<y<1,u,(0, y) 0,u,(x,0) = g(x), 
u(x, 1) = f(x). 

(b) By integrating numerically over the finite domain 0 < a < 20, 
obtain a graph of the solution surface. 


68. 


69. 
70. 
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(c) From the graph of the solution surface, obtain a contour plot of 
the level curves (isotherms or equipotentials) determined by the 
BVP. 


(d) Estimate the error made when computing u(2, 1) through 
integration over 0 < a < 20 instead of over 0 < œ < oo. 


. f(x) = xH(1 — x), g(x) = HU — x) 
. f(x) = Hd — x), g(x) = xH(1 — x) 
f(x) = (1 — x)H(l — x), g(x) = H(1 — x) sinzx 
"ea =x 
. f(x) = H@ — 1) - Hx -2), 


x)H(l — x), g(x) = H(x — 1) — H(x — 2) 


g(x) = (H(x — 1) - Hx — 2)(x — D(Q — x) 


f(x) = (Hx-1)- Hx -2)(x — 1) — x), 
g(x) = H(x — 1) - Hx — 2) 


f(x) = 0 — x3H(1 — x), g(x) = —xH(1 — x) 
f(x) = 2x(x — IHU — x), g(x) = —xH(1 — x) 


Chapter Review 


1. Use the Laplace transform to solve the one-dimensional heat on the 
semi-infinite rod if the rod is initially at a temperature of zero, the 
left end, at the origin, is maintained at a temperature of A and the 
temperature in the rod must remain bounded. 


2. Use the Laplace transform to solve the one-dimensional wave 
equation on the semi-infinite string for which the initial shape and 
velocity are zero and the left end satisfies the condition u(0, t) = 
(1 — Heaviside(t — 1)) sin f. 

3. State the exponential form of the Fourier integral theorem. Give an 
example of its validity. 

4. State the trigonometric form of the Fourier integral theorem. Give 
an example of its validity. 

5. Define the Fourier transform and give its inversion integral. Give an 
example of a function for which the transform and its inversion can 
be computed. 

6. State the operational rule for the Fourier transform of a derivative 
and the rule for the derivative of a Fourier transform. Give 
examples illustrating each. 


7. State the First Shifting law for the Fourier transform and illustrate it 
with an example. 
8. State the Second Shifting law for the Fourier transform and 
illustrate it with an example. 
9, State each of the two convolution theorems for Fourier transforms, 
and given an example of each. 
10. Explain the term amplitude spectrum. 
11. Demonstrate how the Fourier transform is used to obtain 


D'Alembert's solution of the one-dimensional wave equation on an 
infinite domain. 


12. 


13. 


14. 


16. 


17. 


18. 


19. 


20. 


Demonstrate how the Fourier transform is used to solve the 
one-dimensional heat equation on an infinite rod. 


Demonstrate how the Fourier transform is used to solve Laplace's 
equation on the infinite strip —oo < x < 00,0 < y < b, on which 
the conditions u(x, 0) = 0, u(x, b) = f(x), and 

lim, 4s; u(x, y) < oo are imposed. 


State the rule for the Fourier sine transform and give an example of 
a sine transform and its inversion. 


. State the operational rule for the Fourier sine transform of a second 


derivative and give an example illustrating its validity. 

State the rule for the Fourier cosine transform and give an example 
of a cosine transform and its inversion. 

State the operational rule for the Fourier cosine transform of a 
second derivative, and give an example illustrating its validity. 


Demonstrate the use of the Fourier sine transform in solving the 
BVP consisting of Laplace's equation in the first quadrant of the 

x y-plane, and the boundary conditions u(0, y) = 0, 

u(x, 0) = f (x), lim, s; u(x, y) — 0. 

Demonstrate the use of the Fourier sine transform (taken with 
respect to x) in solving the BVP consisting of the one-dimensional 
heat equation on the semi-infinite rod whose temperatures also 
satisfy the conditions u(0, t) = 0, u(x, 0) = f(x). 


Demonstrate the use of the Fourier cosine transform in solving the 
BVP consisting of Laplace's equation in the semi-infinite strip 

0 <x « o0, 0 < y < b and the boundary conditions u, (0, y) = 0, 
u(x,0) = f(x), and u(x, b) = 0. (If u is the steady-state 
temperature in the strip, the left edge is insulated, the temperature 
on the bottom edge is f(x), and the temperature on the top edge is 
Zero.) 


UNIT Six 


Matrix Algebra 


Chapter 31 Vectors as Arrows 
Chapter 32 Change of Coordinates 
Chapter 33 Matrix Computations 
Chapter 34 Matrix Factorizations 


Facility with the concepts and operations of matrix algebra is of increasing im- 
portance to the modern engineer and scientist. This unit discusses the vector 
and matrix manipulations most often met in the applications. With an em- 
phasis on vector and matrix computations, it treats vector space, subspace, 
basis, and dimension intuitively, exemplifying them in the three-dimensional 
space familiar from multivariable calculus. 

Vectors are introduced as arrows, based on a familiarity with the or- 
thogonal unit basis vectors (i, j, k}, and then generalized to a column of real 
numbers giving the components with respect to the basis vectors. The dis- 
tinction between row and column vectors is maintained because we treat the 
contravariant and covariant transformation laws. In Unit Four we saw how 
tangent vectors along a curve arise by differentiation, the model being the ve- 
locity vector for a moving particle. We associate tangent vectors with column 
vectors and show why a gradient vector, also seen in Unit Four, should be a 
row vector. 

We discover how the components of a vector change when the basis 
used to express the vector changes. The change of basis relationship allows 
us to characterize rigid rotations and leads us to the orthogonal matrix. Then, 
after defining the reciprocal basis, we obtain the contravariant and covariant 
transformation laws for column (tangent) vectors and row (gradient) vectors. 

A great deal of matrix arithmetic was introduced in Unit Three, where 
it was used to study systems of differential equations. After a brief review of 
these skills and ideas, we considerthe concept of a projection. We give a pre- 
scription for forming the matrix of a projection of a vector onto another vector 
or a space spanned by a collection of vectors. Finding the orthogonal com- 
ponent of the vector is the key idea in the Gram-Schmidt orthogonalization 
process that transforms a set of vectors into an "equivalent" set of mutually 
orthogonal vectors. 

Eigenvalues and eigenvectors for a matrix were also introduced and 
used in Unit Three when solving systems of differential equations. In Unit Six, 
the eigenpairs of a matrix are used in an analysis of quadratic forms, allowing 
us to generalize the “second derivative test” for functions of several variables. 


Our discussion of matrix norms also relies on a familiarity with eigen- 
pairs of a matrix. Vector norms measure the length or “magnitude” of a vector. 
A matrix norm is a function that assigns a real number to a matrix in a similar 
attempt to assign a “size” to the matrix. One common norm, the 2-norm, is 
computed from eigenvalues, while other norms can be determined from the 
matrix entries themselves. 

Using the least-squares technique to fit a curve to data points is a very 
common operation in the applications. Data points come from observations 
and experiments; curves of fit come from theory. Least squares is a technique 
for obtaining the best fit of the curve to the data. Our matrix formulation of 
the calculation is an entry point for understanding the geometry underlying 
the linear system Ax = y. Thus, we tie the row space, null space, and column 
space to a discussion of what really happens when a least-squares solution 
of an overdetermined system of equations is calculated. 

A matrix written as a product of special factors is said to be factorized 
or decomposed. There are a number of useful such factorizations that arise in 
the applications, and we discuss four of them. We treat the LU decomposition, 
which is very important for solving linear systems Ax = yy, k=1,..., n. The 
similarity transform from Unit Three is seen as the factorization A = PDP’. It 
is not possible to diagonalize every matrix in this fashion. For some matrices, 
the diagonal matrix must be replaced by a Jordan matrix J, which is almost 
diagonal and gives the factorization A = PJP™. 

Far more important is the QR decomposition in which A is expressed as 
a product of an orthogonal matrix and an upper triangular factor. This factor- 
ization is the basis of the very powerful QR algorithm for finding eigenvalues. 
We treat the underlying concept in this unit and revisit the algorithm in Unit 
Eight, where we study numeric methods. 

The fourth factorization is the SVD, the singular value decomposition, 
which relates to computing the 2-norm of a matrix and provides a basis for 
approximating a matrix with “nearby” matrices. Finally, the singular value de- 
composition is related to the generalleast-squares problem and the pseudoin- 
verse, a matrixthat behaves like an inverse when a true inverse does not exist. 


FIGURE 31.1 Unit basis vectors i, j, k 


Chapter 3] 


Vectors as Arrows 


INTRODUCTION Vectors as arrows, and vectors as columns of numbers—both 
views are useful, and often at the same time. Vectors as columns of numbers were used in 
Chapter 12 when solving systems of linear differential equations. Vectors as arrows were 
used in the vector calculus of Unit Four. 

This chapter reviews the algebra and geometry of vector addition and subtraction. The 
dot product, used as early as Chapter 12, is generalized to the inner product and is defined 
for vectors with complex numbers as components. The cross-product, introduced in Section 
12.4 and used in Unit Four is revisited. We derive the determinantal form of A x B from 
the assumptions that the cross-product forms a right-handed orthogonal system with A and 
B and has length ||A||||B|| sin 9, where 0 is the angle between A and B. 


The Algebra and Geometry of Vectors 


Directed Line Segments 


In a Cartesian (i.e., Euclidean) space, such as the familiar three-dimensional rectangular 
space with mutually perpendicular x-, y-, and z-axes, a vector P is the directed line segment 
connecting the origin O to a point p. It is said to run from the origin to the point p. The 
origin is then the rail of the vector, and the point p is its head. When an arrow is used to 
represent the vector, the point of the arrow becomes the head of the vector. 

The length and direction of the directed line segment are the two essential pieces of 
information carried by the vector. The length of a vector is the length of the line segment 
connecting the origin to the point p, while the direction of the vector is the direction of this 
line segment taken from O to p. 

If — p is the point whose coordinates are the negatives of the coordinates of p, then 
the vector from O to — p is —P, the negative of the vector P. The vectors —P and P are 
colinear but point in opposite directions. 


Unit Basis Vectors 


Vectors of length 1, directed along the coordinate axes, are called unit basis vectors. In three 
dimensions, these vectors are typically taken as i, j, k and are directed along the x-, y-, and 
z-axes, respectively. Consequently, the coordinates of the heads of these vectors are then 
(1, 0, 0), (0, 1, 0), and (0, 0, 1), respectively. Figure 31.1 shows these three vectors. 


[Pli = Ipil + |p2| + psl 


[Plo = V Ipil? + |pol? + |p3l? 
IPl = VipiP + [pP + [psl 
Pils = vIpil^ + |pol* + |p3l4 
IPIls = v IpiP + Ep25 + Ipsl? 
|P Ilo = max(|pil. |P2|, |p3l) 


TABLE 31.1 Different norms for 
measuring the length of a vector 


P» 


FIGURE 31.2 Loci of (pi, p2) satisfying 
I Pli zm Lik = dys, 4, where 
P= pic prj 


FIGURE 31.3 
a, B, y 


The direction angles 
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Coordinates and Components 


If the point p has coordinates (pi. p», pa). then pi, p2, ps are the components, with respect 
to i, j, and k, of the vector 


pi 
P = pii + pj + psk = | pr 
P3 


where, on the right, we have used the column-vector notation for P and in the middle, we 
have written P in terms of p;i, p2j, and p3k, the vector components of P. Typographically, 
the column vector looks like a matrix with one column, and indeed, mathematics blurs the 
distinction between the two. 


Length of a Vector 


The length of the real vector P, also called its magnitude or norm, is ordinarily taken as 


IPI = y pi + p2 + p 


the square root of the sum of the squares of the components of P. Hence, this is also called 
the “two-norm,” denoted ||P|;. 

As in the definitions in Table 31.1, the “2” can be replaced with any positive integer k 
or, in the limit as k becomes arbitrarily large, by the symbol “oo.” (See Exercise A1.) The 
|-norm is just the sum of the absolute values of the components, while the infinity-norm 
is the largest magnitude amongst the components. For vectors with real components, the 
absolute values can be dropped in ||Pll;;, k > 1. 


Pll IP |l I|Pll3 ||P]]4 IIP || 5 IP || 
15 J/832911 4495-791 431072747 42001752 726 7 
TABLE 31.2 Vector norms for P = 5i + 3j — 7k 


For example, if P = 5i + 3j — 7k, then we have the norms listed in Table 31.2. The 
norms form a decreasing sequence converging to the infinity-norm. The Euclidean norm 
(2-norm) is but the second member of the sequence. 

Figure 31.2 shows the loci of (pi, p»). the heads of vectors P = pii + p2j for which 
[P]; = 1,4 = 1,...,4. The innermost curve, the square, is the locus of the tips of all 
plane vectors whose 1-norm equals 1. The curve just outside the square is the unit circle, 
the locus of the tips of all plane vectors whose 2-norm equals 1. Next beyond the circle is 
the locus for the 3-norm; then finally, the locus for the 4-norm is the outermost curve. 


Direction of a Vector 


In the plane, the direction of a vector can be given by the angle formed by the positive 
x-axis and the vector. In three dimensions, the direction of a vector can be given by the 
direction angles a, B, y, which the vector respectively makes with the three coordinate 
axes, as shown in Figure 31.3. The cosines of these angles are called the direction cosines. 
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ik: 
Y 


zo 


FIGURE 31.4 Parallel translation of a 
plane vector 


y 


B A 
A +4 
+ p> x 
-3 — -1 0 1 2 


FIGURE 31.5 Parallelogram of vector 
addition 


FIGURE 31.6 The vector from the head 
of A to the head of C is the difference 
C-A 


EXAMPLE 31.1 


Addition, Subtraction, and Scalar Multiplication 


Vectors are added and subtracted componentwise. Multiplication by a scalar is accomplished 
by multiplying all components of the vector by the scalar. Thus, addition, subtraction, and 
scalar multiplication of vectors are given by 


ay bi aj c bi ay cay 
a | + | b | = | a b2 c| a2 | = | ca 
a3 b3 az + ba a3 ca3 


Multiplication of a vector by a positive scalar c # 1 changes the length of the vector without 
changing its direction. Multiplying by a negative scalar c zz —1 changes the length of the 
vector and reverses its direction. 


Parallel Translation of Vectors 


Consider the collection of all possible smooth curves passing through point p in Euclidean 
space. At this point, each curve has a tangent vector. The collection of all such tangent 
vectors is the tangent space T, at p. A tangent space for a point in Euclidean space is again 
a "copy" of Euclidean space, so we can imagine each point to be the origin O for these 
tangent vectors. The distinctive property of Euclidean space is that the unit basis vectors 
(i, j, k} in the tangent spaces remain parallel to their counterparts in the original space. 

The parallelism of the unit basis vectors allows us to translate an arbitrary vector parallel 
to itself so that its tail is no longer the origin, but some other point. The vector still has the 
same components, but the tail rests at a point other than the origin. When a vector is attached 
to a point, it is sometimes called a bound vector. While the vector is being translated, or if 
its tail is attached to no specific point, it is sometimes called a free vector. 

Figure 31.4 shows the vector P — i 4- 2j drawn both at the origin and at (1, —1). In 
either case, the vector representation is the same, namely, P — i 4- 2j. To see this, consider 
the parallel lines described by 


R; =ti+2tj and. Ro = (t + Di -2(r — Dj 


the first passing through (0, 0), the second through (1, —1) at t = 0. Differentiation with 
respect to the parameter t leads to Ri = R4 = P. Thus, under parallel translation in Carte- 
sian space, a vector and its parallel translate have the same magnitude and direction and, 
therefore, are considered to be equivalent. 


The Geometry of Vector Addition 


The vector A + B is the diagonal of the parallelogram whose sides are A and B. This 
diagonal, sometimes called the resultant of A and B, is illustrated in Figure 31.5 for the 
vectors A = 2i + 3j, B = —3i + j, C = A+ B = —i + 4j. The resultant is the diagonal 
of the parallelogram or the third side of the triangle formed by A and the translation of B, 
which puts the tail of B at the tip of A. Since C = A + B, it follows that B = C — A, so 
the difference of two vectors with the same initial points (A and C) is a vector (B) pointing 
from the tip of the first to the tip of the second. Isolating the triangle formed by A, B, and 
C gives Figure 31.6. Consequently, the vector from point p; to the point p» is the vector 
P: — P}. 


The vector from the point (4, —3, 2) to the point (5, 1, —2) is the vector i + 4j — 4k. % 


EXERCISES 31.1—Part A 


A1. Obtain ||P||, for the vector P = 2i + 3j — 4k, and compute 
lim; s; ||P][;. Show this is 4, and then construct a more general 
argument justifying the claim about ||P || in the lower right corner 
of Table 31.1. 


If P = ai + bj + ck and a, f, y are its direction angles, show 

a - = b "E o € i - if "^ 
Pip ^ COS gpp = COS P. ipi; = ©SY: Consequently, if P is a 
unit vector, then its components are its direction cosines. 


A2. 


EXERCISES 31.1—Part B 
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A3. Show that the direction cosines always satisfy cos? œ + cos? B + 
cos? y = 1. 
A4. Find a unit vector from the tip of A = 5i — 7j + 8k toward the tip 
of B= 6i 4- j — k. 
AS. For A and B given in Exercise A4, obtain A + 2B. 


B1. Obtain the direction cosines for the vectors A and B given in 
Exercise A4. 


In Exercises B2-11: 


(a) Find [A]l;, |All2. IA ls. Als- 
(b) Find ||B||,, ||Bllz. ||Blls. || Blloo. 
(c) Plot A, B, A+B, A — B, i(A T B). 


(d) Show that ||A + BI? + IIA — BI? = 2l AIP + |[BI), the 
parallelogram law, holds. 


(e) Obtain a unit vector from A to B. 
(f) Determine the locus of the tip of A + tB, 0 < t < oc. 


(g) Determine the values of a, B, y for which A = aC; + 
BC, + yC; if C; = i+ 2j — 3k, C; = 2i — j — k, 
C, = —i+ 3j+ 2k. 

(h) In the parallelogram formed by A and B, show that the 
diagonals A + B and A — B bisect each other. 


(i) The third side of the triangle formed by A and B is B — A. 
Show that 1 (A + B) is a vector from the origin to the midpoint 
of the third side of the triangle. Show also that the medians of 
the triangle intersect at the tip of the vector i(A +B). 


(j) In the triangle formed by A and B, show that the line segment 
connecting the midpoints of sides A and B is parallel to the 
third side and half its length. 

A =i-+ 8j — 2k, B = 7i — 7j + 3k 

A = Ti — 3j, B = —9i + 2j + 9k 

A = 5i +j — 2k, B = —i + 3j — 8k 

A = 7i — 2j + k, B = —8i + 7j + 3k 

A = 2i — 5j — 4k, B = i — 4j — k 

A = —4i — 7j — 4k, B = 2i + 2j + 4k 

B8. A =i + 2j — 2k, B = i + 9j — 7k 

B9. A = 9i — 6j — 9k, B = 5i — 2j + 8k 
B10. A = —2i + 6j + 8k, B = —6i + 9j — 2k 
B11. A = —3i + 9j — 9k, B = 7i — 3j + 8k 


B2. 
B3. 
B4. 
B5. 
B6. 
B7. 


In Exercises B12-16, two points p; and p» in the (vertical) xz-plane are 
given. Also given is the value of c, the weight in pounds of an object 
suspended at the origin by two ropes connected to the points p; and po. 
Find the magnitude of the tension in each rope. Hint: If u; and up are 
unit vectors from the origin toward p; and p», respectively, find œ and £ 
for which F = au, + Bu; = ok. 


B12. p; = (10,0, 11), p; = (—19, 0, 18), œ = 195 
B13. p; = (21,0, 23), p; = (—11,0,10), 0 = 115 
B14. p; = (17, 0, 13), p; = (—30, 0, 22), w = 345 
B15. p; = (27, 0, 30), p; = (—23, 0, 16), œ = 130 
B16. p, = (26,0, 11), p; = (—29, 0, 17), œ = 380 
In Exercises B17—21, the given points pz, k = 1,...,4, forma quadrilat- 
eral in which A, B, C, D, the midpoints of consecutive sides, are joined 


to form the quadrilateral ABC D. Show that ABC D is a parallelogram. 
Hint: Show the vector equalities AB = DC and BC = AD. 


B17. p; = (18,28), p; = (20, —29), p; = (—17, —14), 
pa = (—29, 20) 
B18. p; = (25,26), p; = (24, —30), p3 = (—25, —28), 
p4 = (—18, 29) 
B19. p, = (22, 24), p; = (16, —17), p3 = (—19, —20), 
p4 = (—25,21) 
B20. p, = (29, 10), p; = (25, —12), p3 = (—24, —21), 
pa = (—20, 14) 
B21. p; = (17, 10), p; = (19, —26), p3 = (—10, —25), 
p4 = (—23, 15) 
In Exercises B22-26, if the points pz, k = 1,...,3, form a triangle and 
P}, k =1,...,3, are vectors from the origin to the respective points px, 


(a) Show that the medians of the triangle intersect at the tip of the 
vector iP, + P5 + P3). (A median connects a vertex with the 
midpoint of the opposite side.) 

(b) Show that the line segment connecting the midpoints of the 


two sides meeting at P;, and the median to the remaining side 
bisect each other. 
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B22. p, = (21,20, —9), p; = (24, 12, —18), p = (11, —19, —15) B25. p, = (14, 1, 20), p; = (—10, 13, 16), p; = (20, 14, 19) 
B23. p; = (20, —13, —19), p; = (—18, 9, 9), p = (—23, —1,25) B26. p; = (19, 12, 18), po = (—21, —24, —7), p3 = (2, —12, 8) 


B24. p; = (—5, 16, —9), p; = (1, 19, —11), p3 = (—9, 25, 3) 


EXAMPLE 31.2 


EXAMPLE 31.3 


FIGURE 31.7 Triangle for illustrating the 
law of cosines 


Inner and Dot Products 


The Dot Product 
The dot product between the vectors 
A=qitaj+a3k and B = bii + bj + b3k 
is the real number 
A-B = a;b; + ab + a3b3 (31.1) 
Alternatively, the dot product can be expressed by 
A -B = A'B 


in conformity with the process of matrix multiplication. If A and B are column vectors, then 
AT, the transpose of A, is a row vector that multiplies B from the left. 


The dot product of the vectors 
3i—2j+5k and 7i-4-3j — 4k 
is the real number A - B = ATB = (3)(7) + (-2)(3) + (5)(-4) = —5. 


:$; 
Sd 


From the expression for A - B, we see immediately that 
A ; A = aja; + aa + a343 = a; + a; + a = |A]? 


and ||A|| = VA - A. (Henceforth, unless stated otherwise, ||A || will denote the 2-norm. The 
expression 


A -B = |/All|[Bl| cos 8 (31.2) 


where @ is the angle between A and B satisfying 0 < 0 < x, is derived after Example 31.3. 


The angle between the vectors P; = 5i and P5 = 3i + 3j is clearly 0 = 7 since the first 


4 
vector is along the positive x-axis and the second along the line y — x. Thus, we calculate 
P; - P) = (5)(3) + (0)(3) = 15, and since ||P; || = 5, ||P2|| = 34/2, and cost = F we 
get P, - P; = 53/2) = 15, thereby verifying (31.2). E 


DERIVATION OF EQUATION (31.2) The equality of the right-hand sides of (31.1) and (31.2) 
hinges on the law of cosines, w? = u? + v? — 2uv cos 0, where u, v, w, 0 are as in Figure 
31.7. Identify the vector B = bii + b2j + b3k with side u and A = aji + a2) + a3k with side 
v. Then C, the vector from B to A, is C = A — B = (a; — bi)i + (ay — b1)j + (a1 — bi)k, 
and we identify C with side w. Thus, we have the triangle in Figure 31.8. 

The law of cosines gives 


T] 


w? — u’ — y? - ICI? — JAI? — IBI? 
—2uv [LA JL |B) 


cos 0 = 


FIGURE 31.8 Vector version of the law 
of cosines 


FIGURE 31.9 The function 
f(x, y) = 3x? + 2xy -3y? has a 
minimum of zero at (0, 0) 


EXAMPLE 31.4 
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and multiplication by ||A||||B|| gives 
A-B—-53(ICI? — IAI? — IBI) 
l 


= —l[(ai — b1)? + (a — bn)? + (a — b3)?] + Ha? + a3 +a3)+ 5 (bj + b3 + b3) 


= dıb; + a2b2 + a3b3 


A gives a simple way for 
determining the angle between the vectors A and B. If A and B are perpendicular, 0 = 7 
and cos 0 = 0, so A - B = 0. Orthogonality is therefore characterized by the vanishing of 


the dot product. 


ANGLE BETWEEN Two Vectors Solving (31.2) for cos 0 = 


Positive Definite Matrices 


A symmetric matrix A with positive eigenvalues is said to be positive definite. The strict 
positivity of the eigenvalues guarantees x! Ax > 0 for x 4 0. For example, the matrix 


A= di 31.3 
Si E" (31.3) 
is symmetric and has eigenvalues A = 2, 4. If x = xi + yj, the quadratic function 
xl Ax = 3x? 4+ 2xy -3y? = f(x, y) (31.4) 


has a minimum of zero at (x, y) — (0, 0), as suggested by Figure 31.9 and confirmed by 
the second derivative test. (See Exercise A1.) Section 33.4 deals at greater length with the 
connection between positive definite matrices A and the quadratic functions x’ Ax they 
define. 


Real Inner Products 


The dot product is actually a function that, for each pair of real vectors, returns a real number. 
This number, A - B = (A, B), satisfies the conditions 


(A, A) 20 
2. (A, A) = 0 just when A = 0. 
3. (A,B) = (B, A) 
4. (aA + bB, C) = a(A, C) + b(B, C), for real scalars a and b. 


Any function satisfying these conditions is called a (real) inner product. Hence, the dot 
product is an example of a real inner product. 

The first condition, requiring the inner product of a vector with itself to be nonnegative, 
makes sense since the dot product of a vector with itself is the length squared. A vector 
should have positive length unless, of course, it is the zero vector. That is the content of the 
second condition, whereby the only vector with zero length is the zero vector. 

The third condition is symmetry and holds for real vectors, as does the fourth condition, 
which requires the real inner product to be linear in the first entry. In light of the third 
condition, the real inner product is also linear in the second entry. 


If A is the positive definite matrix in (31.3), then (x, y) = x" Ay defines an inner product. 
The first and second properties for an inner product hold because the function f(x, y) 
defined in (31.4) has a minimum of zero at the origin. The third and fourth properties are a 


consequence of the linearity of matrix multiplication and are left to Exercises A2 and A3. 
D 
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EXAMPLE 31.5 


Of course, the dot product is an inner product for which A = 7, the identity matrix. 
(See Exercise A4.) 


Complex Inner Products 


The definition of the dot product must be changed for complex vectors. If a real inner 
product is applied to vectors containing complex components, the following anomalous 
result can occur. Using the dot product and the vector A = i + ij, we would get A - A = 
1? +i? = 1 — 1 = 0, thereby violating the requirement that only the zero vector have zero 
length. This problem can be avoided if one of the vectors in the dot product is conjugated. 
(If z = x + iy is a complex number, then z = x — iy is the complex conjugate of z. The 
superimposed “bar” in Z typically denotes the complex conjugate in the literature, and z, 
the conjugate of a vector, is obtained by conjugating each component of z.) 

Unfortunately, the literature is about evenly split on the issue of which vector to conju- 
gate. Texts such as [52] conjugate the second member of the pair, while texts such as [64] 
conjugate the first. We will follow the convention of conjugating the second vector so, in 
three dimensions, v - w = RR Ui U,. AS a consequence, the properties of the (complex) 
inner product must be stated as 


1. (AA) >0 

2. (A, A) = 0 just when A = 0. 

3. (A, B) = (B. A) 

4. (aA + bB, C) = a(A, C) + b(B, C) 


The first two conditions still require that only the zero vector have zero length and all 
other vectors have positive length. The third condition modifies the symmetry exhibited by 
the real inner product. Here, interchanging the order of the vectors conjugates the value of 
the inner product. 

The fourth condition still requires the inner product to be linear in the first entry but, 
in light of the third condition, no longer yields linearity in the second entry. A linear 
combination of vectors in the second entry would now simplify to 


(A, bB + cC) = b(A, B) + GA, C) 

Scalar multiples of the second vector “come out of" the inner product as conjugates. 
Texts that conjugate the first vector will still impose the third condition but preserve linearity 
in the second entry and conjugate-linearity in the first entry. 

Given the vectors 
A = (1 + 2i)i -3j- (4—5i)k and B= (3 — i)i + (2 + 3i)j + (5 + 6i)k 
we find 
|All = /(A, A) = v55 (A,B)=-—3-5li (B,A) 5 —3- 51i 
Furthermore, if 
C-(5-7idü-—2ij- (98k z1=7—3i  z;26-—4i 


then 


(zi À + 2B, C) = 537 — 571i = zı (A, C) + zo (B, C) 


and 
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(A, z B + z2€) = 270 — 742i = zi(A, B) + Z2(A, C) 


Without conjugating the scalar multipliers in the second expression, the incorrect z; (A, B) + 
z2(A, C) = —468 — 620i would result. id 


EXERCISES 31.2-Part A 


A1. Use the “second derivative test" of multivariable calculus to 
classify the critical point of f (x, y) given by (31.4). (At the critical 
point, fer f, — po! > O0 and f, > 0 indicate a minimum.) 

A2. Define the inner product (x, y) by x' Ay, where A is given by 
(31.3). Show that (x, y) = (y. X). 


EXERCISES 31.2-Part B 


A3. For the inner product defined in Exercise A2, show (ax + by, z) = 
a(x, z) + b(y, Zz), where a and b are real scalars. 


A4. Show that x - y, the ordinary dot product, is an inner product with 
A = I, the identity matrix. 

AS. Show that A = [} ;] is positive definite. Verify that x" Ax > 0 for 
x z 0. 


4 
—2 


5 
B1. Verify that A = | -5 4 is positive definite so that x! Ay 
4 cg 


9 
defines an inner product. Compute this inner product for x — 
2i — 3j + 5k and y = —4i +j + 7k. 

B2. If (x, y) = 0, the vectors x and y are said to be conjugate. (Think 
of this as a generalization of orthogonality.) For the inner product 
defined in Exercise B1, find all vectors conjugate to x. 


In Exercises B3-7: 


(a) Write V = aC, + C2 + yC; and solve for a, p, y by 
equating components. 


(b) Write V = aC, + 8C; + y C; and solve for a, P, y by 
computing V - Cj, k = 1, 2, 3. 

(c) Write V = aC, + 8C; + yC; and solve for o, B, y by 
computing (V, Cz), k = 1, 2, 3, where the inner product is 
defined in Exercise B1. 


i -2 4 5 
B3. V = 8|[,C4- 4|,Q= 6/,G= ] 
| 10 =] —12 —10 

[ 1 -5 =] 12 

B4. V2|-11|[,C;2| 12],€22| 1|. = |=2 
|1 =I 1 =j 

[-2] pu 8 
B5. V= 6|,Ci- 4) C= 17 le 
| 9 -3 3 

3 4 

7 8 

1 2 


[—3] MI 8 
B6. V=|-7].C, =| -6],CQ2= = | 11 
12 1 2 


r57 rä 
B7. V=|-2|,Ci =] 11]. 
2 


In Exercises B8-17, graph A and B, use a ruler to measure their lengths, 
use a protractor to measure the angle 0 between A and B, and compute 
\| A||||B|| cos 9. Then, compare to the computed value of A - B. 


B8. A =7i—8j,B=3i+5j B9. A=—5i+5j,B=—7i+j 
B10. A = —-i+3j,B=8i+3j B11. A= -i — 4j, B — 2i 4- 9j 
B12. A = —2i—7j,B=8i+5j B13. A = —3i — 6j, B = —8i + 2j 
B14. A=5i+j,B=3i+4j B15. A= 9i — 8j, B=i+9j 

B16. A = 9i — 4j, B = —5i+6j B17. A = 5i — 7j, B = —3i — 8j 


In Exercises B18—22: 


(a) Show that A- B = B- A. 

(b) Show that (rA + sB) C 2 r(A - CO) 4- s(B- C). 
(c) Show that A- (rB + $C) = r(A - B) 4- s(A : C). 
(d) Show that A - B = F(A + BI? — |A — BI’). 


| 7 —12 7 

B18. A= 9) ,B= 5|,C= 11 | jr = 2, $s = —3 
L3 —5 12 
| —7 —8 10 

B19. A = 5|,B=|-10|,C=]| 1|, =-7,s=5 
| -11 —8 3 
[0 —2 7 

B20. A= | 10] ,.B= 8|,C- 1|,r=1l,s = —4 

1 11 -1 
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In Exercises B23-27: 


B23. 


B24. 


B25. 


B26. 


B27. 


(a) Show that A- B = B- A. 
(b) Show that (z;A + z;2B)- C 2 z (A CO) - z: (B: C). 
(c) Show that A + (zj B + z;2C) = zi(A - B) 4- z:(A * C). 


(d) Show that A - B = į (IA + BI? — ||A — BI) + 
i (A + iB|? — lA — iB. 


in" S= 9 4- 2i 
A= 6i .B=|-4-71|,C=|-7-2i], 
L-8 + 9i —] — 6i 6 4- 8i 
zı = 7 — 5i, z2 = —8— 5i 
[2-3 3+9i —5 — 8i 
A-|5-2i|,B-|8-i|.C-—|!-4-—6i|, 
[8 + 2i Ti —348i 
zı = 9 — 2i, z2 = —9 + i 
[-3— 5i] —4.— 4i -5-i 
A=|-3+61|,B=]-5-—4i|,C=| 5-—3i|, 
|.-8—5| 8i 1 4-9i 
zı = —4 + 5i, z2 = 1 + 6i 
= o] 2+6i 4 — 2i 
A=] 9-i |,B-2|-3-i|,C 642i |, 
|-34 6i | —4 54i 
zı =3-—7i, z2 = —2 — i 
| -9- 6i] —4 +i 447i 
A=|-24+3i],B 2-i|,.C=]1+4+9i], 
84 5i <7 8+6i 


m— ——— NES 


In Exercises B28-37: 


(a) Use the dot product to find o so that B — «A is perpendicular 
to A. 


(b) Use calculus to minimize |B — «A|?, thereby recomputing o 
from an alternative perspective. 


B28. 
B30. 
B32. 
B34. 
B36. 


(c) Sketch A, B, X = oA, and Y = B — X. 
(d) Use the diagram in part (c) to explain why o is the same in 
parts (a) and (b). 

A = 8i + 12j, B = —3i — 2j 
A = 12i - 2j, B = —i + 11j 
A = —9i + 11j, B = 8i + 3j 
A = 7i- j, B = —i — 3j 

A = —8i — 2j, B = 7i + 11j 


B29. A = —5i + Sj. B— i — 10j 
B31. A 2 i-- 5j, B = 10i 4- 11j 
B33. A — 7i — 9j, B — 3i — 7j 
B35. A = 11i — 12j, B= 7i — 11j 
B37. A 22i - jjB— i4 3j 


In Exercises B38-47: 


i The Cross-Product 


(a) Use the dot product to find o and f for which C — («A + BB) 
is perpendicular to the plane spanned by A and B. 

(b) Use calculus to minimize ||C — («A + BB)||?, thereby 
recomputing o and f from an alternative perspective. 

(c) Sketch A, B, and the plane in which they lie, and then include 
C, X = gA + pB, and Y = C- X. 


. A = 4i — 6j + 8k, B = 11i + 12j + 6k, C = 7i — 11j — 12k 
.A=-—i-8j 
. A = —7i+j+ 8k B= 
. A = 9j — 2k, B = 11i — 7j — 9k, C = 4i — 6j + 12k 
. A = —3i 
. A = —5i — j + 5k, B = 3i + 11j + 12k, C = —i — 4j — 5k 
. A = 3i+5j+ 3k, B — 7i — 9j 


12k, B 


6i 4- 10j 
3i+ 12j 


2k, C = 9i + 8j + 10k 
2k, C = —8i + 7j — 11k 


10j + 3k, B = —2i — 11j + 9k, C = —2i — 12j + 6k 


6k, C = —5i+ 8j — 5k 


. A = 3i — 5j + k, B = —3i - 4j + k, € = —12i — 2j + 9k 
. A = —8i — 6j + 12k, B = 5i + 10j — 3k, C = 6i + 7j — 4k 
. A = 10i + 2j + 2k, B = 9i — 9j — 2k, C = 7i + 4j — 10k 


. Using vectors, prove that the median to the base of an isosceles 


triangle is also the altitude to that side. 


Derivation of Formula (12.5) for the Cross-Product 


Formula (12.5) in Section 12.4 can be derived from the three properties that A x B, the 
cross-product of the vectors A and B, is orthogonal to both A and B, forms a right-handed 
system with A and B, and has length given by 


IA x B|| = ||A]|BI| sino (31.5) 


where 0 in [0, zr] is the angle between A and B. To do this, let the vectors A, B, and C be 


given, respectively, by 


A=aqi + adj + ask 


B= bji + boj + b3k 


C=AxB=ci+ coj+ck 


The condition that C be perpendicular to both A and B yields the two equations 


A+-C=ajc; aoc? +a3¢c3 =0 and B.C = bici +hocr + b3c4 = 0 


EXAMPLE 31.6 


FIGURE 31.10 The vectors A, B, and 
A x B in Example 31.6 
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Then, (31.5) yields the third equation 


(dededo- faced ed fne es 


Solving these three equations for c1, c2, c3 gives the two solutions 


(aibi + aab» + a3b3Y? 
(aj + a$ + a3) (bi + b + b3) 


ab; = d3b» aonb = a3b 
a3b, = a,b3 and — a3b, = a,b; 
aj b» = arb; a,b = aonb, 


A simple test with the unit vectors {i, j, k} shows the first solution obeys the right-hand 
rule and points in the appropriate direction. The other solution is its negative. Consequently, 
orthogonality, the length condition (31.5), and the right-hand rule determine the cross- 
product, which we write more compactly as 


i j k 
AxB-det|aj a» a (31.6) 
bi b» b3 


in terms of the determinant of a 3 x 3 matrix. (Determinants are discussed in Section 12.4.) 


If A = 2i — 2j — k and B = i + j + k, then 
i j k —1 
AxB=//2 -2 =1 ||= | -3 
1 1 1 4 


with A, B, and A x B shown in Figure 31.10. e 


Additional Properties of the Cross-Product 


A compendium of formulas for the cross-product includes those listed in Table 31.3. The first 
two laws suggest the cross-product obeys some of the rules of ordinary algebra. However, 
the failure of the commutative law (3) and of the associative laws (4) points out the singular 
nature of the cross-product. 


(1) Scalar multiplication (aA) x (bB) = ab(A x B) 
Ax(B--C)-CAxB-AxC 
(B+C)xA=BxA+CxA 

(3) Anticommutation BxA=-AxB 

Ax (Bx C) =(A- C)B— (A- B)C 
(A x B) x — (A- OB — (B-C)A 


(2) Distributive laws 


(4) Nonassociativity 


TABLE 31.3. Additional formulas for the cross-product 
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EXERCISES 31.3—Part A 


In Exercises Al-5,let A =i+j+k,B=i-—j—k,C=i-—j+k. 
Al. Verify A x (B+C)=AxB+AxC. 
A2. Verify (B+C) x A=BxA+CxA. 


EXERCISES 31.3—Part B 


A3. Verify B x A= —A x B. 
A4. Verify A x (B x C) = (A- OB — (A - B)C. 
A5. Verify (A x B) x C= (A: OB — (B: OA. 


€ €) C35 


ai a2 a 
B1. The triple scalar product, A - (B x C) = det | bz 1 j 


appeared in a proof in Section 21.6. Show that |A - (B x C)| 
represents the volume of the parallelepiped whose edges are the 
vectors A, B, C, and their translates. 


B2. Verify the identity (A x B) x (Cx D) = (A -B x D)C— 
(A -B x C)D. 


B3. Verify the identity (A x B) x (C x D) = (A- C x D)B— 
(B.C x D)JA. 


B4. Verify the identity (A x B) - (C x D) = (A- C)(B- D) — 
(A - D)(B- C). 


B5. Verify the identity A x (B x C) +B x (Cx A) + 
€ x (A x B) = 0. 


B6. Verify the identity ||A x B|? + (A - B? — [A] ||B|? = 0. 
B7. Verify the identity [A x (A x B)] x A - € = [AJ (A -B x C). 
B8. Verify the identity (A x B) - (B x C) x (C x A) = (A -B x ©)’. 
In Exercises B9-18: 
(a) Obtain A x B via the determinant formula, (31.6), and then 


compute its length. 


(b) Compare part (a) to ||A x B|| = ||AJ||B|| sin 6, where 0 is 
obtained from A - B = ||A||||B|| cos 8. 


B9. A = 7i — 9j + 3k, B = —7i — 5j — 11k 
B10. A = —10i — 10j + 12k, B = —12i — 5j — 5k 


B11. A = —8i — 10j — 8k, B = —2i + 8j + 11k 
B12. A = 7i — 11j + 12k, B = 10i + j + 3k 
B13. A = 7i — j — k, B = —3i + 4j — 6k 
B14. A = —12i — 6j + 8k, B = —2i — 7j + 4k 
B15. A = 10i — 7j +k, B = 8i — 3j + 12k 
B16. A = —2i+ 11j — 7k, B = —9i + 4j — 6k 
B17. A = 9i — 2j — 12k, B = 6i — 5j — k 
B18. A = 5i + 3j + 11k, B = 12i — j — 4k 


For each pair of vectors A and B in Exercises B19-26, let C = cji 4 
c2) + c3k and determine C = A x B from the three conditions A - C = 
0, B- C = 0, and ||C|| = ||AI|||B]| sin 9. Verify the result by computing 
A x B. 


B19. A =i — 11j — 12k, B = 12i + 11j — 12k 
B20. A = 8i + 11j + 12k, B = 6i 4- 7j — 11k 
B21. A = —12i — 6j + 10k, B = —2i+ 9j + 8k 
B22. A = 12i — 3j — 10k, B = 3i — 2j — 11k 
B23. A = —Si+ 3j + 5k, B = 3i + 7j — 9k 
B24. A = —6i — 5j + 8k, B = —5i + 3j — 5k 
B25. A =i — 3j — 4k, B = i — 12j — 2k 
B26. A = —2i — 8j + 7k, B = 5i + 10j + 11k 
In Exercises B27—36: 
(a) Verify A x (B x C) = (A- C)B - (A. B)C. 
(b) Sketch B, C, and A x (B x C). 
(c) Verify (A x B) x C= (A- OB - (B- CA. 


(d) Find the triple scalar product A - (B x C) and the volume of 
the related parallelepiped. 


(e) Sketch A, B, and (A x B) x C. 
B27. A = 9i — 8j — 6k, B = 12i + 5j + 10k, C = —3i+ 6j + 7k 
B28. A = —4i + 10j + 2k, B = 2i + 9j — 9k, C = —2i + 7j + 4k 
B29. A = —10i — 7j — 7k, B = 5i — j — 5k, C = 7i + 11j — 2k 
B30. A = 10i + 4j — 12k, B = i + 7j — 3k, C = —6i + 5j + 7k 


B31. A = —9i + 12j + 8k, B = —10i — 7k, C = 3i + 4j — 6k 
B32. A = —7i + j +k, B = —2i— 5j — k, C = —2i — 5j + 9k 
B33. A = —3i — 9j — 3k, B = —10i — 12j, C = 6i — 2j +k 


B34. 
B35. 
B36. 


A = 8i — 4j +k, B = 5i — 10j + 11k, C = —5i — 2j — 2k 
A = —2i — 10j — 5k, B = 6i — 5j + 10k, C = —9i + 5j — 10k 
A = —2i — 12j — 7k, B = —6i — 3j — 3k, C = —7i — 12j — 10k 


In Exercises B37—41, find the area of the triangle determined by the given 
points. Hint: See Figure 21.2, Section 21.1, and the related discussion. 
B37. pi = (9,6, 8), p; = (—4, —6, —3), p3 = (6,10, 6) 

B38. p, = (9,7, 5), p; = (—12, 11, —2), pa = (5, —10, 11) 

B39. p, = (9, —11, 4), p; = (—12, —9, 28), p3 = (2, 6, 8) 

B40. p, = (6, —5, 1), p2 = (—8, 4, 12), ps = (—5, 4, —2) 

B41. p; = (10,5, —5), p2 = (8, —7, 4), p3 = (—9, 5, —6) 


In Exercises B42—49: 


(a) Show that the four given points are coplanar. 
(b) Show that the four given points determine a parallelogram, 
and sketch the parallelogram. 
(c) Find the area of the parallelogram. 
(d) Find the lengths of the diagonals of the parallelogram. 
(e) Find the coordinates of the intersection of the diagonals. 
B42. p; = (-3, 27, 1), p; = (—5, —2, 12), p3 = (72,4, -1), 
pa = (0, —1, —12) 
B43. p; = (—5,12, —1), p2 = (11,4, —3), ps = (27, —14, 10), 
pa = (11, —6, 12) 
B44. p, = (4, 11, 5), po = (4.6, 
p4 =(-1,1,1) 
B45. p, = (8,7, 3), p; = (4, 8, 12), p3 = (—7, —1, 4), 
pa = (—3, —2, —5) 
B46. p; = (5, 1, —10), p2 = (12, —2, —1), p3 = (18, —12, 20), 
p4 = (11, —9, 11) 
B47. p, = (7, 211, 12), p; = (10,1, 3), p; = (10, 11, —10), 
pa = (7,-1,-1) 
B48. p, = (8, 11, 2), p2 = (0, —5, 12), p = (—1, —25, 13), 
pa = (7, —9, 3) 


Il 


12), p3 = (—1, —4, —16), 


Chapter Review 


Let the vectors A, B, C be given by 
A = 21+ 3j — 5k, B = 5i — 2j + 7k, C = 4i — 5j — 6k. 


1. What are the components of A? 


r2 


. What are the vector components of A? 
. What is ||A||, the length of A? 


. Obtain A 4- B, and draw the parallelogram that represents this sum 
graphically. 


A w 


Un 


. Obtain A — B, and draw the triangle that represents this sum 
graphically. 
6. Compute A - B and verify that A - B = || A|||B|| cos@, where 6 is 
the angle between A and B. 
7. Compute A x B and verify that ||A x B|| = ||A||||B|| sin 8. 
8. Verify that A x B is orthogonal to both A and B. 
9. Compute A » B x C and interpret its value. 
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31.3 The Cross-Product 


B49. p; = (—2, 8, 11), p; = (1, —11, 
p4 = (12, 11, —12) 


12), p3 = (15, —8, —35), 


When a force F is applied at point Q in an object, the tendency of the 
force to generate a rotation about the point P is called the torque or mo- 
ment of the force about P. If r is the vector from P to Q, this torque is 
given by T — r x F. The magnitude of T measures the tendency of the 
vector r to be rotated counterclockwise about an axis lying along T. In 
Exercises B50—59: 

(a) Obtain T and ||T||. 

(b) Sketch r, F, and T. 
B50. P = (7, 11,12, Q = (10, 1, 3), F = 7i — 11j + 12k 
B51. P = (—3,4, —6), Q = (8, 11, 12), F = —3i + 4j — 6k 
B52. P = (—12, —6, 8), Q = (-2, -7, 4), F = —12i — 6j + 8k 
B53. P = (10, —7, 1), Q = (8, —3, 12), F = 10i — 7j +k 
B54. P = (6, —5, —1), Q = (5,3, 11), F 26i — 5j —k 
B55. P = (—S, 3,5), Q = (3, 7, —9), F = —5i + 3j + 5k 
B56. P = (9, —8, —6), Q = (12, 5, 10), F = 9i — 8j — 6k 

P 

P 

P 


B57. (—4, 10,2), Q = (2, 9, —9), F = —4i + 10j + 2k 
B58. P = (10,4, 12), Q = (1,7, 3), F = 10i + 4j — 12k 
B59. ( 


-7, 1, 1), Q = (-2, —5, —1),F = i jak 


10. Compute A x (B x C) and (A x B) x C. 
11. Verify that A x (B+C)=AxB+AxC. 
12. Verify that (B-- C) xX A2 BxA--C x A. 


Let M =[_) $] and define (x, y) = x' My, where x = [7] and y = 
[3]; Show that (x, y) defines an inner product by answering Questions 
13-16. 


13. Show that 


(x, X) > Oforx Z 0. 
14. Show that (x, 

( 

( 


X, X) = 0 > x = 0, and conversely. 

15. Show that (x, y) = (y, x). 

16. Show that (ax + by, z) = a(x, z) + b(y, z), where z = [3 ] 

17. If x = 2i — 3j and y = 5i + 7j, compute x - y and (x, y). É 

18. When is a square matrix A said to be positive definite? Give an 
example of a positive definite 2 x 2 matrix which contains no zeros. 
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Chapter 32 


Change of Coordinates 


INTRODUCTION In the vector calculus of Unit Four, vectors tangent to curves 
arose by differentiation of the radius-vector form of the curve and vectors orthogonal to 
coordinates surfaces arose as gradient vectors on those surfaces. In the orthogonal coordi- 
nates systems of Unit Four, the essential difference between tangent and gradient vectors is 
masked by the orthonormal bases used. This difference is in the way components change 
when the coordinates in the space are changed. 

Therefore, to understand the contravariant and covariant transformation laws for ob- 
taining the components of tangent and gradient vectors under a change of coordinates, we 
begin the chapter with an examination of a change of basis for vectors thought of as arrows. 
From this perspective, we then discuss rotations and reflections in space and the orthogonal 
matrices that express them. 

A change to polar or spherical coordinates induces a change in basis for vectors in 
those systems. The new basis vectors can be taken as either tangents to coordinate curves 
or normals to coordinate surfaces. These sets of basis vectors are related as reciprocal sets 
of vectors. In coordinate systems that have orthonormal bases, the two sets of reciprocal 
vectors are coincident. However, in nonorthogonal coordinates systems or in orthogonal 
systems where the basis vectors are not normalized, the reciprocal bases are different. 
Vectors expressed in terms of these two different types of basis vectors transform differently. 
Vectors expressed in terms of a basis of vectors tangent to coordinate curves are represented 
as column vectors, and transform contravariantly. Vectors expressed in terms of a basis 
of vectors normal to coordinate surfaces are represented as row vectors, and transform 
covariantly. 


Change of Basis 


Basis 


We have informally used the notion of a basis for a null space in Sections 12.6 and 12.12 
and, in Section 31.1, have used {i, j, k} as the set of unit basis vectors for three-dimensional 
Euclidean space (R?). A more formal definition is the following. 

A basis for a space of vectors is a “minimal” set of linearly independent vectors whose 
linear combinations generate all members of the space. By minimal, we mean that the 
number of vectors in the set is as small as possible. This unique number is the dimension 
of the space. 
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For example, the xy-plane is a two-dimensional space in its own right. When it sits 
inside three-dimensional Euclidean space, it is considered a subspace of the larger space. 
In fact, any plane through the origin of R? is a two-dimensional subspace of R?. Although 
every vector in the xy-plane can be represented in terms of (i, j, k} by taking the component 
of k to be zero, a basis for the xy-plane is (i, j}, a set of just two linearly independent vectors. 


Components of a Vector 


A vector, defined as a directed line segment, has been represented geometrically by an 
arrow and analytically by its components with respect to the orthonormal set (i, j, k}, a 
basis of mutually perpendicular vectors of unit length. Typographically, the vector V whose 
components are the numbers v! , v?, v? can be written explicitly in terms of (i, j, k} or as a 
column, as in 


Vaevit¢vj+tuk = |v 


In the course of Chapter 32, the formalism that pairs superscripted indices with column 
vectors will eventually be matched with a formalism that pairs subscripted indices with row 
vectors. Both are related to the type of basis used to represent the vector, and it is to this 
question we now turn. In particular, we wish to learn how a vector’s components, given 
with respect to one basis, are related to its components given with respect to another basis. 


New Basis Vectors 
Deliberately written with subscripts, the three vectors 
e = —8i + 8j- 5k e =-—3i-5j+3k e3 = —8i + 3j-— k 
are linearly independent, in accord with the definition in Section 12.6. We wish to express 


the vector V = v!i + vj + v?k in terms of the new basis (e; , e», e3}, that is, we wish to 


Ll 5:2 


know 'v!, ^v?, ^v?, the components of V with respect to the new basis vectors. The vector 
V will still be the same arrow, even though its representation will be 


3 
9 k a 
V ='vle, +'v e + ve, = > "ve, — "ve, 
k=l 


where the Einstein summation convention (sum on the repeated index k appearing once 
raised and once lowered) allows us to drop the explicit sigma notation. 
To find the new components, solve the equations 


e;—-—8i--8j—5k  e,—-—3i—5j-3k e; =—8i+3j—k 


for (i, j, k} in terms of [e;, e». e3}, obtaining 


: : 2 32 3 / 4 
i--z£e-Zie-4e j--Ze« ete, kc--Ze — Ze. + Se; 


from which we get 


) 4.1. 27,2 49.3 7,1..32,2 40.3 1,41 4,29,2 464,3 
V= at -ar— av let ae — a ait) ea ar + eee H Siu?) ez 


For insight into the structure of this result, let A be the matrix of coefficients for 
the equations relating the old basis to the new. In particular, let the columns of A be the 
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EXAMPLE 32.1 


EXAMPLE 32.2 


y 
Component of V Á 
along e, 


Component of V 
along e; 


T 
FIGURE 32.1 Example 32.1: The vectors 


V, €i, and e; and the vector components of 
v along e; and e; 


EXERCISES 32.1 


Chapter 32 Change of Coordinates 


coefficients of the new basis vectors in terms of the old. Then, A and A~! are given by 


= UD . H9 

= 28 ug 61 61 61 

= = —1 j| 32 . 40 
A= 8 5 3 a = 61 61 61 
—5 3 -l1 d 39 64 

61 61 61 


and inspection shows that if V and 'V are written as column vectors, then 'V = A7'V is 
the transformation law for the change in coordinates induced by a change of basis. 


In the xy-plane, change bases from {i, j} to e; = —i — 4j, e; = —5i + 3j. To find the com- 
ponents of V = 2i + 3j with respect to the new basis vectors, solve the equations —i — 
4j = ei, —5i + 3j = e; for (i, j} in terms of (e;, e;], obtaining i — -ġe — $e j = 
—3;€i + 5; €». Then, by direct substitution, obtain 'V = -Ze — 3e. 


Alternatively, proceed algorithmically by forming A, the matrix whose columns are the 
coefficients of the new basis with respect to the old, and then computing A^! and 'V = 


A~'V, thereby obtaining 
3 21 
=L 8 -1 7m TB , = EH 21 5 
A- [A ; A [5 J> V—A v- | 3|--8- e 


|- jo 


N 


Figure 32.1 shows V, ei, e2, and the components of V along e; and e». In addition, the 
parallelogram of addition formed by the components of V along e, and e» is also shown. % 


For the vectors 


—5 4 —3 2 
V= |—6 e=]8 e = 7 e3—|8 
—8 2 —6. 0 


find the components of V with respect to (ei, e2, e3}. Thus, form A, the transition matrix 
whose columns are components of the new basis vectors in terms of the old. Then, the 
components of V with respect to the new basis are given by 'V = A^!V or 


1 


4 -3 "1 Ts 68 
V=/8 7 8 —6 ET 36 $ 
2 6 0 —8 — 107 


In Exercises 1—10: 


(a) Show e, and e; are linearly independent. 


(b) Obtain 'V, the representation of V with respect to e; and e, by 
solving for i and j in terms of e; and e; and then substituting into V. 


(c) Obtain 'V using the transition matrix A = [e;, e;]. 


1. V = —2i — 12j,e, = —71 
2. V = -7i — 12j, e; = —10i — 6j, e; = —4i — 9j 
3. V = —4i — 1j, e; =i + 10j,e = 2i + 8j 
4. V = 4i+ 11j,e, = —2i + 7j, e; = —3i — 3j 
5. V 23i — 8j, ei = —3i - 7j. e; = —9i — j 


6j. e; = —3i — 3j 


6. V = — 2i — 10j, e; = —8i — 11j, e; = —7i + 9j 
7. V = —9i 7j, e; = 3i — 6j, e; = 5i + 3j 


8. V = 10i — je; = 8i 9i 4- 11j 
9, V = 3i — 7j, e; = —9i — 6j, e; = 5i — 8j 
10. V = 10i — 6j, e; = —4i + 10j, e; = 12i — 7j 


2j. € = 


In Exercises 11—20: 


(a) Show ex, k = 1, 2,3, are linearly independent. 


(b) Obtain 'V, the representation of V with respect to ex, 
c = 1, 2, 3, by solving for i, j, and k in terms of e;, e», 
and e; and then substituting in V. 

(c) Obtain 'V using the transition matrix A = [e;, e», es]. 

11. V = —12i — 9j — 8k, e; = 2i + 6j + 8k, e; = —3i — 9j — 2k, 
e; = 6i — 3j — 2k 

12. V =i + 12j — 8k, e = 
e; = —8i + 6j + 7k 

13. V = 6i — 5j + k, e; = —8i + 4j + 12k, e; = —5i + 4j — 2k, 
e; = —6i — 2j — 8k 

14. V = 2i — 12j +k, e; = 7i + 9j 
e; — 6i — 12j — 4k 

15. V = —6i + 10j — 4k, e; = —4i + 4j + 11k, e; = —4i + j + 4k, 
e; — 9i — 8j — 9k 

16. V = 10i + 5j — 5k, e; = 8i — 7j + 4k, e; = —9i + 5j — 6k, 
e; = —4i — 11j — 8k 

17. V = —8i — 4j — 2k, e; = —5i — 12j 
e; = 6i — 10j — k 

18. V = —7i + 11j+ 10k, e; = 5i + 12j + 11k, e; = 12i + 10j + 3k, 
e; = 12i — j — 7k 

19. V = —12i+ 12j+ 11k, e; = —4i+ 2j — 3k, e; = —12i +j + 11k, 
e; = —8j — 4k 

20. V = 12i + 6j + 4k, e; = 6i — 5j + 9k, e; = —5i — j — 3k, 
e; = 4i + 11j + 10k 


10k, 


9i+ 11j+ 10k, e; = 81+ 4j 4 


k, e; = —7i+2j 


8k, e; = 5i + j — 8k, 


If L is ann x n square matrix, then LV = Y defines a (linear) transfor- 
mation on vectors V. If the columns of A = [ei,..., e, | are a new set 
of basis vectors so that V and Y undergo a change of basis defined by 
A 'NV = V and A'Y = Y, then L(A'V) = A'Y and A! LA'V — 'Y. 
Hence, the matrix B = A^! LA, similar to A, represents the action of L 
in the new coordinate system. Thus, similar matrices represent the same 
transformation in different coordinate systems. In Exercises 21-30, using 
the given L, V, and A = [ei e2]: 


(a) Obtain Y = LV and'Y = A^! Y. 
(b) Obtain B = A^! LA and show B 'V — 'Y. 


21. L= le Hi and A, V from Exercise 1 

22. L = [7 |] and A, V from Exercise 2 
23. L = Ls "l and A, V from Exercise 3 
24. L = [5 Z] and A, V from Exercise 4 
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25. L —[ i j]and A, V from Exercise 5 
26.L =[~} "]and A, V from Exercise 6 
27. L = |i} ~$] and A, V from Exercise 7 
28. L = ['}] 2] and A, V from Exercise 8 
29. D= [I el and A, V from Exercise 9 
30. L — $ a and A, V from Exercise 10 


In Exercises 31—40, using the given A = [e;, e;, e3], V, and L: 


(a) Obtain Y = LV and'Y = A^!Y. 
(b) Obtain B = A^! LA and show B 'V — 'Y. 


8 12. —3 
31... £F, — |- —5 ; and A, V from Exercise 11 
1 -10 12 


[-2 =f 1i 
32. L= u ] and A, V from Exercise 12 
[u 2 0 
[-5 12 7 
33. L = | -9 3 -7] and A, V from Exercise 13 
=5 =i] 0 
[10 1 5 
34. L = 10 11 -10] and A, V from Exercise 14 
-10 12 -12 
| s 5 a8 
35. L = | -10 -8 -2| and A, V from Exercise 15 
$ H 1 
[-11 -12 1 


2 2 
36. L — 11 —12 | and A, V from Exercise 16 
12 0 


—3 | and A, V from Exercise 17 


11 12 6 
38. L = | 7 -—1 -| and A, V from Exercise 18 
8 2 


=] 4 -1 

39.L—| 4 0 | and A, V from Exercise 19 
= = =12 
-6 10 =2 

40. L =] 9 8 10] and A, V from Exercise 20 
- ij 8 


The dot product V - W can be written as the ordinary matrix multi- 
plication VW wherein a row “vector” multiplies a “column” vector, 
yielding a scalar. If the columns of A = [e;,..., e, | are a new set of 
basis vectors so that V and W undergo a change of basis defined by 
A'V = V and A'W = W, then V. W = VIW = (A 'V)(A "W) = 
"VT ATA ^W. Thus, in the new basis, the dot product is obtained by mul- 
tiplying the symmetric matrix AT A from the left by a row vector and 
from the right by a column vector. In Exercises 41—50, using the given 
V, A = [ei, e; ], and W: 


(a) Obtain V - W and the matrix C — ATA. 


(b) Obtain’W. (c) compute 'VT C "W, and compare to V - W. 


728 Chapter 32 Change of Coordinates 


41. W = 5i — 11j and A, V from Exercise 1 (b) Obtain "W = A'W. 

42. W = —11i + 2j and A, V from Exercise 2 (c) Compute "VT C "W, where 'V = A~'V, and compare to V - W. 
43. W = 2i + 11j and A, V from Exercise 3 51. W = — 12i + 5j + 8k, V and A from Exercise 11 
44. W = —1li + 12j and A, V from Exercise 4 52. W = 10i — 3j — 11k, V and A from Exercise 12 
45. W — 3i — 9j and A, V from Exercise 5 53. W = 9i + 12j + 3k, V and A from Exercise 13 
46. W — 8i 4- 4j and A, V from Exercise 6 54. W = —8i — 11j — 12k, V and A from Exercise 14 
47. W =i + 4j and A, V from Exercise 7 55. W = 6i + j — 9k, V and A from Exercise 15 

48. W — —i — 6j and A, V from Exercise 8 56. W — i — 4j + 3k, V and A from Exercise 16 

49. W — 7i — 11j and A, V from Exercise 9 57. W = 12i 4- 7j + 3k, V and A from Exercise 17 
50. W = 9i + 6j and A, V from Exercise 10 58. W — 9i — 8j — 3k, V and A from Exercise 18 

In Exercises 51—60, using the given V, A = [e], e2, e], and W: 59. W = 5i + 11j — 7k, V and A from Exercise 19 


m" z . , "nr 
(a) Obtain V - W and the matrix C = AT A. 60. W ep 24 — 9, Vara. A fom Exercise 20 


Rotations and Orthogonal Matrices 


Rotation as a Change of Basis 


: Consider a change of basis to {e;, eo}, 
1+ ; 
cos Ó — sin 
= 2 = 32.1 
M s ‘| in | cos 4 imd 


where e,is a unit vector rotated an angle 0 counterclockwise from the x-axis and e» is a unit 
vector rotated $ counterclockwise from e,;. Figure 32.2 shows e; and e» for 0 = =a From 
the figure, we see that e; = cos 0i + sin 0j. Then, reversing the components and inserting 

a minus sign gives e», a vector orthogonal and to the left of e1. 
The matrix A whose columns are the vectors e; and e» is the transition matrix for a 
x change of basis. Hence, 'V = A~'V, where V is a vector referred to the unrotated basis and 
'V is that same vector given in terms of the rotated basis. Thought of this way, the vector V 


0 ] 


FIGURE 32.2 Vectors e; and e» are the is an arrow that does not move. Just the sets of basis vectors used to express it are rotated 
vectors i and j rotated counterclockwise with respect to each other. 


through the angle 0 
Rotation as an Operation 


We continue to think of the basis (i, j} as fixed while we have 'V = ae; + be; and A = 
[ei, e2], where the rotated basis vectors ez, k = 1, 2, are given by (32.1). The arrow repre- 
sented by 'V = A~'V is fixed in the plane described by (i, j}. The vector Y = ai + bj has 
the same geometric relationship to the axes in the fixed plane as 'V has to the rotated axes. 
Since the two sets of axes are related by a rotation through an angle 6, the vectors “V and 
Y must also be related by a rotation through an angle 0. Thus, V — A 'V must be rotated 
through an angle 0 with respect to Y, so AY must be the rotation of Y through the angle 6. 
Indeed, if 


AY = pe — M H » f cos — b sin 3 (32.2) 


sin 0 cosé | |b a sin 0 + b cos 


FIGURE 32.3 AY as a rotation of Y 
through the angle 0 


0 


FIGURE 32.4 Reflection of X =i+j 
across U = (1+ /2)i +j 


EXAMPLE 32.3 
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then the angle between Y and AY is 0 because the cosine of that angle is given by 
Y. AY (a? + b?) cos 0 
= = = = cos 
YI AY (a? + b?) 


Hence, as shown in Figure 32.3, A rotates Y through the same angle as ej and e; have been 
"rotated." 


Properties of a Rotation Matrix 


The matrix A is called a rotation matrix since the vector AY is rotated by an angle 0 with 
respect to the vector Y. Such a matrix has the property that the columns are orthonormal 
(length 1 and mutually perpendicular); consequently, the rows are orthonormal, as we will 
verify. 

The orthonormality of the rows and columns of A imply that the transpose of A is its 
inverse, so that AT = A~!. Showing ATA = I for A given in (32.2) is left to Exercise Al, 
but not before observing that det A — 1. 


Reflections and Reflection Matrices 


The matrices 


BO cos 0 sin 0 d C=B 1 1 [1 1 32.3 
i j= a ed sa i (2-3 M p 
are examples of reflection matrices, matrices that have orthonormal rows and orthonormal 
columns, inverses that are the transpose, but determinant —1. Given a vector Y, the vector 
BY is the reflection of Y across a line that passes through the origin and has direction U. 
Figure 32.4 illustrates the reflection of X = i + j for the matrix C given in (32.3). 


Let 0 = Z(u, v), 0 < 0 < x, denote the angle between the vectors u and v. If Y = xi + yj 
and U = ai + bj, then the equation Z(Y, U) = Z(U, CY) where C is given by (32.3) 
should be an identity in x and y for appropriate values of a and b. Indeed, this equation is 


(5 + by ) (£ +b)x+(a- 2) 
arccos | ————- | = arccos 
WYO, V2|Y liU |) 


and the obvious manipulations give 


(a + b)x + (a — b)y 


ax + by = J (32.4) 
For (32.4) to be an identity in x and y, we must then have 
Q — 42)a — 2b 20 and 2a — (2- 2) 20 (32.5) 


for which a solution is a = 1 + /2, b = 1. With U = (1 + //2)i + j and YX = i + j, the 
angle 0 in Figure 32.4 is Ẹ, a calculation we leave for Exercise A3. e 


Rotations in Three Dimensions 


The matrices 


1 0 0 cosB 0 —sinf cosy -—siny 0 
R,=|0 cosa -—sina R, = 0 1 0 R, = | siny cosy 0 


0 sing COS € snp 0 cos f 0 0 1 
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represent counterclockwise rotations through angles o, 8, y about the x-, y-, and z-axes. 
respectively. 

A rotation of o = $ about the x-axis, followed by a rotation of B = 7 about the y-axis, 
followed by a rotation of y = 7 about the z-axis is represented by the product 


1 1 3 1 1 
z " x 16 —i-$v2. 1V3— $6 
R.( ) Ry ( ) Re ( E i42 i/43-i/6 -i-iÓiJ2|-2Ry (826) 
142 — iV6 1/2 
Not only is the order in which the individual rotation matrices are multiplied important. 


more importantly, the transpose of R,,, is the inverse, as a straightforward computation of 
Rs Rzyx = [ shows. 


Orthogonal Matrices 


A square matrix P with real entries is called an orthogonal matrix if its transpose is its 
inverse, that is, if PT = P-!, or equivalently, if PTP = PPT = J. 
The properties of a real orthogonal matrix P include the following. 


1. The columns (rows) of P are orthonormal and a matrix with orthonormal columns 
(rows) is orthogonal. 


2. Lengths and angles are preserved. Thus, || Pu|; = ||ul|; and Z(Pu, Pv) = Z(u, v). 


The determinant of P is +1. (When det P = 1, P isa rotation matrix, otherwise it is 
a reflection matrix.) 


4. The eigenvalues of P have magnitude 1. 


S. If P Æ Lis 3 x 3 and P is a rotation, then à = 1 is its one real eigenvalue and P 
represents a rotation about an axis whose direction is the eigenvector associated with 
this eigenvalue. 


Property 1 


If Q is a square matrix with orthonormal columns, then the following schematic, drawn 
for the 3 x 3 case where Q = [u, v, w], with (u, v, w} being orthonormal, shows why 


OO — EL 
<u> Tow Od u-u u-v u-w 1 0 0 
< y> u v w|=|vu v:v vew]=]|0 1 O 
—wWw— d o. of w-u Wy WW 0 0 1 


Showing Q QT = I, which is equivalent to showing the rows of Q are orthonormal 
is more difficult. To begin, you need to prove that Q^, the inverse of Q, exists. Once you 
know this inverse exists, you can show it is QT. If QT is Q^, then clearly QQT = J. The 
complete proof is given next. 

Take the determinant of both sides of QTQ = J to obtain det Q'Q = det J = 1. Since 
the determinant of a product is the product of the determinants, we have det QT det Q = 1 
Since the determinant of the transpose is the determinant of the matrix, we have det C 
det Q = 1, from which we get (det Q)? = 1, so det Q z 0 and Q^ exists. 

Once the existence of the inverse is established, the inverse can be used in the remainder 
of the proof. Again, take the self-evident statement QTQ = J and multiply by the inverse 
of Q, obtaining (QTQ = I) Q^. Clearing parentheses, we have QTQ Q^! = I Q^, which 
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reduces to QT = Q~!. We now know the transpose is the inverse, so we can write Q QT = 


QQ^! = I, which is what we wished to show. 
If W is a square matrix with orthonormal rows, then WWT = 7 is self-evident and 
det WWT = 1 establishes the existence of W^! = WT, from which we then get WTW = 7. 


Thus, a square matrix with orthonormal rows must have orthonormal columns and is an 
orthogonal matrix. 
Property 2 


Preservation of length by an orthogonal matrix P is established by the following calculation 
that uses the 2-norm. 


| Pull? = (Pu) - (Pu) = (Pu)" Pu = u" P” Pu = u" Iu = uu = u - u = |ul? (32.7) 
Preservation of angle by an orthogonal matrix P follows from (32.7), the calculation 
(Pu) - (Pv) = (Pu) Pv = u! P Py =u" lv =ulv=u-v 


and the observation that 


Z(Pu, Pv) = arccos (oS) = arccos ( ECT ) = Z(u, v) 
|| Pul] Pv || lull Lv I 


Property 3 

If P is orthogonal, then PTP = J, so det PTP = (det P)? = 1, as we obtained when prov- 
ing Property 1. Hence, we must have det P = +1. 

Property 4 


Let (A, v) be an eigenpair for the orthogonal matrix P so that Pv = Av. Then, using a 
calculation similar to that in (32.7), we have 


| Py] = ivi and. ||Pv|| = lvl = |All ivi 


from which ||v|| = |A|||v|| and |A| = 1 follow. 
Property 5 
If A is ann x n matrix with eigenvalues Àz, k = 1,...,, then its characteristic polynomial 


is the nth-degree polynomial 
n 
p(X) = det(A — AI) = (-1)" | [A — àx) (32.8) 
k=1 

and det A = p(0) = Ha A4. For a 3 x 3 rotation matrix P where det P = 1, we have 
À1À2À3 = 1, with one or three eigenvalues being real, since they are roots of a cubic equation 
with real coefficients. In light of Property 4, if the three eigenvalues are real, they are 1, 1, 1 
or 1, —1, —1. In the first case, P = J; in the second, we have established the existence of 
the single eigenvalue A = 1. 

If there is a single real eigenvalue, it must be +1 and the other two eigenvalues must be 
complex conjugates whose product, by Property 4, is 1. Finally, if two of the eigenvalues 
are complex conjugates, then the real eigenvalue must be | to satisfy 414543 = 1. We have 
therefore established that a 3 x 3 rotation matrix always has the eigenvalue 4 = 1 and, 
except for the two cases where P = / or the eigenvalues are 1, —1, —1, the other two 
eigenvalues are complex conjugates with magnitude 1. 
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EXAMPLE 32.4 


FIGURE 32.5 Example 32.4: The axis 
about which R.,, rotates vectors has 
direction v. A plane orthogonal to v 
contains vectors a and b that are both 
rotated the same amount 0' by Ry. 


The matrix Rzyx in (32.6) has the eigenvalues 1 and 0.04638 + 0.9989i. The eigenvector 


corresponding to the eigenvalue 1, spanning the null space of the matrix R,,, — 17, is 
54/3 — AJ/6 — 10 + 6/2 —2.652423558 
v= l = 1.0 
24/6 — 34/3 +4 — 4/2 —1.954027186 


The plane for which this eigenvector is the normal passes through the origin and has an 
equation of the form 


(54/3 — 4/6 — 10 + 64/2)x + y + (2V6 — 34/3 + 4 — 44/2); = 


If multiplied by R;,,, a vector in this plane will remain in this plane but will be rotated 
about the axis defined by the eigenvector that is normal to the plane. 
For example, two vectors in the plane of rotation are 


0 
4a 0 b= 1 
4 0 2 6 T 20 4 
52-3 V3 + Z6 mv m3 E 23 2 


and the angle between these two vectors is found to be 111.52?. The angle between the 
vectors a^ = R;,,a and b' = Rb is likewise found to be 111.52°. The actual angle of 
rotation about the axis of rotation can be determined by calculating 6’, the angle between 
a, a vector in the plane, and a’. This angle turns out to be 1.5244 radians, or about 87.342°. 
Thus, the combined rotation about the coordinate axes is equivalent to a single rotation 
through the angle 6’, about the axis defined by the eigenvector whose eigenvalue is 1. 

A sketch of the pair of vectors before and after rotation and the plane and its normal 
(the axis of rotation) is given in the Figure 32.5. The plane has been displaced slightly from 
the origin so that the vectors may be seen more clearly. Additional views and animations 
of the rotation are found in the accompanying Maple worksheet. $ 


Real Symmetric Matrices 


Continued experimentation with orthogonal matrices would be expedited if we had some 
way to generate them. One approach is to use a matrix whose columns are orthogonal vectors 
that can be normalized. The real symmetric matrix will turn out to have eigenvectors that 
either are, or can be made, orthogonal. 

Typically, the term “symmetric matrix” refers to a matrix whose entries are real; but 
on occasion, the word “real” is included for absolute clarity. Such real symmetric matrices 
have the following four very special properties. 


1. Symmetric matrices always have the maximal number of eigenvectors and, hence, are 
diagonalizable. 
2. The eigenvalues of a symmetric matrix are always real. 


3. In a symmetric matrix, the eigenvectors corresponding to distinct eigenvalues are 
orthogonal. 


4. Consequently, symmetric matrices are diagonalizable via an orthogonal transition 
matrix. 


EXAMPLE 32.5 
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The first property is a theorem that can be found in linear algebra texts such as [64] or [52]. 
After Example 32.5, we give proofs of the second and third properties. The fourth property 
is actually a consequence of the first three and an orthogonalization algorithm we will study 
in Section 33.3. (See Section 12.16 for details on diagonalizing a matrix.) 


Consider the following (real) symmetric matrix A with eigenvalues 2, 5, —1 and corre- 
sponding eigenvectors V1, V2, V3, where 


3 1 —2 1 =] 1 
A= l 0 1 vV = 1 vV = 0 Va = —2 
—2 1 3 1 1 1 


Since v, * Vo = V, * V3 = V2 * V3 = Q, the eigenvectors are mutually orthogonal. If, as in 
Section 12.16, the eigenvectors are made the columns of a matrix S, we see that S is the 
transition matrix for a similarity transformation of A to a diagonal form because 


MES MEE $ E ITO =) 1 2 0 0 
S-cia9selt 9 2 1 0 1|] 0 -2/=]0 5 O0 
1 1 1 == 1 S112 1 1 0 B -1 


However, S will not necessarily be an orthogonal transition matrix because its columns 
will not have been normalized, and therefore its transpose is not its inverse. If P is the 
matrix consisting of the normalized columns from S, then det P = 1, the rows of P each 
have length 1, and the rows of P are orthogonal. In fact, we can show that the transpose of 
P is its inverse by showing 


e code fae Ri 12d. fe 
V3 J2 v6 V3 v2 V6 
Tp _ |.L EP A. ex: 
Pel 0 "E m |=! 
A ES ES 1 1 1 
Ja v2 V6 4 v2 J6 


In addition, P is the transition matrix for a similarity transformation of A to diagonal 
form, with the entries on the diagonal being the eigenvalues of A. Thus, we find 


B. ed, ar i 31 AL 
V3 J2 v6 3 1 32 J3 J2 V6 p 0 

T 1 2 1 2 
PAP=| ug 0 =A 1 0 lly 0 -%gl=|/9 5 0 
1 1 1 —2 1 9 1 1 1 0 0 —1 

Ja JA Se V3 43 Jo 
4 


Consequently, for the (real) symmetric matrix A with distinct eigenvalues, there is an 
orthogonal transition matrix P taking A to diagonal form by a similarity transformation. 
The matrix A is said to be orthogonally similar to a diagonal matrix and is, therefore, said 
to be orthogonally diagonalizable. 

After we see the Gram-Schmidt orthogonalization algorithm in Section 33.3, we can 
consider the real symmetric matrix with repeated eigenvalues. In that case, the eigenspace 
associated with the repeated eigenvalue has a basis of eigenvectors that can be orthogonal- 
ized by the Gram-Schmidt process and then normalized. 
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In Section 34.2 we will consider the diagonalization of matrices that are not symmetric. 


Proof: Symmetric Matrices Have Real Eigenvalues 


Let A be a real symmetric matrix for which Ax — Ax, making x an eigenvector with 
eigenvalue A. Compute 


(Ax, x) = (Ax) x = x! ATx = x? AX = xl Ax = x Ax = Ax'& = À (x, x) =Al|x||? 


(Ax, x) = (Ax)!x = (Ax)TX = Ax! ® = A (x, x) = AlxI? 


then equate each result to obtain (A — A)||x||? = 0. But by definition of an eigenvector, 
x Æ 0, so à —A = 0, or à =A, making A real. 
Proof: Symmetric Matrices Have Orthogonal Eigenvectors 


Let A be a real symmetric matrix for which Ax — Ax, making x an eigenvector with eigen- 
value A, and for which Ay = uy, making y an eigenvector with eigenvalue u 4 A. Since 
A is real and we now know A and p are real, we also know x and y are real. Hence, we 
compute 

(AX)-y —-(AX)*y =Ax-+y and (Ax)-y= (Ax)ly = xl Ay =x yy = x+y 


Equate to obtain (A — u) (x - y) = 0. Since A Z u, we must have x - y = 0, making x and 
y orthogonal. 


EXERCISES 32.2—Part A 


A4. Show that if u is a unit vector, the matrix H = I — 2uuf is 
symmetric and orthogonal. 


A1. For the matrix rotation A given in (32.2), verify ATA = 1. 
A2. From (32.4), obtain the equations in (32.5). 


E 
ly" 


A3. Obtain the angle between the vectors U and X in Example 32.3. AS. Let y = —2i + 3j and u = Form H by the prescription in 
Exercise A4, and show that H is a reflection, reflecting vectors 


across a line that is orthogonal to u. 


EXERCISES 32.2-Part B 


B1. For the matrix R.,, given in (32.6), show that RT. Rey, = I. 
In Exercises B2-11: 


(a) Show that P is orthogonal by verifying PTP = PPT = I. 
(b) Verify that det P — 1. 
(c) Show that the columns of P are orthonormal vectors. 3 E | 1 
x= 
i = 


(d) Show that the rows of P are orthonormal vectors. Ee 
(e) Find the angle between x and Px. 

(f) Show ||x|| = || Px||. 

(g) Graph the vectors x and Px. 

(h) If v = ai + bj, show that ||v|| = || Pv ||. 


1] 6 1 _ |10 
so aS x= ly 


In Exercises B12-19, given the matrix P: 


(a) Show that P is orthogonal by verifying PTP = PP? = 1. 


(b) Verify that det P — 1. 


(c) Show that the columns of P are orthonormal vectors. 


(d) Show that the rows of P are orthonormal vectors. 
(e) Find the axis about which P rotates vectors. 


(f) Find the equation of the plane orthogonal to the axis of 
rotation. 


(g) Find v; and v2, two vectors in the plane found in part (f). 
(h) Find the angle between v, and v2. 

(i) Find the angle between Pv, and Pvp. 

(j) Find the length of v; and Pv;. 

(k) Find the length of v = ai + bj + ck and Pv. 


8 82 3 3 EM 1 
114 17670 V155 VIL 3/110 3/10 
1 85 5 1 25 5 
B12. 114 17670 155 B13. VIL 3/110 3/10 
1 6l 1l 1 l4 8. 
114 17670 V155 JIL 3/110 3/10 
re. 3 _ 6 5 8 _ 58 EE 
52 5/17 43 v89 V/1869 V21 
l 2 3 4 38 1 
B14. /2 V17 34 B15. J/89 1869 J21 
E: 17 0 3 16 4 
- 5/2 54/17 V89 /1869 J21 
r2 58 3 Ill 148 OW 3. 
/14 4886 V349 7 119 V17 
3 39 4 3 BS m 22. 
B16. V14 4886 V349 B17. 7 119 V17 
| l 18 6 S/T 2 
- 4*4 4886 V349 7 may1 v17 
rol 8 cde l ext). 9 
Fil 22 J/2 v11 V1166 V106 
B18. |-> 2 0 B19 = -A AX 
i 1 22 * V11 /1166 /106 
l 3 udis 3 6 4 
C yil J22 V2 Jn /1166 J/106 


In Exercises B20—29, orthogonally diagonalize the given symmetric ma- 
trix A, that is, find an orthogonal matrix P for which PTAP = D, where 
D is a diagonal matrix whose diagonal elements are the eigenvalues of A. 


Jj um 3 6 6 —4 
B20. É e B21. |: El B22. LÀ a 
2 -8 
d ij 
6 12 S -4 -4 3 
5 
B27. E ex B28. LA 4 B29. | 2 E 
In Exercises B30—39, orthogonally diagonalize the given symmetric ma- 
trix A, that is, find an orthogonal matrix P for which P'AP = D, where 
D is a diagonal matrix whose diagonal elements are the eigenvalues 


of A. If A has a repeated eigenvalue, the corresponding eigenvectors 
{x, y}, which initially need not be orthogonal, can be orthonormalized to 


[w;, W2} by taking w; = ixi and w2 = m. where yx is the component 
of y orthogonal to x. id 

-1 -8 -3 3 2 3 
B30.|-8 7 -1 B31.|2 6 6 

—-3 -1 2 3 6 —5 

4 1- -5 9 -4 

B32. 1 4 —1 B33. | —9 8 9 

=j -1 4 -4 9 5 
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8 6 2 0 2 4 
B34. |6 -8 -—6 B35. | 2 0 -4 
|2 -6 8 4 -4 6 
é g =2 1 = 0 
B36. 5 2 2 B37. | —6 1 0 
|-2 2 3 0 0 7 
8 -$ 1 5 -3 3 
B38. | -3 0 3 B39. | -3 4 2 
| 1 3 2 3 2 4 


The following recipe for constructing an orthogonal matrix that rotates 
objects counterclockwise about a specified axis and through a speci- 
fied angle is found in texts on computer graphics. Let the axis of rota- 
tion be specified by the vector v = ai + bj + ck, and let the angle of 
counterclockwise rotation about this axis be 0. If L = Va? + b? + c? 
and p = Vb? + c?, then the desired orthogonal matrix is R = [R, (o)]T 
[R,C8 )]T R. (0) Ry CB) R, (a), where R, (o) rotates the object (and the vec- 
tor v) through the angle œ counterclockwise about the x-axis until v lies 
in the xz-plane; R,(£) rotates the object (and the vector v) through the 
angle 6 counterclockwise about the y-axis until v lies along the z-axis; 
R.(@) rotates the object through the angle counterclockwise about the 
z-axis, the direction in which v, the axis of rotation is now pointing; and 


i p 0 0 | p 0 -—a 
Ry (a) = 0 e =) Ry (B) = L 0 L 0 
0 b e a 0 p 
cos@  —sin8 0 
R,(0)-— | sin cos 0 0 
0 0 1 
This step actually accomplishes the intended rotation. However, the ro- 
tation about the y-axis must be undone by [R,()]^! = [R,(8)]7 and 


the rotation about the x-axis must be undone by [R,(o)]7! = [R,(@)]". 
Since rotation matrices are orthogonal, the inverses are the transposes. 
For v and 0 given in each of Exercises B40—44: 


(a) Construct R, an orthogonal matrix corresponding to a 
counterclockwise rotation of 0 about the line along the 
vector v. 


(b) Verify that R has an eigenpair (1, V), where V is proportional 
to v. 

(c) Obtain the equation of the plane perpendicular to V (or v). 

(d) Find u, a vector in this plane; verify that it is orthogonal to v; 
and compute the angle between u and Ru. Hint: It should 


be 8. 
T 


4 


T 
B43. v = 4i — j + 3k, 0 = — 
v 1 — J+ 5k, 12 


Ik, 0 


B40. v=i+ 5) + 2k, = 7 B41. v = 3i — 2j 4 
B42. v = —21+ Tj 6k, 0 = 7 


B44. v = 5i + 9j — 8k, 0 = 


vja 


736 Chapter 32. Change of Coordinates 


FIGURE 32.6 Coordinate curves for 
polar coordinates 


EXAMPLE 32.6 


FIGURE 32.7 Coordinate curves for the 
nonorthogonal system x = 4 (u? — v?), 
y = 2uv 


Change of Coordinates 


Coordinate Curves 


When the Cartesian plane is “changed to polar coordinates,” a grid of circles and radial 
lines is superimposed on the rectangular grid of the xy-plane. These circles and radial lines 
are called coordinate curves. Points labeled (x, y) now acquire new labels, namely, (r, 0). 
but remain in the same location in the plane. (All the houses and streets in town remain in 
place, but the city declares new street names and house numbers.) 


POLAR COORDINATES—AN ORTHOGONAL COORDINATE SysTEM Polar coordinates are 
defined by the familiar equations x = r cos 0, y = r sin 0. Therefore, the radius-vector form 
for a curve in the xy-plane, namely, R = xi + yj, becomes R(r,0) = x(r, 0)i + y(r, 0)j. 
Curves for which 0 is held constant, that is, along which r varies, are radial lines. Curves 
for which r is held constant, that is, along which 0 varies, are concentric circles centered at 
the origin. (See Figure 32.6.) Since the radius is orthogonal to the circle, polar coordinates 
are an example of an orthogonal coordinate system. 
We next examine a coordinate system that is not orthogonal. 


We will show that the change of coordinates defined by the following equations is not or- 
thogonal. 

x= tu? —w) y=2wv (32.9) 
Grid lines on which v is constant and u varies are parabolas opening to the right, while 
grid lines on which u is constant and v varies are parabolas opening to the left, as shown in 
Figure 32.7. s 


Notation 


THE Inverse Map Ifthe xy-plane is taken as “fundamental,” then equations of the form 
x = x(u, v), y = y(u, v), which define a mapping from the uv-plane to the xy-plane, com- 
prise a vector-valued function of the form x = x(u). Here, the vector x is the vector of 
coordinates (x, y) and the vector u is the vector of coordinates (u, v). We will call this the 
function ^, where the designation “inverse” suggests the mapping is “to” the xy-plane 
"from" the uv-plane. 


Tur Forwarp Ma» Again taking the xy-plane as fundamental, equations of the form 
u = u(x, y), v = v(x, y), which define a "forward" map from the xy-plane to the uv-plane, 
comprise a vector-valued function of the form u = u(x). We will call this the function ®, and 
for polar coordinates the function ® would be defined by the equations r = yx? + y?, 0 = 
arctan ~. 

x 


Natural Basis of Tangent Vectors 


If the radius-vector form of a curve is differentiated with respect to the curve’s parameter, 
a vector tangent to the curve results. (See Section 17.1 for details.) At each point in the xy- 
plane for which they are nonzero, the vectors tangent to the intersecting coordinate curves 
form the natural basis of tangent vectors. These vectors are not necessarily unit vectors and 
are not normalized. 


eg 


FIGURE 32.8 Polar coordinates: natural 
basis of tangent vectors e, and eg at 


(x, y) = (3, 1) 


FIGURE 32.9 At (x, y) = (0, 2), natural 
tangent vectors for the coordinates defined 
in Example 32.6 
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PoLAr Coorpinates The backward map ^! for polar coordinates is defined by x = 
r cos0, y = r sinO. The radius-vector form for coordinate curves is then R = r cos 6i + 
r sin 0j, and derivatives with respect to r and 0 yield the tangent vectors 


e, =cos6i+sinéj and eg = —r sin ĝi +r cos6j (32.10) 
These vectors are orthogonal, but |/eg || = r, so eg is not a unit vector. Figure 32.8 shows e, 
and e; at (x, y) = (V3, 1), where r = 2 and 6 = s 


NONORTHOGONAL COORDINATES The radius-vector form for coordinate curves of the 
coordinate system given in (32.9) is R = 5 (u? — v?)i + 2uvj, and derivatives with respect 
to u and v yield the tangent vectors 


e, =ui+2vj and e, = —vi + 2uj 
Since |le, || = vu? + 4v? and ||e,]| = vv? + 4u?, these vectors are not unit. Moreover, 
e, - e, = 3uv shows that, in general, the vectors are not orthogonal which verifies the 


nonorthogonality claimed in Example 32.6. Figure 32.9 shows these natural tangent basis 
vectors at the point (x, y) = (0, 2) where u = v = 1. 


GENERAL Case In general, if the equations defining the change of coordinates in three 
dimensions are 

2 2 2 p) 3 2 

x = y(u uw) x? = x? (u! u?, u’) x = x?(ul,u?, u°) 

(where the convention is to use superscripts as indices on coordinates), then the Cartesian 
radius vector R = xi 4- yj + zk becomes 


9 2 2 9 2 s 9 
R(u!, uw’, u’) = x! (u!, u?, ui x^(ul, u^. uj 3a eu, u?)k 


(Of course, the three-dimensional case includes the two-dimensional case by restriction to 
a single plane.) 

The u!-, u?-, and i?-coordinate curves through (u!, u?, u?) = (a, B, y) are given, re- 
spectively, by R(u!, B, y), R(a, i?, y), and R(a, B, u?). Vectors tangent to these coordinate 
curves are obtained by differentiation, yielding 

ƏR ax’, Ar^. ax? 
oul Out d 
dR ax! 0x?, ax? 
Oo "a0 38 2.2J * 23 
Qu^ | Ou* du ous 


ƏR | 0x!, ax?, 0 
ei = 13 iJ ;k 


€i 


~ 3u? au3 Qu? Qu? 
or, as column vectors, e;, e», €3 would be, respectively, 

ax! ax! 9x! 

ðu! au2 au3 

ax? Ox” ax? 

du! Qu? au3 

ax? ax? ax? 
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These tangent (basis) vectors are just the columns of the Jacobian matrix 
dx! Ox! ax! 
ðu! ðu? du 
9x? 0x? ax? 
ðu! ðu? ðu’? 
əx? OQ ax? 
ðu! ðu? di? 
whose general element is A. = 0x" /8u*. The upper index is the row index, and the lower 
index is the column index. The columns of J4-: are the tangent vectors along the coordinate 
curves for a curvilinear coordinate system pulled over to the Cartesian plane. 
The Jacobian matrix for ®, the forward mapping whose vector form is u = u(x), is 


Jou = 


ðu! ðu! u! 


ax! 3x? Ox? 


« ? ‘ 5 £ 9 
Qu^ ðu  Ou* 
ax! Ox? ax3 
au> due ðu? 


ax! ax2  ax3 


Jo 


where the general element is du’ /0x*. 
The Jacobian matrices Jẹ and J4-: are inverse matrices, as we now demonstrate for 
® ® 
polar coordinates. The equations of the backward map ®~! are x = r cos 0, y = r sin 0; and 
: > ' "e E) 2 : y PENA 
the equations of the forward map ® arer = yx“ + y^, 0 = arctan s The matrices J-:, Jo. 
and Jom), where Jory) is Jo expressed in terms of polar coordinates, are respectively, 


X y 
i um = cosÓ sind 
cos@  —rsin6 J22 +y} V/x? + y? 
sin 0 r cos 0 y x 2 O gose 
x+y x24 y r r 


from which we can verify that Jẹ- Jom) = / = Jon Jo. 
More generally, differentiating the identities 


: 
x! 2 xl (ul, ut) = x! (u! (x, x”), u^ (xl, x?)) 


9 o 9 Y e "n 9% 
x? 2 x?(ul, u“) = x? (ul (x! , x”), u? (x, x?)) 


gives 
ax! ' ax! ðu l ax! Ju? u : ax! auk 
ax! — — Qulàx! ` Ou2 dx! — = duk 9x! 
4.1 4,14 nod 522 2 BE. 
Ox 0 Ox’ Ou " Ox’ Ou Y ox’ ðu 
0x? ðu! əx? Ow jox? — Qu* əx? 
ax? 20- ax? du , 3x? ðu? _ y 8x? aut 
ax! su Ax!  Ou20x! — = duk dx! 
ax? _ ax? ðu 0x? du? u Y ax? auk 
0x2  0u!lüx? Ou2 x2 — duk 9x? 
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Since Jẹ- = [9x//8u/] and Ja = [9u//8x^], the ik-element of the product Ja-:Ja 
would be 
u 1 
~ 10 


because when multiplying two matrices P,e and Q,., the product matrix M,e is defined 
element-by-element via the sums m,e = . Prikdkc. The summation varies over the 
column index of the first factor and over the row index of the second factor. This identity 
property of the Jacobian matrices for the mappings ® and ^! is normally expressed 
without the sums, with summation on a repeated index implied. Thus, texts on tensor 
analysis typically write this last result as (2x' /9u/)(0u/ /0x*) = 51, where the Kronecker 
delta is used to represent the identity matrix. 
Alternatively, if we start with the identities 


y ax! dul E 
aus axk — * 


j=l 


i=k 
i xk 


" 

ul! =ul(x!, x?) = u! (x! (u!, u”), x?(ul, u?)) 
? 2 3 

u’ = a (x!, x?) = u? (x! (ul, u^), x?^(ul, u?)) 


and again differentiate by the chain rule, we would obtain 


2 


ðu! sje ðu! ax! ðu! ax? Y ðu! ax* 
ðu! — Əx! ðu! — x2 Du — = ax* du! 
au! ES du! ax! | au! ax? _ du! ax* 
Q8) ^ Ox!à 2 3u? = ðxk ðu? 
au? 0 3u? dx! ðu? Ox? z : du? ax* 
dul xt ðu!  üx?0u! — £— Ax ðu! 
au? ài? dx! 3u? ax? _ s: ðu? ax* 
ðu? — Əx! ðu? 2 ðu? - ax* Ju? 


If we now multiply the Jacobian matrices in the opposite order, we obtain Jo Jo-! 
(du! /dx*][ax* /du/] and the ij-element of the product is 377. (Ou! /Ox*)(Ax*/du/) = à. 

Except for the tedium of writing the sums in the case of n variables, the general case 
would proceed exactly as for the case n — 2. 


General Tangent Vectors and the Contravariant Law 


If x = x(p), y = y(p) are the parametric equations of a curve in the xy-plane and R = 
x(p)i+ y(p)j is its radius-vector form, then 


£R=R(p) = x(pi+ ypj 

dp 
the derivative of R with respect to the curve's parameter, is a vector tangent to the curve. 
What is the equivalent expression for this tangent vector if coordinates in the xy-plane 
are changed via the mapping ^! defined by x = x(u, v), y = y(u, v)? Answering this 
question requires the functions u = u(p), v = v(p). For example, if a curve is given by 
x = p, y = p°, then, for polar coordinates, we solve the equations p = r cos 6, p =rsin@ 
forr =r(p) = py p? +1 and 0 = 0(p) = arctan p. 
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EXAMPLE 32.7 


The radius-vector form of the curve, namely, R = x(p)i+ y(p)j, becomes, under the 

change of coordinates x = x(u, v), y = y(u, v), 
R = x(u(p), v(p)i + y(uCp), v(p))j 

Computing R'(p) by the chain rule yields 

R'(p) = (xu! + xyv)i + (Yul + y,v)j = u (xui + yj) + 0’ vi + yp) (32.11) 
Recognizing that the terms in parentheses on the right in (32.11) are the natural basis vectors 
e, and e,, respectively, we have obtained 

R'(p) = u'e, + v'e, 


as the expression for a tangent vector in the new coordinate system. Notice that the compo- 
nents are just the derivatives of the coordinate functions, just as in the xy-plane. However, 
our use of the chain rule has brought about a change of basis vectors to the new (natural 
basis. 

Next, examine the derivatives u'(p) and v'(p) under the aegis of the chain rule. Begin 
with 


u-u(x(p)..y(p) v-vw(x(p)y(p) 


and obtain 


du dv 
‘ —u,x' ru,y and v = — = vx + vy 


Since u’ and v’ are components of a (column) vector, we are inspired to write 


u = — 
dp 


where the matrix on the right is the Jacobian matrix Jẹ. Thus, the transition matrix connected 
with the change of basis vectors from {i, j} to {e,, e,) can be applied to the components of 
the tangent vector. This is the contravariant transformation law for tangent vectors, 


" 
K du” q 


vU = =U 
ax 


In the original frame, the components of the contravariant vector are v* and are with 
respect to a set of basis vectors such as the i, j, k system of the Cartesian plane. In the 
new frame, the transformed components of the contravariant vector are v^ and are with 
respect to the set of new basis vectors (e,, ey}. By the Einstein summation convention, the 
repeated index k is a summation index. The symbol du" /dx* represents the elements of 
Jo, the Jacobian matrix for the forward transformation ®, where ® is given in the form 
u — u(x). Quantities with primed indices are in the new coordinate system, while quantities 
with unprimed indices are in the old coordinate system. 

The product of the Jacobian matrix Jẹ and the column vector of components v^ is 
ordinary matrix multiplication with the matrix on the left and the column vector on the right. 
The sum on the index k is a sum on the column index in the matrix, and that corresponds 
to the matrix product against a column vector from the left. 


In the xy-plane, the parabola x(p) = p, y(p) = p? has the tangent vector i + 2pj. The con- 
travariant transformation law for transforming to polar coordinates requires multiplication 
by the Jacobian matrix Jẹ, evaluated along the parabola. Consequently, the transformed 


vector is then 
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1 
W vp i 
1 


pP +1 


e = 


p 142p? 
J/p? 41 1 / p2 2 
PEF = pc 1 px LIRE ise "S ej (32.12) 
1 2p l af p?+1 p*4 
p(p? + 1) p -l 
To obtain corroboration of this result, solve (32.10) for 
i 4 DX 2: : 
= i+ - j and e; = —p^i- pj (32.13) 
Jp? «1 /p? 1 


along the parabola. Hence, 'V transforms back to i + 2pj, thereby verifying the transfor- 


mation law for this example. 


EXERCISES 32.3 


9$. 
hod 


1. Verify that (32.13) substituted into (32.12) restores the tangent 
vector i 4- 2pj. 
In Exercises 2-7: 

(a) Sketch the given curve. 

(b) Obtain the tangent vector V — R'(p). 

(c) Transform V to polar coordinates, obtaining 'V by applying the 
contravariant law as per (32.12). 

(d) Obtain 'V by expressing i and j in terms of e, and ey, and 
substituting in V. 


(e) Change 'V back to V by replacing e, and e, with their 
equivalents in terms of i and j. 


[2] 


. X(p) = pcos p, y(p) = psinp,O < p < 4x 


3. x(p) = J/1 + p?, y(p = V1 — p, -l <p <1 

at (p) cR 
(p) = pe’, 

l+p WM pe 


5.x(p-—pl-3p-ly(p-p-p-clLl-Irzpxl 


4. x(p) — 


lapal 


6. x(p) = 3cos2p, y(p) = 4sin p,0 < p < 27 


1- p? 1- p° 
7.x(p)= za 
| t p 


in Exercises 8-15, for the coordinate system defined by the given inverse 
nap $^: 
(a) Obtain a labeled plot of the coordinate curves. 
(b) Obtain {e,, e,), the natural basis of tangent vectors. 
(c) Obtain J44-:, the Jacobian matrix of the inverse map. 
(d) Obtain Jo; = [Jo-]7', the Jacobian matrix for ®, the 
forward map. 


8. x = t (u? — v’), y = uv, the parabolic coordinate system 


u 
9.x — 


=, the tangent coordinate system 


v 
2 2* y = 2 
u^ v u* +v 


10. x = cosh u cos v, y = sinh u sin v, the elliptic coordinate system 


11. x = Vu? + v? +u, y = V Nu? + v? — u, the hyperbolic 
coordinate system 


sinh v sinu 
12. x — M E 
cosh v — cosu 
system 


, the bipolar coordinate 
cosh v — cosu 


13. x = 3u + 2v, y = 5u — 7v, an undistinguished skew coordinate 
system 


14. x = 2u? — 5v, y = 3u + 4v? 
15. x = 5u? + 3v’, y = 4u? — 9? 


For the curves given in Exercises 16-21: 


(a) Obtain the tangent vector V — R'(p). 
(b) Transform V to the coordinate system x — Ly u? =v"); 
y = 2uv, wherein 6, the forward map, is given by u = ž, 
v= 2, d= VN 4x? + y? — 4x, obtaining 'V by applying the 
contravariant law as per (32.12). 
(c) Obtain 'V by expressing i and j in terms of e, and e, and 
substituting in V. 
(d) Change 'V back to V by replacing e, and e, with their 
equivalents in terms of i and j. 
16. the curve of Exercise 2 B17. the curve of Exercise 3 
18. the curve of Exercise 4 B19. the curve of Exercise 5 


20. the curve of Exercise 6 B21. the curve of Exercise 7 


In Exercises 22-27: 


(a) Obtain the tangent vector V — R'(p). 
(b) Transform V to the parabolic coordinate system wherein ®, the 
forward map, is given by u = *, 


yx? + y? — x, obtaining ‘V by applying the 
contravariant law as per (32.12). 


vV =s, S = 
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(c) Obtain 'V by expressing i and j in terms of e, and e, and 
substituting in V. 

(d) Change 'V back to V by replacing e, and e, with their 
equivalents in terms of i and j. 


22. the curve of Exercise 2 B23. the curve of Exercise 3 


24. the curve of Exercise 4 B25. the curve of Exercise 5 


26. the curve of Exercise 6 B27. the curve of Exercise 7 


In Exercises 28—33: 


(a) Obtain the tangent vector V — R'(p). 
(b) Transform V to the tangent coordinate system wherein ®, the 


forward map, is given by u = a>. V = 71. obtaining "V 


by applying the contravariant law as per (32.12). 
(c) Obtain 'V by expressing i and j in terms of e, and e, and 
substituting in V. 
(d) Change 'V back to V by replacing e, and e, with their 
equivalents in terms of i and j. 
28. the curve of Exercise 2. B29. the curve of Exercise 3 
30. the curve of Exercise 4 B31. the curve of Exercise 5 


32. the curve of Exercise 6 B33. the curve of Exercise 7 


In Exercises 34—39: 


(a) Obtain the tangent vector V — R'(p). 


(b) Transform V to the hyperbolic coordinate system wherein o, 
the forward map, is given by u — io? — y2), v = xy, 
obtaining 'V by applying the contravariant law as per (32.12). 

(c) Obtain 'V by expressing i and j in terms of e, and e, and 
substituting in V. 

(d) Change 'V back to V by replacing e, and e, with their 
equivalents in terms of i and j. 

34. the curve of Exercise 2 B35. the curve of Exercise 3 
36. the curve of Exercise 4 B37. the curve of Exercise 5 


38. the curve of Exercise 6 B39. the curve of Exercise 7 


In Exercises 40—45: 


(a) Obtain the tangent vector V — R'(p). 


(b) Transform V to the coordinate system x = 3u + 2v, 
y — 5u — Tv where 6, the forward map, is simple enough to 


find, obtaining 'V by applying the contravariant law as per 
(32.12). 
(c) Obtain 'V by expressing i and j in terms of e, and e, and 
substituting in V. 
(d) Change 'V back to V by replacing e, and e, with their 
equivalents in terms of i and j. 
40. the curve of Exercise 2 B41. the curve of Exercise 3 
42. the curve of Exercise 4 B43. the curve of Exercise 5 
44. the curve of Exercise 6 B45. the curve of Exercise 7 
46. Define spherical coordinates by x = pcos@ sin $, 
y = p sinô sing, z = p cos $, where $ is the angle between the 
radius vector and the z-axis. 
(a) Obtain the forward map ® whose equations would be 
pp(x.y,2.,0ó(x,y,2,08 =O, yz). 
(b) Sketch the three coordinate surfaces p = 1, $ = £,0 = €. 
(c) Obtain a plot of the three coordinate curves through point P 
whose coordinates are (x, y, x) — G, ; 2 
(d) Obtain {e,, eg, e), the natural basis of vectors tangent to 
coordinate curves. 
(e) Evaluate {e,, e;, €o} at point P, and add their graphs to the 
sketch drawn in part (c). 
In Exercises 47—50: 
(a) Sketch the given curve. 
(b) Obtain the tangent vector V — R'(p). 
(c) Transform V to spherical coordinates, obtaining 'V by applying 
the contravariant law as per (32.12). 


(d) Obtain 'V by expressing i, j, and k in terms of e,, eg, and ez 
and substituting in V. 


(e) Change 'V back to V by replacing [e,, ey, eg} with their 
equivalents in terms of i, j. and k. 
47. x(p) = p,y(p-phz-2p.,-2spz2 
48. x(p) = cos p, y(p) = sin p, z(p) = p,0 < p < 4r 
49. x(p) = pcos p, y(p) = psin p,z(p) = p,0 < p < 4r 
50. x(p) = cos 2p, y(p) = sin p, z(p) = p, 0 < p < 27 


Reciprocal Bases and Gradient Vectors 


Reciprocal Vectors 


A set of vectors (el, ..., e") is reciprocal to the set of tangent basis vectors {e}, ..., e, ) id 
the dot products between the vectors obey e' - e; = à'. 


EXAMPLE 32.8 


FIGURE 32.10 
ind the reciprocal vectors {e!, e°} in 
=xample 32.8 


Tangent vectors (ej, e;) 


EXAMPLE 32.9 


EXAMPLE 32.10 


EXAMPLE 32.11 
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Let 
e; —i—2j and e = 2i+3j 

be a set of tangent basis vectors in the plane. The vectors 

e'—aj--aj and e?- bj bj 
will be reciprocal if the equations 
e! -e) = 2a, +3a = 0 
e.e = 2b, 43b; = 1 
are satisfied. The unique solution is 

e! = 1(3i—2j) and e? = +(2i+j) 


shown in Figure 32.10. The tangent vectors e; and e» are not perpendicular to each other, 
and neither are the reciprocal vectors e! and e?. However, e; is perpendicular to e? and e; 
is perpendicular to e!. $ 


To test if two sets of vectors are mutually reciprocal, take all possible dot products between 
members of the two sets. For example, given the vectors (vi, V2, V3} and the set of vectors 
(vl, v?, v?], testing for reciprocity requires forming the nine dot products v - Wu: = 
1,2,3, j = 1, 2, 3. This can be done by forming matrices M; = [vi, v», v3] and M» = 


[v', v?, v?] and computing 
—vy-—||lt t 1 vlev view. vlev 
MIM; = | — x — || v vl =]Wey evn v-v (32.14) 
«— y? = 4 d 4 Vev v.v Vev 
If the product is the identity matrix, then the sets of vectors are mutually reciprocal.  %& 


The following sets of vectors, namely, (v;, V2, v3} and (v! , v?, v?), are mutually reciprocal. 
The v; are unit vectors but are not orthogonal. The v^ are neither unit nor orthogonal. 
Indeed, the norms of the v* are 1.27, 1.31, 1.12, respectively. The relative orientations of 
these vectors can be seen in Figure 32.11 on page 744. 


1 5 EE __ 13726 54/66 254/30 
J/26 v66 J30 162 81 162 
15 TEN. l . 35426 V66 . 5430 D 
J26 66 v30 12 |^| 81 |’ 162 
5 2 
> = 54/26 4/66 74/30 
p v66 30 754. 27 "B 


Orthonormal vectors are se/f-reciprocal. For example, if the tangent vectors S = (vi, V2, v3] 
are orthonormal, that is, are each of length 1 and mutually perpendicular, then they are their 
own reciprocal vectors. Indeed, taking M» = Mi in (32.14) yields, by the orthonormality 
of S, M] M; = I. 

Readers who have worked only in Cartesian, polar, spherical, and cylindrical coordi- 
nates will not have experienced reciprocal bases as distinct from a basis of tangent vectors. 
Each of these orthogonal coordinate systems has an orthonormal basis for which the recipro- 
cal vectors are always the same as the tangent basis vectors. It is only when the tangent basis 


is not orthonormal that a difference between the basis and its reciprocal basis is observed. 
$ 
* 
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EXAMPLE 32.12 


FIGURE 32.11 Reciprocal vectors {v*} 


and {v,}, k = 1, 2, 3, in Example 32.10 


Chapter 32 Change of Coordinates 


Impose polar coordinates on the xy-plane, and use the natural tangent basis vectors 
e, = cos ĝi + sinj and eg = —r sin ĝi + r cos 6j 


instead of the more familiar unit basis vectors. By brute force, the reciprocal vectors are 
found to be 


r 


l ] 
e' = cos ĝi + sinj =e, and e" = —(—sin 0i + cos 0j) = seg 
: 72 


7 
Notice that the reciprocal vectors are not unit vectors, but they are mutually orthogonal, 
just like the vectors {e,, eg}. Notice further that the reciprocal vectors are the rows of the 
Jacobian matrix J@,,,). Indeed, since Ja, and Ja-: are inverse matrices, we have 


' -i ; ji 
= cosÜ  —rsinO cosÓ  sin8 ^ 
[Jo] =]. = sinO cos | = Joy) KS 
sin 0 r cos 0 -— 
r r 


Why Reciprocal Vectors? 


Example 32.12 suggests the first of two reasons why reciprocal vectors are of importance. 
Because Jo)Jo- = I, the rows of Jo) are always the vectors reciprocal to the columns 
of Jo-1, that is, to the natural basis of tangent vectors. The basis of vectors tangent to the 
coordinate curves arise naturally by differentiating the radius vector with respect to the 
new coordinates. The formalism of the Jacobian matrix means these tangent vectors are the 
columns of Jo-'. 

The rows of J) are reciprocal to the natural tangent basis, but what meaning do these 
row vectors have in their own right? We again illustrate with polar coordinates. 


= d ax! ax! 
au! ] | ax* ax! 0x? au! au? 1 0 
JoJo dm axk Ej. = 9 5 2 9 = 0 1 

x du: (26 ae | ax? ax? 

əx! ax? Qul Qu? 


or or ax ax 

E x or 36 10 
00 ə dy ay -| | 
Es à ðr a0 


The rows of Ja. the Jacobian matrix for u = u(x), the forward mapping ®, are gradient 
vectors! 


Gradient Vectors 


For polar coordinates, the rows of the Jacobian matrix corresponding to the forward mapping 
o, the mapping whose equations are u = u(x), are the gradient vectors 


or or y 
e = —i+ —j=Vr(tx,y) = i+ = j=coséi+sin0j —(32.15a) 
Ox ð /x? + y? 4 / x? + y? 
a 30. y . x sind, cosd, , 
= —i + —j = V0 (x, y) = — i4 = i4 32.15b 
ax ay” -— x2-y  x?- y? r j ( ) 
computed from the functions r = „yx? + y?, 0 = arctan A. Since gradient vectors are 
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orthogonal to their level sets, the gradient vectors (32.15a) and (32.15b) are orthogonal to 
the level curves r — constant and 0 — constant. 


Conclusions 


The backward map ^^ 


k 


' a vector-valued function of the form x = x(u), gives rise to the 
u*-coordinate curves determined in the space of x by varying u^ while holding the other 


u’s fixed. The vectors ez, tangent vectors along these coordinate curves, are the columns of 


the Jacobian matrix 


The forward map 6, a vector-valued function of the form u = u(x), gives rise to level 
things determined in the space of x by implicit functions of the form u^ (x) = constant. The 
vectors e", gradients of these functions, are vectors normal to the level sets; these gradients 
are the rows of the Jacobian matrix 

Together, the tangent vectors and gradient vectors constitute sets of reciprocal vectors. 


EXERCISES 32.4—Part A 


Al. 


A2. 


If e, = 3i + 2j and e; = 5i — 7j, obtain {e}, e?}, the vectors 
reciprocal to [e;, e;]. 


Given the linearly independent vectors [e;, e;, e3} in R?, show that 


i exe 2 ei X € " e; x e 
e= e e = —— 
e 


, 


1°@ Xe; ej + @ xe e;:€ Xe 


are reciprocal. Hint: Verify e' - e; = 5. 


. For the vectors in Exercise A2, show that the numbers e! - e? x e? 


and e; - e; x es are reciprocals. Hint: Use Exercise B8, Section 


31.3 to obtain 
(023.34 (eéxe)x(exe)-(exe)  (e-exe)» 
e-exe= 5 = a 
(e; -e X e) (e; -e; x ey 


. Derive the recipe in Exercise A2. Hint: The equations e! - e; = ôi 


say that e! is perpendicular to e; and e3, so write e! = we x e3. 


EXERCISES 32.4—Part B 


Determine o by the condition e, - e! = 1. Similar calculations 
yield e? and e^. 

AS. Fill in the details of the following proof that a set of reciprocal 
vectors is unique. Let § = {e), e;, e3} be linearly independent in 
R?, and assume both {e*} and (v^), k = 1, 2, 3, are sets of vectors 
reciprocal to S. The conditions e! - e; = à would hold, as would 
e,-v— Lk = 1,2,3, ande; - v = 0, i Æ j. For all values of i 
and j, write out the equations e; - (ef — v/) = 0 which are obtained 
by subtraction. Show that if one vector e/ — v/ were nonzero, it 
would be orthogonal to three linearly independent vectors, which is 
impossible. Hence, e/ — v/ — 0 and a reciprocal set of vectors is 
unique. 


B1. Obtain N, a vector normal to the plane through the points 


pi = (1, 2, 3), p; = (5,3, —4), p3 = (2, 7, 6). Then, let P, be 
the vector from the origin to the point pz, k = 1, 2, 3. Find {e*}, 
the vectors reciprocal to (P4). Show that e! + e? + e? is along N. 


In Exercises B2-11: 


B2. 
B3. 
B4. 
B6. 
B8. 


(a) Find the vectors {e!, e?) reciprocal to the given (ei, eo}. 

(b) Sketch the given vectors and the reciprocal set. 

e; = —6i+ 8j, e; = 10i +j 

e; = —11i + j, e = —2i + 6j 

e, = 9i — 3j, e2 = —7i +j B5. e = —5i — 2j, e = 12i — 2j 
e = 4i — j, e = —5i + 12j B7. e = lli — 6j, e; = 12i + 4j 
e; = 81+ 7j, e —3i--4j B9. e; = 8i + 12j, e; = —3i — 2j 


B10. e, = —9i + 11j, e = 8i+11j B11. e, = 7i — 9j, e = 3i — 7j 
In Exercises B12-21: 
(a) Use “brute force” to find the vectors {e!, e?, e?) reciprocal to 
the given (e;, e2, e3}. 


(b) Use the recipe in Exercise A2 to find the vectors reciprocal to 
the given (ei, €2, es}. 


(c) Show that the numbers e! - e? x e? and e + e; x e; are 
reciprocals. 


(d) Sketch the given vectors and the reciprocal set. 
B12.e; = —8i — 2j + 8k, e; = 11i +j — 11k, e; = —12i + 12j + 11k 
B13. e; = —12i - 7j — 11k, e; = 12i + 10j + k, e, = 3i + 7j — k 
B14. e; = —i — 3j + 4k, e; = —6i + 8j + 11k, es = 12i + 6j + 7k 


B23 


. ei 
. e; = 8i — 5j + 3k, e = —5i + j — 3k, e 


.@€ = 
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12j 
8i + 10j 


6k, e; = 8i — 2j — 7k, e = 4i — j + 4k 
7k, e; = i + 8j — 3k, e; = 12i — 2j — 8k 

6i + 12j —3k, e; = —10i+ 3j — 2k, e; = —11i + 9j — 2k 
12i + 6j — 5k, e; = —i + 5j + 3k, e = 1i + 12j — k 
4i — 5j + 3k, e; = 5i + 3j + 7k, e = —9i — 6j — 5k 
-fpj — 12k 
8k, e; = —6i + 12j + 5k, e; = 10i — 3j + 6k 


2i 4- 9j 


. For the map $^! defined by x = UR —v*), y = 2uv, with ® 


B24. 


2 v=ł d= 


given by u = ž 2 /Ax? + y? — 4x, the natural 
basis of tangent vectors {e,, e,) was obtained in Section 32.3. 


(a) Obtain the Jacobian matrices Jo-: and Ja. 

(b) Show that the columns of J4-: are the vectors e, and e,. 

(c) Obtain a labeled plot of the level curves of u(x, y) and v(x, y). 

(d) Obtain the gradient vectors orthogonal to the level curves of 
u(x, y) and v(x, y), expressing them in terms of the variables 
u and v. 

(e) Show that the rows of Jeu) are the gradient vectors found in 
part (c). 

(f) Show that the tangent vectors {e,, e,) and the gradient vectors 
in parts (c) and (d) are reciprocal vectors. 

(g) Sketch the tangent and gradient vectors at the point where 
iw 

In Exercise B8, Section 32.3, the natural basis of tangent vectors 

(e,, e,) and the Jacobian matrices J-: and Jøa) were obtained 

for the parabolic coordinate system. The forward map ® is given 


ER MR 
byu=<,v=s5,5= 
(a) Show that the columns of Jg-: are the vectors e, and e,. 


(b) Obtain a labeled plot of the level curves of u(x, y) and 
v(x, y). 

(c) Obtain the gradient vectors orthogonal to the level curves of 
u(x, y) and v(x, y), expressing them in terms of the variables 
u and v. 


(d) Show that the rows of Jo,,) are the gradient vectors found in 
part (c). 


(e) Show that the tangent vectors (e, , e, ), and the gradient 
vectors in parts (c) or (d) are reciprocal vectors. 

(f) Sketch the tangent and gradient vectors at the point where 
w= nsl 

In Exercise B9, Section 32.3, the natural basis of tangent vectors 

(e,, e,) and the Jacobian matrices Jg-1 and Jøa) were obtained 

for the tangent coordinate system. The forward map 6 is given by 

u = v= LÀ. 


X 
s a A 
xe+y* Kpy” 


(a) Show that the columns of J4-: are the vectors e, and e,. 


(b) Obtain a labeled plot of the level curves of u(x, y) and 
UC, y). 
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B26. 


B27. 


(c) Obtain the gradient vectors orthogonal to the level curves of 
u(x, y) and v(x, y), expressing them in terms of the variables 
u and v. 

(d) Show that the rows of Jẹ) are the gradient vectors found in 
part (c). 

(e) Show that the tangent vectors {e,,, e,) and the gradient vectors 
in parts (c) and (d) are reciprocal vectors. 

(f) Sketch the tangent and gradient vectors at the point where 
ucl. 

In Exercise B11, Section 32.3, the natural basis of tangent vectors 

{e,, e) and the Jacobian matrices Ja-: and Jou) were obtained 

for the hyperbolic coordinate system. The forward map 6 is given 

byu= 5 (x? = y*), v= xy. 

(a) Show that the columns of J'4-: are the vectors e, and e,. 


(b) Obtain a labeled plot of the level curves of u(x, y) and 
v(x, y). 

(c) Obtain the gradient vectors orthogonal to the level curves of 
u(x, y) and v(x, y), expressing them in terms of the variables 
u and v. 


(d) Show that the rows of J) are the gradient vectors found in 
part (c). 


(e) Show that the tangent vectors {e,, e,) and the gradient vectors 
in parts (c) and (d) are reciprocal vectors. 


(f) Sketch the tangent and gradient vectors at the point where 
u-—vz-l. 

In Exercise B13, Section 32.3, the natural basis of tangent vectors 

(e,. e,) and the Jacobian matrices J4-: and Jo.) were obtained 

for a skew coordinate system. 


(a) Show that the columns of J4-: are the vectors e, and e,. 


(b) Obtain a labeled plot of the level curves of u(x, y) and 
v(x, y). 

(c) Obtain the gradient vectors orthogonal to the level curves of 
u(x, y) and v(x, y), expressing them in terms of the variables 
u and v. 

(d) Show that the rows of J ,) are the gradient vectors found in 
part (c). 


(e) Show that the tangent vectors (e, , e, ) and the gradient vectors 
in parts (c) and (d) are reciprocal vectors. 

(f) Sketch the tangent and gradient vectors at the point where 
B= v— l: 

In Exercise B10, Section 32.3, the Jacobian matrices Ja-: and 

Jo for the elliptic coordinate system were obtained. The tangent 

vectors {e,, e,) are the columns of J4-:, and the gradient vectors 

(e", e") are the rows of Ja. 


(a) Show that the tangent and gradient vectors are reciprocal sets 
of vectors. 


(b) Sketch the tangent and gradient vectors at the point where 
u-—vz-l. 


B28. 


B29. 
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In Exercise B12, Section 32.3, the Jacobian matrices J4-: and 
Joay for the bipolar coordinate system were obtained. The 
tangent vectors {e,, €} are the columns of J4-:, and the gradient 
vectors (e", e") are the rows of Jou). 


(a) Show that the tangent and gradient vectors are reciprocal sets 
of vectors. 


(b) Sketch the tangent and gradient vectors at the point where 
u=v=l. 

In Exercise B14, Section 32.3, the Jacobian matrices Jẹ-ı and 

Ju) for the coordinate system x = 2u? — 5v, y = 3u + 4v? were 

obtained. The tangent vectors (e,, e,) are the columns of J4-:, 


B30. 


(a) Show that the tangent and gradient vectors are reciprocal sets 
of vectors. 

(b) Sketch the tangent and gradient vectors at the point where 
uu -l. 

In Exercise B15, Section 32.3, the Jacobian matrices Jg-1 and 

Jow) for the coordinate system x = Su? + 37, y = 4u? — 9? 

were obtained. The tangent vectors {e,, e,) are the columns of 

Ja-:, and the gradient vectors (e", e") are the rows of Ja. 


(a) Show that the tangent and gradient vectors are reciprocal sets 
of vectors. 


(b) Sketch the tangent and gradient vectors at the point where 


and the gradient vectors (e", e") are the rows of Jou). T) exis 


Gradient Vectors and the Covariant Transformation Law 


The General Normal Vector 


In Section 32.3, the contravariant transformation law for a vector tangent to a curve was 
obtained. In this section we will explore the covariant transformation law for a gradient 
vector. Remember, in Section 32.4 we discovered that the rows of the Jacobian matrix J are 
vectors reciprocal to the natural basis of vectors tangent to the coordinate curves. Moreover, 
these row vectors are the gradients of the coordinate functions u^(x) and, therefore, are 
orthogonal to the coordinate surfaces u = constant. (Chapter 18 details the orthogonality 
of the gradient vector with respect to level curves and surfaces.) 

We denote the basis of gradient vectors, orthogonal to the coordinate surfaces, with 
superscripts, as in (el, e?, e°}, for example. Again, these are just the basis vectors reciprocal 
to the natural basis of tangent vectors, (e, e», es]. 

If the function f e y, z) = O implicitly defines a surface z = z(x, y), then the gradient 


vector V f — E TRE Kk is perpendicular to this surface. We wish to determine how 


this gradient vector transforms under a change of coordinates. 


The Coordinate Change 


Change coordinates via the backward map ®~! defined by the vector-valued function x = 
x(u). Specifically, let the coordinate change be given by 


x = x(ul, u°, u°) y = y(u!, u’, u’) z = z(u!, u°, u°) 


The corresponding forward map 6 is defined by the vector-valued function u = u(x), whose 
equations would then be 


u! =u! (x, y, Z) u =u (x, y, 2) u =u (x, y, z) 


Change of Coordinates in f (x, y, z) 
Apply the mapping $^! to the function f (x, y, z), obtaining 
f (x (ul, w, w), y(u ac^, uy, ce, u^, uy) = fut, u?, uw?) (32.16) 


The notation signals that the transformed function is a different combination of the new vari- 
ables. For example, if the function were f(x, y, z) =x + y? + L, and the new coordinates 
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were spherical, then the transformed function would be 
1 

p cos $ 
In the function f(x, y, z), the first variable is x, and that appears in f as itself. In the trans- 
formed function, the first variable is p, but it certainly does not appear just as itself. It appears 
multiplied by various trig functions, squared, and in the denominator of a fraction. Hence, the 
notation f(x, y, z) instructs the user to perform certain operations on the variables x, y. z 
whereas the symbol flo, $, 0) instructs the user to perform very different operations on 
the three variables p, $, 0. 

If we start with the transformed function, and restore the original variables via the map 
®, we get 


fto. $,0) = pcos sing + p? sin? 0 sin? $ + 


fu (x, y, z), ui (x, y, Z), u° (x, y, Z)) = f(x, y, z) (32.17 


The Transformed Gradient Vector 


Under the change of coordinates, the gradient vector V f = fi + a + LK becomes 
af, OF 5, OF 5 
—e + ——-e E 32.18 
ðu! ðu? * aus ( 


where e! , e?, e? are the gradient vectors orthogonal to the coordinate surfaces defined by 
o = constant. In fact, these gradient vectors are reciprocal to the vectors tangent to the 
coordinate curves defined by ®~!. We prove these claims using (32.17) and the chain rule 
for differentiation, thereby obtaining 

OPPROPTE 1 


Vf=—i+ — —k 
f ax = a OZ 


_ E: au! " afau2 af x) E! ðu! af aw? " af zar 


du! Ox | Ou? Ox * ðu? ax du! dy du? dy 3w? Oy 


du! az ` 3u? az T Qu? Oz 


E: ow af au? | of 4 
af jul aut jul i " af 
= 1 

du! \ ax ay 4 az 2 


Pi af i). " ðu? " LAM 
: i 
Qu? X Ox dy J Oz 


af a afa afa 
= e -e e 
ðu! ðu? Qu? 


The Covariant Transformation Law 


The result in (32.18) is the structure of the gradient vector under a change of coordinates. 
However, it is expressed in terms of derivatives of the transformed function. In general, we 
don't have the transformed function. What we have are the derivatives of f(x, y, z) since 
what we really begin with are the coefficients of the gradient vector computed in Cartesian 
coordinates. Thus, we seek the law that details how to convert these derivatives in Cartesian 
coordinates to their appropriate counterparts in the new coordinate system. 


32.5 Gradient Vectors and the Covariant Transformation Law 749 


This time, start with (32.16) and compute the components of the transformed gradient 
vector, as required in (32.18). It is tempting, but not useful, to write 


af af ax | af ay | af az əx dy ac7af 
ðu! ax ðu! ` dy au! Əz du! ðu! ðu! ðu! ax 
af _ | af ax of dy af Oz ax ay dz af 
juz | | Ox du2 dy du2 Əz du? ðu? ðu? du? dy 
af af ox | Of dy | Of Oz Ox dy Oz of 
aut dx ðu?  OyOw Az ðu? ðu? ðu? Ju? az 


since the matrix on the right is not a Jacobian matrix. It is the transpose of the Jacobian 
matrix 


x X " 
J Ox! D] 0 0 
a = | — |=| — [y|], yl. — 
s dus ðu! | 3u? |- du? | 
so, instead we write 
Ox Ox Ox 
ðu! ðu? ðu? 
af af afl Taf af afll ay ay ay 
[ur 3f ad = E cd z] IO E (32.19) 
ol J Bu ax Oy Oz ðu! ðu? 3u? 


Oz z dz 
ðu! ðu? 3u? 
and, using the Einstein summation convention, enunciate the covariant law 


ax* 
Ve = Vk 
i k Juk 


for the transformation of gradient vectors v;. 


Contravariant vs. Covariant 


The contravariant law for transforming tangent vectors is v^ = (9u* /8x^)v*, whereas the 
covariant law for transforming gradient vectors is vy = v, (0x^/8u* ). The tangent vector 
is written as a column vector, but the gradient vector is written as a row vector. The dis- 
tinction between column and row is reinforced using upper indices on the components of a 
tangent vector but lower indices on the components of a gradient vector. Moreover, for the 
contravariant law, the components v* are written on the right of the Jacobian matrix in agree- 
ment with the formalism for multiplying a column vector by a matrix. In contrast, for the 
covariant law, the components v; are written on the left of the Jacobian matrix in conformity 
with the formalism for multiplying a row vector by a matrix. In each case, if the summation 
is viewed from the perspective of the Jacobian matrix, the contravariant law sums “uphill” 
against (contra) gravity, whereas the covariant law sums “downhill” with (co) gravity. 

Tangent vectors are expressed via e;, e», es, a basis of vectors tangent to the coordinate 
curves; and components of tangent vectors are denoted with superscripts, as in v*. Gradient 
vectors are expressed via e!, e^, e?, a basis of gradient vectors normal to the coordinate 
surfaces; and components of gradient vectors are denoted with subscripts, as in vg. 

The contravariant components v* and the covariant components v; are two distinct 
representations of the same geometric arrow. The two sets of basis vectors are mutually 
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reciprocal and can be thought of as existing in the same space. Hence, it should be possible 
to convert a contravariant representation to a covariant one and vice versa. This is indeed 
the case and is known in the literature as "lowering and raising indices." 


In Cartesian coordinates, the gradient of f(x, y) = xy is V f = yi + xj. To transform this 


vector to polar coordinates, we compute 


[rsind rcos0]Ja- = [r sin20 r?cos20] — rsin20e' --r?cos20e^ (32.20 
To corroborate this result, we solve 
e” =cos6i+sinéj and e^ = — T^i + cose j (32.21 
for 
i— cos0üe' —rsinOe^ and j= sinĝe” +rcosde® (32.22 
and substitute into V f = yi + xj = r sin 0i + r cos6j. $ 


EXERCISES 32.5 


1. Verify the calculations in (32.20). 


r sin 0i + r cos 0j becomes (32.20). 
In Exercises 3-12: 


(a) Obtain V f, the gradient of the given function f (x, y). 


(b) Convert V f to polar coordinates via the covariant 
transformation law as embodied in (32.19). 


(c) Convert V f to polar coordinates by obtaining i and j in terms 
of e” and e^, making the appropriate substitutions and changing 


coordinates in the expressions for pi and a 


(d) Obtain f(r, 6) = f(x(r, 0), y(r, 0)) and the derivatives za 


(e) Since the gradient in polar coordinates is Mer + PL ef, show 
that the derivatives obtained in part (d) are the components of 


the gradient in polar coordinates as found in parts (b) and (c). 


(f) Obtain the physical components of the gradient in polar 
coordinates. (The physical components of a vector are the 
components with respect to unit basis vectors.) 


. f(x,y) =3+9xy— 7x? 4. f(x,y) 28—6x —9y? 


f(x, y) =3 +7x + Ty — 8x? +9xy? 
. f(x, y) = Ixy — 3x? + 3y? 
. f(x, y) = 2xy + 5x? + y? 

. f(x, y) = 9x? — 3x?y — 7x3 
10. f(x, y) =14+ 6x + 9y — y? — 2x?y + 2y3 

11. f(x, y) = 9x — 2xy + y? — 3x?y — 4xy? + 8y? 
12. f(x, y) = 1 — 8xy? — 7x3 


8. f(x, y) = 4x + 8xy — 4y? 


e$ utu 


13. For the nonorthogonal coordinate system defined by x — 
iu? — v?), y = 2uv, obtain (e", e") from the rows of the Jacobias 
matrix Jow = [Jo-1]^!. 


In Exercises 14-23: 


(a) Obtain V f, the gradient of the given function f(x, y). 

(b) Convert V f to uv-coordinates via the covariant transformatios 
law as embodied in (32.19). 

(c) Convert V f to uv-coordinates by obtaining i and j in terms 
e" and e", making the appropriate substitutions and changing 
coordinates in the expressions for X and ar 

(d) Obtain fu, v) = f(x(u, v), y(u, v)) and the derivatives + 


af 


and |, 
dv 


(e) Since the gradient in uv-coordinates is if er A afer, show tha 
the derivatives obtained in part (d) are the components of the 
gradient in uv-coordinates as found in parts (b) and (c). 

(f) Obtain the physical components of the gradient in 
uv-coordinates. 

14. f(x, y) =6+ y + 10x?y + 933 + 12y? 

15. f(x, y) 29x -8y +y? 16. f(x,y) =5—xy + 5x? 

17. f(x, y) 24 —2xy - 3y? 18. f(x, y) = 4 + 8x?y — xy? 

19. f(x, y) = 1 — 12x + 5y? + 8x? + 10x?y — 3y? 

20. f(x, y) =2x—1ly—10xy 21. f(x, y) = y - 9x? — 10xy? 

22. f(x, y) 22x — 8x? -y? 23. f(x, y) = 6x —4xy — Ty? +1 

24. For the parabolic coordinate system defined by x — iae —v’), 

y = uv, obtain {e", e") from the rows of the Jacobian matrix 


Jow) = [Jo 1]. 
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In Exercises 25-27: 


(a) Obtain V f, the gradient of the given function f (x, y). 

(b) Convert V f to parabolic coordinates via the covariant 
transformation law as embodied in (32.19). 

(c) Convert V f to parabolic coordinates by obtaining i and j in 
terms of e" and e", making the appropriate substitutions and 
changing coordinates in the expressions for z and 2% 


oy" 
(d) Obtain fu, v) = f(x(u, v), y(u, v)) and the derivatives a 
af 
and >. 
(e) Since the gradient in parabolic coordinates is er + Her, 
show that the derivatives obtained in part (d) are the 
components of the gradient in parabolic coordinates as found in 


parts (b) and (c). 

(f) Obtain the physical components of the gradient in parabolic 
coordinates. 

25. f(x, y) = 5y 

26. f(x, y) = 10+ 4x — 3y? 

28. For the tangent coordinate system defined by x — 


xy — 2x? + 3x? + 3xy? + 6y? 
27. f(x, y) 22 - 9xy + Tx? 


u 
"cz 
ut-rv* 


17. obtain [e", e") from the rows of the Jacobian matrix 


PES 
ur+v2 


Jow = [Joi] 7. 


y= 


In Exercises 29-31: 


(a) Obtain V f, the gradient of the given function f(x, y). 
(b) Convert V f to tangent coordinates via the covariant 
transformation law as embodied in (32.19). 


(c) Convert V f to tangent coordinates by obtaining i and j in terms 
of e" and e", making the appropriate substitutions and changing 
coordinates in the expressions for and af 


Ox ðy ` 
(d) Obtain flu, v) = f (x(u, v), y(u, v)) and the derivatives af 
and 2. 


(e) Since the gradient in tangent coordinates is e + ier, show 
that the derivatives obtained in part (d) are the components of 


the gradient in tangent coordinates as found in parts (b) and (c). 


(f) Obtain the physical components of the gradient in tangent 
coordinates. 
29. f(x, y) =7+7xy + Ty? + 9x3 — 3xy? 
30. f(x, y) =x+10y—10xy 31. f(x, y) =x? — Axy — 10y? 


32. For the elliptic coordinate system defined by x — cosh u cos v, 


y = sinh u sin v, obtain (e", e") from the rows of the Jacobian 


matrix Jow = [Jo-: T€ 


In Exercises 33-35: 


(a) Obtain V f, the gradient of the given function f (x, y). 


(b) Convert V f to elliptic coordinates via the covariant 
transformation law as embodied in (32.19). 
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(c) Convert V f to elliptic coordinates by obtaining i and j in terms 
of e" and e", making the appropriate substitutions and changing 
coordinates in the expressions for af and 2f 


)x dy" 
(d) Obtain fu, v) = f (x(u, v), y(u, v)) and the derivatives af 


and 24, 


ðv 
(e) Since the gradient in elliptic coordinates is af e + Mer, show 
that the derivatives obtained in part (d) are the components of 
the gradient in elliptic coordinates as found in parts (b) and (c). 
(f) Obtain the physical components of the gradient in elliptic 
coordinates. 


33. f(x, y) 25 — 11x 4+ 4y + 11x? — 11x?y + Sy? 
34. f(x, y) 21x — 7y -8xy 35. f(x, y) 29 — 2x? — 9x?y 


36. For the coordinate system defined by x = 5u? + 3v?, y = 
4u? — 9v?, obtain {e", e") from the rows of the Jacobian matrix 


Jou) E [Jo Je. 
In Exercises 37-39: 


(a) Obtain V f, the gradient of the given function f(x, y). 


(b) Convert V f to uv-coordinates via the covariant transformation 
law as embodied in (32.19). 


(c) Convert V f to uv-coordinates by obtaining i and j in terms of 
e" and e", making the appropriate substitutions and changing 
af 


coordinates in the expressions for Z- and of 


(d) Obtain flu, v) = f(x(u, v), y(u, v)) and the derivatives af 


(e) Since the gradient in uv-coordinates is oF et + Uer, show that 
the derivatives obtained in part (d) are the components of the 
gradient in uv-coordinates as found in parts (b) and (c). 


(£) Obtain the physical components of the gradient in 
uv-coordinates. 
37. f(x, y) = lly +xy— 7x? + 9xy? 
39. f(x, y) 2 4xy + lly? — 2x?y 


38. f(x, y) = 9y -3x -8y? 


40. For the bipolar coordinate system defined by x = S357 
y — nante obtain [e", e"] from the rows of the Jacobian matrix 
Jow = Jai. 


In Exercises 41—43: 


(a) Obtain V f, the gradient of the given function f (x, y). 
(b) Convert V f to bipolar coordinates via the covariant 
transformation law as embodied in (32.19). 


(c) Convert V f to bipolar coordinates by obtaining i and j in terms 


of e" and e", making the appropriate substitutions and changing 
: : : P à 
coordinates in the expressions for = and a 


(d) Obtain fu, v) = f (x(u, v), y(u, v)) and the derivatives af 


and af 
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(e) Since the gradient in bipolar coordinates is af qu + aler, show 
that the derivatives obtained in part (d) are the components of 
the gradient in bipolar coordinates as found in parts (b) and (c). 
(f) Obtain the physical components of the gradient in bipolar 
coordinates. 
41. f(x, y) = 4 — 6x? — 2x?y — 5xy? + 3y? 
42. f(x, y) 28y -5y?-l1x? | 43. f(x, y) = 4x — 6xy? — y? 
44. For the skew coordinate system defined by x = 3u + 2v, 
y = 5u — 7v, obtain (e", e") from the rows of the Jacobian matrix 


Joco) = [Jai]. 


In Exercises 45—47: 


(a) Obtain V f, the gradient of the given function f(x, y). 


(b) Convert V f to skew coordinates via the covariant 
transformation law as embodied in (32.19). 


(c) Convert V f to skew coordinates by obtaining i and j in terms 
of e" and e", making the appropriate substitutions and changing 
coordinates in the expressions for = and zu. 


(d) Obtain fu, v) = f (x(u, v), y(u, v)) and the derivatives af 


and M 

au 
(e) Since the gradient in skew coordinates is Mer + afer, show 
that the derivatives obtained in part (d) are the components of 


the gradient in skew coordinates as found in parts (b) and (c). 


(f) Obtain the physical components of the gradient in skew 
coordinates. 


45. f(x, y) = 10x + 6y — 4xy + 12x? — 4x7 y 
46. f(x, y) 29x —3y—Sxy 47. f(x, y) 34 - 3xy? - x? 
48. For the coordinate system defined by x = 2u? — 5v, y = 3u +407 


obtain (e", e") from the rows of the Jacobian matrix 


Jow) = Bol. 
In Exercises 49-51: 


(a) Obtain V f, the gradient of the given function f(x, y). 


(b) Convert V f to uv-coordinates via the covariant transformation 
law as embodied in (32.19). 
(c) Convert V f to uv-coordinates by obtaining i and j in terms of 
e" and e", making the appropriate substitutions and changing 
f af 


. . . C. ð 
coordinates in the expressions for 3f and =. 


(d) Obtain fu, v) = f(x(u, v), y(u, v)) and the derivatives 2 


and 27 


ðv ` 


, á " "E. 9f y ‘ 
(e) Since the gradient in uv-coordinates is 24 e" + 2Z e", show that 
is Ju ðv 


the derivatives obtained in part (d) are the components of the 
gradient in uv-coordinates as found in parts (b) and (c). 


(£) Obtain the physical components of the gradient in 
uv-coordinates. 
49. f(x, y) = 8x + 3y — 4xy? 
51. f(x, y) = 10x + 8xy + 11? 


B50. f(x, y) = 12y +7y? + 12x7 


Chapter Review 


1. What is an orthogonal matrix? What are its properties? 
2. Let x = 2i + 3j, and define e; = 3i 


2j, e; = 4i + 5j. 

(a) Find 'x, the representation of x with respect to the new basis 
fei, e2}. 

(b) If X and 'X are the column-vector representations of x and ’x, 


respectively, obtain the transition matrix M for which 
'X — MX holds. 


3. Given M — E —sina 


Ras S kk where a = $ and x = i + 2j: 

(a) Show that M is an orthogonal matrix. 

(b) If y = Mx, show ||yl| = Ixl]. 

(c) Show that y is the counterclockwise rotation of x through the 
angle a. 


(d) Let the columns of M define new basis vectors e; and e», 
respectively. Express x with respect to this new basis, and show 
that ‘x = y. 


(e) Show that e; and e» are, respectively, the counterclockwise 
rotation of i and j, through the angle a. 


4. Obtain an orthogonal matrix R for which the product y = Rx is the 
result of applying to x a sequence of three counterclockwise 
rotations about the coordinate axes through angles of $, 2, and = 
respectively. 


5. If R is the matrix in Question 4: 


(a) Show that à = 1 is the only real eigenvalue and that the 
associated eigenvector is the axis of rotation for a single 
rotation moving x to y. 

(b) Obtain an equation for the plane whose normal is the 
eigenvector in part (a). 

(c) Find a vector z that lies in the plane determined in part (b), and 
show that Rz remains in that plane. 

(d) Find the angle between z and Rz. 

6. What is meant by the term real symmetric matrix, and what are the 
properties of such a matrix? 

7. Give an example of a real symmetric 3 x 3 matrix and show that 
eigenvalues are real and that its eigenvectors are orthogonal. 


11 


12 


32.5 Gradient Vectors and the Covariant Transformation Law 


. The matrix A — [s ‘| is symmetric but not real. Show it does not 


have real eigenvalues. 


. Sketch the proof that the eigenvalues of a real symmetric matrix are 


real. 


. Sketch the proof that, for a real symmetric matrix, the eigenvectors 


13. 


14. 


of distinct eigenvalues are orthogonal. 

What is orthogonal diagonalization of a matrix? Give an example. 

Verify that the columns of M = are orthogonal and 
rot 3 

each of unit length. Show that MTM is the 2 x 2 identity matrix but 

that M MT is not an identity matrix. 

If e, = 2i + 3j and e; = —5i + 4j, obtain {e!, e?], the basis 

reciprocal to {e;, e»]. 


For polar coordinates, the forward map ® is given by 

p nam jos T—— zd re oi 

=y X + y0 = arctan 7, whereas the inverse map ^ is given 

by x —rcos0, y =r sinð. 

(a) Obtain the Jacobian matrix Jo x). 

(b) Obtain the Jacobian matrix J4-1(. 

(c) Show that Jow) = [Jo- w]. 

(d) Show that the columns of J-1,y) are the natural tangent basis 
vectors. 

(e) Show that the rows of Jo x) are the natural gradient basis 
vectors. 


15. 


16. 
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(f) Show that the sets of basis vectors in parts (d) and (e) are 
reciprocal vectors. Hint: Use part (c). 


Let R(p) = pi + p?j define a plane curve in the Cartesian plane. 

(a) Obtain V = R'(p), the tangent vector along the given curve. 

(b) Evaluate Jo x), determined for polar coordinates in Question 
14(a), along the given curve. 


(c) Use the contravariant transformation law for tangent vectors to 
obtain 'V, the representation of V in polar coordinates. 
Schematically, this calculation can be represented as 
'V = Jew V. where V is written as a column vector. 


(d) Express the basis vectors (i, j} in terms of {e,, eg}, the natural 
tangent basis vectors for polar coordinates. 

(e) Use the expressions in part (d) to transform V to 'V, and 
compare to the result in part (c). 

Let f(x, y) 2 x?y?. 

(a) Obtain the row vector X — V f, the gradient of f. 

(b) Use the covariant transformation law for gradient vectors to 
obtain 'X, the representation of V f in polar coordinates. 
Schematically, this calculation can be represented as 
'X = XJ- w), provided the variables are all changed to polar 
coordinates. 

(c) Using the result in Question 15(d), change V f = f.i + f,j to 
polar coordinates and compare to 'X computed in part (b). 
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Chapter 33 


Matrix Computations 


INTRODUCTION Basic matrix arithmetic and the eigenvalue problem were 
covered in Chapter 12. In the present chapter, we continue with a discussion of common, 
but more advanced, matrix and vector manipulations. Vector projection, and its cousin, the 
Gram-Schmidt orthogonalization process, the matrix norm, and its relation to the eigenvalue 
problem, the least-squares problem for fitting a curve to a set of data, and a study of 
quadratic forms are the framework on which we hang the details of more sophisticated 
matrix computations than were needed in Chapter 12. 

After a brief review of Gaussian elimination, determinants, Cramer's rule, and the 
eigenvalue problem for vectors, carried out mainly by a set of review exercises, we show 
how to obtain the components of a vector along, and orthogonal to, a given direction. 
These components are called the projections on, and orthogonal to, a given vector. This 
operation of projecting a vector onto a given direction is cast into a matrix formalism that 
then generalizes to a projection of a vector onto, and orthogonal to, a subspace spanned by 
a collection of vectors. 

This ability to project vectors onto a subspace and perpendicular to the subspace is at 
the heart of the Gram-Schmidt process for transforming a set of nonorthogonal vectors into 
an "equivalent" set of mutually orthogonal vectors. Interestingly enough, if the given set 
of vectors are not linearly independent, the Gram-Schmidt process will yield orthogonal 
vectors that are linearly independent. 

Quadratic forms are the basis for the second derivative test of optimality for functions of 
several variables. The test for a function of two variables, learned in multivariable calculus, 
is explained and then generalized to the case of n variables using the theory of quadratic 
forms. 

The length or magnitude of a vector is a single number measuring the "size" of the 
vector. We likewise assign a "sizing" number to a matrix and call it a matrix norm. There 
1s more than one way to assign such a number, so we examine the Frobenius norm as well 
as the 1-norm, the 2-norm, and the infinity-norm for a matrix. Computing a 2-norm for a 
matrix requires solving an eigenvalue problem. 

Finally, we conclude with an analytic and algebraic approach to the least squares fit 
of the general linear model to data. The overdetermined set of algebraic equations that is at 
the heart of this problem is solved both analytically and algebraically for the solution that 
minimizes the sum of squares of the error between the data points and the fitting curve. A 
geometric interpretation of this problem illustrates the role of the fundamental subspaces 
of a matrix in determining the solution of a system of linear equations. 
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Summary 


Review 


Chapter 33 details a variety of matrix manipulations and calculations. Many of these have 
been seen earlier in the context of a matrix formulation for systems of linear ordinary differ- 
ential equations. Thus, we merely recall that we have already seen basic matrix arithmetic 
in Section 12.3; the determinant and Cramer's rule in Section 12.4; Gaussian elimination in 
Sections 12.5 and 12.6; matrix inverse in Section 12.7; the eigenvalue problem in Sections 
12.10, 12.12, 12.14, and 12.15; and the matrix exponential in Sections 12.8 and 12.9. 

The following exercises will serve as a review of most of the concepts and calculations 
seen in earlier parts of the text. 


In Exercises 1—5, compute the following quantities. 6. A= | 6 a b= B j T: A= he e b= l r 


(a) 2A + 3B, A(SB — 7C), ABC 

(b AB — BA, AC - CA, BC — CB 
(0 1+ A+A*+ A? 

(d) det AC, det(A B)T — det A det B, de 
(e) A7! BA, AT B 

(f) (AB)! — B^! A^, (AC)! — CTAT 
(g) rref (A), rref (B), rref(C) 


-6 8 [-11 1 9 
LA- [i j^ [5 Je 
[-5 -2 12 11 4 
2.A-2|-2 4 ,B=] 11 6 
|-8 1 = 4 11 
r 4 8 2 12 -2 
3. A=|-3 2 5|,B=|11 9 
L 5 1 -10 8 T 


[10 -2 9 5 
tA — i 9,A=| 8 10 alfa 
d 1 


det A 


Al For the matrix A in each of Exercises 11—20: 

1 

" 2 5 s (a) Obtain det A, and obtain A`! if det A z 0. 

2| C= E 1 ] (b) Obtain det AT, and obtain [AT]-! if det A? ¥ 0. 
5 8 7 3 


P " (c) Obtain the eigenvalues and corresponding eigenvectors. 
-1 0 —5 2 
1 C= l 7 -9 1 (d) Show that each eigenpair (A, v) satisfies Av = Av. 

S i (e) Obtain e^'. 


r 0 10 1 -12 -5 -5 | =i -12 ; i à , "un 
4 A-| S 10 n[,B2|-8 -10 -8],c=|12 u -2| 44 | | 12. | Pl 13. i | 
L-10 —10 d E 8 d E -H d 4 —6 10 —9 6 8 


Un 


A- [9 IT ul n gt 
UU 18 7]  |-3 4l | i 


For the system Ax = b given in each of 


(a) Obtain x using Cramer's rule. 


2 10 3 
17 | —6 4 3 
(b) Obtain x using Gauss elimination and back substitution. -2 —4 7 


(€) Obtain x by computing and using A^. [ 


: [3 9 6 —3 - P ? 
al 14. 7 s 15. É- 4 | 6 1 ] 
E í =T ey -—41 


Exercises 6-10: 


2 2 -7 
, ; r 19. |-11 —5 9 20. | —9 4 
(d) Obtain x by Gauss-Jordan reduction of [A, b] to the reduced [ 7 m 


row-echelon form. 
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FIGURE 33.1 
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1 2 


Resolution of B — i +j 


into components along and perpendicular 


to A =2i 


EXAMPLE 33.1 


4 Projections 


Resolution of a Vector into Orthogonal Components 


If neither of the vectors B and A are 0, the zero vector, we can express B in terms of its 
vector components along A and perpendicular to A. Each of these vector components are 
called projections, either Ba, the projection of B on or along A, and B14, the projection 
(or component) of B orthogonal to A. 


PROJECTION OF BALONGA The vector B4 (“B on A"), the projection of B on or along 
A, is given by 

Bas SA (33.1) 
As an example, consider the two vectors A = 2i and B = i + j, graphed along with B4 in 
Figure 33.1. From the figure, the angle between A and B is 7, so the length of B4 is found 


to be ||B|| cos | = V2- = 1. A vector of this length in the direction of A is IGAD =j 


Alternatively, BA = BAA = £0) =i. 


PROJECTION or BORTHOGONALTOA The projection, or component, of B perpendicular 
to A is Bia = B — Ba = (i +j) — i = j, as shown in Figure 33.1. 
Projections—A Matrix Formulation 


We next recast in matrix form our work on projections along and perpendicular to a vector. 


PROJECTION OF B ALONG A The matrix 


Ps —— (33.2) 


will project any vector onto the vector A. When applied to a vector B, we can write 
AAT, (AB, _ BA 

ATA ATA A-A 

Remember, A is a vector, so ATB = A - B is a scalar that commutes with A, thereby 
validating the middle fraction. 


PB= 


The matrix that projects any vector B onto the vector A = i + 2j + 2k is 


l 
ZI 2 s] 
T |2 i2 2 
Pate mika (33.3) 
ATA ij 8 
24 4 
(i 2 2|]2 
2 


Applied to the vector B = i + j + k we get PB = B4 = s + 2j + 2k). Of course, Ba is 
also given by 


l l 
I 2 
| l 
B-A 2 5 5 
Ac 2)=-|2] =-G4+2j+ 2k $ 
Ack 1 ^ 9 | 5 git j + 2k) v 
AEN i 
2 2 


FIGURE 33.2 Resolution of B into 
components along and perpendicular to 
A in Example 33.1 


EXAMPLE 33.2 


EXAMPLE 33.3 
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33.2 Projections 


PROJECTION or B ORTHOGONAL TOA The projection, or component, of B perpendicular 
to A is given by 
Bi, =B — Ba =B — PB = (1 — P)B =} (4i — j — k) 


since 


loo 
| 


4 
—]1 
—] 


(= P)B=|- 


win 


| 
OIF OIN Oly 
| 
Wu CIE wl 
— 


SIN 


In general, if P projects onto the vector A, then J — P projects onto the direction or- 
thogonal to A. Figure 33.2 shows the vectors B, A, Ba, and Bia. 


PROJECTION MATRICES A matrix P is called a projection matrix if it is symmetric and 
P? = P. (If PB is the projection of B onto A, then P (PB), the projection of the projection 
onto A, is still PB, so P? = P.) The matrix P in (33.3) is symmetric, and a computation 
shows P? — P. Hence, it is a projection matrix. 


Projection onto a Subspace 


Next, we consider the concept of projecting a vector onto a subspace generated by the basis 
vectors Aj,..., Aç. For example, the projection of B onto the subspace spanned by A, and 
A» would be Bj4, a] = Braj, the component of B lying in the plane formed by A, and A». 

By calling the vectors A, ..., Ay a basis, we are stating that they span the subspaceall 
possible linear combinations of the basis vectors) and that they are linearly independent. 
This last point is very important. 


Let A be the matrix whose columns are the vectors Àj, ..., A, sothat A = [Ay,..., Ag]. 
A recipe for a matrix P that projects vectors onto this subspace is 
P = A(AT A)! AT (33.4) 


The matrix in (33.2) can be written as A(ATA)-! AT because ATA is a scalar. This suggests 
(33.4) is an appropriate generalization of (33.2). 


Form a matrix that will project vectors onto the subspace spanned by the vectors Ay = i+j 
and À; = j, two vectors that constitute a basis for the xy-plane. To form P, a matrix that 
projects onto this plane, write 


1 0 1 0 2 r 10 1 0 0 
A=]1 1 Ps|1 1 11 6 1 8^ 0 1 0 
0 0 0 0 0.0 0 
The projection of B = ai + bj + ck onto the plane spanned by A, and A» is PB = ai + bj, 


a result that should not surprise us. $ 


To project the vector B onto the subspace spanned by A, and A», where 


| 1 0 

2 0 | 

B=|,; A=|_j| AÀ-]|, 

4 ] 2 

write 

10 1 0 6-1-7 4 
jal ©. el T2 led tale ae 
-1 1 -11|l1 6| [o 1 12|717|-7 4 n 1 
12 12 4 5 114 


FIGURE 33.3 Projection of B onto plane 
spanned by A, and Ay. Component of B 
orthogonal to this plane is the shortest 
vector from the plane to the head of B. 
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and compute Bia, a] = Bj4j = PB. The component of B perpendicular to this subspace is 
then B [4,,4;; = Bita] = B — PB = (7 — P)B. Both components of B are given as 


—] 18 

1 | 37 í] dn 

Bia) = 17 | 38 Bia) = 7/2 * 
13 —5 


FINAL Comments IfA is anr x c matrix whose columns are independent, then (33.4) 
projects onto the column space of A. (The column space of A is the span of the columns, 
that is, the set of all possible linear combinations of the columns of A.) The matrix AT A 
will be an invertible c x c matrix and P can be constructed from (33.4). 

If A has rank k < c, then AT A will be singular and not invertible and (33.4) fails. The 
redundant columns in A must be deleted before the projection matrix P can be constructed 
with (33.4). For example, 


1. Ther x c matrix A is 4 x 5, so its rank is at most k = 4, and the 5 x 5 matrix AT A is 
definitely singular. 

2. Ther x c matrix A is 5 x 4 and has maximal rank k — 4, so the 4 x 4 matrix AT A is 
invertible. 


3. Ther x c matrix A is 5 x 4 and has rank k < 4, so the 4 x 4 matrix AT A has rank 
k « 4 and is singular. 


Minimizing Property of Projection 


The projection of B onto the subspace spanned by A}, ..., A, is the component of B in the 
subspace spanned by Aj, ..., Ag. The component orthogonal to this subspace is the shortest 
vector from the tip of B to the subspace formed by A;,..., Ag. Figure 33.3 illustrates this 
for the vectors 
5 1 —1 
B= 7 A; = | 2 A,=]| 0 
6 l 2 
The matrices A = [A;, A2] and P = A(AT A)^! AT are given by 
1 =l 1 —1 = 13 12 -8 
A=|2 0 P=|2 0 l ; E : l= 12 20 6 
l 2 1 2 7 |-8 6 25 


The projection of B onto the span of A; and A; is the vector PB = Bra) = —i + 4j + 
8k, whereas the component of B orthogonal to the subspace spanned by A, and A» is 
B — PB = Biya) = —4i + 3j — 2k. The vector Bija] = (J — P)B is the shortest vector 
from the plane formed by A, and A; to the tip of B. 

To see this, let 


Y = cA; + c2À» = (cı — c2)i + 2c1j (c1 + 202)k 


be a general vector in the plane of A, and A». By varying c; and c» the vector Y moves in 
the plane. Correspondingly, the vector 


R=B-Y= (—5 = Cj c cjd-4 (7 — 2cı)j + (6 — ci — 2c5)k 


from the tip of Y to the tip of B varies. We then seek values of c; and c» that minimize 
F (cr, €2) = IRI? = (-5— c1 + €2)? + (7 — 26)? + (6 — c1 — 202)? 


(Minimizing ||R||* is equivalent to, but simpler than, minimizing ||R ||.) 
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33.2 Projections 


The techniques of calculus are sufficient for finding the desired minimizing values of 
cı and c». They must satisfy the equations 


Of — 


dc] 


= —30 + 12c; + 2c. =0 


a 
and 3f = —34 + 2cı + 10c2 = 0 


C2 


and are therefore c, = 2, c; = 3. The minimizing Y is then 


Y —2A, + 3A: = —i + 4j + 8k = PB 


The shortest vector R is then 


R= 


B — Y =B — PB = By = —4i + 3j — 2k 


in agreement with the original calculation. 


EXERCISES 33.2—Part A 


Al. If A = 2i+ 3j and B = i + 5j, obtain B4 and B , 4 via the 
formalism in (33.1). 


A2. With A as in Exercise Al, obtain P by the formalism in (33.2). 


Show P? — P. 
A3. Use P from Exercise A2 and B from Exercise A1 to obtain B4 and 
Bia. 


A4. For A and B given in Exercise Al, obtain B 4 using the techniques 
of calculus to find the value of o that minimizes ||B — «Al. 


EXERCISES 33.2-Part B 


AS. If A; =i— k and A; = i + j, obtain P, the matrix that projects 
onto the plane determined by A; and Aj. Show P? = P. 

A6. If A; and A; are as given in Exercise A5 and B = 2i + 3j — 5k, 
obtain Bray and Bia. 

A7. For the vectors used in Exercise A6, obtain B ; (4; using the 
techniques of calculus to find the values of o, k = 1,2, that 
minimize |B — $7; , oA; |’, where A;, k = 1,2, are the two 
(independent) columns of A. 


B1. From P? = P we easily see that det P must be either 0 or 1. 
Explain why det P — 0 and not 1 when projecting onto a 
subspace whose dimension is smaller than that of the space in 
which it is contained. 


In Exercises B2-11: 


(a) Obtain Ba = BAA, the vector projection of B along A. 
(b) Obtain B; 4 = B — B4, the vector component of B orthogonal 
to A. 


' a: ; T 
(c) Obtain the projection matrix P = “* 


ATA 


(d) Show B4 = PB and B,, = (I — P)B. 


(e) Obtain B, 4 using the techniques of calculus to find the value 
of a that minimizes ||B — «A^. 


(f) Sketch A, B, By, and B | 4. 


and show P? — P. 


B2. A = —8i — 2j, B = 8i + 11j B3. A= 12i + 10j,B=i+ 3j 
B4. A = —7i — 9j, B = 4i — 6j BS. A = 5i + 3j, B = 1li + 12j 
B6. A = —12i — 6j, B = 10i — 2j 


B7. A = —i — 4j — 5k, B = 3i + 5j + 3k 
B8. A = 7i — 9j — 6k, B = —5i + 8j — 5k 
B9. A = 5i + 10j — 3k, B = 6i + 7j — 4k 
B10. A = 10i + 2j + 2k, B = 9i — 9j — 2k 


B11. A = 6i + 4j + 10k, B = 4i 


12j +k 
In Exercises B12-21: 


(a) Show that the columns of A are independent. 

(b) Obtain the matrix P = A(A™A)~!AT that projects vectors 
onto the subspace spanned by the columns of A. 

(c) Show P? — P. 

(d) Obtain Bj4; = PB, the projection of B onto the column space 
of A. 

(e) Obtain Bija; = (/ — P)B, the component of B orthogonal to 
the column space of A. 


(f) Obtain B | 4; using the techniques of calculus to find the 
values of o, k = 1,...,n, that minimize 
IB — * 7; , o; Acl, where Aj, k =1,..., n, are the n 
(independent) columns of A. 

(g) Sketch a representative diagram showing B, Bia), B (4j, and 
the column space of A represented as a plane. 


—5 3 —8 —6  —5 
Bl12.4-| 5 3|.B=|-4 B13. A=| 8 STR 
7 —9 1 3 —5 
—2 —2 6 
—4 10 —4 
B14. z 2 JEBE] wall ; 3-3 
2 E —3 
4  —12 6 
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[a cs H r ee : B23. Given that the inverse of an invertible symmetric matrix is 
315.3217 Ti] Bman -Ele 7 ; T AY-1 AT ; ; 
7 | 3 =g" —6 s 6 p 5 symmetric, show that P = A(A A) A is symmetric by 
Ed». ed E RE = -12 computing PT. 
Ee =E kx B24. If A is a square matrix of maximal rank (so it is invertible), show 
B18. A=| 3 _10| +B 5 that P = A(AT A)-! AT = J. Explain why this makes sense. 
dis. 7B B25. Show that if P = A(ATA)-! AT, then P? = P, necessarily. 
[-6 -4 -9 Fon 
B19. A= bs ph 1 B= 1 In Exercises B25—30, find a matrix that projects onto the given plane bs 
T $o P B L 4 (a) forming A(AT A)-! AT, where A is a matrix whose columns 
die e =i are any two independent vectors in the plane. 
Bial = el 2 ; i ; 
7 -9 se =$ (b) calculating (7 — P), where P is a matrix that projects onto 
a : - the normal to the plane. (Hint: A vector perpendicular to the 
E k E i plane ax + by + cz = 0 is ai + bj + ck.) 
B2.4- 1 P |a. 9 
l-10 9 -4 E: B26. 7x -9y -102z 20  B27. 11x -2y - 72 20 


B22. Find P, the matrix that projects vectors in the plane onto the line B28. 8x — 3y + 7z = 0 B29. 10x — 8y — 1lz =0 


2x + 3y = 0, and then obtain the matrix H = I — 2P. Apply H B30. 2x + 8y —9z 20 
to several vectors in the plane and deduce its general effect. Show 
that H? = I, and explain why this should be true. 


|The Gram-Schmidt Orthogonalization Process 


The Gram-Schmidt Process 


We seek an algorithm for deriving an orthonormal collection {w4}, k = 1,...,r < n 
whose span is the same as the span of the given vectors, from a given set of vectors {vz} , k = 
doi is n. We can work in stages, first transforming the given vectors into an orthogonz! 
collection and then normalizing each of the orthogonal vectors to produce a collection of 
orthonormal vectors. 

The following prescription is a form of the Gram-Schmidt orthogonalization process 
which yields a set of mutually orthogonal vectors that can then be normalized to form a set 
of orthonormal vectors 


wi;—v; Wj;-—(l-Pmw.w)Vj J>l 


EXAMPLE 33.4 Given the four vectors vz, k = 1,...,4, shown respectively in (33.5), 


—3 —] —l 2 
—2 —3 —2 3 
b 33.5 
3 2 1 —2 ( 
ian —1 3 —3 —2 
V2 we build w;, k = l,..., 4, a set of mutually orthogonal vectors as follows. Begin by 
accepting v; as the first “new” vector, calling it wj. Next, take as w2 the component of v- 
that is perpendicular to vı. Thus, 
| w2 = V?— Piw V2 = (I — Piw) v2 
W» = V5 — component of v; on v is V2 less the projection of v? on wi, as shown in Figure 33.4. To obtain w2, form Piy,) = 
TA.\-l aT ; 
FIGURE 33.4 Example 33.4: The vector A1(A1 A1) A, from the matrix A = [wi] and compute w2 = (J — Piw) V2. 
W; is the component of v; orthogonal to Take as w3 the component of v3 that is orthogonal to the plane spanned by w; and 


Wi = Vi w2. To obtain ws, form Pty, Ww.) = Ax(ATA3) AT, the matrix that projects onto the sub- 
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space spanned by w; and w2, from the matrix A» = [w;, w2]. Then, compute w3 = (J — 
Piwi w;1) V3- 

Finally, take as w4 the component of v4 that is orthogonal to the subspace spanned by 
w1, Wo, and ws. To obtain w4, form Piw, w,.w,j = A3(A1A3) ^! AT, the matrix that projects 
onto the subspace spanned by w1, W2, and w3, from the matrix A3 = [Wi, W2, w3]. Then, 
compute w4 = (J — Priw, w,,w,j) V4. The projection matrices Piw,}, Prw, w;]. Ppw, w;,w;] are, 
respectively, 


9 6 —9 3 
tj E 4-6 2 
23|-9 -6 9 -3 
3 2 -3 1 
158 75 —145 96 69 —14 —56 7 
ES 75 155 —120 -—125 1 [-14 114 -16 2 
385| —145 —120 155  —15 118 | —56 —16 54 8 
96 —125  —15 302 7 2 8 117 
and the orthogonal vectors wz, k = 1,..., 4, are, respectively, 
—3 13 356 21 
—2 1 |-45 . | —640 l|6 
3 23 10 385 | —200 59 | 24 
—1 81 —388 —3 
Normalizing the vectors w;, k = 1,..., 4, we get 
—3 13 89 7 
1 —2 1 —45 1 —160 1 2 e 
— — — a — + 
J23 | 3 48855 | 10 45430 | —50 J118 | 8 
— 81 —97 —1 


Gram-Schmidt and Dependent Vectors 


What happens if a set of dependent vectors is given to the Gram-Schmidt process? For 
example, the vectors Vg, k = 1,..., 4, where V; = vj, V; = Vo, V3 = 3v1 — 7v2, V4 = 
5v, + 2v2, are linearly dependent because the second two vectors are linear combinations 
of the first two. Thus, applying the Gram-Schmidt process to the four linearly dependent 
vectors 


-3 = -4 E 
2 - 15 —16 
3 2 -5 19 

=j 3 —24 1 


2 
J23 | 3 /8855 | 10 
| 81 


The redundancy is eliminated, a useful feature of the orthogonalization process. 

A moment’s thought reveals how the redundancy is detected and eliminated. When V3 
is projected onto the subspace spanned by W; and W2, the projection is V3 itself. There is 
no component perpendicular to the subspace, so W3 = 0. The same happens with V4. There 
is no component orthogonal to the space spanned by W1, W2, and W3. Hence, W4 = 0. 
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Thus, the Gram-Schmidt process can be used as a filter for sifting out a maximal set 
of independent vectors from amongst a set of linearly dependent vectors. 


EXERCISES 33.3 


In Exercises 1—9, apply the Gram-Schmidt process to each of the 


following sets of vectors (vi, ..., vz}, obtaining the orthonormal sets 
(wi,..., w,), where r < kif (vi, ..., vz} is a linearly dependent set of 
vectors. 


1. v; = 10i — 9j — 9k, v; = —3i — 10j — 8k, v = —4i — 12j + 12k 
2. vı = 8i + 4j — k, v; = 8i + 3j — k, v4 = —2i — 10j + k 
vi = 6i + 10j + 12k, v; = —10i + 5j — 7k, v3 = —4i + 15j + 5k 
vı = —12i — 6j — 2k, v; = —11i — 9j — 10k, v4 = —3i + 2j + 9k, 
v4 =7i+7j+ 12k 
5. v; =i +4j + Hk, vz = —9i — 4j + 6k, v; = 7i — 3j — 10k, 

v4 =2i—2j-—k 


ROO 


= 


7 -1 12 
7 -7 —8 
6. vi = =i .V2-— —9 ,V3— E 
| 4 -2 11 
11 2] | —9 
—11 4 15 
WS ups gm. 
|. —8 —| | * 
[^6] 10 | [-1 3 
owes] Blew 5 NET 
| SI Leere ele oq 
Le} Lud Le s 
3] [ -1] | 5 0 
Gee! Yael] Ml «| Sla 14 
"S emen enr n | a | e | 
-3J | 2j | -8 2 
The Gram-Schmidt process can be implemented without constructing 
projection matrices. Given the set of vectors {v,,..., Vg}, create the or- 


thogonal set (wi, ..., w,], r < k by defining w; = v; and 


i-l 


(vi, wj) i 
W; — Vj —W; —— k 
2, (wj, Wj) i? 


j=! 


If (u,v) = u » v = ul v,apply this version of the Gram-Schmidt algo- 
rithm to each set of vectors (v, ..., vg} given in Exercises 10-17. 


10. v; = —i +j — 3k, v = 9i — 12j + 7k, v = —2i — 10j + 11k 
11. v; = 10i + 4j — 9k, v; = 8i + 11j + 9k, v = 6i — 8j — 27k 
12. v; = —6i — 6j + k, v; = 12i — 4k, v = 6i + 18j + k 


13. v, = —2i — 7j 


6k, v) = 7i + 17j + 9k, v3 = 5i + 10j + 3k, 


v, = —1li — 16j + 3k 
14. v; = 4i + 12j — 8k, v; = 13i + 12j 
v4 = 7i — 6j + 11k 


k, v; = —11i — 6j — 3k, 


[ 7 2 7 
eee | BS) eel = EE: 
S. y = _9 .V2— 23 V3 = 10 
| 4 1 0 
| =8 —16 —8 0 
-7| | _ |-10 _|-3 -4 
16. v; = 1 |= 12|°%3= 117% =I] 40 
E 15 3 9 
[dg -8 10 -] 
12 4 —10 —9 
17. v = —2 .V2— 10 .V3-— 11 ,V4 = 6 
| -9 5 11 11 


The finite-precision numerical implementation of the Gram-Schmidt 
process can suffer loss of orthogonality through round-off error. Greater 
accuracy is achieved by the following modification wherein, at each stage. 
all “old vectors” are made orthogonal to each “new vector." In particular, 
wW = Ti but each of the remaining vectors v2, . . . , Vg, are made orthog- 
onal to w; by subtracting from each v;, its projection along w; by means 


(1) 


& f . > . 

of v? = vj — (wi + V)Wi, i = 2,..., k. Then, w; = i» is already 
Y) 

orthogonal to w;, so the remaining UM $isud LM are made orthogonal 

to w2 by means of v? = v® — (W5* vw, mS usas k. In general, 

w, = v6-D /|v6-P|l and vi? = v67P — (wv )w,, i — s--1,..., k. 

Apply this modification of the Gram-Schmidt process to each set of vec- 

tors (Vi, ..., vz} given in Exercises 18-25. 

18. v; = —1li — j + 6k, v; = 5i — 4k, v; = 3i — 2j + 5k 


19. v, = —7i + 9j — 7k, v; = —9i + 11j + 10k, v; = 2i — 2j — 17k 

20. ¥ = 9i — 12j + 3k, v; = 13i — j — 7k, v = —7i — 7j + 9k, 
v4 = 16i — 5j — 6k 

21. vı = —1 1i + 3j — 5k, v, = —10i — 4j 
v4 = 3i — 8j — 4k 

22. v = —9i + 4j +k, v; = 
v4 =i— 8j—7k 


2k, v4 = 5i — 9j — 11k, 


5i + 6j + 4k, v3 = 8i + 4j + 6k, 


4 5 9 
12 2 14 
23. vı = 7 »%¥2= 5 Ye = 12 
—1 -7 —8 
7 8 —10 -—7 
10 6 —3 —5 
24. v = a|:—|4|**—| glsva-| 4 
—12 7 6 —39 
9 14 —4 5 
9 —6 12 3 
25, v = A ,V2-— E .V3— 7 V4 = =| 
—8 —17 —1 —9 


In Exercises 26-35, orthogonalize the functions x", n = 0, 1,...,5, by 
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4 


applying the Gram-Schmidt process with the given inner product. 33. (f(x), 8@)) = 2. f Gx)8 (xx), where x, = 4’ iesus 4 
k=0 
E i 
26. (f(x), 2()) = | f(x)g(x) dx 34. (f(x), g(x)) = y fg nx. where x; = a TIER 4 
; 
k=0 
4 
27. x), g(X)) = (x) g(x) dx 2 j 
(FO), 800) Í fooga 35. (f(x), g(x)) = Y feos; where x; — pi =0,..., 4 
1 k=0 
28. (f(x), g(x) = Í f(x)g(x)V 1 — x? dx $ 5 o3 38 
p Let (u, v) = u! Mv, where M = 2m : s A . To the vectors 
29. (f(x), g(x)) = Í f Gg) sin zx dx a 2 € mw 
0 given in Exercises 36-41, apply the Gram-Schmidt algorithm w; = V1, 
E " id (x w. 
30. (f(x), g(x)) = Í fG)gQ) cos =x dx wi=v-)) NeW, dsi 
0 E ii WS Wi) 
; 
31. (f(x), 60) = Í fgv dx 36. the vectors in Exercise 8 — 37. the vectors in Exercise 9 
1 38. the vectors in Exercise 16 — 39. the vectors in Exercise 17 
5 (u^ m 4 Tq m» 
32. (fo), 860) = Í f Gg GO /x dx 40. the vectors in Exercise 24 41. the vectors in Exercise 25 


Quadratic Forms 


Second Derivative Test in One Variable 


The following is a brief review of the second-derivative test for extrema of functions ofa 
single variable. 

Let f'(c) = 0 so that c is a critical value for f (x). To test if the critical point (c, f(c)) 
is a maximum, minimum, or neither, examine f"(c). If f"(c) > 0, the critical point is a 
minimum; if f"(c) < 0, a maximum; if f” (c) = 0, no decision. To tell if the critical point 
is a “saddle,” check if f" (x) changes sign across x = c. 

This second derivative test flows from the local behavior of f(x) near x — c. This 
local behavior, which can be studied via the Taylor expansion of f (x) up through quadratic 
terms, namely, 


fo) 2 f() * f'KO(x — o 4 $f" — o OG) 


Since f'(c) = 0, this expansion becomes (with x — c = h, sox = c-r h) 


h2 
f(c-h) = f+ f" C) + 00?) 


Near x — c a function value f (x) is the function value at x — c altered by an amount 


that is approximately f "(ey a quantity whose sign is determined solely by the sign of 


f" (c). If f" (c) > 0, then nearby values are greater than f(c), so f (c) is a minimum. If 
f" (c) < 0, then nearby values are less than f (c), so f (c) is a maximum. 


Second Derivative Test in Two Variables 


A point p at which V f — 0 is called a critical point for the multivariable function f(x). 
In two variables, the nature of the critical point p can be determined by evaluating T = 
fub £É at p. If T. < 0, then p is a saddle point. If T > 0, then p isa minimum when 
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EXAMPLE 33.5 


f > 0 and a maximum when f, < 0. If T = 0, then T does not reveal the nature of p 
and the test fails. 


Consider the function f (x, y) = x? — 6xy + y? whose critical points (0, 0) and (2, 2) are 
found by computing the first partial derivatives, setting them equal to zero, and solving for 
x and y, resulting in the pair of equations 


3x? — 6y 23y — 6x 20 


Next, compute the second partial derivatives f,, = 6x, fyy = 6y, and fyy = —6; then 
form the test expression 


T = faf — fey = 36xy — 36 


and evaluate T at each critical point. Thus, T (0, 0) = —36 and T (2, 2) = 108. At (0, 0) 
the test number 7 (0, 0) is negative and we conclude that (0, 0) is a saddle. At (2, 2) the test 


number T (2, 2) is positive. Since f,, is also positive, we conclude that (2, 2) is a minimum. 
ae 
* 


Quadratic Forms and the Second Derivative Test 


Let F(x, y) have a critical point at (0, 0) so that F,(0, 0) = 0 and F,(0, 0) = 0. Then. 
consider 


F(x, y) = F(0,0) +F,(0, 0)x + F,(0,0)y + 35,,(0, 0)? 
+F,y(0, 0)xy + 5 Fyy(, 0)y? + Rx, y) 


a Taylor expansion of F(x, y) with expansion point at (0, 0). The remainder term R(x, y) 
is O(r?), where r = y/x? + y?. The first derivative terms vanish at the critical point. The 
three second derivative terms in 


F(x, y) = F(0,0) + 5IFx* + 2F;xy + Fjy^] + RG, y) (33.6) 


suggest defining the symmetric matrix Q, called the Hessian of F(x, y), and the vector V 


in (33.7) 
Pex Fry |X 
a= x wen (33.7) 


(Of course, for functions with continuous second partial derivatives, Fy, = F,,.) Except for 
the multiplicative factor of 1, the second derivative terms in (33.6) are given by the product 
VTQV, an expression called a quadratic form. The matrix Q is the matrix of the quadratic 
form. 

The classification of the critical point (0,0) as a maximum, minimum, or saddle 
amounts to determining if the quadratic form V'QV is always positive, always nega- 
tive, or sometimes positive and sometimes negative. Since, to quadratic terms, F(x, y) — 
F (0, 0) + 1VTQV, if the quadratic form is always positive, the critical point is a minimum 
since positive values are being added to F (0, 0) in the neighborhood of the critical point. If 
the quadratic form is always negative, the critical point is then a maximum. If the quadratic 
form is sometimes positive and sometimes negative, the critical point is a saddle. 

If the matrix Q were in diagonal form we could tell much more easily if the form were 
positive, negative, or both, because the associated quadratic form would contain just sums 
of squares and no cross-terms such as the product x y. Our strategy, then, is to transform the 
quadratic form to a strict sum of squares. 

Since Q is a symmetric matrix, it is certainly diagonalizable with real eigenvalues. 
(See Section 32.2.) The columns of the transition matrix P are the eigenvectors that either 


x* 
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are, or can be chosen as, orthogonal. If these eigenvectors are then normalized, P will be 
an orthogonal matrix for which P^! = PT. (See Section 32.2.) Hence, the quadratic form 
becomes 


V'OV = V'P'DPV = (PV) D(PV) = W'DW 


where D is a diagonal matrix of eigenvalues A, 42 and W = ui + vj is an arbitrary vector. 
A sum of squares, the quadratic form can now be written as 


VIOV = Au? + Av? 


Clearly, if both eigenvalues are positive, the quadratic form is positive for every vector W. 
If both eigenvalues are negative, then the quadratic form is negative for every vector W. 
If the eigenvalues are of different signs, then the quadratic form can be either negative or 
positive, depending on the vector W. Finally, if one of the eigenvalues is zero, then this 
analysis fails. 

The second-derivative test for functions of two variables is based on an analysis of the 
eigenvalues in terms of the second partial derivatives. In light of the equality of the mixed 
second partials, these eigenvalues are 


A+ = 5 [Fe + Fyy Æ Js = FS» AFP, | 
and À.,A.., a product of the form (a + b)(a — b) = a? — b’, is 
pA = Fus By PT (33.8) 


This is the “test number” T of the second-derivative test. If the product of the eigenvalues 
is negative, the eigenvalues are of opposite signs; so there are vectors V for which the 
quadratic form is positive and vectors V_ for which it is negative. This means the second- 
derivative term in the Taylor expansion can either add to F (0, 0) or subtract from it, so the 
critical point must be a saddle. 

If the product of the eigenvalues is positive, then the eigenvalues are of the same sign. 
The two eigenvalues are either both positive or both negative. If they are both positive, 
then for all vectors V, the second-derivative term adds to F'(0, 0) so the critical point is 
a minimum. If both eigenvalues are negative, then for all vectors V, the second-derivative 
term subtracts from F (0, 0), so the critical point is a maximum. 

Now, what determines if the two eigenvalues are both positive or both negative? First, 
the condition 


Aya = Fu Fyy a F2, -0 


requires F,, and F,y to be nonzero and of the same sign. Certainly, the condition can’t be 
true if either F,, or Fy, is zero. If Fy, = 0 then F,, Fy, > 0, so Fy, and Fy, are of the 
same sign. If F,, Æ 0 then Fy, Fyy > p > 0, so again, FxxFyy > 0 and F,, and Fy, 
are of the same sign. 

Next, consider the sum of the eigenvalues, A, +å- = Fy, + F y. Since F,, and Fyy 
are of the same sign and the eigenvalues themselves are of the same sign, if F xx is positive, 
both eigenvalues are positive, and if Fx is negative, both eigenvalues are negative. Thus, 
when (33.8) is positive and Fx is positive, the second-derivative term is positive and adds 
to the value F(0, 0), making the critical point a minimum, and when F ,, is negative, the 
second-derivative term is negative and subtracts from F (0, 0), making the critical point a 
maximum. 


For the function f (x, y) of Example 33.5, we would have, at the critical point (0, 0), the 
Taylor expansion f(x, y) — —6xy and the Hessian Q in Table 33.1. The eigenvalues of Q 
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are A = +6, and the normalized eigenvectors of Q are the columns of P, an orthogonal 
transition matrix that diagonalizes Q via the similarity transform P™Q P, as given in Table 
33.1. Thus, there is a coordinate system in which the quadratic form of second partials 
reduces to a sum of squares; but since the coefficients on these square terms are both 
positive and negative, it is possible to find points near the critical point (0, 0) so that this 
quadratic form is positive and points near (0, 0) where the form is negative. This is the 
essence of a saddle. 


_[ 0 -6 mot.) 23 ptop-|© ? 
g= —6 0 ^xw2|-i 1 ~10 -6 
TABLE 33.1 Example 33.6: Testing the critical point (0, 0) 


The same analysis at (2, 2), the second critical point, gives the Taylor expansion 
f(x,y) =—-8+ 6X? — 6XY + 6Y2, where X =x — 2 and Y = y — 2, in which case the 
matrix of the quadratic form is Q, which has eigenvalues 6 and 18, and is given in Table 
33.2. The eigenvalues are both positive. There is a basis in which Q is diagonal and the 
quadratic form is a sum of squares with positive coefficients. As before, the similarity trans- 
formation taking Q to its diagonal form can be constructed from its eigenvectors. Thus, P 
and PTQ P, given in Table 33.2, show (2, 2) is a minimum. s 


Q= 12 —6 P- 1|-1 1 POP = 18 0 
^ |-6 12 “Aj 1 1 oF=l 6 g 
TABLE 33.2 Example 33.6: Testing the critical point (2, 2) 


Classification by Eigenvalues 


On the basis of Example 33.6, we realize that we only need to know the eigenvalues of Q 
to determine the nature of the critical point p. We therefore have the terminology in Table 
33.3. If the eigenvalues are all positive, then Q is positive definite and p is a minimum. If 
the eigenvalues are all negative, then Q is negative definite and p is a maximum. If there are 
positive and negative eigenvalues, then Q is indefinite and p is a saddle. Surprisingly, if zero 
is an eigenvalue so that Q is semidefinite, then p is minimum in the positive semidefinite 
case and a maximum in the negative semidefinite case. 


Eigenvalues Quadratic Form Terminology 
Positive (all A, > 0) x'Ox > 0 Positive definite 
Negative (all Aj < 0) x'Ox < 0 Negative definite 
Nonnegative (all A, > 0) x'Ox > 0 Positive semidefinite 
Nonpositive (all A, < 0) x'Ox <0 Negative semidefinite 
Positive and negative Positive and negative Indefinite 


TABLE 33.3 Terminology for quadratic forms 
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Second-Derivative Test for Three Variables 


Consider the function 


f(x, y,z) =x? — Oxy — 6xz — 6yz +y? +z? (33.9) 


with critical points (0, 0, 0) and (4, 4, 4). At (4, 4, 4), a Taylor expansion gives 
ff =—064+- 12x? + 12Y*-- 1227 — 6Y Z — 6X X —6XY 


where X = x — 4, Y = y — 4, Z = z — 4. The (Hessian) matrix of second partials is then 


24 —6 -6 
Q=|-6 24 —6 (33.10) 
6 -6 24 


with eigenvalues 12, 30, 30. The eigenvalues are all positive, so the quadratic form of second 
partials is positive definite (strictly positive) and the critical point (4, 4, 4) is a minimum. 


EXERCISES 33.4—Part A 


A1. Obtain the critical point for the function f(x, y) = 2x? + 3y?+ 
2x — 5y + 7xy, and determine its nature using T = fix fyy — = 


A2. For the function in Exercise A1, determine the Hessian and its 
eigenvalues at the critical point. Is the information provided by the 
eigenvalues consistent with the conclusions in Exercise A1? 


EXERCISES 33.4—Part B 


A3. Obtain the critical points for the function in (33.9). 


A4. For the function in (33.9), obtain the Hessian matrix and its 
eigenvalues at (0, 0, 0). 


AS. Verify that (33.10) is the correct Hessian matrix at (4, 4, 4) and 
that its eigenvalues are à = 12, 30, 30. 


B1. With a graph, show that f(x, y) = x? has a minimum all along 
the y-axis. Evaluate T = fix fy, — ie at any point on the y-axis. 
Does the test succeed? Obtain the Hessian and its eigenvalues at 
any point on the y-axis. Is the information from the eigenvalues 
consistent with the geometric information obtained from the 
graph of f(x, y)? 


In Exercises B2-11: 


(a) Find all real critical points. 
(b) Test each critical point with the second-derivative test based 
onT = faf, — f2. 
(c) Test each critical point by finding the eigenvalues of the 
corresponding Hessian. 
B2. f(x, yy = —y? + 12x? + 10 — 9x + 4y 
B3. f(x, y) = —4y? — x? +9 t 7xy + 12x + 9y 
B4. f(x, y) = 8y? + 12x? — 10 — 7xy + 7x — 10y 
B5. f(x, y) = —8y? - Ax +14 1d0xy — 4x + 12y 
B6. f(x, y) = —y? — 11x? — 11 - 8xy — 4xy? — 11y? 
B7. f(x, y) 2y? + 12x? — 3 + 10xy — 5x — 6y 


5 


B8. f(x, y) = 3y? + 9x? — 3 + 7xy + 10x 
B9. f(x, y) = 10? + 9x? — 1 — 8xy — 4x — 9y 
B10. f(x, y) = —2y? + 11x? — 5 + 3xy + 11x — 8y 


B11. f(x, y) = —10x?y + 3x? +44 2xy + x? + 4x 
In Exercises B12-21: 


(a) Find all real critical points. 


(b) Test each critical point by finding the eigenvalues of the 
corresponding Hessian. 


B12. f(x, y, z) = 12y? — 102 + 12 — 11x — 10x?y — 22 
B13. f(x, y, z) = 9y? — 62 + 10z — 6x? + 6 — 7x 

B14. f(x,y,z) = y? +3xz — 1 + 3x)z + 10x2? — 2y? 

B15. f(x, y, z) = 6xz — 10z? + 10xy + 7x + 12y 

B16. f(x, y, z) = 12z? — 10x? — 4yz + 9x?z — 2xyz + 7xz? 
B17. f(x,y,z) = —Sy? — z — 2z — 3x? — 1 + yz 

B18. f(x, y, z) = —9xz — 3xz? + llxy — 5x — 4y? + 3xy? 
B19. f(x, y, z) = llxz + Az? — 9z + 10x? — 12xy + 11x 
B20. f(x, y, z) = —9y? + 9x? — 11 — 9yz — llxy + 2x?z 
B21. f(x,y,z) = xz + 3z? — 6z — 4 + 12yz — 8xy 


In Exercises B22-31, find the Hessian matrix. 

B22. f(x, y) = 7xy? — 9x? y + 5x? + 2x?y? — 11x 
B23. f(x, y) = 6y? + 6xy? + 6x? y? — 3x4 — 12x? — 7 
B24. f(x, y) = 4x* + 8x?y? — x? - Ty? +4y4 — 3y 
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B25. f(x, y) = 4x?y + 5x3 y + Axy? — 6x3 — 2y? 

B26. f(x, y) = 10xy + 4y? — 12x? — 2y + 8 + 3x 

B27. f(x, y. z) = 8xy + 9x? yz — y?z + 9y + 9x 

B28. f(x, y, z) = 5xy — 2x? yz + 4y?z? + 8yz? + 5xz? + 6yz 
B29. f(x, y, z) = 3yz? — 9x?y?z — 8y2z3 — Ay?z? — 2x 

B30. f(x, y, z) = 2 —9y?e +. 62 + 4x3 yz — 2x? yz? + 9x 
B31. f(x, y, z) = 9x? y — 4x3z — xy? — Sx? yz + Ax? + 3y2? 


In Exercises B32-41: 


(a) Find Q, the (symmetric) matrix of the given quadratic form. 

(b) Verify that x'Qx generates the given quadratic form. 

(c) Find P, an orthogonal transition matrix that diagonalizes Q, 
that is, a matrix for which Q = PDP", where D is a diagonal 
matrix of eigenvalues. 


(d) Find a change of variables that reduces the quadratic form to a 
“sum of squares". 

(e) Determine if Q is positive definite (x'Qx > 0), negative 
definite (X 'Qx < 0), positive semidefinite (x'Qx > 0), 
negative semidefinite (x'Ox < 0), or indefinite. 

(f) If Q is semidefinite, either positive or negative, find a nonzero 
vector x; for which x}Qx; = 0. (Hint: The null space of Q is 
the eigenspace belonging to the eigenvalue à = 0.) 

(g) If Q is indefinite (the quadratic form has both positive and 
negative values), find a nonzero vector x; for which 
x}Qx; < 0 and another nonzero vector x» for which 
X1Qx» > 0. 

B32. x? — 6xy + 18xz + y? — 6yz + 92? 
B33. —7x? — 10xy — 7? — 22? 

B34. 8x? + 6xy + 10xz — 4y? — 6yz + 82? 
B35. 6x? — 4xy + Sy? — 4yz + 92? 


B36. —8x? — 16xy — 8xz — 7? — 12yz + 22? 
B37. 4x? — 8xy — l6xz + 4y? — 16yz + 82? 
B38. 9x? + 12xy — 12xz + 6y? — 8yz + 627 


B39. 4x? + 14xy + Axz + 4y? + Ayz + 42? 
B40. 2x? + 2xy — 18xz + 2y? + 18yz — 8z? 
B41. x? — 18xy — 6xz + 3y? + 6yz — 727 


The Rayleigh quotient for the (real) symmetric n x n matrix A is the 


function p4(x) = z. defined for x 4 0. If each matrix A in Exercises 


B42-51 has its eigenvalues ordered Aj < A < Az, 


(a) show that p4(X) assumes its maximum value at X = x3, the 
eigenvector corresponding to 43, the largest eigenvalue, and 


that the maximum value of the Rayleigh quotient is A3. Hint: 
If v = ai + bj + ck, then p4(v) is a function of a, b, c. Use 
the techniques of multivariable calculus to maximize this 
function. 


(b) show that p4(Xx) assumes its minimum value at x = x4, the 
eigenvector corresponding to A, the smallest eigenvalue, and 
that the minimum value of the Rayleigh quotient is A,. The 
maximization process used in part (a) should yield both the 


maximum and the minimum. 


= 


[12 8 8 -1 -8 -3 32 3 
B42. | 8 6 -2 B43. | -8 7 -I B44. 2 6 6 
8 -2 6 -3 -l 2 3 6 —5 
[-5 e9 <4 -6 5 -2 0 —1 1 
B45.|-9 8 9 B46.| 52 2 B47. |-1 5 4 
|-4 9 -: 22 3 1 45 
[2-1 6 -7 4 -2 
B48.|-1 9 - B49.| 4 9 — 
| 6 -1 2 -2 -6 0 
[1 4 6 -6 6 8 
B50. |4 -11 —9 BS1.| 6 7 -6 
[6 -9 1 8 -6 —6 
For the (real) symmetric n x n matrices of Exercises B42—-51, the eigen- 
values Aus = 2,..., n — 1, are characterized by the min-max principle. 
To pair the next-larger and next-smaller eigenvalues, let r = 1,..., n—2 


so that A,,_, and 4,.,; are, respectively, the rth eigenvalue smaller than 
the largest and the rth eigenvalue larger than the smallest. For each r. 
let (vi, ..., v,} be a set of exactly r arbitrary vectors. Then, An- = 
min,, y, MAXx.y,—9 Pa X) and A,,, = max... y, miny.y,-o PA (X), where 
the optimizations are restricted by x 4 0. The extreme values occur for 
the eigenvectors corresponding to the eigenvalues. For 4,,_,, the “inner” 
maximum is taken over all vectors x 4 0 orthogonal to each fixed set 
of (vi, ..., V,}. Hence, the optimal vector x is a (complicated) function 
of the vectors vz. The "outer" minimization is then taken over all possi- 
ble sets of vectors (vi, ..., v, ), with a similar explanation for 4, ;. (See 
[64] or [44] for proofs.) For the matrices in Exercises B52-61, where 
n —3,r = l, adn —r =r + 1 = 2, so that the two conditions merge, 
apply the min-max principle to find the *middle" eigenvalue and its cor- 
responding eigenvector. The “inner” extreme of p(x) is taken over all 
vectors x = xi + yj + zk that are orthogonal to v; = cii + c2) + c3k, so 
the optimization in x, y, z, constrained by cix + c? y + ¢3z = 0, could 
be performed by the Lagrange multiplier technique. The optimal x, y, z 
are thereby computed as functions of c, c». c3; and the "outer" optimiza- 
tion is computed with respect to the variables c1, c», c3. 


B52. A is the matrix of Exercise B42 
B53. A is the matrix of Exercise B43 
B54. A is the matrix of Exercise B44 
B55. A is the matrix of Exercise B45 
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Vector and Matrix Norms 


Vector Norms 


As seen in Section 31.1, the vector P = xji + x2j + x3k can be “measured” with a variety 
of vector norms, some of which were given in Table 31.1. Corresponding to each vector 
norm, we can define a matrix norm, a real number that measures some "size" property of 
the matrix. How these numbers are assigned and what they measure are the subjects of this 
section. 


Matrix Norms 


A matrix norm is a function that assigns to the matrix A, the real number ||A|| with the 
properties 


1. |l = 0. 

2. ||A|| = 0 just when (if and only if) A is the zero matrix. 
3. ||aA|| = |a@|||A]| for any real or complex scalar œ. 

4. |A- B|| x ||Al| + | || (the triangle inequality). 

5. JABI < IAT FI. 


Strictly speaking, property 5 is convenient but not necessary. We will include it in our 
requirements for a matrix norm because one of its consequences is that || A*|| < | AJ. Thus, 
if || Al] < 1, then limy_.. [| A*|| = 0. 


The Frobenius norm of the r x c matrix A whose entries are a;; is the number 


This is just the square root of the sum of the squares of the magnitude of each entry in 
the matrix. Of course, if A contains only real entries, the absolute values are not necessary. 
As an example, the Frobenius norm of the matrix A in (33.11) is | A||g = 4/313. 


—6 8 -9 
A=] 9-3 5 (33.11) 

3-2 2 
4e 

Compatible Matrix Norms 

A matrix norm || - || is said to be compatible with a vector norm || - ||v if the inequality 
(33.12) holds for every vector x in A", the space of column vectors with n real components. 
I Axllv < I|AllMIIxllv (33.12) 


Subordinate Matrix Norms 


Each vector norm in Table 31.1 defines a subordinate (or induced) matrix norm by the 
prescription 


I Alle = iux. || AxI| (33.13) 


Ix] — 
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EXAMPLE 33.8 


EXAMPLE 33.9 


That (33.13) defines a compatible norm (satisfying properties 1—5) is the content of 
theorems whose proofs can be found in [52], for example. That (33.13) is equivalent to 


Axli 
läh ae unas 
IX l|; 


is a consequence of property 3 for a matrix norm. Another consequence of (33.13) is the 
very useful 
Axle < Alle Xe 

in which the norm on the left is the same vector norm as is used on the right (for ||x||,) so 
that the matrix norm ||A||; is a bound on the factor by which the matrix A “stretches” any 
vector x. 

When the context is clear, we will drop the subscript k. 

The Frobenius norm is not a subordinate norm because there is no vector norm from 
which it is derived. 


THEOREM 33.1 


1. ||Al; = max $ |d,c|, largest column-sum of absolute values in A = (ai;]. 
€ 


2. ||Alles = max 7. , la-cl, largest row-sum of absolute values in A = {a;;}. 
t 


3. ||Al||l = Vi. where A is the largest eigenvalue of the symmetric matrix ATA. 


As a memory aid, we suggest the following. The “1” in || A||; is a vertical stroke, 
suggestive of “sum the elements down the columns,” whereas the “oo” in || A||;; appears 
to be the number 8 lying horizontally, suggestive of “sum across each row." For a proof of 
this theorem, we suggest a text such as [52] or [64]. 


In addition to || A||g = J/313 = 17.7 for the Frobenius norm, the matrix (33.11), has, among 
others, the norms | A||; = 18, || All; = 17.08, and || A||;; = 23. The norms || A||; and || Alo. 
are available by inspection. The 2-norm requires computing the eigenvalues of the (neces- 
sarily) symmetric matrix 


126 —81 105 
A'A=]-81 77 —91 (33.14) 
105 —91 110 


These eigenvalues of ATA are 0.1783, 20.93, 291.89; and their square roots are 0.422, 
4.575, 17.085.The square root of the largest eigenvalue of AT A is indeed the 2-norm of A. 


4 
Let A be the matrix on the left in (33.15), so that AT A is the matrix on the right 
I 2 T 10 14 
A= I d A A= E: ii (33.15) 


We can compute 


Ally = VÂ = V15 + 221 = 1[/34 + V26] = 29.866 25.465 —— (33.16) 
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where A is the largest eigenvalue of ATA. Alternatively, we can compute || A||2 by carrying 
out the optimization in (33.13) for the 2-norm. 
For the unit vector v — cos ti 4- sin tj, form the vector 


Av = (cost +2sint)i+ 3cost+4sint)j 
then compute and plot 
| Av|l5 = (cost + 2sint)* + (3cost + 4sin t)? (33.17) 


obtaining Figure 33.5. Using the techniques of elementary calculus, the angle at which the 


first maximum occurs is found to be t = arctan SE = 0.9569101336, and the corre- 


sponding maximum value of ||Av||2 is then v 15 + 4221, in agreement with (33.16). The 
maximum in ||Av||2 occurs for v; = 0.576i + 0.817j, so Av; = 2.211i + 4.998j. Figure 
33.6 shows both v; and Avı. (See the accompanying Maple worksheet for an animation 
showing v and Av as v rotates around the unit circle.) $ 


A 
1 st 
30 llAvIl2 Ay 


: >t 
0 1 2 3 4 5 6 -1I 
FIGURE 33.5 Graph of || Av||3 for a unit FIGURE 33.6 The 
vector v and matrix A in Example 33.9 vectors v, and Av; in 


EXERCISES 33.5-Part A 


Example 33.9 


A1. For A given in (33.11), verify that || A||p = 4/331. 
A2. For A in (33.11), verify that || Al, = 18 and that || All; = 23. 
A3. For A in (33.11), verify that ATA is given by (33.14). 


EXERCISES 33.5-Part B 


A4. Obtain the eigenvalues and their square roots for AT A given in 
(33.14). 


AS. For A in (33.15), verify that the largest eigenvalue of ATA is 


15 + 4/221. 


B1. Show that V15 + /221 = VZ + VĒ = 1(./34 + /26). Hint: 
Write v 15 + /221 = ya + Vb, square both sides, and match 


like terms. 


B2. Show that the first maximum in (33.17) occurs at / = 
arctan 254221 zs — 


B3. Show that at ? given in Exercise B2, (33.17) becomes 15 + 4/221. 


B4. Obtain v; (f) and Av; (f), where f is given in Exercise B2. 


For the vector v given in each of Exercises B5-14, obtain ||v||;, l| vllo. 
Ilvll3, and ||vllso. 

B5.v=8i1+12j  B6.v—12i—2j B7.v=8i+1]j 

B8. v = —3i-2j B9v=—S5i+12j B10. v = 7i — 9j + 3k 
Bll. v = 5i + 10j+ 11k B12. v =i -— 11j— 12k 

B13. v = 6i — 5j - 2k B14. v = —2i + 8j + 4k 
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For matrix A given in each of Exercises B15—24: (b) Sketch the level curves of |x||; = |x| + |y| = c, for 


. 0 < c < 10, being sure to include c = 1. 
(a) Obtain || Allı, || All». || A|| +, and ||A ||;;. Use an appropriate 


aro termine As Mice iere e dois iMm 
(b) "or that | Allo = VA, where A is the largest eigenvalue of sei dle Brain . mm , 
T——— PUB ned oe 

constrained optimization problem, where the constraint is 1 

lixI| — ] and the objective function to be maximized is B29. * E B30. R 1 B31. e E B32. EE ^ 


|| Ax||5. The Lagrange multiplier technique works, but a 
computer algebra system with a command for finding extrema For the matrix A given in each of Exercises B33-36: 
will be useful here. 


[2-6 8 =ġ 1 Oo. 8 (a) Obtain || A]].o. 
B15. | B16. 5 B17. -- 2x. : 
10 1 -2 6 -7 l (b) Show that the locus of points satisfying ||x||.. = 1 is a square 
T5 " 4 -1 1l 4 with side 2 and center at the origin. 
B18.| 3 5 B19. B B20.|-3 11 -6 = 
| 12 "1 La a 2 4 1 (c) Show that the vectors Xi, ..., X4 = H f | |] ; Hl ; Ki 
Fr s à ë 3 4 8 —] €t < 1, trace the sides of the square in part (b). 
B21. |-12 -1 1 B22. | 12 -3 -2 (d) Obtain Ax; and || Ax;||,. fork = 1,..., 4; show that || Ax; 
L 1 S 7 -5 5 l is maximized only when t = +1, with the sign dependent os 
[-10 12 -2 2 0 -5 the signs of the entries of the matrix A, and chosen so the 
B23. | -1 11 -9 B24. | 12 7 -9 vector norm is a maximal sum of absolute values across a n 
11 8 11 3 -T7 =5 of A. 
B25. Show that IL AI = max; z, 4t = MaXxxz9 pr (X), where (e) Show that the largest of the four norms in part (d) is the 


IxIls 

Pata (X), the Rayleigh quotient for A? A, defined for Exercises 

B42—51 in Section 33.4, has for its maximum value, the largest 10 1 -] -1 -6 8 6 7 
; ee à q ji B33. B34. B35. B36. wd 

eigenvalue of AT A. Hence, ||A ||; is the square root of the largest | 3 1 E i| | 11 A as -D 

eigenvalue of AT A. 


largest row-sum of absolute values. 


For the matrix A given in each of Exercises B37—40: 


p : Aca por Dias 
For the matrix A in each of Exercises B26—28: (a) Obtain || Alla by applying the definition || Alla = 


(a) Obtain ||A||;. maxi, || AX||4. This is a constrained optimization problem 
(b) Sketch the locus of points satisfying ||x|]; = |x| + |y] = 1 a candidate for the Lagrange multiplier technique, where the 
P JESUS EES B : vr er constraint can be taken as g(x, y) = x* + y* = 1 and the 
(c) Obtain || Ax||; for x along each segment of the locus sketched objective function as f (x, y) = |Axl|Id. 
1 art b 3 è E E A 
in part (b) l i (b) Obtain ||A||4 by applying the definition ||A||4 = maxx 
(d) Show that the maximum of || Ax || is the largest sum of This calculation can be approached as an unconstrained 
absolute values for the columns of A. optimization problem and yields to the techniques of 
5 10 —10 12 a b Itivariable calculus. 
B26. lá ES B27. E: AX B28. É | nae riable ca’ i " - M 
For the matrix A given in each of Exercises B29-32: PS e B - E 1 mS E El me E 3] 


(a) Obtain || AJ). 
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Interpolation 


Passing a curve through a prescribed set of n points is called interpolation. The numbes 
of points matches the number of free parameters that define the curve, so the interpolatioz 
problem requires solving a set of n equations in n unknowns. 


EXAMPLE 33.10 


at+tb+c=2 a=-3 
9a -—3b+c¢=4 = {b= » 
25a + 5b +c = —5 c= 


TABLE 33.4 Interpolation equations and 
their solution in Example 33.10 


EXAMPLE 33.11 


e7-W 
+e 
Y 


FIGURE 33.7 The data points from Table 
33.4 in Example 33.11 


0 


NF 


FIGURE 33.8 Deviation of data points 
from a least-squares curve 


773 


33.6 Least Squares 


Consider the problem of passing the parabola y = ax? + bx + c through the three points 
(1, 2), (—3, 4), (5, —5). Since the coordinates of each point must satisfy the equation of 
the parabola, substitution of these coordinates into the equation of the parabola leads to 
the equations on the left in Table 33.4. This set of three equations in the three unknowns 


a, b, and c has the solution given on the right in Table 33.4, so the interpolating parabola is 
y=- Brt, $ 


A Least-Squares Fit 


Far more common than interpolation is the least-squares fitting problem arising from ex- 
perimental data. Data points are acquired by experiment and some curve is passed through 
the data points in an optimal fashion. There are more points than parameters for the curve, 
so the set of equations that result are overdetermined, that is, there are more equations than 
unknowns. In fact, there is generally no solution to the set of equations, so a "solution" that 
minimizes the error of the fit is accepted as the "best fit" of the curve to the data. 


As an example, we will fit the parabola 
y(x) 2 ax? +bx +c (33.18) 


to the nine data points (xx, yy) in Table 33.5. Figure 33.7 contains a plot of these points that 
seem to fit a parabolic shape. 


TABLE 33.5 Data points for Example 33.11 


For each point, we substitute the corresponding x and y values into (33.18), thereby 
generating the nine equations 


l6a — 4b +c = —60 a-—-b+c=-—4 
9a — 3b + c = —44 c — 10 
4a — 2b + c = —21 at+b+c=3 


4a +2b +c = —5 
9a +3b +c = —15 
16a + Ab + c = —39 


(33.19) 


in the three unknowns a, b, and c. In general, we do not expect a set of nine equations in 
only three unknowns to have a solution. In fact, if the equations are written as Ax — y, the 
augmented matrix [A, y] can be reduced to the row-echelon form rref(A) in (33.20). The 
fourth row represents the equation 0a + 0b + 0c = 1 for which there is no solution. 


16 —4 1 -—60 1 0 0 0 
9 -3 1 -44 0100 
4 -Z 1 2 0010 
i-i i = 000 1 
[A,y] 2] 0 0 1 10 rref([A,y])=|0 0 0 0 (33.20) 
i 1 1 3 0000 
4à 9 1 4 0000 
U 3 1 = 0000 
16 4 1 —39 0000 


Hence, we seek a curve that is as close as possible to the points and that minimizes 
the vertical deviations from the points to the curve. (See Figure 33.8.) These deviations are 


FIGURE 33.9 Data points and 
least-squares parabola in Example 33.11 
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squared (so that positive and negative deviations don't cancel out) and added. The curve 
that minimizes this sum of squares of the deviations is called the least-squares fit of the 
curve to the data points. 

For the nine data points of Table 33.5, let $ = RA [y (xz) — yg]? be the sum of squares 
ofthe deviations from the hypothesized parabola y (x). This sum of squares, which simplifies 
to 


S = 4440a — 420b + 9c? + 60b? + 7873 + 120ac + 708a? + 350c (33.21) 


is minimized by solving the three normal equations on the left in (33.22) for the solution 
on the right. This minimization process amounts to finding the critical point (a, b, c) for S 


and gives the least-squares curve y — — ex? + ix + m. graphed in Figure 33.9. 
Las 790 
-— = ' + 2220 = ———— 
2 3a 708a + 60c + 2220 = 0 a 231 
las T 
2 = 60h -210 =0; > 4 b= -= (33.22) 
2 ðb 2 
135 TID 
zz =60a+9c+175=0 = — 
gg, rr “= 331 


— 


The minimum value of S, the sum of squares of the deviations, is then Smin = XE = 132.9 


9$. 
“Se 


Matrix Formulation 


The original nine equations in Example 33.11 are linear, as are the three normal equations, 
suggesting a matrix formulation of the least-squares problem. Let A be the matrix of co- 
efficients in the original set of nine equations, and let y be the vector of right-hand sides 
in these equations. (See (33.20).) Let M be the matrix of coefficients in the three normal 
equations, and let b be the vector of right-hand sides, provided the equations are rearranged 


as 
708a + 60c = —2220 60b —210 60a+9c = —175 


Finally, define the vector u as the vector of unknowns a, b, c. Then the normal equations 
can be written as Mu = b, where 


708 0 60 a —2220 
M-| 060 0| u-|b| b=! 210 (33.23) 
60 0 9 c -175 


A calculation would show that M = ATA and b = ATy. Thus, the original set of 
equations Au = y, multiplied through by AT, become Mu = b, the normal equations, 
since AT[Au = y] leads to AT Au = Aly, or Mu = b. The assumption that the columns 
of A are independent means M is invertible. In agreement with (33.22), the solution of 
Mu — b is found to be 


1 
u= i (33.24) 


Geometric Analysis of the Matrix A 


The matrix A has dimensions 9 x 3, nine rows and three columns. It multiplies vectors in 
R? and sends them to R°, the space of column vectors with nine real components. Matrix 
multiplication therefore defines a function from a domain in R? to arange in R?. The domain 

* 
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is called the row space, a basis of which is given by {i, j, k}, as can be seen from rref(A), 
the reduced row-echelon form of A given in (33.25). 


0 0 


— 


(33.25) 


ao So o © oo 
oooocor 
oooococoro 


0 0 


In (33.25), the three rows with the lead 1s are a basis for the row space. Here, that row space 
is all of R°. 

The range is that part of R? spanned ("reached") by the columns of A. This part of R? 
consists of all possible linear combinations of the columns of A and is called the column 
space of A. The reduced row-echelon for A shows all three columns of A are independent. 
Hence, the three columns of A are a basis for the column space of A. 

A solution to the system Au — y exists if the vector y lies in the column space of A. 
Thus, if y is a linear combination of the columns of A, then you can calculate a solution u. 
If not, then there is no solution for u. From (33.20), we know that y is not in the column 
space of A. 


Rank of a Matrix 


The number of independent rows or columns in a matrix is called its rank. Generally, texts 
define “row rank" as the number of independent rows and then prove that the “column rank" 
is the same. Hence, the "rank" of the matrix is a unique number. 

The rank is therefore the number of basis elements in a basis for the row space. A basis 
for the column space would have the same number of elements. Thus, the rank of the matrix 
A is 3 because rref(A) has three nonzero rows. If the rank of A is 3 but the rank of the 
augmented matrix [A, y] is 4, then it is clear that one equation in the reduced row-echelon 
form of the augmented matrix must be the inconsistent equation 0 = 1. This is a clear signal 
that the system Au — y is inconsistent and, therefore, has no solution. In other words, y is 
not in the column space of A, so no u can be found that A sends to y. 


The matrix 


—85 -55 -37 -35 97 50 79 
A= 56 49 63 57 —59 45 —8 
—93 92 43 —62 77 66 54 


has rank 3. Since A has three rows and seven columns, the rank is as large as it can possibly 
be and A is said to be of maximal rank. The reduced row-echelon form of A is 


10 0 172316 423736 340237 124109 

409017 409017 409017 136339 

318673 130444 515992 139681 
0 10 409017 409017 409017 136339 (33.26) 
00 1 464750 95063 995915 201647 

409017 409017 409017 136339 


so a basis for the row space consists of the vectors forming the three rows of rref (A), or the 
three rows of A itself. 

The column space is all of R?. A basis for it is given by (i, j, k}, as can be seen from 
the first three columns of rref (A) given in (33.26). E 
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EXAMPLE 33.13 The matrix A on the left in (33.27) has rank 2, as seen from its reduced row-echelon form 
given on the right in (33.27). 


—28 28 —15 5 —10 —9 -—6 19 19 19 19 
31 —31 20 -10 15 13 7 0.0 1-38 $ EZ 3 
24 —2A F -15 a 15 à 0 0 0 0 0 0 
v B 3 oH c 0 0 0 0 0 0 0 
6 o =F B = = 3 0 0 0 0 0 0 0 


(33.27) 


The reduced row-echelon form of A tells us that there are two independent rows in A. Since 
we don’t know which two of the five rows of A are independent, we select the two nonzero 
rows of rref(A) The reduced row-echelon form of A also says the first and third columns 
of A are a basis for the column space of A. The first and third columns of rref (A) are not a 
basis for this column space. 


Null Space The matrix A on the left in (33.27) is 5 x 7, that is, it has five rows 
and seven columns. Not all the rows are linearly independent. In fact, since A has rank 2, 
there are only two independent rows. Now A maps R7 to R5. The domain space for A is a 
two-dimensional subspace in R’ spanned by, for example, the basis vectors rı and rz given 
on the left in (33.28). The matrix A maps the remaining portion of R’ to 0, the zero vector 
in R?. This part of R” is called the null space of A. Any vector x in the null space of A 


satisfies the equation Ax = 0. A basis for the null space of A, (nj, k = 1,..., 5}, is given 
on the right 

0 l 5 3 3 

0 -1 73 2 2 2 1 

1 0 0 0 0 0 1 

28 10 0 0 0 1 0 

$ P 1 0 0 o| |0 (33.28) 

22 5 

19 ^ 19 0 1 0 0 0 

17 _ 3 0 0 1 0 0 

19 19 25 ïi ET _19 0 

5 3 2 2 2 

19 19 


A calculation shows that An; = 0, k = 1,...,5; and another calculation shows that 
for j = 1,2, the dot products rj + nj, k = 1,...,5, all vanish. Hence, the vectors in the 
row space are perpendicular to the vectors in the null space. (Since the basis vectors for 
the row space are orthogonal to the basis vectors for the null space, the row space itself is 
orthogonal to the null space.) The action of A on vectors in R7 is shown in Figure 33.10. 


R7 R° 
Row space of A Column space of A 
dimension = 2 dimension = 2 


Null space of A Null space of AT 
dimension = 5 dimension = 3 


FIGURE 33.10 The four fundamental subspaces for A in Example 33.13 


In the sense just discussed, the row space of A, of dimension 2, is orthogonal to the 
null space of A, of dimension 5. The matrix A maps R” to R5 and takes vectors in the null 
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space of A to the "origin" in R?. The row space of A is mapped to the column space of A 
in R?. The column space, of dimension 2, is orthogonal to the rest of R5, which turns out 
to be the null space of the transpose of A. Clearly, if the column space in R? has dimension 
2, then the orthogonal complement of the column space must be of dimension 5 — 2 — 3. 


These four subspaces are called “the four fundamental subspaces of A” in the literature. 
4e 


Geometric Interpretation of Least Squares 


The least-squares problem Au — y, having the 9 x 3 matrix A defined in (33.20), has an 
interesting geometric interpretation. The matrix A maps R? to R?. The vector u is in R?, and 
the vector y is in R?. Because y is not in the column space of A, there is no solution u. What 
the least-squares solution provides, however, is that vector u that maps to the projection of 
y onto the column space of A. Because A is of maximal rank 3, the row space of A is all 
of R? and the null space of A is empty. All of R? maps to the three-dimensional column 
space of A over in R°. The vector y, in R°, has a vector component in the column space of 
A and a vector component in the orthogonal complement. Figure 33.11 summarizes these 
observations. 


R R? 
Row space of A Column space of A 
dimension = 3 dimension = 3 y 
u 
Py 


Part of R? orthogonal 
to column space of A 


dimension = 6 


FIGURE 33.11 Fundamental subspaces for A in Example 33.11. Also shown 
are the projections of y onto, and orthogonal to, the column space of A 


Analytic justification for the observations captured in Figure 33.11 begins with form- 
ing the projection matrix P = A(ATA)^! AT, which projects vectors in R° onto the three- 
dimensional column space of A. 


109 21 9 1 1 2, 7% 2 d: 

165 55 55 165 I 55 165 55 55 

21 46 21 13 2 1 t 17 1 

55 165 10 10 33 55 110 330 55 

9 21 232 149 13 293 26 — 1 17 

55 10 115 770 77 2310 385 110 165 

l 13 149 268 18 — 153 293 1 F 

165 110 770 1155 7" T0 230 55 55 

P= 1 2 13 18 59 18 13 À — i 
= 11 33 T T 23 TI 77 33 i 
7 1 293 153 18 268 149 13 d 

55 55 2310 770 7] 1155 770 i 165 

17 ] 26 — 293 13 — 149 232 21 9 

165 110 385 2310 T TO 15 110 55 

l 7 1 1 2 13 21 46 21 

55 330 110 55 33 110 110 165 55 

4 2 i _7 1 1 9 21 109 
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The projection of y onto the column space of A is then Py, and the vector component 
of y orthogonal to the column space of A is yi;4] = y — Py = U — Py. 


2.19 
] 59 
2503 is 
66 401 
66 
— i? 28 
77 
_ 349 67 
154 ^ 184 
775 — | 1535 
Py 231 Jua = |. 231 
529 —.67 
i54 154 
à . 129 
— 256 77 
77 
127 
"dli 66 
66 E" 
411 I 


The minimum value of S, the sum of squares found by the least-squares technique, was 


30705. which is also the value of [|y ;(4;||?. The least-squares solution (33.24) is the vector 
231 Yita q 


in R? that A maps to Py, the component of y lying in the column space of A over in R°. 
This is verified by showing Au — Py. We summarize the solution process as follows. 


1. The least-squares problem consists of the overdetermined system Au = y. 

2. Multiplication by AT gives the normal equations A Au = ATy or Mu = b. 

3. The 3 x 3 matrix M = ATA is invertible, so u = (ATA)! ATy is the least-squares 
solution. 


We summarize the analysis of this solution process as follows. 


The matrix A maps u = (ATA)! ATy to Au = A(ATA)-! ATy = Py. 


2. The vector Py is the projection of y onto the column space of A over in R?. 
3. The least-squares solution u is the vector in R° mapped by A to Py, not y. 
4. The vector b = Aly is the pre-image in R? of Py. 
5. The matrix M = AT A maps u in R° to b in R°. 
6. Solving the normal equations Mu — b finds the u in R? that A maps to Py in the 
column space of A over in R?. 
EXERCISES 33.6—Part A 
A1. Verify the equations and solution in Table 33.4. A4. For Example 33.11, verify that the solution in (33.22) gives 
A2. Verify the equations listed in (33.19). Smin = me 


AS. Verify that the solution of Mu — b determined by (33.23) is given 
by (33.24). 


A3. Verify the equations and solution in (33.22). 


EXERCISES 33.6—Part B 
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B1. Obtain the reduced row-echelon matrix in (33.20). 
B2. Obtain S in (33.21). 
B3. For the 9 x 3 matrix A in Example 33.11, obtain the projection 
matrix P = A(ATA)-! AT, and show that A'y = AT(Py) = b. 
In Exercises B4—8, interpolate the parabola y = ax? + bx + c through 
the given set of points. Plot the points and the interpolating parabola. 
B4. {(—8, 9), (—6, 7), (3,5)} BS. {(—12, 5), (—2, —10), (11, 11)} 
B6. {(2, —3), (6, —9), (8, —2)} B7. ((—3, 1), (—2, 12), (6, —8)} 
B8. {(—8, 6), (6, —5), (7, 1)} 
In Exercises B9-13, interpolate the cubic y = ax? + bx? + ex +d 


through the given set of points. Plot the points and the interpolating 
cubic. 


B9. ((—11, —8), (—10, 1), (0, —8), (9, 4)] 
B10. ((—12, 12), (—9, 11), (6, —4), (11, 2)] 
B11. ((—12, 0), (—3, —8), (1, —4), (11, —2)} 
B12. ((—1,2), (2, —12), (7, —10), (10, —6)} 
B13. ((—11, —4), (—8, —2), (—6, —5), (—4, 


12)} 
For the set of data points given in each of Exercises B14—23: 


(a) Write the equations that arise from fitting the parabola 
y = ax? + bx + c to the data. 


(b) Put the equations in part (a) into matrix form Au — y, where 
Aisanr x c matrix. 


(c) Use the reduced row-echelon form of the augmented matrix 
[A, y] to show that the equations in part (a) are inconsistent. 


(d) Find the rank of A and the rank of [A, y]. 

(e) Obtain S = } A[yGu) — y. F^, the sum of the squares of the 
deviations of the data from the target parabola. 

(f) Using calculus, minimize S' to obtain the least-squares 
solution. 

(g) Obtain Smin, the minimum value of S. 


(h) Obtain the normal equations A" Au = ATy — b and, from 
them, the least-squares solution. 

(i) Obtain P = A(ATA)-! AT, the matrix that projects vectors in 
R” onto the column space of A. 


(j) Use the reduced row-echelon form of [A, Py] to show that 
the equations Au — Py are consistent. 


(k) Obtain the least-squares solution by solving the system 
Au — Py. 

(D Find yia] = y — Py, the component of y orthogonal to the 
column space of A. 


(m) Show that ||y — Py||? = Smin- 
(n) Sketch the data points and the least-squares parabola. 


(0) Sketch a figure analogous to Figure 33.11. 


B14. 


B15. 


B16. 


B17. 
B18. 


B19. 
B20. 


B21. 
B22. 


B23. 


(—4, 85), (—3, 55), (—2, 14), (—1, 25), (0, 23), (1, 45), 
2, 30), (4, 176), (5, 228)} 

(—4, 149), (—2, 26), (—1, 
4, 109), (5, 218)] 


5), (0, —18), (2, 6), (3, 54), 


(—5, —7), (—4, 1), (-3, 


(—5, 162), (—3, 54), ( 
4, 78), (5, 159)} 


(—5, 6), (—4, 11), (—2, 13), (0, 6), (1, 4), (4, —21), (5, —47)} 


(—5, 147), (—2, 44), (—1, —26), (0, 8), (2, 48), (3, 95), 
(4, 183), (5, 277) 


{(—5, 45), (—2, —4), (—1, —5), (1. 16), (2, 13), (3, 25), (5, 60)} 


7), (0, 8), (1, 1), (4, —23), (5, —27)} 
2, 36), (—1, 20), (2, 12), (3, 62), 


{(—4, —64), (—3, —36), (—2, —14), (—1, —15), (2, 5), (3, 6), 
(4, 16), (5, —4)} 
{(—5, —105), (—2, —17), (—1, —12), (0, —22), (1, —16), 


(2, —26), (4, —102)) 


For the set of data points given in each of Exercises B24—33: 


(a) Write the equations that arise from fitting the cubic 
y — ax? + bx? + cx + d to the data. 

(b) Put the equations in part (a) into matrix form Au — y, where 
Aisanr x c matrix. 

(c) Use the reduced row-echelon form of the augmented matrix 
[A, y] to show that the equations in part (a) are inconsistent. 

(d) Find the rank of A and the rank of [A, y]. 

(e) Obtain S = 377 [y Gu) — xF^. the sum of the squares of the 
deviations of the data from the target cubic. 


(f) Using calculus, minimize $ to obtain the least-squares 
solution. 


(g) Obtain Smin, the minimum value of S. 


(h) Obtain the normal equations AT Au = ATy = b and, from 
them, the least-squares solution. 

(i) Obtain P = A(AT A)! AT, the matrix that projects vectors in 
R” onto the column space of A. 


(j) Use the reduced row-echelon form of [A, Py] to show that 
the equations Au — Py are consistent. 


(k) Obtain the least-squares solution by solving the system 
Au — Py. 


(D) Find yita] = y — Py, the component of y orthogonal to the 
column space of A. 


(m) Show that |y — Py||? = Smin- 
(n) Sketch the data points and the least-squares cubic. 


(0) Sketch a figure analogous to Figure 33.11. 
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B24. ((—2, 194), (—1, 133), (0, 81), (1, 169), (2, 181), (3, —156), we k E "€ we 
(4, —449), (5, —693)} 30 (25 59 35 12 
B35. | 7 aa : 
B25. ((—5, —828), (—4, —499), (—1, 178), (0, —196), (1, 34), 6 37 56 -34 -12 
(2, 183), (4, 414), (5, 1098)} 3 -14 -1 20 25 
L. 97 23 25 8 1 
B26. ((—5, 345), (—4, 269), (—2, 32), (—1, 7), (1, 55), (3, —26), - 
(5, —571)) 9 5 $ 7T TY EB 
—2 -—1 -7 -9 4 1 
B27. ((—5, 450), (—4, 416), (—3, 275), (0, 93), (3, —144), B36.| 3 2 7 9 5 4 
(4, —450), (5, —919)) Ü 9 e$ e = ý 
B28. ((—3, 56), (—2, 35), (—1, —28), (0, —40), (1, 42), (2, 14), Ga os e$ Box g 
(5, 481)) [ 13 —25 B 2 41 -18 
29 —27 —] 12 51 —32 
B29. ((—5, 1022), (—4, 594), (—1, 25), (0, 91), (2, —19), mm ile - o os xi - 
(3, —243), (4, —478), (5, —766)) —21 13 -13 -2 —57 2 
B30. ((—5, —339), (—4, —65), (—1, —64), (1, —111), (4, 470), L-36 79 -15 9 3 A 
(5, 806)} r 30 7  —36 —8 60 
B31. {(—3, —443), (—1, —161), (0, —236), (1, —185), (2, 29), $5 ae 2 B 
(3, 88), (4, 511), (5, 888)} B38. | o0 as 531 077 
B32. {(—4, 575), (—3, 271), (—2, 245), (—1, 186), (0, —122), 46 21 -30 -2 50 
(1, 135), (4, —396), (5, —919)) -55 —44 39 11 -43 
B33. {(—5, 913), (—4, 752), (—3, 256), (—2, —137), (0, —125), Poel a ; o: E 
(1, 179), (2, 43), (3, 48)} "MM. 
B39.| 2 = 5 e 
For the r x c matrix A in each of Exercises B34—43: —10 14 2 -14 2 
mE 0 49 -3 -44 -28 
(a) Find the rank. L=3 -35 -3 31 23 
(b) Obtain a basis for the row space. [235 2 | cED 830 7 
—29 8 79 13 15 18 
(c) Obtain a basis for the null space. B40. | -16. —31 64 52 24 —18 
(d) Obtain a basis for the column space. | 33 8 51 -3 -9 6 
—]15 18 71 20 30 23 


(e) Obtain a basis for the null space of AT, the orthogonal 


complement of the column space of A. )- 


6 
4 
(f) State the dimensions of the four fundamental subspaces. B41. | 11 11 33 16 13 32 
5 
2 


(g) Show that the dimension of the row space, plus the dimension 


11 
of the null space, equals c, the number of columns in A. 


(h) Show that the dimension of the column space, plus the 45 9 29 3 
dimension of the null space of AT, equals r, the number of B42 13 32 16 =22 
rows in A, E: 2 —20 -4 16 
. $ é = e — 
(i) Show that the row space is orthogonal to the null space, that is, n s : E 
show the vectors in part (b) are orthogonal to the vectors in = E 
[-9 -10 -12 -3 1 16 
part (c). 13 26 3 1 1 32 
= — 260 —22 34 
(j) Show that the column space is orthogonal to the null space of B43. —37 8 B 45 6 28 
AT, that is, show the vectors in part (d) to be orthogonal to the L 34 6 5 26 -5 36 


vectors in part (e). ; 
K In Exercises B44—48: 
(k) Sketch a figure analogous to Figure 33.10. 


(a) Show that the equations Au — y are inconsistent. 


9 7 1 -8 -3 
3 2 5 6 7 (b) Obtain the least-squares solution by solving the normal 
Ba4, | 4^ -5 0 -4 -4 equations AT Au = Aly = b. 
: 8 —-—5 5 1 -1 y ; 
3 9 4 5 1 (c) Show that the equations Au = AT are consistent and have 
6 9 1 2 —2 for their solution the same vector u as found in part (b). 


FBE 2 ei d 1 

9 B 8 1 5 

B44. A—- | 2 0 -5 12| y=] 10 
T 9 $ = 11 

Ls -11 0 10 —10 

r-10 12 -12 -5 = 

a5 28 HO 8 ei 

=2 8 1 1 =3 

B45. A—| i1 12 12 n y=| 4 
-j2 7 -ji 12 —6 

L 10 1 3 7 8 


Chapter Review 


1. If A = [; 7], obtain det A, A~', and the eigenvalues of A. Write 
the characteristic polynomial for A. What is the rank of A? 

2. For each, answer true or false. If false, explain why, and where 
possible, correct the statement. 
(a) The product of symmetric matrices is symmetric. 
(b) The product of orthogonal matrices is orthogonal. 
(c) The product of nonsingular matrices is nonsingular. 
(d) The product of invertible matrices is invertible. 
(e) The determinant of a product is the product of the determinants. 
(f) The transpose of a product is the product of the transposes. 
(g) The transpose of a sum is the sum of the transposes. 
(h) For matrices, the inverse of a sum is the sum of the inverses. 


(i) The transpose of the inverse is the inverse of the transpose, 
provided the inverses exist. 


(j) For matrices, the inverse of a product is the product of the 
inverses in the reverse order. 
3. Find the eigenpairs of A = [; {]. Orthogonally diagonalize A. 
Write the characteristic polynomial for A. If y = [2 3]T, use 


Cramer's rule to solve Ax — y for x. 
4. Given A = 3i + 2j and B = 7i — 5j, find the components of A 
along and orthogonal to B. 
. Given A = [3 —2 4], B-[6 —1 1]’, andC=[5 3 —2]', 
find the projection of C onto the subspace spanned by A and B. 
What is the component of C orthogonal to this subspace? 


Un 


6. Are the vectors A, B, C of Question 5 linearly dependent or 
independent? Why? 

7. Apply the Gram-Schmidt process to orthogonalize A, B, and C, 
the vectors in Question 5. 


8. What is the quadratic form determined by the matrix A in Question 
3? Is this form positive definite? Why? 
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11 12 6 —8 
7 -11 -12 —12 
B46. A = _6 8 = y= Ee 
—] 4 —1 10 
—2 9 12 
8 10 —2 
B47. A= 4 1 Yy-—|.5 
8 -3 7 
—11 0 9 9 
—2 11 -—7 —2 
B48.A=| -9 4 -6 y=|-12 
12 -3 -10 6 
3 -2 -ll —5 
9. Let (a, b, c) be a critical point of the function f(x, y, z). Describe 


13. 


14. 


15. 


16. 


a "second-derivative test" for determining if the critical point is a 
maximum, minimum, or saddle point. 


- Apply criterion in Question 9 to the critical point of the function 


f(x, yz) = 2x? — 3y? + 5z* — Tx + 6y + 2z — 1. 


. Define the two-norm for the matrix in Question |. Describe how to 


compute this norm. 


. Obtain the one-norm and the infinity-norm of the matrix A in 


Question 1. 


Obtain the frobenius norm of the matrix A in Question 1. 


39 —49 -19 -52 

; ; 4 = -47 
Given the matrix A — e = E `- 
57 -54 -3 -709 


(a) Obtain the reduced row-echelon form of A. 

(b) Find the rank of A. 

(c) Find a basis for its null space. 

(d) What is the most general solution of the equation Ax — 0? 

(e) Find a basis for its column space. 

(f) Find a basis for its row space. 

(g) Draw a diagram to show how the row space, null space, and 
column space are related. 

(h) Obtain the least-squares solution to Ax — y, where 
y 2 [-1 2 4 3]. 

(i) Demonstrate the relationship between the least-squares solution 
found in part (h) and the null space. 

Obtain the least-squares quadratic function that best fits the points 

{(—2, 3), (71, 0), (0, —1), (2, 0)}. 


For the data in Question 15, obtain the least-squares fit using the 
functions (1, cos x, cos 2x]. 


Chapter 34 


Matrix Factorizations 


| INTRODUCTION The organizational principle of matrix factorization struc- 
| tures this chapter. Integers can be uniquely factored as a product of prime numbers. Matrices 
can be factored in a variety of ways as a product of matrices with different properties. These 
different factorizations, or decompositions, reveal different aspects of matrix algebra and 
are useful in different computational arenas. 
The factorization called the LU decomposition can be obtained as a by-product of 
Gaussian elimination. The row reductions that yield the upper triangular factor U also yield 
the lower triangular factor L. This decomposition is an efficient way to solve systems of the 
form Ax — y, where the vector y could be one of a number of right-hand sides. In fact, the 
Doolittle, Crout, and Cholesky variations of the decomposition are important algorithms 
for the numerical solution of systems of linear equations. 
| In Sections 12.16 and 12.17 we uncoupled systems of differential equations by diag- 
onalizing a matrix, obtaining the similarity transformation A = PDP™!. This is another 
example of a factorization, one for which the most general form is A = PJP^!, where J 
is a Jordan matrix rather than a diagonal matrix D. The Jordan matrix is a diagonal matrix 
with some additional 1’s on the superdiagonal, the one above the main diagonal. For some 
matrices, the Jordan matrix is as close to diagonalization as can be achieved. 
| The QR decomposition factors a matrix into a product of an orthogonal matrix Q and 
l an upper triangular matrix R. It is an important ingredient of powerful numeric methods 
| for finding eigenvalues and for solving the least-squares problem. The QR algorithm for 
| finding eigenvalues is discussed in Section 34.4 and also in Sections 45.3 and 45.4 where 
| some of its more numerical aspects are treated. 

The singular value decomposition factors a matrix as a product of three factors, two 
being orthogonal matrices and one being diagonal. The columns in one orthogonal factor 
are left singular vectors, and the columns in the other orthogonal factor are the right singular 
vectors. The matrix itself can be represented in outer product form in terms of the left and 
right singular vectors. One use of this representation is in digital image processing. 

Finally, we use the least-squares problem to motivate the pseudoinverse. As seen in 
Section 12.7, not every square matrix has an inverse. And no inverse has been defined for 
matrices that are not square. Yet, the equation Ax = y represents a mapping of vectors 
from one space to another, and the question of reversing the map is certainly valid. The 
pseudoinverse inverts these maps in the sense of least squares and can be constructed from 
the factors of the singular value decomposition. 
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EXAMPLE 34.2 


34.1 LU Decomposition 783 


LU Decomposition 


Decompositions of LU Type 


The similarity transform that diagonalizes the matrix A is represented by the equality 
P-!AP = D, where the transition matrix P has the eigenvectors of A for its columns 
and the entries on the diagonal of the diagonal matrix D are the corresponding eigenvalues. 
If this equation is rewritten as A = PDP~', then A is said to be factored into the product 
of the three matrices P, D, and P^. This is but one of a number of ways the matrix A can 
be factored, or decomposed. 

In this section we study several LU decompositions in which the matrix A is factored 
into the product of L, a lower triangular matrix, and U, an upper triangular matrix. There 
are at least four different versions of this decomposition, and often the phrase “LU” can 
refer to any one of the four. The four possible decompositions to which the generic “LU” 
might refer, along with the related Cholesky decomposition, are collected in Table 34.1. 


Doolittle L,U 1’s on main diagonal of L 

Crout LU, 1’s on main diagonal of U 

LDU L,DU, 's on main diagonals of L and U 
D is a diagonal matrix 

Gauss LIDL! A is symmetric, l’s on main diagonal of L 
D is a diagonal matrix 

Cholesky RRT A is symmetric, positive definite 


R = L, D, with D a diagonal matrix 


TABLE 34.1 A spectrum of “LU” decompositions 


Doolittle decomposition The matrix A and its Doolittle factors L; and U are given in 
(34.1), where we see that A = LU. 


o3 14 8 ] ü üTqr-3-1 d 5 
SA 52 l o 0|[| 0-3 4 -7 

&5|3 7 3 s|^| ta i pjo gog g| $955 
2-4 4 -3 2 14 7 113 


By definition, the lower triangular matrix L; has 1’s on and 0’s above the main diagonal. 
Again by definition, the upper triangular factor U has 0’s below the main diagonal. (A 
memory aid: Doolittle contains the letter “/” and the factor L;. Crout contains the letter “u” 

* 


and the factor Uj.) de 


Use ofthe LU decomposition Let A and its Doolittle decomposition be as given in (34.1), 
and consider the system Ax = y where y is the vector y = [2 0 —2 1]!. Write Ax = y as 
LiUx = y. Let c = [cy c» c3 c4]', and set c = Ux, the original system reads Lic = y, 
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as seen in (34.2). 


1 0 0 lfa 2 
1 1 0 Gl, 0 
zl s 34.2) 
P x allal" i 
2 u I 1| Lea l 
3 9 20 


The rows of (34.2) are solved from the top down, in a forward sense, as shown in 
(34.3). The kth equation yields c; because at that point, cj, i = 1,...,k — 1, are known. 
This process is called forward substitution. 


C= 2 ei — 2 
cj 6€; —0 C2 = —-c; = —2 si 
ic — fc 4062-2 E c2-2t$0-i02-2 Tem 
-łc + Be — Ses +4 = 1 c4 — 10-3565 — fat icq =F 


Once the vector c is known, x is obtained as the solution of the system Ux = c in 


(34.4). 
—-3 -1 ] 3i xi 2 
0 —3 d E p —2 
0 0 4 2 s E - (34.4) 
0 0 0 1B X4 al 


This time, solve the equations in the reverse order, from bottom to top. The equations, and 
the solution process that solves them, is shown in (34.5). The solution process is called back 
substitution and was seen in Section 12.5. 


_ AT3X)—od& Sra _ 25 


li = = 226 
—3x; — x2 + x3 + 5x4 = 2 —2 — 4x3 + 7x4 292 
X2 — = 
—3x2 + 4x3 — 7x4 = —2 -8 226 
2 2¢ > 2_ 2 34.5) 
gx +54 = -F y= a _ I8 
- = 40 = 
Ig, E a ^ 226 
2 84 
“= ~ 356 
1 D 
Crout Decomposition 


The Crout decomposition can be obtained from the Doolittle decomposition by factoring ou: 
a diagonal matrix D from U to obtain the factorization L; DU;. The factor D is combined 
with L; to form L = L; D, and the Crout factorization is then 


A= L,U = L1(DU|) = Lı DU; = (Lı D)U; = LU, 


34.1 
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The diagonal matrix D has Uj; as its diagonal elements, and U; = D-!U. The product 
U = DU, is 


A 1 g a © ¢€ gh 4- 4 
0 -3 4 -7 o -3 o ojjo 1-4 7 
40 2| = 40 j 

0 0 F 45 P 9 y File 4$ 1 2 
113 3 

0 0 0 $ 0 0 0 Billo g o 4 

The complete Crout decomposition is then 

1 1 5 

—3 -1 1 5 re ee d s-s- 

eR oe 3 =2 -3 -3 0 O;|o 1-i 4 

- 153 á| |4 $ 7 "la na 1 2 
9. A 4 -3 14 14 113 

2-3 -y wllo 0 0 1 


Cholesky Decomposition 


When A is symmetric and positive definite, it has a Cholesky decomposition of the form 
A = RR’ where R is lower triangular, so RT is upper triangular. 

One way to build a symmetric positive definite matrix A is to start with the symmetric 
matrix M and compute A — M MT, as shown in (34.6). 


3-8 4 af $—5 4 A 50 2 8-5 
"CANTE à S5 d 3 

A=) 4 oa o|| 4 oa 0|^| s-r 17 16| 849 
kp dd] 4-1 d = -5 2 16 42 


We see by inspection that A is symmetric, and since the eigenvalues are 3.77, 35.15, 51.61, 
53.47, we are assured that A is also positive definite. The Cholesky factorization is then 


A = RR’, where R is given by 


54/2 0 0 0 

v2 34/97 
T s 89 0 

R= i 
4/2 308.97 . 4/963.113 0 

5 1455 291 
1 dd 4704 605 
42 97 963,113 19,858 


The Cholesky decomposition can be obtained from the Lı DU; factorization if D is 
written as D4/D. (If the diagonal elements of D are U;;, then the diagonal elements of 


JD are VU.) Hence, we have 


A = L4DU; = Li DA DU, = (L4 D DU) = (Li D(UTN D) 


and since Ur = L; when A is symmetric, we finally have A = RR", where R = Li D. 
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We leave it to the reader to verify that 


l 0 0 0o] [5⁄2 0 0 0 

L 10 Ø ollo 827 o 0 
nvP-5 i om a oo o XB o ^^ 

T p a l 0 0 0 JS 


When A is symmetric, U} = Lf, soA=L,DU, = Ey, Dit, and we have the Gauss 
decomposition of Table 34.1. 


Decomposition by Brute Force 


Some insight into the nature of matrix factorizations is obtained by factoring A into the 
product LU by the following “brute-force” technique. Write A as the product 
=|% 1 0 0|| 0 Un U» Ux (34.7) 
~ [Z3 L3 1 0/110 0 Us Ua ' 


La La La 1 0 0 0 Uyu 


which yields 16 equations in the 16 unknowns {L;j,i = 2,...,4,j = 1,...,i — 1} U 
(Ui, = 1,..., "m EE 4}. For example, if A is the symmetric matrix in (34.6), the 
solution of these equations yields the factorization 
1 0 0 01 [50 2 8 —5 
l 873 308 9 
A= 4 5 PA 
4 308 9929 1568 
25 873 l 0 0 0 873 97 
l 5 14,112 366,025 
^10 ^97 9929 l 0 0 0 19,858 


We also see why there is a multiplicity of LU decompositions. If n = 4, there are 
n+) — 10 nonzero entries in an upper triangular or lower triangular matrix. The product 
in (34.7) yields n? = 16 equations, but there could have been as many as 10 + 10 = 20 
unknowns. We obtained a determinate system by choosing the diagonal elements in L to 
be 1, reducing the number of unknowns in L to ARED, = 6. Without such a choice, the 
solution for L and U would have contained arbitrary parameters. 


Elementary Matrices 


We next consider elementary matrices as devices for recording the individual transforma- 
tions applied to a matrix A during Gaussian elimination. Letting r represent row k, we list 
the following three types of elementary transformations used in row-reducing a matrix A 
by Gaussian elimination. 


1. Interchange two rows of A. 


2. Replace r with crz, that is, replace row k with c times row k. 


3. Replace r; with the sum r; + cr;, that is, add to row j, row i times the scalar c, called 
the multiplier. 


Each of these three elementary operations can be respectively represented by a matrix 
Ey, k = 1,2,3, so that the matrix product E;,A gives A subjected to the corresponding 
elementary Gaussian transformation. For each type of elementary transformation, the ele- 


€ 
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mentary matrix E; is just an identity matrix with the elementary operation performed on it. 
For added clarity, we write E; as E3(i, j, c). We illustrate using the matrix 


j| 4 dd 3 2 
3 5 4 -8 2 
á= 1 5 4 =e 
4 6 -4 +3 0 
©- 5 1 5 


The elementary matrix £, that records the interchange of rows 2 and 5 and its effect 
on A are 


1 0 0 0 0} ]1 4 6 —-3 -2 1 4 6 —3 -2 
0.0 0 0 1|143 5 4 —6 2 0 —1 2 1 3 
EjA-|001001||5 -1 5 4 —5|2|5 -1 5) 4 —5 
000 1 OJ }4 0 —4 -3 0 4 0 -4 -3 0 
01 00 0;}0 -I1 2 1 5 3 5 4 —6 2 


The elementary matrix £» that records multiplying the third row of A by s and its effect 
on A are 


10000 1 4 6 —3 -2 l 4 6 -3 -2 
0 1 00 0/13 5 4 —6 2 3 5 4 —6 2 
E,A—-|0. 0 s 0 0|1|5 -I 5 4 —5|2|5s -s 5s 4s —5s 
0.00 1 0||4 0 —-4 -3 0 4 0 —4 -3 0 
0 0 00 1 0 -1 2 l 5 0 -1 2 1 5 
The elementary matrix £3(1, 2, —3) that adds —3 times row 1 to row 2 and its effect 
on A are 
1 0 0 0 0 1 4 6 -3 -2 1 4 6 -3 -2 
—3 1 0 0 0 9 5 4 -6 2 0 —-7 -—14 3 8 
E3(1,2, —3)A = 0.0 1 0 0 5 -1 5 4 —5|2|5 -1 3 4 —5 
0 0 0 1 0 4 0 —-4 -3 0 4 0 —4 -3 0 
0 0 0 0 1 0 -1 2 l 5 0 -1 2 1 3 


The elementary matrix E;(1, 2, —3) pivots on the element a11, thereby replacing a2; by zero. 
The multiplier is —3, and the notation r2 — r2 — 3r, captures the effect of E3(1, 2, —3) 
on A. 


i 8 4 
The matrix A — E -1 | can be row-reduced to an upper triangular matrix U by 
3 0 2 


applying the three elementary transformations contained in the matrices £3(1,2, —2), 
E3(1, 3, —3), and E3(2, 3, — 2). Indeed, E3(2, 3, —2)E3(1, 3, —3)E3(1, 2, —2)A = TA = 
U, as shown. 


1 0 0 100 100][1 3 4 1 3 4 
90 1 O/] 6 1 0||]-2 1 0||2 —-1 1i1|25|0 -7 -7 
0-2 1{[-3 0 1 0 0 1|[[3 © 2 0 0 -1 


The matrix T = E3(2,3, —2)E3(, 3, —3) Ex(1, 2, —2), capturing the totality of the 
reduction of A to U, the matrix T~!, and L, a 3 x 3 identity matrix in which zeros have 
been replaced with the negatives of the corresponding multipliers used in the reduction of 
A to U are 


1 0 0 0 0 100 
f=|-2 1 0) p32|[2 10| ga|£ 1 8 
-$ -3 3 $ 1 3 & I 
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Since TA = U, we have A = T-!U, but T7! = L, so A = LU. However, L = Lj, so 
in reality, we have A = LU, the Doolittle factorization of A. The Gaussian arithmetic 
whereby A is row-reduced to the upper triangular matrix U provides Lı by merely storing 
the negatives of the multipliers in the locations where pivoting creates zeros. Thus, the 
arithmetic of Gaussian elimination provides both factors in the Doolittle decomposition 


Wa. d . 2 
and does it in a storage-efficient manner. 


Computer Implementation of the Doolittle Decomposition 


The following algorithm would implement, on a digital computer, the Doolittle decompo- 
sition of the n x n matrix A. 


form = 1,...,n, execute each of: 


m-1 


forj—m,..., n, compute U,; = Amj — J Link Uk; 
k=1 


-1 
1 m 
fori=m+l,..., n, compute Lim = —— | — >. LitVion 
k=l 


mm 


The decomposition is obtained by computing the kth row of U, followed by the kth 
column of Lı. The left schematic in (34.8) illustrates the “row over column" strategy of 
the algorithm. The “vector” a is computed first and is essentially the first row of A. The 
"column vector" b is computed next, followed by the pair € and d, then the pair e and f. 
then the pair g and h, and finally, the last calculation yields i. The algorithm fails if any of 


the Uw = 0. 
a, a2 a3} a4 ds dj bj b b} b4 
bi Cy & €3 4 d) C| d d di 
b; d ej e» es a, €) € fi h (34.8) 
b dy fi Bi g a4 C3 € g hi 
by d fo h ty ds C4 6 2 i 


Computer Implementation of the Crout Decomposition 


The following algorithm would implement, on a digital computer, the Crout decomposition 
of the n x n matrix A. 


for m = 1,...,n, execute each of: 
m-1 


fori =m,...,n, compute Lin = Aim — ) Lig Uy 
k=1 


mm 


1 m-—1 
for j =m+1,...,n, compute U,; = —— |n — DD Tont w| 
k=1 


The decomposition is obtained by computing the kth column of L, followed by the kth 
row of U1. The right schematic in (34.8) illustrates the “column before row” strategy of the 
algorithm. The “vector” a is computed first and is essentially the first column of A. The 
"row vector" b is computed next, followed by the pair c and d, then the pair e and f, then 
the pair g and h, and finally, the last calculation yields i. The algorithm fails if any of the 
Linm = 0. 

Because the algorithm for the Crout decomposition calculates a column of L before 
it calculates a row of U4, it is possible to implement a pivoting strategy whereby rows are 


* 
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interchanged to minimize the round-off error introduced when dividing by small values of 
Lmm. Thus, prior to computing column k, the row with the largest remaining element in 
column k can be moved to become row k. 


EXERCISES 34.1—Part A 


2 18 10 
A1. Obtain the Doolittle decomposition of A = | 8 —69 “| . 
—6 78 160 


Obtain U by upper triangularizing A via Gaussian elimination, and 
obtain L; by storing the negatives of the multipliers in a copy of 
the 3 x 3 identity matrix. Verify that the product of L; and U is A. 


A2. From the L1U decomposition in Exercise A1, obtain the 
factorization L; DU. 


A3. From Exercise A2, obtain the Crout decomposition of the matrix A 
given in Exercise Al. 


EXERCISES 34.1—Part B 


A4. For the matrix A in Exercise Al, obtain L; and U by the 
“brute-force” technique illustrated in (34.7). 

A5. Modify the calculation in Exercise A4 to obtain the Crout 
decomposition of the matrix A in Exercise Al. 


A6. If y = —40i — 178j — 22k and A is the matrix in Exercise A1, 
solve Ax = y by solving L;c = y by forward substitution and 
Ux — c by back substitution. Verify that your solution is correct. 
AT. Obtain L; from the three elementary matrices Es(l1, 2, m2), 
E3(1, 3, m3), E3(2, 3, m23), which record the Gaussian arithmetic 
taking A to upper triangular form. 


4 16 —12 
B1. Verify A = | 16 73 24| is positive definite, and write it as 
—12 24 628 


A=L,DL! = Lj / DA DLI = RR’, thereby obtaining its 
Cholesky decomposition. 


For the matrix A given in each of Exercises B2-11: 


(a) Use a software tool to obtain the Doolittle (L;U) 
decomposition of A. 


(b) From the Doolittle decomposition, obtain the L; DU, 
factorization. 


(c) From the L; DU, factorization, obtain the Crout (LUj) 
factorization of A. 

(d) If A is positive-definite, obtain the Cholesky (RAT) 
decomposition from the L; DU, factorization found in part 
(b). Check the result with an appropriate software tool. 


[—6 8 10 9 -6 -1 
B2. 1 -11 l B3. | -6 10 —5 
-2 6 9 =]. c5 8 


i 4 —12 -12 -4 
B4 E = 3 ps. | 2 4 4 m 
. | à I 7 "|-12 44 61 -6 
i -4 12 -6 47 
-5 312  —3 1 —20 7 —24 -18 
4 -3 11 -6 7 -30 -7 -9 
B6. 12 4 11 5 B^. — 19 11 
L4 6 -12 -l -18  —9 Ji =27 
5 15 10 35 —10 —1 ll -9 11 8 
15 49 30 109 —30 li 2 O = 12 
B8. 10 30 23 76 —26 B9. 7-9 3 =F 
35 109 76 263 —88 —]] 0 10 1 5 
—10 —30 —26 —88 56 10 11 —10 —10 12 


18 —20 —27 —30 —13 12 5 —5 —8 -10 

—20 —16 26 26 6 -8 -2 8 Il | 

B10. | —7 26 —27 —26 -18 Bll.|-11 -12 12 11 -12 
—30 26 —26 21 -6 7 —11 12 10 l 

—13 6 —18 —6 —26 3 7-1-1 -3 


In Exercises B12-21: 


(a) Obtain the Doolittle (L; U) decomposition of A. 

(b) Use A = LU and forward and back substitution to solve 
AX, = Gi k = leiers n, where n is 3 or 4 as appropriate and 
ez is the kth column of the n x n identity matrix. 

(c) Verify that [x;,..., x,] = Aq. 

(d) Obtain the Doolittle decomposition by setting up and solving 
n? equations in the n? unknown entries in L; and U. 

(e) Obtain the Crout decomposition by setting up and solving n? 
equations in the n? unknown entries in L and U}. 

(f) Use Gaussian elimination to row-reduce A to an upper 
triangular matrix U. Record the transformations in a sequence 


of elementary matrices. Show that L; = T^, where T is the 
product of the elementary matrices. Show that TA = U so 
that A = L 1 U. 
7 -1 0 —6 12 -3 
B12,.A=| 9 -2 11 B13. A = | -10 3 -2 
|-7 -9 4 —11 9 -5 
[-12 6 —5 -4 -5 3 
B14. A=] -1 5 8 B15. A=] 5 3 OF 
| H 2 =i -9 -6 -5 
r ? m 9 -8 —-—6 
Ae 3 ii s tf 4 
B16. A = | -5 1 m B17. A= 
a 3 oa 8 7 -4 10 
5 2 2 9 =9 
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-à 7 4 -1ü á -8 7 6 8 à A 4 +i 
—7 -1 5 —1 4 10 4 —12 4 0 0 -1 -8 
BIB A=| 5 3 4, .5| BI-4-]i4 7 -3 -6| mamLA-|-1:2 -6 10 -2 9 
LO -2 -2 —1 5 7 -9 12 8 10 -7 1 8 
~ "X 2 - p 
& 10 0 7 "UTE. *o4 £2 cR d 
-| 3 4 6 7 -|712 0 6 -2 In Exercises B25-27: 
B20. A = 1 1-2 5 B21. A= 1 8 4 1 
[mi -2 -»9 9 3 —10 11 -—5 (a) Obtain A = L, DU, as the product of the three given factors 
In Exercises B22—24: (b) Obtain the Doolittle decomposition of A from the given 
factors. 
a) In the computer language of your choice, implement the ; " : 
(a) ursi. ter it: e: ae on aie A (c) Apply the numeric procedure of developed for part (a) of 
computer algorithm for the Doolittle decomposition. Apply it : ; è à 
3 : "S : Exercises B22—24. Does it succeed? Why? 
to the given matrix, and verify the correctness of your results. 
(b) In the computer language of your choice, implement the B25 4 s : 4 i A : 
computer algorithm for the Crout decomposition. Apply it to “|g _2 ıl lo o -s8| lo o 1 
the given matrix, and verify the correctness of your results. 
» mE 1000][-9 00 0] [1 5 7 -9 
(c) Modify the code in part (b) so as to include the pivoting 26 3 10 0 03 0 0 0 1 4 0 
strategy described at the end of this section. Polished B26. -9 5 1 0|1000 0/l']0 0 ] -1 
computer code would not literally move rows but would =3 © A 1 0006]||0 0 0 1 
instead use a pointer file to keep track of the row-interchanges [ 1 0 0 0 0 ium 0 0 0 0 
that are called for by the pivoting strategy. (See, e.g., [60] for -9 1 0 0 0 0 -2 0 0 0 
details.) On a finite-precision machine, how much difference  B27. | 1 8 1 0 0|, 0 0 0 0 0 
in accuracy is achieved by pivoting? -8 3 =9 l 0 0 0 D =a 0 
: "P g L 0 3 4 6 1 0 0 0 0 -5 
E 1 5 1 -10 12 -2 Fi 8 ] =9 5 
EX 4e|- U2] Hmháàe| > HW 2 " 0 1 -8 -5 -8 
4-1 S 8 H 2 0 0 0 1] -6 -2 
-5 12 7 -9 0 0 0 1 7 
LO 0 0 0 1 
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Similar Matrices 


Two square matrices A and B are said to be similar if an invertible matrix P can be found 
for which A = PBP'. (See Sections 12.16 and 12.17.) Clearly, this equality is equivalent 
to B = P-!AP. If A and B are thought of as transformations on a space of vectors, then. 
if they are similar they represent the same transformation but only in different bases. 

Given the matrices A and P, the matrix B = P^!AP is then similar to A, as for ex- 
ample, with 


B3 p 3r 3-; 


The eigenvalues of A and B are 2, 3; and the determinant of both A and B is 6. Similar 
matrices have the same eigenvalues and determinants, but not necessarily the same eigen- 
vectors. (The eigenvectors of A are i — j and i — 2j, whereas the eigenvectors of B are i 
and 3i 4- 4j.) 

The equality of the eigenvalues is not that hard to prove. The eigenvalues of A and B 
satisfy characteristic equations of the form 


det(A — A7) =0 and det(B — A7) -0 
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Multiply the first equation from the left by det(P ^!) and from the right by det(P) to get 
det(P~') det(A — AI) det(P) = 0 
But the product of determinants is the determinant of the product. Hence 
det(P"![A — A]]P) 20 or det(P AP — AP !P) =0 


which is det(B — AJ) = 0. Any value of 4 that satisfies the characteristic equation for A 
also satisfies the characteristic equation for B. 

The equality of the determinants of similar matrices also hinges on the property of 
determinants whereby the product of determinants is the determinant of the product. In 
fact, 


det(A) = [1] det(A) = [det(/)] det(A) = [det(P~! P)] det(A) 
= [det(P~!) det(P)] det(A) = det(P-!) det(A) det(P) = det(P~!AP) = det(B) 


Notice that in going from the fourth step to the fifth, we were able to commute the deter- 
minants of P and A, since determinants are scalars. 


Similarity to a Diagonal Matrix 


In Section 12.16 we found, by brute force, a transition matrix P for which P^! AP = D, 
where D was a diagonal matrix. In effect, we showed A was similar to the diagonal matrix 
D. The columns of P were the eigenvectors of A, and the diagonal elements of D were the 
corresponding eigenvalues. 

In (34.9), the columns of P are the eigenvectors of A, the corresponding eigenvalues 
of A are the diagonal entries in D, and P^! AP — D. 


4-| ] Pel 1 Be ] (34.9) 


Motivation was provided in Sections 12.16 and 12.17 where coupled sets of differential 
equations were uncoupled by finding a similarity transform taking the system matrix to 
diagonal form. The system of differential equations x’ = Ax, where A is given in (34.9), 
uncouples from 


— y = 3y1 
o 
y = -2x + 4y » = 22 
under the diagonalization induced by P. In fact, write A = PDP~' to obtain x’ = PDP-^!x; 


then multiply by P^! (from the left) to obtain P~'x’ = DP-'!x. Defining y = P^!x gives 
the uncoupled system y' — Dy, with y obtained by inspection, and x — Py, as shown in 


(34.10). 
ae” p ae* + be” (34.10) 
= 5 =x = = 5 è 
s be^ 7 2ae” + be” 


Jordan Canonical Form 


The n x n matrix A is diagonalizable if it has n linearly independent eigenvectors. Not every 
matrix has this maximal number of eigenvectors. In that case, A is similar to J, its Jordan 
form, a matrix that is as close to a diagonal as it can be, in a sense to be made precise by 
the following examples. 

A matrix is always similar to its Jordan form, so that P^! AP = J or A= PJP™!, 
where J is the Jordan form. The matrix J is either a diagonal matrix (with the eigenvalues on 
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the main diagonal) or is nearly a diagonal matrix with the eigenvalues on the main diagonal 
and at least one 1 in the diagonal immediately above the main diagonal. Thus, the similarity 
transformation taking A to its Jordan form yields another factorization of the matrix. 

We will consider three matrices A, B, and C, each of which fails to have a maximal 
number of eigenvectors. In each case J, the Jordan form of the matrix, is given. Although 
this canonical form J will have the eigenvalues of the matrix on its main diagonal, it will 
not be a diagonal matrix. Above the diagonal there will be at least one 1, the location being 
determined by inherent properties of the matrix. 

The matrix A in (34.11) has eigenvalues 3, 2, 2, with only one eigenvector correspond- 
ing to the repeated eigenvalue 2. The first two columns of the transition matrix P4 are 
eigenvectors, and J4 is the Jordan form of A. The action of A on the columns of the transi- 
tion matrix gives some insight into the meaning of the 1 in the super diagonal. The product 
A P4 shows the first column behaves as an eigenvector with eigenvalue 3, the second column 
behaves as an eigenvector with eigenvalue 2, but the third column behaves in a novel way. 
Denoting the columns of P4 by pi. p». p3, we have the third column of the product A P4 
behaving as a generalized eigenvector, that is, Ap3 = p2 + 2ps. 


6 9 =3 l 3 0 3. 0 0 3 6 3 
A=|-l 0 l Pa=]|0 -1 0 Ja=|}0 2 1 APa=|0 -2 -1 
2 5 l 1 Lo 0.0 2 3 2 =I 


(34.11) 


The matrix B in (34.12) has eigenvalues 2, 2, 2, with but two corresponding eigenvec- 
tors, the first and third columns of the transition matrix Pg. The Jordan form of B is Jg. 
Denoting the columns of Pg by pi. p». p3, we see from the product BP» that p, and p; are 
eigenvectors but that p» is a generalized eigenvector because Ap» = p; + 2p». 


2 —1 0 —] 0 0 2 1 0€ —2 -—] 0 

B-—|0 2 0 Py = 0 1] 0 Jgp—-|0 2 0 BP; = 0 2 0 

0 —l1 2 —] 1 1 0.0 2 —2 l 2 
(34.12) 


The matrix C in (34.13) has eigenvalues 2, 2, 2, with but one corresponding eigenvector, 
the first column of the transition matrix Pc. The Jordan form of C is Jc, and the two 1’s on 
the superdiagonal indicate there are two generalized eigenvectors associated with the one 
eigenvector. Denoting the columns of Pc by pi. p». p3, we see from the product C Pe that p; 
is an eigenvector but that p» and p3 are generalized eigenvectors because Cp; = pi + 2p;. 
and Cp3 = p» + 2p3. 


5 5 -3 1 3 1 2 1 0 2 P 5 
C-|-1 0 l Pc=ļ|0 -I1 0 Jc-2|0 2 1 CPe=|0 -2 -1| 
l 1 l 1 1 0 0.0 2 2 8 1 | 
(34.13) 
EXERCISES 34.2—Part A 
A1. Show that A = fe il and B = L5 q have the same A4. For A and B from Exercise A1, find a transition matrix R for 
eigenvalues and determinant. which A = RBR™'. 
A2. For A from Exercise A1, find a transition matrix P for which AS. Answer true or false, and give a reason for your answer: Two 
P-!AP = D, where D is a diagonal matrix. matrices with the same determinant and eigenvalues are similar. 


A3. For B from Exercise A1, find a transition matrix Q for which 
Q^! BQ — D, where D is from Exercise A2. 


EXERCISES 34.2- Part B 


B1. 


B2. 


B3. Show that B from Exercise Bl is not similar to a diagonal matrix. 


B4. 


bo 
A 


t3 


pJP-! 
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-1 -3 =6 11 5 -2 
Show that A = | -4 -2 -8|andB—|4 4 -1|have 
4 4 10 44 
the same eigenvalues and determinant. 
For A from Exercise B1, find a transition matrix for which 
P-'! AP = D, where D is a diagonal matrix. 


Are A and B from Exercise B1 similar? 


Answer true or false, and give a reason for your answer: If an 


eigenvalue of the matrix A is repeated (has algebraic multiplicity 


greater than one), then its Jordan form cannot be diagonal. 


For the pair of matrices A and B given in each of Exercises B5-14: 


B5. 


B6. 


B7. 


B8. 


B9. 


B10. 


B11. 


B12. 


B13. 


B14. 


(a) Obtain transition matrices P4 and Pg for which P,'AP, = 
P3 ' BPs = D, thereby showing A is similar to B. 


(b) From P4 and Ps, construct a transition matrix P for which 
B= PAP. 


(c) Use “brute force,” solving four equations in four unknowns, 
to find a transition matrix P for which B = P^! AP. 


Li bet 
a[i xe * i] 
A-|5 ei s 
dE LUE 
H Jaji 78] 
i-e 3s 
a=[5 ie s 10] 
a-[ la 2 
asfi ie-[ o 


For the Jordan matrix J in Exercises B15-24: 


(a) Find the eigenvectors. 


(b) Find the generalized eigenvectors, and give the algebraic 
equation, involving J, that each generalized eigenvector 


satisfies. 
2 1 9 9 2100 
0 2 l1 0 Qg 2 1 8 
0 0 2 1 B16. 0 0 2 0 
00 0 2 D 0 0 2 


B17. 


B19. 


B21. 


B23. 


B18. 


NROCO 
iz 
Xd 
e 
cocoon 


oo 
eo 


B22. 


d 
NOO 


oo 
oo 
oc 


B24. 


NFO 


SON coco CON 


oo 


oooon 


e 
e 


YO 


© 
N 


© 
e 


© 
CONF 
N 


p 
© 


Ne 
e 
tQoooo 


oonoo o 
© 
© 


li 
N c 


| 
| 
| 


For the pair of matrices given in each of Exercises B25-29: 


(a) Show the matrices have the same eigenvalues. 


(b) Show the matrices have different Jordan forms and, therefore, 


are not similar. 


53. 257 38] [107 275 110 
4 -26 -2|.]-10 -28 -10 
41 -187 -31 80 —200 -83 
-17 -30 20] [-49 -14 52 
.| 0 -2 Of,| 4 0 4 
-15 -30 18] |-45 -15 48 
-37 -140 80] [-53 -204 80 
10 38 —20|.| 14 54 —20 
2 -1 7| |= -u 7 
I8 170 -59] [-1 189 -21 
| 7 -3|.| 0 8 -1 
9 81 -29 0 90 -ll 
-52 79 72] [-130 105 —84 
-54 77  60|,|-126 101 —84 
15 -26 -30 42 -35 24 


B30. Show that (P^! AP)* = P-! A* P for conformable matrices A 


B31. 


and P. 


If A= PJP-!, where J is the Jordan form for A, show 
e^! = ePI? 1 — Pe” P- Hint: e^ = Y Zo L(At)*, and apply 


Exercise B30. 


For the matrix A given in each of Exercises B32-41: 


(a) Find P and J for which A = PJP~', where J is the Jordan 


form of A. 


(b) Compute e^' either with a computer algebra system or with 
the Laplace transform as detailed in Section 12.8. 


(c) Compute e^', as per part (b). 
(d) Verify that e^! = Pe"P-!, 
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B32. | 1] Bss. [73 3| Bea. [~ 

Bao | B36. (“Sr s] | 
EXAMPLE 34.4 
EXAMPLE 34.5 


a ww [5 z] »[2 2] 
EMI B40. [i Tas] Bal. [33 25] 
QR Decomposition 


The QR Decomposition of A 


Every real matrix A can be factored into the product of Q, a matrix with orthonormal 
columns, and R, an upper triangular matrix R, so that A = QR. The factors Q and R are 
unique once the otherwise arbitrary signs on the diagonal of R are fixed. (See [4].) 

For the normalized QR decomposition in [64], if A is a real r x c matrix, then Q is 
the matrix whose columns are the orthonormalized columns of A and the upper triangular 
factor R is given by R = QT A. If A has rank k, Q will be r x k and R will be k x c. If 
k = c, then |R;;| equals the distance the ith column of A is from the space spanned by the 
first i — 1 columns of A. 


The matrix A on the left in (34.14) has dimensions r = 4, c = 4 and rank k = 3. The 
columns of the matrix Q given in the center of (34.14) are the orthonormalized columns 
of A. (There are only three independent columns in A, so Q has just three columns.) The 
product QT A gives the factor R, shown on the right in (34.14). 


1 LL g 
a 2 1 9 
TERME AG 4 W. 
_ n z | 2 6 wé - S3 SWS 

A-| iar 3 3| 997|, à al FR Fw 
-1 1-3 1 ? So wh 0 0 0 v6 

—1 B 2 

2 6 WG 


(34.14) 


Because of the orthonormality of the columns of Q, a computation would show QT Q = 
I. However, 


1000 
poito | 
00° = 0110 zl (34.15) 
0.0 0 1 
a matrix for which an interpretation will be given shortly. 


The matrix A on the left in (34.16) has dimensions r = 4, c = 3 and is of maximal rank 
k = 3 = c. The three columns of Q, shown in the center of (34.16), are the orthonormalized 
columns of A, which are independent. The product QT A gives the factor R, shown on the 
right in (34.16). 


NI 
NIH 


1 
[$3 203 23| QE OE 
A= Q=|? 2 2 R=|0 5 -2 (34.16) 
1 4 2 1 £ 1 
2 2 2 0 0 4 
1-1 0 $7 
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Because A is of maximal rank k = 3, the diagonal entries of R can be interpreted as 
lengths of orthogonal projections on subspaces of the column space of A = [A1, A», A3]. 
The vector component of A; orthogonal to Aj, namely, A5 — TFA], has length 
I[-à 3 3 —§}"| = 5 =|R2|. The vector component of A3 orthogonal to the subspace 
spanned by A, and A» is given by (J — P)A3, where P = M(M'M) ! MT and M = 
[A1, Ag]. It's length is ||[2 —2 2 —2]"|| = 4, agreeing with |R33| = 4. “ 


Interpreting QQ" 


The product QTQ is 7, but the product Q QT need not be the identity 7, as in Example 34.4 
where the columns of A were not linearly independent. Since the columns of Q are the 
orthonormalized columns of A (with dependent columns filtered out), we can form P — 
Q(Q" Q)^! QT, the matrix that projects onto the column space of A. This projection matrix 
can be based on Q since its columns are independent, whereas it cannot always be based on 
A, whose columns might not be independent. We claim that QQ? = P = Q(QTQ) ! QT. 

For the matrix A in Example 34.4, computing P = Q(QT Q)^! QT yields the matrix 
in (34.15), namely, Q QT. When R™! exists (as in Example 34.5 where A has maximal 
rank), Q QT is the projection matrix A(AT A)! AT. This is demonstrated, in general, by the 
following calculation, valid when R^! exists. 


Qo" - oIIQ' 
= Q[RR (RI RT] Q" 
- OR[R'R| RTQ" 
—QR[R' IR|'! RT QT 
= QR|R QT QR] !R' QT 
= (QR)(QR) (QR)]  (QR)T 
= A(AT A)*! AT 


Brief Summary 


For the normalized decomposition in [64], when A, square (r = c) or “tall and thin" (r c), 
is also of maximal rank, then R~! exists, AT A is invertible so that QQ? = A(AT A)! AT, 
and |R;j| = ||Aiipa,,...,A;:]|]- In all other cases, QQT projects onto the column space of 
A, and R (with dimensions k x c) has full rank but more columns than rows. Table 34.2 
illustrates these relationships. 


r — c (square) 
A = [Ags savy Ac] or r < c (low & wide) 
r « c (tall & thin) 


R`! exists : 
B R:1 de 
Full rank QQT = A(ATA)-1AT a Hin : 
(Rul = I Aiit; ull 
: R: low & wide R: low & wide 
Not full rank QQ'— P QQ'-P 


TABLE 34.2 Characteristics of the normalized Q R decomposition for different 
matrices A 
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EXERCISES 34.3 
: ed dv A= OR. 6 -5 -1 5 3] [-14 20 -46 49 -—49 
1. For the matrices in (34.14), verify Q nla r ; à 5. h s "m 
2. For the matrices in (34.14), verify that QT Q — I and that Q QT is 3 5 3 7 —9 21 -31 51 -—56 56 
given by 4:13); -i 38 -4& -8 ri lI i 9 
3. For the matrices given in (34.14), let B be a matrix whose columns —9 49 34 -42 -72 -2 6 -7 -9 4 
are a basis for the column space of A. This can be found from 13.| 22 27 -35 -25 ll 9 5 -9 -1 0 
rref (A), the reduced row-echelon form of A. Then show that 57 82 —58 -20 -78 3 —5 2 -3 3 
P = B(B™B)"'BT = QQ'. -10 -17 29 6 25| L-1 -3 -3 3 5 
$ ‘ n 2 4 1 
4. For the matrices in (34.16), verify A = QR. = F- i : ED 1 
5. For the matrices in (34.16), verify QT Q — I and compute Q QT. 14.| 75 22 -—35 7 -3 -6 
: - Pagal au T —40 -—31 4-55 5 7 —9 
6. For the matrices in (34.16), show that P = A(A A) "A = QQ’. -A8 —27 -27 12 8 10 
In Exercises 7—15, matrices of the same dimension, but different ranks, 4 2 22 59 28 
are given. In each case: -8 -160 -172 104 —60 
s 3 : 15. 76 6 14 69 88 
(a) Determine the rank of each given matrix a . -21 -87 -105 12 -63 
(b) Use an appropriate software tool to obtain Q and R, the factors —13 133 126 —149 10 
of the QR decomposition. 31 -51 -19 9 -9 
" ATA —19 33 43  —36 36 
(c) Verify that QT Q = I. -14 20 -46 49 A9 
(d) Orthonormalize the columns of A, and call the resulting —18 26 —54 58  —58 
2] —31 5] —56 56 


matrix Q. 
16. Given the least-squares problem Au — y, the normal equations 
AT Au = Aly = bare consistent, but numeric computation with the 
matrix M — ATA can lead to large errors in the computed solution 
x. Show that replacing A with QR leads to RT Ru — RT QTy. 


(e) Obtain R = QT A, and compare to part (a). 
(f) If R7! exists, show QQT = A(ATA)-! AT, 

(g) If R^! exists, verify |R; = ||Aiiti, Aral 1 = 2, s e. 
(h) If R^! does not exist, let B be a matrix whose columns are a 
basis for the column space of A. This can be found from 

rref (A), the reduced row-echelon form of A. Then show that 
P = B(B' B)- B! = QQ". 

(i) Use Table 34.2 to explain the difference in outcomes for the 
given matrices. 


Since R always has maximal rank and at least as many columns as rows, 
RT has maximal rank and no more columns than rows. By a theorem 
in [64], RT then has a left inverse, that is, there exists a matrix L for 
which LRT = I,, the k x k identity. Thus, by Exercise 16, the equations 
RT Ru = RT QTy become Ru = Ql y, a triangular system easily solved 
by back substitution. For each of the least-squares problems Au — y 


given in Exercises 17—25: 


52 63 1 1 u 9 
a) = = ci u s u (a) Obtain M — AT A and find its condition number C(M) — 
. —7 -60 56 2 0 —5 j 


26 3 35 I 7 = 


[ -85 9 32 4 -3 8 
5 2 Illes X 5 
| 21 -26 -35 0 4 4 
r-44 2 73 18 49 —34 32 56 
14 18 3 -31 —40 10 -5 -35 
—33 -22 13 49 —10 46 -—53 —35 
—37 -20 20 49 28 #22 -31 7 
L21 -8 2 2 —8 2 -1 <7 
40 -6 -21 41 1 =ï 3 8 
—4 124 -88 -1 3 3 -9 -6 
—-35 97 -57 35 3 9 -9 -5 
i 64 10 -49 75 6 0 1 -7 
[ -9 4 —6 12 44 -40 -—20 88 
-3 -10 3 -2],/-88 -9 67 -99 
—11 9 =2 12 6 35 -15 -23 


IMIM! ||, where any matrix norm will do. (The condition 
number estimates the factor by which errors in the data, either 
M or y, may be magnified in the solution x.) 


(b) Obtain u by solving the normal equations numerically. 
(c) Obtain the QR decomposition of A. 
(d) Obtain u using back substitution to solve Ru = QTy. 


(e) Obtain L, a left inverse of RT, by solving the set of equations 
generated by LRT = I, where L is ak x c matrix of unknowns 
and RT is c x k. Show that LRT = I, for your L. 


9.75 5.66 8.37 0.28 

8.25  —6.48 3.32 —7.94 

17. A= 8.43 5.74 4.49 y= 7.68 
3.74 2.45  —447 —1.41 

—6.88 2.204 —9.33 5.48 


N 
N 


[ 4.69 
9.43 
-6.71 
—6.16 
| 6.32 


—9.80 
8.19 
9.38 
| 9.90 
[—7.99 
2.65 
—3.74 
0.49 

| 9.85 


[| -9.54 
9:11 
—4.47 
| 9.17 
[6.16 
8.31 
7.35 
8.31 
5.64 
L2.24 


—3.34 
—2.99 


8.66 


2.45 


7.81 


7.21 
—5.10 
9.29 
—6.48 


8.837 
—6.63 
9.80 
—424 
6.08 | 
424] 
—8.94 
3.87 
-7.28 | 


1.41 
8.54 
8.25 
8.83 
7.14 
2.83 


9.06 
6.24 
4.58 
2.83 
9.38 
3.87 


9.06 
9.94 
—8.12 
9.22 
—6.16 


7.21 
6.40 
—4.9 


2.83 


8.77 
2.84 
5.74 
3.87 
5.66 
2.65 


[ 877] 
—5.57 


—5.50 
L 7.62] 
F—5.10] 


5:57 
8.25 


—4.36 


5.39 
4.80 


y= 


8.43 


6.40 
7.35 


| —4.80 | 


5.74 
2.65 
5.83 
9.85 
8.37 
6.24 
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—4.95 F 794 440 510 4.69 7.15 
8.31 —412 806 436 -—374 4.40 
y = | —5.48 23.a | 954 566 -347 715 | 70-23 
—5.5] 8.91 -—9.06 9.49 0.39 : 6.78 
3.46 224 8.77 954 954 -8.77 
2 | 8.83 7.07 -775 141 —6.16 
8.54 [-539 283 458 -873 
8.31 5.10 —872 6.16 0.90 
-02 140 —L4] =721 9.22 
24. A= | 342. 735 49 Y=) _7.62 
721 —4.90 8.89 7.55 
|-7.07 436 —4.69 8.60 
T 5.66 —4.85 5.57 
728 173 9.54 
—6.78 6.48 —5.92 
25.A—| 248 917 Y=) 638 
5.10 —6.78 9.49 
825 4.47 —7.48 
4.24 
5.57 
[374 
Y= | 7.94 
5.10 
7.87 


QR Algorithm for Finding Eigenvalues 
The QR Algorithm for Finding Eigenvalues 


Modern computational algorithms for finding eigenvalues numerically use some version of 
the QR algorithm. The following treatment will illustrate the idea behind the Q R algorithm 
but will not show all the many refinements that have been added to speed up the computation 
and make it more stable. But with this introduction, the algorithm will be understandable 
when met, for example, in a numerical analysis course. 

The QR algorithm finds the eigenvalues of A = Aq by factoring Ao to Qo Ro and 
generating the sequences of matrices Qz, Rk, and Aj, Kk = 1,2,..., according to the 
prescription Ay4; = R&Qy, where Ag = Q; Ry. Thus, at each step, the QR factorization 
of A, is obtained and the factors are reversed to generate a new matrix Aj. At this point 
it is helpful to visualize the first few steps of the algorithm. 


Ap = QoRo Ar = RoQo = QiRı A2 = RıQı = QR Az = R2Q2 = Q3R3 


If A is real and no two eigenvalues have equal magnitude, that is, if the eigenvalues 
satisfy the condition 


0< |An| S |An—1| mM es m |A2| ss [^1] 


then the sequence of matrices A, converges to an upper triangular matrix with the eigen- 
values of Ao on the main diagonal. If, in addition, A is symmetric, then A; converges to a 
diagonal matrix. 
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EXAMPLE 34.6 


If A is real, with at least two eigenvalues of equal magnitude, then A; converges to a 
quasi-triangular matrix such as 


412 413 414 415 416 
y y2 424 G25 426 
434 435 436 
0 0 Z: ü45 | 46 
0 0 0O w w 
0 0 0 0 Wa W4 


(34.17) 


ooooRs 
< 
o 
V 
qx 


where all entries below the subdiagonal are zero and no two consecutive subdiagonal entries 
4 j44,; are nonzero. Going down the diagonal there are n x n submatrices, n = 1, 2, called, 
respectively, blocks of order 1 or 2. In (34.17), for example, x and z sit in blocks of order 
1 and are eigenvalues. The submatrices 


yı X wj w2 
ys y4 w3 w4 


are blocks of order 2 and generate the usual pair of eigenvalues for a 2 x 2 matrix. Of 
course, if A is symmetric (with eigenvalues of equal magnitude), then A, converges to a 
block-diagonal matrix with an interpretation similar to that of the quasi-triangular matrix. 

The off-diagonal elements in A, decrease by one of the factors |..1/A4], k = 1, .... 
n — 1. The largest ratio of the magnitudes of successive eigenvalues determines how quickly 
the basic QR algorithm converges to a diagonal matrix. 

At each step, the Q R factorization can be obtained by applying Gram-Schmidt orthog- 
onalization to the columns of A; to form Qx and then determining R = OQ; Ax. In practice, 
much more sophisticated numerical techniques are used to obtain the QR decompositions 
required. (See, Chapter 45, [4] or [60].) 


We illustrate the QR algorithm for finding the eigenvalues —6, -jiü + 4145) of the 
symmetric matrix 


(34.18) 


The sorted absolute values of these eigenvalues are 5.520797290, 6, 6.520797290, so the 
ratios of successive magnitudes are 0.92 and 0.92, ratios close enough to 1 to signal slow 
convergence. To see this, begin the QR algorithm by factoring Ag = A as Ap = QoRo. 
where the factors are 


_ 3 166 8 Pre 3 l 
35 40,110 1146 35 v35 J/35 
Qo = 5 85 ul dis ec 0 1146 _ 102 
0 35 40,110 1146 0-77 40,110 J40, 110 
1 73 31 0 0 216 
35 40.110 1146 /1146 
then obtaining 
17 5628 216 
5 1,403,850 40,110 
" 5628 2142 2628 
A1 — RoQo 1.403,850 955 /1.276,835 
216 2628 1116 
40,110 1,276,835 191 
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To avoid excessive “expression swell," we can work in floating-point arithmetic when 
factoring A; to Qı R; and obtaining A2 = Rı Q1. Rounding entries to three digits, we have 


5.94  —0.503 0.182 —0.572 0.780 | 0.254 
R,-2|0 5.72 —0.552 Qi—| 0.800 0.462 0.383 
0 0 6.35 0.182 0.422 —0.888 
—3.77 4.48 1:15 
A2=| 448 2.41 2.68 


1.15 2.68 —5.64 


Factoring Az to Q5 R2 and forming A3 = R» Q», we find 


5.96 —0.499 0.193 —0.632 0.726 | 0.250 
R,2|0 5.73 | —0.595 Q2 = 0.750 | 0.487 0.447 
0 0 6.32 0.193 0.485 | —0.853 
—4.11 4.18 1.22 
A3= 4.18 2.50 3.07 


1:22 3.07 —5.39 


Factoring A3 to Q5 R5 and forming Ay = R3 Q3, we obtain 


5.99 —0.497 . 0.204 —0.686 0.670 0.285 
R3 = | 0 5.74 | —0.639 Q3=| 0.699 0.496 0.516 
0 0 6.29 0.204 0.553 —0.808 
—4.41 3.88 1.28 
A4 = 3.88 2.449 348 


1.28 3.48 —5.08 


Continuing in this way, we obtain 


6.14 —0.513 0.225 —0.897 0.319 0.306 
Ro = | 0 3.88 — —0.787 Qo — 0.381 0.206 0.901 
0 0 5.99 0.225 0.925 | —0.306 

—5.65 2.06 1.35 

A10 = 2.06 0.483 5.54 


1.35 5.54  —1.84 


along with 


—6.35 0.492 0.563 —6.51 0.0591 0.0253 
A2 = 0.492 —4.29 4.24 A40 = 0.0591  —5.94 0.885 
0.563 4.24 3.64 0.0253 0.885 5.45 


Since the eigenvalues are approximately —6, 5.521, —6.521, we can see the slow con- 
vergence of the sequence (A,] to a diagonal matrix of eigenvalues. After 10 iterations, 
the off-diagonal elements in Ajo have been reduced only by a factor of 0.92!° = 0.43. In 
A»o, this factor is 0.922? = 0.19; and in Ago, itis 0.924 = 0.036. We leave to the exercises 


computation of A joo, significantly closer to a diagonal matrix for which 0.92! = 0.00024. 
b 
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Theory Behind the QR Algorithm 


If the n x n matrix A, of rank k, is QR-factored, the columns of the n x k matrix Q are 
orthonormal, so QTQ = I, and QTA = I, R = R since R is k x n. Therefore, in the QR 
algorithm, 


Asi = RkQy = QJ Ac Qe 


so Ax4+1 is similar to A; and has the same eigenvalues as Az. By induction, Ag+1 is similar 
to Ao = A. The eigenvalues of Ag+; are therefore the same as the eigenvalues of A. 
Indeed, starting the process from Ag = A, we find 


Ao = QoRo Ai = RoQo = [Q] AolQo > Ai similar to Ag = A 
for the first step and 
Ai=Q:ıRı A= RiQi — [QT AilQi > Ao similar to A; similar to Ao = A 


for the second. At each stage of the algorithm, the matrix Aj, is orthogonally similar to 
the preceding A, and, hence, has the same eigenvalues. In fact, generalizing from 


A3 = R50» 
= 03A20> 
= QiR1Q1Q» 
= 030} A1Q1 Q2 
= Q3 OQ RoQ0Q1Q> 
= Q3 Q1 Q0 4oQoQ1Q» 


we have Ar+ı = (Qj --- Qi) Ao (Qo: Ox) = (Qo QT A(Qo -+ Ox) = PTA P. 

The convergence of {Az} to a diagonal matrix with eigenvalues on the main diag- 
onal is discussed, for example, in [4] or [60]. This convergence is related to the be- 
havior of the power method for finding eigenvalues, seen in Section 45.1. In essence, 
AF*1 = (Qo... Qi) (Ri --- Ro) = P Ux, giving the QR factorization of A**! , established 
by an induction based on the following sample calculation. 


Ao = AoAoAo 
= (Qo Ro) (Qo Ro) (Qo Ro) 
= Qo(Ro Qo) (Ro Qo) Ro 
= QoA,1A4,Ro 
= Qo(QiRi)( Q1R)) Ro 
= QoQi(R1 Qi) Ri Ro 
= Q)QiA2Ri Ro 
= QoQi( Qo R5) Ri Ro 
= (Q0Q1Q2)(R2 Ri Ro) 


Exercise 3 empirically explores this relation and also the identity A;,; = Bra" 
which relates Ay, to A**?. 


EXERCISES 34.4 
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1. Using the software of your choice, implement a version of the QR 
algorithm. 


2. Using the code from Exercise 1, continue the QR algorithm for the 
matrix in (34.18), obtaining A100- 


For the matrices given in Exercises 3-12: 


(a) Use an appropriate software tool to find the eigenvalues. 

(b) Sort the eigenvalues by magnitudes, and obtain the ratios of 
successive magnitudes. 

(c) Use the QR algorithm from Exercise 1 to obtain numerical 
approximations to the eigenvalues. 

(d) Test the decrease in the off-diagonal elements of {Ax}, 
comparing to the ratios in part (b). 

(e) With P, = Qo--- Qx and Uk = Ry - - - Ro, show, for k = 5, 
10, 15, that P,U, = A**! and that Aj; = Bratem. (See, 
e.g., [52] or [88] for induction proofs.) 

0 0 =12 
j! 0 8 
0 1 1 


[-3 4 -6] 7 — 12 
5.| $ dt B 4. | 10 | 3 5. 


| 6 7 -lij 7 -1 -1 
je -3 -8] —12 -6 8 
6.|-3 -12 11 7,| 2 -7 4 
|-8 11 -5] -1 4 0 
-3 10 7 -2 =} 2 =| = 
-2 6 8 -5 0 12 4 —8 
8. -4 10 3 3 9. —6 3 -ii —2 
t-5 -9 -2 12 5 12 = lH 
E -1 3 11 0 0 0 48 
-j -1 2 -12 1 0 0 44 
10 3 2 10 2 11. 0 1 0 4 
m -12 2 0 0 0 1 —5 


12. 


L 


For the vector w given in each of Exercises 13-22: 

wit 
Householder reflection matrix that will be used for numeric 
computations in Section 45.2. 

(b) Let x = [1 2 3 4]', and obtain Hyx = y. 


(c) Show that xy the projection of x along w, is the negative of yy. 
the projection of y along w. 


(a) If Z is the 4 x 4 identity matrix, form Hy = I, — 


(d) Show that xw, the component of x orthogonal to w, and y i. 
the component of y orthogonal to w, are equal. Hence, y is the 
reflection of x across the subspace orthogonal to w. 


(e) Show that Hy is a symmetric orthogonal matrix. 


(f) Show that det(H,) = —1. 
13. [-6 8 10 1]7 14. [-11 1 —2 6]" 


ww, the 


15. [9 —3 —7 1]" 
17. [11 —6 12 4]? 
19. [8 7 3 4]" 

21.[7 —9 3 —4]* 


16. [-5 —2 12 —2]' 
18. [11 5 4 6] 
20. [8 12 —3 —2]T 
22. [5 —7 —8 10]" 
For each matrix A given in Exercises 23-27: 
(a) Let x be the first column of A, define w = x — ||x||2e;, where 
e; = [1 0 0 OJ"; and obtain the Householder matrix Hy. 
(b) Show that Hyx = |xl;e; = [||xll2 0 0 OJT. 


(c) Show that Hy A is a matrix whose first column is 
[xl 0 0 0J". 


6 -9 -6 -9 2 9 -5 -2 
=4 $9 9 +7 -6 -2 ő 1 
23. | | _3 -9 -8 24. | 4 6 8 -9 
l9 -4 1 -9| lo 3 s 3] 
[2 2 <2 ú [o4 7 5 4 
T 3 -7 <6 -1 -6 4 4 
3.) 6 -7 6 3 26. 6 —8 1 
[-9 -4 -1 -2] [7 -9 5 -4] 
FT 3 -8 -—5 
4 9 5 6 
2.13 3 4 9 
E =f = 5 


The QR decomposition of a matrix can be obtained by multiplying it by a 
sequence of Householder matrices. For each matrix A given in Exercises 
28-32: 
(a) Let u; be the first column of A, and obtain w; = u; — 
[lull 0 0 OJ", Hi = I, — iwi, and A; = H, A. The 
first column of A, will have three zeros for its last three 
elements. Hint: Compute with floating-point numbers or 
expression-swell will become a significant challenge. 


(b) Let U be the second column of Aj, set uz = [U5 U3 U,]!, and 
obtain w; = w — [||u;]|; 0 0I", h; = I5 — Eg aW? 
Hy = i Ap and A; = H>A\. In the first and second columns 
of A; there should be only zeros below the main diagonal. 


(c) Let V be the third column of A, set u, = [V3 V4]", and obtain 
= T = 2 T _fh 0 
w3 = us — [lus]; 0]. A3 = h — iwi W373 Hj = is "ai 
and A; = HA». The matrix A; is an upper triangular matrix 


and is, in fact, the factor R in the QR decomposition. 

(d) Obtain H = H;H>H,, and show H is orthogonal. In fact, 

H = Q", where Q is the factor companion to R in the QR 
decomposition. 

(e) Show HA = A; = R. 

(f) Show that A = HT A3. This verifies that the QR decomposition 
can be achieved by Householder reflection matrices. This 
technique obtains R and along the way gets Q — H", in 
contrast to the computation of Q by the Gram-Schmidt 
process, leading to R = QTA. Computing QR by Householder 
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matrices is “economical” and numerically stable. We will see H E- : E d Ei v = 
this in Sections 45.2 and 45.3, where we consider the numerical 30. 7 9 à 6 31. n 5 8 —10 
calculation of eigenvalues. 12 -3 —10 3 -8 —2 8 1 
4 -6 8 11 0 0 -1 -8 i =< 2% 12 
12 6 F =i -12 -6 10 -2 ii =ï? 72 ti 
28.| 12 -6 8 -2 29. 9 & 10 7 Sli. qm i 3 
F 4 =I 4 1 8 -3 12 ET NET NE 


SVD, The Singular Value Decomposition 


Singular Values, Singular Vectors and the SVD 


A square matrix is similar to either a diagonal matrix or to a Jordan matrix. (See Section 
34.2.) Thus, we have A = PDP™' in the case of the diagonal matrix and A = PJP^! in 
the case of the Jordan matrix. In either event, the eigenvalues of A appear on the diagonal 
of D or J, and the eigenvectors of A appear in the transition matrix P. 

A square symmetric matrix is orthogonally similar to a diagonal matrix, in which case 
A = PDP” since now P can be chosen to be an orthogonal matrix. The eigenvalues of A 
are on the diagonal of D, and the columns of P are an orthonormal set of eigenvectors of A. 

The r x c matrix A of rank k can be written as A = U X VT, a factorization called the 
singular value decomposition (SVD) of A. In particular, for A real: 


1. ATA isac x c symmetric matrix of rank k, whose k nonzero eigenvalues are positive, 
as shown in (34.21). 


2. AATisanr xr symmetric matrix of rank k, whose k nonzero eigenvalues are the same 
as those of AT A. (See Exercise A1.) 


3. Ordering the positive eigenvalues of AT A or AAT in the descending order A} > Az > 
eo >A, 0, the singular values of A are o; = / Aj, i = 1,..., k. (We follow [4] in 


taking singular values as nonzero, noting that texts such as [52] allow singular values 
to be zero.) 


4. Xisanr x c matrix whose only nonzero entries are Dj; = 0;,i = 1,...,k. (See 
(34.19).) 


5. U = [U,, U2]isan orthogonal matrix whose columns are the orthonormal eigenvectors 
ofthe symmetric r x r matrix AAT, The columns of U are called the left singular vectors 


of A. 

6. The columns of the matrix U; = [u;, ..., uz] are an orthonormal basis for the column 
space of A. 

7. The columns of the matrix U5 = [uz+1, ..., u,] are an orthonormal basis for the null 
space of AT. 


8. V —[V;, V5]isanorthogonal matrix whose columns are the orthonormal eigenvectors 
of the symmetric c x c matrix AT A. The columns of V are called the right singular 
vectors of A. 


9. Thecolumns of the matrix V, —[v;, ..., Vg] are an orthonormal basis for the row space 
of A. 
10. The columns of the matrix V» =[Vz+1; Vo] are an orthonormal basis for the null 


space of A. 
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34.5 SVD, The Singular Value Decomposition 


These relationships are summarized 
U 


CHS 


15M TEES 


rm 
Eigenvectors of AAT 
Orthonormal Bases of 


col null 
space | , | space 
A AT 


in (34.19). 


[Ivi,... 
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Eigenvectors of ATA 
Orthonormal Bases of 


T 
row null 
space | , | space 
A A 


(34.19) 


Figure 34.1 shows the relationship of the singular value decomposition to the four 


fundamental subspaces for A. 


Row space of A 


dimension = k 


Column space of A 
dimension = k 


U, 


Vi 
— 
Null space of A 
T 
ds dimension = c — k 
cx 
V2 
FIGURE 34.1 


relationship to the SVD for A 


AAT 
FXT 


Null space of AT 


dimension = r — k 


Uz 


The fundamental subspaces of the matrix A = U E VT and their 


Obtained as the product of 5 x 2 and 2 x 4 matrices of maximal rank, the 5 x 4 matrix A 


in (34.20) has rank k = 2. 


45 

21 

A= 72 
—56 

50 


Tue Matrices ATA AND AA! 


—108 36 —45 
—68 26 —33 
—32. —16 24 

64  —8 8 
-3 ý 10 


(34.20) 


Figure 34.2 illustrates the action of A on a vector in 


R* = R*. Since the rank of A is k = 2, both the row space and the column space will have 
dimension 2. By subtraction, we find the dimensions of the spaces orthogonal to the row 
and column spaces. The space orthogonal to the row space of A is the null space of A. The 


space orthogonal to the column space of A is the null space of AT. 


The matrices AT A and AAT and their eigenvalues are given in Table 34.3. The matrix 
ATA is 4 x 4. In general, if A is r x c, then AT A is c x c. The matrix AAT is 5 x 5. In 
general, if A is r x c, then AAT isr x r. Observe, in addition, that these matrices are both 
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R 4 R 5 
Row space of A Column space of A 
i a ; : AA! 
dimension = 2 dimension = 2 5x5 
Vi U, 
Null space of A Null space of AT 
ATA : : : 2o 
dimension = 2 dimension = 3 
4x4 
V, U, 


FIGURE 34.2 Fundamental subspaces for the matrix A in Example 34.7 


17,010 10,710 5040 —10,080 5040 


= 9 M 
ES em E 2 10,710 6830 2480 —6000 2740 
ATA = i 162 — 5464 2328 2986 AAT = 5040 2480 7040 —5760 4960 
938 6528 - 2086 3854 —10,080 —6000  —5760 7360  —4720 
ü i 5040 2740 4960 —4720 3660 
Eigenvalues: 0, 0, 20,950 + 304/204,983 Eigenvalues: 0, 0, 0, 20,950 + 304/204,983 


TABLE 34.3 Example 34.7: The matrices ATA and AAT and their eigenvalues 


symmetric. They have to be, since 
(ATA)! = AT(AT)T = ATA and (AAT)T = (AT)T AT = AAT 


Because A has rank 2, AT A and AAT also have rank k = 2. 

Each matrix has nearly the same set of eigenvalues. They each have the same nonzero 
eigenvalues, and the only difference is in the number of times à = 0 is an eigenvalue. Clearly, 
à = 0 has to be an eigenvalue because each matrix is not of full rank, so the determinant of 
each matrix is zero. 

The eigenvalues of AT A are necessarily real since AT A is symmetric. (See Section 
32.2.) Moreover, the eigenvalues are nonnegative. To see this, let p be an eigenvalue of 
AT A and let x be the corresponding eigenvector. Then we have 


|| Ax||? = (Ax) - (Ax) = (Ax) Ax = x! AT Ax = x! px = plx|l? (34.21) 
and consequently, 0 < p = E . (A similar statement holds for AAT. See Exercise A2.) 


THE SINGULAR VALUES OF ÁA The k = rank(A) = 2 singular values of A, the square roots 
of the nonzero eigenvalues of AT A or AAT, are 


o = 20,950 + 307 204,983 and o = \/20,950 — 30y 204,983 


Tue Marrix V To obtain the matrix V = [Vi, V2], we find the eigenvectors of AT A and 
sort them in the order corresponding to decreasing eigenvalues, as shown in (34.22). Since 
AT A is symmetric, the eigenvectors from distinct eigenvalues are necessarily orthogonal. 
Two eigenvectors are from the single eigenvalue zero; hence, they need not be orthogonal 
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to each other. In fact, they are not since their dot product is — 1300. 


SIT, f, SOS 3277 _ 23/204,983 
4434 4434 wa wm 0 i 
5666 10./204,983 5666 , 10.0041:983 1 0 
2217 2217 zy + oz (34.22) 
1 28 —30 
l 20 -93 
5641 , „204,983 — 5641 _ 204,983 
eU ea 4434 4434 


The first two eigenvectors in (34.22) need only be normalized and then placed into the 
matrix 


739 3277 + 23,/204,983 739 —3277 + 23./204,983 


2 Ja 9 JB 
T 2833 + 54/204,983 T —2833 + 5./204,983 
y - Ja VB 
1,638,363 1,638,363 
oya E" 
739 —5641 + /204,983 _ 739 5641 + /204,983 
2 Ja 2 JB 


a = 52,054,667,238,495 + 80,926,940, 385./ 204,983 
B =52,054,667,238,495 — 80,926,940,385./ 204,983 


The remaining two eigenvectors need to be orthonormalized and then placed into the matrix 


0 237 
V215,670 
1 260 
V = V/1185 215,670 
277 28 170 
J/1185 215.670 
20 251 


J/1185 215,670 
Finally, we form V = [V , V2], obtaining 


739 3277 + 234/204,983 739 —3277 + 234/204,983 0 237 
2 Ja 3 JB 215,670 
1478 2833 + 5./204,983 1478 —2833 + 54/204,983 1 260 
Ve va VB /1185 —-/215,670 
1,638,363 1,638,363 28 170 
Ja VB J/1185 4/215,670 
739 —5641 + 4/204,983 739 5641 + /204,983 20 251 
2 va 2 VB J/1185 . 4215,670 
(34.23) 
THE Matrix U Although the vectors uj, j = 1,..., k, are eigenvectors of the matrix 
AAT, we obtain them from the equation 
Av; = 0jUj PILAE (34.24) 


thereby linking them to the v;'s. Thus, compute u; — Av;/o;, making each such u; an 
eigenvector of AAT because multiplying Av; = oju; by AT yields AT Av; = co; ATu;. But 
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AT Av; = ÀjVj, so equating the two right sides yields o; ATu; = Ajvj, which we multiply 
by A (from the left) to produce c; AATu; = A; Avj. But Av; = ojuj;, so 

c;AATu; E Aj; AV; = AjOjUj => AATu; = Aju; 
making u; an eigenvector of AAT. Incidentally, computing the u;’s with (34.24) yields the 


matrix relation AV = U X, from which it follows that A = U E VT. 
Using (34.24) to find the vectors u; and u2, we get 


2833 + 5./204,983 —2833 + 54/204,983 
232,785 25-2 232,785 : 
J/ H2 VJ M3 HA 
114,083 + 1814/204,983 —114,083 + 1814/204,983 
3695 3695 
J H2 / Ha Ha 
4903 + 29,/204,983 —4903 + 294/204,983 
U= 29,560 T 29,560 U 
J H1H2 J H3 H4 
12,367 + 324/204,983 —12,367 + 324/204,983 
—29,560 = 29,560 E - 
„y H2 J A3 H4 
35 1792221 + 304/204,983 22.170 — 739] + 304/204,983 
0 J/ H2 = U3 H4 
ui = 52,054,667,238,495 + 80,926,940,385,/204,983 


u2 = 20,950 + 30y 204,983 
143 = 52,054,667,238,495 — 80,926,940,385./ 204,983 


[44 = 20,950 — 30y 204,983 


The vectors in U2 are an orthonormal basis for the null space of AT. Finding and normalizing 
such a basis gives 


5393 
0 0 13.979 
0 168 5859 
113,253 75,388,747 
E 2 143 1080 
Us — 21 J113,253 75.388, 747 
1 254 3276 
21 113,253 75,388,747 
4 8 279 
21 113,253 75.388,747 
The matrix U = [U,, U2] is then 
2833 + 5./204,983 —2833 + 5./204,983 5393 
232,785 : 232,785 0 0 M 
ITE) H3 h4 13,979 
3695 114,083 + 181/204, 983 3695 2114083 + 181 /204,983 à 168 5859 
3695 : J 
Jia /H3 [4 J113,253 4/15,388,747 
4903 + 29,204,983 —4903 + 29./204,983 2 143 1080 
U-—| 29,560 ux 29,560 ia 
Jn V3 Ha J/21 — 4/113,253 V/15,388,747 
99 569 12:361 + 32./204,983 99.560 712361 + 32./204,083 1 254 3276 
n Vna ES V/ Hala /21  J113,253 //15,388,747 
— 2 30./204,983 $i ppc 30./204,983 4 8 279 
7 Jmm = Jha J J2 75,388,747 | 


(34.25) 
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THE Matrix X Because X has dimension r x c, it need not be a square matrix. In this 
case, © is 5 x 4, so the “main diagonal” has four entries, the two singular values, and two 
additional zeros. 


/20,950 + 30./204,983 0 0 0 
0 /20,950 — 30./204,983 0 0 

D= 0 0 0 0 (34.26) 
0 0 0 0 

0 0 0 0 e 


Numeric Determination of the SVD 


A numeric computation of the singular values of A in Example 34.7 would produce a list 
such as 185.8292617, 85.83405796, 0.1836522528 x 107 ?, 0. The third value should be 
zero but is computed as a small positive number. In practice, a threshold must be declared, 
below which values are declared to be zero. 

A numerical computation of the SVD of A could produce 


—0.6779323847  —0.3932107662 . 0.5266768065  —0.3291715495 0.007113908434 
—0.4138821428 —0.3523417895 —0.8289320969 . —0.05560144243 —0.1197367678 
Uy = | —0.3045822425  0.7216102297  .—0.05703451753 —0.3371828652 . —0.5191946775 
0.4535944034 —0.1860447743 —0.09626016074 —0.8649313450 0.04761521857 
—0.2656897221 0.4073163084 —0.1515393199 —0.1635727801 0.8448563053 


(34.27) 
and 
—0.5371284133 0.6716051721 0.4964801281 —0.1180975988 
V 0.7998709493 0.2142912742 0.5513842068 | —0.1012974370 
f= 


—0.1739650811  —0.4172909716 —0.5443539482 0.7065997273 
0.2035575661 0.5734927965 | —0.3913588097 0.6902960319 


(34.28) 


as floating-point versions of U and V, respectively. Notice that U p and V; are not just the 
matrices U and V converted to floating-point form. The matrices U and V are not unique, 
and the numeric algorithm that produced Uy and V; was not the same one we used “by 
hand" to obtain U and V. The singular values are unique, but not U and V. 

If we convert X to floating-point form and call it X;, thereby imposing a cut-off 
threshold of 107? on the singular values, the product Uy, VI yields 


45.00000000 | —108.0000000 35.99999999  —45.00000000 

21.00000002 —68.00000001 26.00000001 = —33.00000000 

Ay =] 71.99999999  —32.00000000 —15.99999999 23.99999999 
—56.00000000 64.00000002 —8.000000014 8.000000020 

49.99999999  —32.00000001 —5.999999996 9.99999999 


which, rounded to three significant figures, is just A. 


The Outer Product Expansion of A 
From the singular value decomposition of A we can obtain the outer product expansion 
A= ouvi + 02U2 V1 TeEX OU, Vi (34.29) 


For A in Example 34.7, k = 2, each vector u; has dimension 5 x 1, and each vector vi has 
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dimension 1 x 5. Hence, each uj vy is a5 x 4 matrix of rank 1. If we drop the term containing 
the smallest singular value, we obtain the matrix B = o,u,v; as arank-1 approximation of 
A. In floating-point form, we find 


67.6672627 —100.7674819 21.9160643 | —25.6441159 
41.3113053 . —61.5192049 13.3799002  —15.6559000 

B = | 30.016257  —45.2729303 9.8464746 —11.5214179 
—45.2751518 67.4220126 —14.6637103 17.1580938 
26.5196008 —39.4919683 8.5891649 —10.0502324 


The difference between A and B is measured by the 2-norm of their difference, || A — B||; = 
85.83405797, which is just the value of o2. (See Exercises A3 and A4.) 


APPLICATION: DIGITAL IMAGE PROCESSING A video image or photograph can be digitized 
by breaking it up into a rectangular array of cells (or pixels) and measuring the gray level 
of each cell. This information can be stored and transmitted using a matrix A. The entries 
of A are nonnegative numbers corresponding to the measures of the gray levels. Because 
the gray levels of any one cell generally turn out to be close to the gray levels of its 
neighboring cells, it is possible to reduce the amount of storage by expressing A as an outer 
product expansion and dropping terms corresponding to small singular values. Since the 
measure of the approximation being made is the size of the singular value dropped, all terms 
corresponding to small singular values can be dropped without appreciably changing the 
quality of the image being transmitted. (See [52] for an example, pictures included, of such 
image compression.) 


EXERCISES 34.5-Part A 


A1. If à is an eigenvalue for AT A, show it is an eigenvalue for AAT. To compute the 2-norm of the matrix C = u;v1, the largest 
Hint: Start with AT Ax = Ax. eigenvalue of CCT must be computed. Show that CC’ = wu}. 

A2. Construct an argument similar to that in (34.21) to show that the A4. Show that (1, u2) is an eigenpair for wu7. (If this is the only 
nonzero eigenvalues of A AT are positive. eigenpair, then ||uovT||; = 1 and ||A — B|l; = 02.) 

A3. Let A in (34.20) be given as its outer product expansion (34.29), AS. Show that if u is a unit vector, then (1, u) is the only eigenpair for 
and let B = oiu; v]. Then, ||A — B||; = lozu;v1 ||» = ozl[u2v1 |». uu”. Hint: Show that uu! y = jy implies y is along u. 


EXERCISES 34.5—Part B 


3 


Bl. Let A = [5 J and let o; > o» be its singular values. Show (c) Form the matrices U = [u;, w], V = [vj, v2], and ©, a 


à 3 3 diagonal matrix with c; on the diagonal. 
Il Al|a = c; and || Ale = yof + o3, where F indicates the Bis k d 
(d) Show that A = UXVT. 


Frobenius norm. 

B3. If A is the matrix in Exercise B1, obtain the matrix W = U VT 
and compute ||A — W ||. Show that W is an orthogonal matrix for 
which det(W) — —1. 


B4. Let M = [? 7] be an orthogonal matrix, and let A be the matrix 


B2. If A is the matrix in Exercise B1, obtain its singular value 
decomposition as follows. 
(a) Obtain AT A, its eigenvalues A; > A», and its corresponding 
normalized eigenvectors v; and v5. The singular values are 


dy ca, Eus LS in Exercise B1. Minimize ||A — M ||r by the Lagrange multiplier 
method, taking as constraints the three distinct equations in 
M" M = I, the condition that M be orthogonal. Compare the 
minimizing M with the matrix W in Exercise B3. 


(b) Obtain u; = Av;/o;,, k = 1,2. 
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B5. Let A be the matrix in Exercise B1, and let B = oiu; vT. Show 
lA — Bl; = ||A — B|lp = 02. Compare ||A — B [s to || A — W llr. 
Remember, B is singular (rank 1) but W, an orthogonal matrix, is 
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(0) Show that U and V are orthogonal matrices. 


(p) Sketch a relevant diagram similar to the one in Figure 34.2. 


not. 2 5 —3 
2 = 
B6. |-1 1 2| BZ} 2 $ 1 ? 
For the r x c matrices A in Exercises B6-20: 7 3 4 : E : = 
(a) Find k, the rank of A. $ =I E zi 3 21 6 = 
(b) Use the software of your choice to obtain the singular value B8 3 ] =f 11 Bg. | 2 -16 -5 11 
T" 7 * = —i p, =a - m = 
decomposition, A = U X VT. 4 -5 2 =H 5 35 5 -235 
ài " à =2 <4 4 5 7 4 22 
(c) Obtain the outer product expansion, A = Y; , o;u;V;, " - " P 
where k is the rank of A, and the vectors u;, v; are as defined 3 T 3 3 -2 - —4 3 
B10.| ; E: j B11 3 5 2 6 
by (34.19). 3 21 6 —12 l : : 
(d) Obtain B — Da o;u; V7, and show that ||A — B||; = ox. 2 —6 -6 2 j 


OOA e TET. wr dI 3 TF———3 


(e) Show that the nonzero eigenvalues of AT A and AAT are just -» =3 c» D 
O2 bes Ly corny k, the squares of the singular values. B12. P a s 
(f) Obtain the r x c matrix £ from the singular values. " "n a j 
(g) Obtain the eigenvectors of AT A, normalize and/or Bld4.| 4 3 3 -1 3 
orthonormalize as necessary, and form the matrix -7 -3 -4 4 4 
V=([Vi, V5]. —4 1 5 =m 99 
(h) Obtain a basis of the row space of A by selecting the B15.| 7 74 |! -15 -2l 
appropriate rows of the reduced row-echelon form of A. : : e K T 
(i) Verify that the columns of Vj are a basis for the row space of , 4 3 à 
A by showing that each column in Vj is a linear combination [4 -6 5 28 —13 li P A P 
of the basis vectors found in part (h). B16. : : a t z B17.| 2 1 2 1 
(j) Verify that the columns of V are a basis for the null space of 0 -1 7 —13 20 3 6 2 5 
A by showing Av; = 0 for each v; in V; and then arguing on e =0 = —L = 
the grounds of independence and dimension. [-5 2 -2 -—13] —6 -28 5 =Z 
(k) Using the results of part (g), calculate u; = Av;/o;A e" 2 b = 3 9 0 6 
"put - QS E Qe NR j = ANGU R B18.| 1 7 2 -8| B19.| 5 17 -1 13 
fe us. k, and from these vectors, obtain U}. -4 -5 -2 -3 1 1 1 =] 
(I) Find a basis for the null space of AT and orthonormalize it, L-s 5 1 = = -4 -7 9 
thereby forming U2 and U = [U;, U2]. 5 29 —7 3159 
9 9 p/ 9 
m) Verify that UDV" = A. " E a 
diem: B20.| 4 4 4 -4 
(n) Show that the columns of U; are eigenvectors of AAT and =| Hl -7 19 
that the eigenvalues are the squares of the singular values. 7 9 6 —4 


Minimum-Length Least-Squares Solution, 
and the Pseudoinverse 


Least-Squares Problem: Formulation 


In this section we again solve a least-squares problem as an example of an over-determined 
system. However, we will look at the general case where the rank of the coefficient matrix is 
less than maximal. Since the system is over-determined, there are more rows than columns 
in the system matrix, that is, r > c. If the rank of the system matrix is k < c, the columns 
of the matrix are not independent. (In Section 33.6 wesolved the least-squares problem 
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for a system whose matrix was of maximal rank, that is, whose columns were linearly 
independent.) 

The system to be solved is Ax = y, where A is the rank-2 matrix given in (34.20), and 
listed (again), along with y and rref([A, y]), the reduced row-echelon form of [A, y], in 
Table 34.4. 


5 7 
45 —108 36 -45 Lg Ll 2 =F ml 
21 —68 26 -33 4 0 1 - Z 0 
A=| 72 -32 -16 24| y=| 4| meta yD=|]o 9 9 o 1 
E e AN : 0 0 0 0 0 
-32 -6 10 = 0 0 0 0 0 


| TABLE 34.4 A least-squares problem where the rank of A is not maximal 


Least-Squares Problem: Solution 


The third row of rref([A, y]) given in Table 34.4 indicates an inconsistent equation 0 = 1, 
so we know there is no solution to the over-determined system of linear equations Ax — y. 
Hence, we seek a least-squares “best fit” solution. 

The normal equations are given by AT Ax = ATy, where ATA, b = A'y, and the 
solution x — X, are 


13,286 —13,776 1162 —938 
—13,776 22,432 —5464 6528 


T ET 
A A=) 1162  .5464 2328 —2986 
—938 6528 —2986 3854 
—254 et 
328 c2 
b=} 56) X= [|-30c +280- 185; 
62 23c1 + 2002 — 339, 


The least-squares solution X contains two free parameters because ATA, like A, has rank 
2. There are only two independent equations in the set of four normal equations. Note, 
however, that the four normal equations are now consistent, but under-determined. There 
is a solution, but not a unique solution. 

Next, we write the solution as X = v; + c1V2 + c2V3, where vz, k = 1, 2, 3, are given 


by 
: 1 0 
0 i 
= 7673 s= = 
vi ^ 13,979 V2 —30 v3 28 
5720 —23 20 


^ 13,979 


The vectors v» and v3 are in the null space of A because Av; = 0, k = 2, 3. The vector v; 
— 361,750 329,244 


is not orthogonal to v2 and v3 because v; + v» = 73.979 Æ 0 and vı + v3 = -sg 7. 
Thus, v; is not orthogonal to the null space, so v; is not in the row space of A. The vector v, 


has a component in the row space of A, but it also has a component in the null space of A. 
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Minimum-Length Solution 


When A has less than maximal rank, the solution to the least-squares problem is not unique. 
One way to select a unique solution from the resulting family of least-squares solutions is 
to pick the least-squares solution of minimum length. Therefore, minimize 


2. 2 2 723,500 658,488, 91,593,329 
IXI = 1430c5 + 1185c, — 2600c1c2 + 3 $79 C2 — "1:979 C1 + 193412 4d 


with respect to the two parameters cı and c». The usual techniques of multivariable cal- 


culus, namely, equating partial derivatives to zero and solving simultaneously, yield c; = 
4184 13131 
> and 


C? = 


489,265° ~< 1,272,089 ° 


_ 13,131 
1,272,089 


4184 
489,265 
1411 
6,360,445 


|... 939 
1,272,089 


X = 


where X* is the least-squares solution of minimum length. 

Adjusting the component of X in the null space of A to minimize the length of X 
is equivalent to projecting X onto the row space of A. But the only part of X having a 
component in the row space of A is vı. Hence, the minimization process we just went 
through is nothing more than finding the projection of v; onto the row space of A. We 
can demonstrate this claim by forming P', a matrix that projects onto the row space of 
A. (Distinguish between P’ and P, the matrix that projects vectors in R” = R? onto the 
column space of A.) If the columns of the matrix C are a basis for the row space of A, then 


673 2 17 251 
0 1 910 7 91 910 

1 0 2 2 8 2 

Cc2| 3 os Peco es) 7 * * 7 
44 11 17 8 93 25 

15 7 91 35 455 91 

22 TI 251 2 25 337 

910 7 9] 910 


and P'X = P'v, = X*. Figure 34.3 shows the relationships between the vectors and the 
four fundamental subspaces. 


R^ R? 


Column space of A 


Row space of A 


dimension = 2 dimension = 2 


X*=P’v, 


V3 


“Null space of A Null space of AT 


dimension = 3 


dimension = 2 


FIGURE 34.3 Fundamental subspaces and X* for the least-squares problem in Table 34.4 


Pseudoinverse 


The over-determined system we are solving is Ax = y. There is no solution—the equations 
are inconsistent because y is not in the column space of A. We settled for a least-squares 
solution X that was not unique. To extract a unique solution from the two-parameter family 
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of solutions contained in X, we found X^, the least-squares solution of minimum length, 
and confirmed that this unique solution resides in the row space of A and is the projection 
of X onto that row space. 

If the system Ax — y were a square system of maximal rank, there would be an inverse 
matrix A~!, multiplication by which would yield the solution x = A^!y via A! Ax = 
A-ly = x. For the over-determined case, we seek a matrix A* with which y could be 
multiplied so as to yield the minimum-length least-squares solution X* — A*y. Such a 
matrix will be called a pseudoinverse, and we now give two prescriptions for constructing 
such a matrix. 


Pseudoinverse by Curious Formula 


We seek a matrix, the application of which to y yields the minimum-norm least-squares 
solution X*. The matrix At can be computed by the formula 


. i5) = 
At = lim[(ATA + s? D'AT] (34.30) 
s—>0 
discussed briefly in [68]. When applied to the matrix A in Table 34.4, it yields 
14,211 1418 41,512 2514 50.311 
12,720,890 908,635 6,360,445 908,635 12,720,890 
1908 186 48 104 62 
n 489,265 69,895 97,853 69,895 489,265 
A' — 
32,391 3817 _ 4100 436 11,013 
12,720,890 1,817,270 1,272,089 908,635 6,360,445 
42,867 2551 28,544 678 30,917 
12,720,890 908,635 6,360,445 908,635 12,720,890 


and a calculation shows Xt = A*y. Moreover, it can also be shown that the rank of At is 2. 
Subsequently, we will show how A* is related to U X V, the singular value decomposition 
of A. 

The matrix A* behaves as an inverse on the column space of A, acting as follows. 
Vectors in R” = R? are projected onto the column space of A, and those projections are 
“pulled back" to pre-images in R^ = R*. These pre-images are then projected onto the 
row space of A. A vector y in R” = R? is projected onto the two-dimensional column 
space of A, and that projection is inverted to a pre-image inR^ — R^ that is not unique. 
By projecting this pre-image onto the row space of A, the unique, shortest least-squares 
solution, Xt = Aty is obtained. 


Pseudoinverse from SVD 


If the singular value decomposition of A is given by A = UXV", the pseudoinverse is 
given by A* = VX*UT, where X* is the transpose of that version of X, in which each 
nonzero singular value has been replaced by its reciprocal. Since X, like A, has dimensions 
r x c = 5 x A, then X* has dimensions c x r = 4 x 5. For our example, we have 


S 0 00 0 
a/ 20,9504-304/204,983 
—— —— 
x*-É i 20,950—30./204,983 " eS 
0 0 0.0 0 
0 0 0.0 0 


and a calculation then shows At = VX^UT, 
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Numeric SVD and the Pseudoinverse 


In practice, the singular value decomposition is computed numerically, not exactly. We there- 
fore consider how A* might be assembled from the factors U ; and V; that were obtained in 
floating-point form in (34.27) and (34.28). If X ;, a numerically computed version of X, is 
obtained from the singular values 185.8292617, 85.83405796, and 0.1836522528 x 107!3, 
the reciprocals that appear in Z^ would include a term with magnitude 10'?. Clearly, the 
numerically determined singular values must be filtered through a threshold barrier to elim- 
inate values that are probably zero. If this is done and xy is constructed from X, then 


AT = V;jEIUT is the matrix 


—0.001117138816 —0.001560582632 0.006526587369 —0.002766787544 0.003954990570 
—0.003899727142 —0.002661134558 0.000490531716 0.001487946205 —0.000126720694 

0.002546284104 0.002100403352 —0.003223044929 0.000479840640 —0.001731482624 
—0.003369811389 —0.002807507965 0.004487736313 —0.000746174206 0.002430411708 


which agrees to eight significant figures with A * expressed in floating-point form. Moreover, 
X$, the floating-point form of the exact solution, and Atyp, the minimum-norm least- 
squares solution computed entirely in floating-point arithmetic, can be seen to agree to 
eight significant figures. 


—0.01032239096 —0.01032239096 
xt= 0.00855 160292 Aty, cs 0.00855160292 
fU 0.00022183982 fI 0.00022183982 
—0.00073815590 —0.00073815590 
EXERCISES 34.6—Part A 
A1. Let A be a square matrix of maximal rank. Show that At = A^. A3. For the matrix A in Exercise A2, use the factors U and V from 


Hint: Show A* A = AA* = I. 
A2. Use (34.30) to obtain At for the matrix A of Exercise B1, Section 
34.5. Show that At = A^. 


EXERCISES 34.6—Part B- 


Exercise B2, Section 34.5, to construct At = U X;* VT. It should 
agree with the results in Exercise A2. 


Bl. If A is an r x c matrix of rank k so that there are k nonzero 
singular values 0), ..., 0, show each of the following. 


(à) (xj) ==  (b(xr*y2zE* (o (ts)? = ata 
(d) (A*)* 2A (9 (AA? -AA* (f) (AFA)? = ATA 
In Exercises B2-11: 
(a) Obtain k, the rank of A, and show that the columns of A are 
not linearly independent. 
(b) Use (34.30) to obtain A*, the pseudoinverse of A. 
(c) Show that (A*)T = (AT)*. 
(d) Show that (A*)* — A. 


(e) Obtain X* — A*y, the minimum-norm least-squares 
solution of Ax — y. 

(f) Show X* is in the row space of A by obtaining a basis for the 
null space of A and showing that X* is orthogonal to each 
vector in this basis. 


(g) Obtain the singular value decomposition of A, thereby 
factoring A to UE VT. 

(h) Compute V X* UT, and compare to At. 

(i) Apply the Gram-Schmidt process to the columns of A, 
letting Q be the resulting matrix. 

(j) From Q, build P = Q(QT Q)^! QT = QQ", which projects 
onto the column space of A. 
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B2. 


B3. 


B4. 


B5. 


B6. 


B7. 


B8. 
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(k) Obtain Py, the projection of y onto the column space of A. 

(D Solve Ax — Py for x, and call this the general least-squares 
solution v; if available, compare this to a least-squares 
solution provided by an appropriate software package. 

(m) Obtain X* from v using calculus to minimize ||v||2. 

(n) Obtain a basis for the row space of A, and let C be the matrix 
whose columns are these basis vectors. 

(0) Construct P’ = C(CTC)^! CT, a matrix that projects onto 
the row space of A. 

(p) Show that P'v — X*, thereby verifying that projecting v, the 
general least-squares solution onto the row space of A, gives 
X+, the minimum-norm least-squares solution. 

(q) Obtain V = (J — P^)v, the component of v orthogonal to the 
row space of A. 


(r) Show AV = 0, indicating that the component of v orthogonal 
to the row space of A is actually in the null space of A. 


(s) Sketch a relevant diagram similar to the one in Figure 34.3. 
f 2 -12 5 —6 
au| 17 24 -16 _| 8 
—l-27 -20 17| ?^|10 
[-11 -4 5 1 
[21 -18 -—18 3 —3 
20 —18 —24 5 = 
A-|-8 10 32 -9| y=] 1 
16 —12 0 -2 S 
E -18 =12 1 =2 
[—9 19 12 —24 23 12 
3 —9 7 20 —14 -1 
A= —1 16 13 17 23 —- 11 
13 -20 -7 58 —19 = 4 
g^ =23 =8 39 —21 —3 
L-8 —14 0 —10 -—10 11 
3 7 8 5 -3 r—6 
E -21 -2 6 2 12 
A-|31 -0 35 —-3 -4| |_| 4 
—6 -235 —24 11 21 a> Eu 
15 =28 -3 —19 30 3 
L17 -—19 13 —22 1 L 4 
-4 10 6 -8 -20 r 6 
11 -20 -27 13 55 —12 
a-|3 © 5 3-B5| ,.|- 
=7 35 —14 -35 -35 dii 1 
=3 30 —27 -33 -15 1 
L—6 5 23 0 —30 L 8 
—12 =17 1 -—13 —2 
—12 15  —15 27 =5 
A-|-M -2 -M 14 | 5 
53| 24 10 10 -4| YF] 1 
44 17 19 —9 —10 
L—20 19 3 10 12 
[-3 5 5 -10 =5 
A=|-7 7 -7 5| y=| 12 
| 8 5 n m 


B11. 


B12. 


—-] -4 -1 11] —5 —9 
A=]-12 7 12 -7 3 y=| 3 
—8 11 —-8 -9 -3 —] 
-5  —6 0 12 —11 1 
ia| 9 —4 = -i — -3 5 
=! o 4 9 3 6| "*-|10 
1 2 —12 -1 -1 11 
—6 4 -2 -3 2 -9 —]0 
e| 7 @ 2 -3 —4 4 _ | -10 
=|- 1 = 1 -9 | T] p 
—9 -—12 5 7 8 -2 —]12 
A matrix M that satisfies the four Penrose conditions AMA = A. 


MAM = M, (AM)! = AM, (MA)! = MA, can be shown to be 
A*, the pseudoinverse of A. 


(a) If A is anr x c matrix of rank k with the k nonzero singular 
values o;,..., 0%, show that E+ satisfies the four Penrose 
conditions by showing ESTE = X,X*XXZX*-—X', 
(E+) = XX*,and (Utd)? = X*X. 

(b) Show that At = 
conditions. 


VX*UT satisfies the four Penrose 


For the pairs of matrices F and G given in Exercises B13—22: 


B13. 


B14. 


B15. 


B16. 


B17. 


B18. 


B19. 


B20. 


(a) Show FTF and GG? are nonsingular. 

(b) Obtain A — FG. 

(c) Obtain A*. 

(d) Obtain C = GT (GGT)-! (FT F)-! FT, and show C = A*. 


3 —5 —4 1 -1 -7 1 10 
F=| 4 -7 3 G=|2 9-7 1 4 
10 11 —7 -2. —12 -1 —2 10 
[5:1 -5 -1-1 0 4 -6 -1 
del d ĉef 7 12 -8 3 J 
= 
: ». e -8 -3 10 -6 -3 
F-|s ig = G=| 6 3 -1 -11 -4 
ls -12 8 12 0 -7 3 -7 
ber: p = -7 —4 nn 12-2 
ded ^ 4- G=|-3 -6 2 11 2 
| 5 i = 6 6 -5 -2 -4 
[-7 0 1 2: 7-1 5-1 -1 
8-9 8 0 2 8 0 2 6 
PEI g gl 2 "s 7 0 6 11 -10 
8 10 —5 —12 -10 -6 3 -3 -5 
0 12 -7 2 10 
im E- c=| 1 -11 Bl 
6 —6 
5 2 —9 -6 
F=|-8 —9 c-| 1 
l D x 10-8 9 2 
S Fos 5 
-39 6€ 2 2 -1 -l1 4 1 1 
-9 3-7 -5 3) 1 -5 -12 10 
"ela. m edo gi el ug 0 5 -10 —2 
9-8 2 7 7 -5 5 -A 5 
19 -—T - -1 
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r-12 1 
-3 —5 
= -—— e, = 
B21. F = ] -3 s e- ds El 
9 5 ^ 
5 4 
[1 -2 1 -5 -1 3 -4 
yas Em: iod = = = 
B2 r=|-9 -0| esf o 4 Zs 2 o 


If the r x c real matrix A of rank k is factored into its normalized Q R 
form, the factors are r x k and k x c, respectively, and both are of rank k. 
The product QTQ = I, is necessarily nonsingular. The product RRT is 
k x k and nonsingular because it is of rank k. Thus, Q and R are the fac- 
tors F and G of Exercise B13-22, and A+ = R'(RRT)-!(QTQ)-! QT = 
RT'(RRT)-! Q". In Exercises B23-32: 


(a) Obtain the QR decomposition of the given matrix A. 
(b) Obtain At = RT(RRT)-! QT. 
(c) Obtain A* by (34.30). 


[-17 -4 4 -8 5 8 10 8 
B23. 3 16 -3 =f B24. | -2 8 11 1 
| 4 28 -5 -13 — —12 12 1i 
1 —-7 = 11 12 6 
20 -4 -12 7 =f —12 
à 2 
B25. 16 ; b B26. 26 8 2 
LH 8 —3 a; 4. =i 
—14 4 -8 0 -5 
B27. | -32 6 -M -4 -7 
T =i 19 —14 18 


815 


D es 8 7 =f 
B288.| 0 9 -2 1 -7 
-9 4 -6 Ë —à 
2 2 5 -5 3 5 
27 16 9 3 7 -9 
B29. 3 8 -3 B30. | -6 —5 8 
-73 -i2 $ 5 3 
4 -16 -—9 Low e 
-5 25 -R -i B 
11 —25 6 —41 -il 
B31. | à 2% -4 32 8 
10 10 12 2 -10 
-37 -37 - 4 
-7 57 -Ù ő 
B32. 7 7 6  —10 
-26 —26 -18 i 


B33. Prove that the matrix AA* projects onto the column space of A. 


Hint: See the calculations of Exercises B23-32. 


B34. Let y — (1 — A* A)x, and prove that the matrix / — A* A projects 


onto the null space of A by showing 

(a) Ay — 0 

(b) (I — A*AP = I — AtA 

(c) (A* A)? = A*A, so (I — A+A)" = I — AtA Hint: Express 
A and A* in terms of the factors of the singular value 
decomposition, and see Exercise B12. 


Chapter Review 


1. Describe the factorization of A into L; U, the Doolittle 
decomposition. 


N 


. Show how the Doolittle factorization is used to solve the linear 
system Ax — y via forward and back substitutions. 

3. Describe how the Doolittle decomposition can be obtained as a 

by-product of the Gaussian arithmetic, which row-reduces A to an 

upper triangular form. 


4 7 -9 
4. Obtain the Doolittle decomposition of the matrix I 7 -8 
3 à 89 


Show how to use it to solve the system Ax = y if y = [4 —3 5]T. 


Un 


. Convert the Doolittle decomposition in Question 4 to the Crout 
decomposition LU}. 

6. Obtain the Cholesky decomposition of A = from its 

Doolittle decomposition by first factoring to the form Lı DU}. 


7. Describe what it means for a matrix A to be similar to a matrix B. 


8. For each of the following, answer true or false. If true, verify. If 
false, give a reason for your answer. 


10. 


11. 


(a) If A is similar to B and B is similar to C, then A is similar to C. 
(b) If A is similar to B, then B is similar to A. 

(c) Similar matrices have the same eigenvalues. 

(d) Similar matrices have the same eigenvectors. 

(e) If two matrices have the same eigenvalues, they are similar. 

(f) If two matrices have the same eigenvectors, they are similar. 


(g) If A = 0 is an eigenvalue of the matrix A, then det A = 0 and 
the matrix is not invertible. 


. Find the matrix P that defines a similarity transform of A = [. 7] 


6 
to a diagonal matrix D. 


Find an orthogonal matrix P that defines a similarity transform of 


A =|} 1] toa diagonal matrix D. 
2.1 0 

The matrix A— |0 2 0] isin Jordan form. Exhibit its two 
0 0 2 


eigenvectors and its one generalized eigenvector. What equation 
does the generalized eigenvector satisfy? 


12. 


13. 


14. 
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2 1 0 
The matrix A = |0 2 1] isin Jordan form. Exhibit its one 
0 0 2 


eigenvector and its two generalized eigenvectors. What equations 
do the generalized eigenvectors satisfy? 


-1 = 0 5 
Determine the rank of A — = e e E- Apply the 
=i 2 o =a 


Gram-Schmidt orthonormalization process to the columns of A, 
thereby forming the factor Q in the QR decomposition of A. Obtain 
R = QT A. What is the rank of R? What is the rank of Q? Show 
that QT Q = h, the 3 x 3 identity matrix. Find QQ" and show it is 
the matrix that projects vectors onto the column space of A. 


Describe the QR algorithm for finding eigenvalues. Consider just 
the case where A is real and no two eigenvalues have equal 
magnitude. Explain why the eigenvalues of A are preserved in the 
matrices Ax. 


15. 


16. 


17. 


18. 


19. 


Describe the singular value decomposition of A, that is, the 
factorization A = U X VT. What are the left singular vectors of A? 
What are the right singular vectors of A? What are the singular 
values of A? 


Describe an algorithm by which the singular value decomposition 
of A might be found. 


Given the singular value decomposition of A, state the outer 
product expansion of A. How can the outer product expansion of A 
be used to obtain the "best" lower rank approximation of A? 


Show that the rank of A — li e is 1. Obtain the general 
least-squares solution of Ax = y, where y = [1 2]". Obtain x*, the 
least-squares solution of minimum length. Use the formula 

At = lim, ,o[(AT A + s? I)! AT] to find the pseudoinverse A* . 
Show that A*y — x*. 

Describe how to obtain the pseudoinverse A* from the singular 
value decomposition of A. 


UNIT SEVEN 


Complex Variables 


Chapter 35 Fundamentals 
Chapter 36 Applications 


Unit Seven has an unusual structure. It consists of two chapters, one on "fun- 
damentals" and one on applications. Chapter 35 provides the tools needed for 
using functions of a complex variable in the applications. Chapter 36 presents 
a spectrum of applications. 

Starting at the beginning, we revisit complex arithmetic and provide 
geometric insight for working with complex numbers in both rectangular and 
polar forms. Then, a systematic study of complex functions follows. First, we 
examine z? and z? and discover the notion of the Riemann surface, on the 
basis of which we can define inverse functions. Hence, we define the square 
root and cube root functions as examples of multivalued complex functions. 

The exponential function is central to the study of complex variables. 
Since w = e? maps horizontal strips of height 2z to the whole w-plane, we 
have our first example of a complex function that is “infinitely many”-to-one. 
The Riemann surface it generates has an infinite number of "sheets"; and 
the inverse function, the complex logarithm, is our first example of a complex 
function that, for each win its domain, assumes an infinite number of values. 

Since the complex trigonometric functions and the complex hyperbolic 
functions are defined in terms of the complex exponential function, under- 
standing the behavior ofthe exponential function is essential for understand- 
ing the behavior of this class of elementary functions. The inverses of these 
functions can all be expressed in terms of the complex logarithm. Hence, a 
thorough understanding of the differences between the real and complex log- 
arithms is essential for effective use of complex functions in the applications. 

Once the behavior of the complex version of the elementary functions 
is established, we extend the differential calculus to these functions. We de- 


fine the derivative of a complex function, obtain the Cauchy-Riemann partial 
differential equations, and specify the category of analytic functions. With 
complex differentiation, we can obtain the Taylor and Laurent series expan- 
sion of a complex function. 

Integration of a complex function takes place in the complex plane, 
as a contour integral, the natural analog of the line integral of Unit Four. 
Surprisingly, there is an interesting connection between integration and dif- 
ferentiation in the complex plane. The coefficients of the Taylor and Laurent 
series can be obtained as integrals of the expanded function! This leads to 
the Cauchy residue theorem, which allows us to evaluate contour integrals by 
obtaining one particular coefficient in a Laurent series. 

By way of applications, we study the evaluation of contour integrals, 
including the contour integrals that yield the inverses of Laplace and Fourier 
transforms. The complexform ofthe Fourier series is shown to be equivalentto 
the trigonometric form of Chapter 10. The root locus diagram and the Nyquist 
stability criterion, two elements of control theory, are examined. 

Conformal mapping and its use in solving certain boundary value prob- 
lems in the plane lead to a study of planar fluid flow. Complicated flows in the 
z-plane are mapped to simpler flows in the w-plane, solved there, and mapped 
backto the z-plane. However, we also study simple flows in the z-plane, which 
are then mapped to complicated flows in the w-plane. The flow past a cylinder 
in the z-plane, mapped to flow past the Joukowski airfoil in the w-plane, is an 
example. 
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Chapter 35 


Fundamentals 


INTRODUCTION This chapter is designed to provide the student with a working 
suite of tools for understanding and manipulating complex quantities, that is, quantities 
arising from and associated with the complex plane. Some familiarity with the behavior of 
complex numbers and the complex exponential function was obtained in Chapters 5 and 
12. The present chapter expands those ideas and presents new ones. 

In rectangular form, the complex number z = a + bi is a relatively tame construct. In 
polar form, z = p(cos + i sin 0) is a construct that will confuse and bedevil the unwary. 
Each point in the complex plane has a unique representation in rectangular form but an 
infinite number of representations in polar form. Arithmetic in polar form is best done by 
converting to rectangular form. But the question of which polar form to give for the result is 
the heart of the problem. Hence, special rules for 0, the argument of the complex number. 
must be observed and, therefore, understood and learned. Thus, we begin by making clear 
the algebra and geometry of working with complex numbers. 

The complex-valued functions w = z? and w = z? are studied as examples of a function 
of a complex variable. Such functions can be interpreted as maps from the z-plane to the 
w-plane. Hence, no simple graph easily represents such a mapping. The special techniques 
available for visualizing and representing the action of a complex function are explored, 
and this includes the Riemann surface. 

The most important complex function, the exponential function, is discussed. Because 
of Euler’s formulas, the polar form of a complex number is actually z = oe'?. Hence, the 
polar representation is replaced by the exponential representation, but the difficulties of the 
multivalued representation are not avoided. Hence, the mapping w = e’? takes horizontal 
strips of width 27 in the z-plane to the whole w-plane, and the Riemann surface for the 
exponential function has an infinite number of sheets. 

Consequently, the inverse function, the complex logarithm, is a multivalued complex 
function. Thus, z = In w takes each point in the w-plane to an infinite number of points in the 
z-plane, requiring users to define appropriate branches of the logarithm in practical work. 
Because the complex logarithm is multivalued, all of the familiar laws of logarithms learned 
in elementary algebra and calculus must be revised. The familiar properties are generally 
not true for arbitrary complex numbers. Hence, this section pays particular attention to a 
precise statement of the rules of logarithms. 

The familiar rules for working with real exponents are generally not true in the complex 
plane. Hence, the properties of exponents in the complex plane are carefully stated and illus- 
trated. If the properties of exponents and logarithms in the complex plane are not understood 
and respected, there is little chance any arithmetic in the complex plane will ever be correct 
if implemented without the guiding hand of technology. And if it is implemented in technol- 
ogy, then it will not be understood if the rules of exponents and logarithms remain a mystery. 
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In the complex plane, the trigonometric functions are defined, by Euler's formula, in 
terms of the complex exponential function. They create periodic maps of the z-plane to 
the w-plane, and their Riemann surfaces are infinitely sheeted; likewise for the hyperbolic 
functions. 'The inverse trigonometric functions, like the complex logarithm, are all multi- 
valued. Working with these functions again requires selection of appropriate branches. The 
inverse hyperbolic functions are also multivalued and can, in fact, be expressed in terms of 
the logarithm. 

At this point, complex arithmetic has been seen and the elementary functions familiar 
from calculus extended to the complex plane. The building blocks and tools are all in place, 
so now, analysis can begin. Hence, we introduce the derivative of a complex function and 
deduce the Cauchy—Riemann partial differential equations that must be obeyed by the real 
and imaginary parts of complex functions that have a derivative. 

The consequences of having one derivative in a neighborhood in the complex plane are 
remarkable. Such analytic functions have all their derivatives and a convergent Taylor series 
to boot. In addition, the real and imaginary parts of such functions are actually harmonic 
functions, solutions of Laplace's equation! 

Some of the remarkable properties of analytic functions are proved as a consequence of 
theorems about integration in the complex plane. Line integrals along well-behaved paths 
called contours are fundamental here. The Cauchy-Goursat theorem shows that closed line 
integrals of analytic functions are always zero. We also have the Cauchy integral formulas for 
representing a complex function and its derivatives as line integrals. It is by these theorems 
that properties of analytic functions are proved. 

We then treat power series in the complex plane and detail the ideas of the radius and 
circle of convergence. Functions that have isolated singularities of a benign type, called 
poles, have Laurent series rather than Taylor series. Because of the Cauchy integral formu- 
las, the coefficients of both the Taylor and the Laurent series can be expressed as closed line 
integrals. One coefficient in particular, the residue, is the closed line integral of the function 
whose expansion is being obtained. Hence, we detail the calculus of residues, the devices 
for obtaining the values of closed line integrals in the complex plane via manipulations of 
Laurent series expansions. 

Chapter 35 provides a robust set of tools for working in the complex plane. Nearly 
all of these tools are implemented in modern software packages like computer algebra 
systems. Hence, much of the tedious and detailed labor of working in the complex plane 
can be automated. However, without a sound knowledge of the tools, the results generated by 
computer programs will be neither understood nor appreciated. Because of modern software, 
it might not be essential to master all the manipulations represented in this chapter, but it 1s 
certainly wise to understand all of the concepts. 


Complex Numbers 


Imaginary Numbers 


The equation x?-- 1 = 0 does not have real solutions. Formally, we might write x = 4-4/—1, 
"numbers" for which the squares are —1. Since no real number has a square that is negative, 
these two formal solutions cannot be real. 

Thus, the real numbers are made a subset of a larger set of numbers called the complex 
numbers by defining the imaginary number i — 4/—1. 
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Imaginary axis 


E 


Izi| 2 N13 
Arg(z;) = arctan(3/2) 


Real axis 


FIGURE 35.1 Argand diagram of 
zı = 2 + 3i and z; = 4 — 7i 


Rectangular Form of Complex Numbers 


If a and b are real numbers, then z = a + bi is the rectangular form of the complex number 
z. The real number a = F(z) is called the real part of z, and the real number b = T(z) is 
called the imaginary part of z. Surprisingly, the imaginary part of the complex number z is 
a real number! Examples of complex numbers would be 


z =2+3i and z;-4- 7i (35.1) 


The real and imaginary parts of these complex numbers are, respectively, R(z1) = 2, 
L(z1) = 3, R(z2) = 4, and Z(z2) = —7. 


The Complex Plane 


A complex number can be represented as a point in the complex plane. A plot of a complex 
number in this plane is often called an Argand diagram in which the horizontal axis is the 
real part of the complex number and the vertical axis is the imaginary part of the complex 
number. For example, Figure 35.1 shows both zı and z2. If the point in the complex plane 
is connected to the origin with a line segment, the complex number a + bi represents the 
planar vector ai + bj, where (i, j} are unit vectors along the x- and y-axes, respectively. 


Magnitude and Argument 


The analogy between the complex number and the vector in the plane suggests defining 
the length of the line segment from the origin to the complex number as the magnitude 
(or modulus) of the complex number. The magnitude of the complex number z = a + bi is 
denoted by |z| = va? + P?. For example, |zi| = 13 and |z2| = V65. 

The angle this line segment makes with the x-axis is called the argument of the complex 
number and is typically denoted by arg(z). Just like with real numbers in polar coordinates, 
the angle, measured from the positive real axis, can lie in [0, 277) or in (—z, 7 ], for example. 
The principal argument, Arg(z), lies in (—7, 7 ], so that Arg(z1) = arctan ($) and Arg(z2) = 
— arctan(2). 


Polar Form 
The polar form of the complex number z — a 4- bi is 
z =r(cos + i sin0) 


where r = |z| and 0 = arg(z). Occasionally, this is shortened to z = r cis(0), where cis is 
an obvious shortening of cosine-i-sine. Thus, for zı and z2 in (35.1) we would write 


zı = v13 cis (arctan 3) = V3 (A tid) =243i (35.2a) 
z2 = V65 cis (— arctan 7) = v65 (+4 = id) —4-]i (35.2b) 


Addition and Subtraction 


Complex numbers are added and subtracted by adding and subtracting the real and imaginary 
parts, respectively. For the complex numbers in (35.1), we have z; + z2 = 6 — 4i and zı — 
z2 = —2 + 10i. Addition and subtraction of complex numbers is modeled geometrically 
by the addition and subtraction of vectors in the plane. 


EXAMPLE 35.1 
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Multiplication 


Multiplication of two complex numbers in rectangular form follows the algebraic pattern 
used for multiplication of two binomials. For the complex numbers in (35.1) we have z;z2 = 
29 — 2i, and in general, we have 


(a+ bi)(c + di) = (ac — bd) + i(ad + bc) 


Geometric Interpretation of Multiplication 


A useful geometric interpretation of multiplication is revealed by expressing the factors and 
product in polar form, as 


[r cis 6j ][r cis 62] = rır2 (cos 0; + i sin 9j) (cos 0» + i sin 62) 
= rır2[(cos 0; cos 0; — sin 0; sin 05) + i (sin 0; cos 05 + cos 0; sin 62)] 
= rjr;[cos(04 + 62) + i sin(0; + 42)] 
=r Fz cis(O + 62) 


The magnitude of the product is the product of the magnitudes of the factors, and the 
argument of the product is the sum of the arguments, expressed as an angle in the range 
(=x, m]. 


For the complex numbers given in (35.1), zız2 = 29 — 2i = 13/5 cis(— arctan Z), where 
clearly, |ziz2| = 4/13/65 = 134/5. It is more difficult to show that 


Arg(ziz2) = — arctan 5 = Arg(z,) + Arg(z2) = arctan E — arctan i (35.3) 

In floating-point arithmetic, however, we have —0.069 = 0.983 — 1.052. (See Exercise A1.) 

On the other hand, the arguments of z4 = —3 +i and zs = —4 + 5 are approximately 

2.820 and 3.017, respectively, but the principal argument of the product z4z5 is —0.446, 

not the sum 5.837, because 5.837 — 27 = —0.446. * 
The Complex Conjugate 


Given a complex number a + bi, the complex number a + bi = a — bi is the complex 
conjugate. Geometrically, a complex number and its conjugate are mirror images across the 
x-axis. The product of a complex number z — a 4- bi and its complex conjugate z — a — bi 
is zz = |z|? = a? +b’. Thus, the product zz is always real. 


Division 
The mechanics of dividing complex numbers in rectangular form hinges on using the com- 
plex conjugate in a most judicious way: multiply numerator and denominator by the conju- 


gate of the denominator. Thus, to evaluate the ratio o where zı and zz are given in (35.1), 
we would compute 


23i  (Q-3i)4-7) _ (8—21) + 2+14i — —134- 26i En 


= =— i 


4—7i (4=7i)(4+7i) - 4? +7? 65 5 
The general case therefore follows the pattern 


N 
N 
N 
N 
NI 
N 
N 
N 
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EXAMPLE 35.2 


Arg(zg) = 3.04 — (—3.04) = 6.08, but rather, 6.08 — 27 = —0.2. s 


In particular, note that the reciprocal of i is the conjugate of i since 


1 I 


i ii 1 
The same device is used to evaluate the reciprocal of a complex number, as in 


= = -—I 


1 " a ib 
atib a+b? gp 


since 


where zz = |z|? = (a+ bi)(a — bi) = a? + b?. 


Geometric Interpretation of Division 


The quotient of two complex numbers in polar form is evaluated as 


ricis} rı [cos6; +i sin 0; cos 05 — i sin 6; 
riCisÓ, m | cos 05 + i sin 0» 


cos 0; — i sin 05 


F 
E [(cos 0; cos 0» + sin 0 sin 05) + i (sin 0j cos 0; — cos 0; sin 65)] 
T? 


= "[cos(0, — >) + i sin(6, — 6;)] 


r) 
Yi 4 
= — cis(01 — 65) 
n 
The magnitude of a quotient is the quotient of the magnitudes of the numbers being divided, 


whereas the argument of the quotient is the difference of the arguments expressed as an 
angle in the range (—z, zr]. 


Using the numbers in (35.1), we obtain the quotient 


Zi 2 4-3i i " 2 is( — 
= =—- M cis(zt — arctan 
z0. 4—Ti 5 35 J/5 
From (35.2a) and (35.2b), we see that [Es = E = 4 Using floating-point arithmetic, 


we also see that 


Arg (=) = 2.034 = 0.9828 — (—1.0517) = Arg(zi) — Arg(z2) 


If we divide two complex numbers that are near the negative real axis, one above and 


one below, the arguments will be close to x and —z, respectively. The difference of the 
arguments will be close to 27, and the resulting angle will have to be expressed as an angle 
in the range (—zr, 7 ]. For example, the quotient of 


i 4/101 . 1 - V101 . 1 
Zz = —1 4 = cis | zt — arctan and zg = ——— cis | arctan — — zr 
10 10 10 10 10 


20 


20 


is cis(— arctan $5). for which the argument — arctan 22 = —0.2 is not just Arg(zg) — 


99 ~~ 


* 
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35.1 Complex Numbers 


A1. Assuming all angles remain in (— 7, 5], establish arctan A — 
arctan B = arctan(-4—5.) as follows. Write X = arctan A — 
arctan B = u — v, and apply to tan X the formula for tangent of a 


difference. 


A2. Use the result in Exercise A1 to show that (35.3) is exactly 
— arctan i. 


A3. If arctan A and arctan B are both in the first quadrant but 

arctan A + arctan B is in the second, then arctan A + arctan B = 
7 + arctan( IUE ). Use this result to show that arctan 3 — 
arctan(—2) = x — arctan(2). 


A4. Write z — 5 — 4i in polar form. 


AS. Write = in rectangular form. 


543i 
EXERCISES 35.1—Part B 
B1. If z; = a + bi and zz; = c + di, show that R(~) + B18. 3 — 6i, —8 + 2i B19. 5 - i, 3 - 4i 
Wish B20. 2— 9i, —5+6i B21. 9 — 8i, 1 4- 9i 
For the complex numbers z given in Exercises B2-11: B22. If zı = xı + iy; and z2 = x) + iy», show that |z; + z^ + 


(a) Obtain |z| and Arg z. 

(b) Obtain z and then plot both z and z. 

(c) Verify that z + z = 27(z) and that z — z = 2iZ (2). 
(d) Verify that zz = |z|?. 

(e) Express z in polar form. 

(f) Obtain z/z and z/z. 


B2. 8+4i  B3.3—5i  B4.—1-—9i BS.7+5i 
B6.8—9i  B7T.4—3i  B8.—5-2i  B9.8-i 
B10.6+2i B11. 9— 7i 


For the pairs of complex numbers z1, z2 given in Exercises B12-21: 

(a) Obtain zi + z2 and zı — z2 in the form a + bi and in the form 
p cis 0. 

(b) Obtain z;z; and o both in rectangular form. 

(c) Verify that |z;z2| cis(Arg ziz2) = |zillza| cis(Arg zı + 
Arg z2 + 2kr), for some k = 0, +1, ..., which keeps the 
argument of cis in the range (—z, 7 ]. 

(d) Verify that =| cis(Arg 2) = lal cis(Arg zı — Arg z2 + 2k), 


Iz2l 


for some k = 0,+1,..., which keeps the argument of cis in 
the range (—z, 7]. 
(e) Verify that |z; — zo? = Iz? Iz? — 2R(z122). 
(f) Verify that |z; + za] < |zil + lz2l. 
(g) Verify that ||zi| — |zall € |zi — zal. 
(h) Verify that Te } Tél = ], the identity from 
Exercise B1. 
B12. 4 4- 7i, —9 + 5i 
B15. —1-4-3i, 8 -3i 


B13. 7 — 8i,3 + 5i 
B16. —1— 4i, 2 + 9i 


B14. —5 + 5i, —7 +i 
B17. —2 — 7i, 8+ 5i 


Izi — zo? = 2(zP + |z2|?). Interpret geometrically in terms of 
the diagonals and sides of a parallelogram. 

B23. If zı = x; + iyı and z2 = x? +iy2, show in general that 

(a) (zi + 22) = R(zi) + R(z;) 

(b) Z(zi + 22) = (G1) + I(G2) 

(e) (z1z2) = R()R(G2) — Z())1 (22) 

(d) Z(ziz2) = R(z))£Z (22) + (3) R(z2) 

In Exercises B24—38, reduce the given complex number to rectangular 

form. 

B24. (—7 +i) - (1 i) - (—2 + 9i) 

B25. (—2 + 6i) + (—7 — 9i) + (44+ 9i) 

B26. (2 — 3i) — (3 — i) + (-3 — 3i) 

B27. (4 — 6i) — (8 — 9i) — (9 — 3i) 

B28. (6 — 3i) + (—9 — 4i) — (—1 — 2i) 

B29. (1 + 7i)(5-2i)(-1—6i) B30. (—9)) (5 — 4) (7 + 3i) 


B31. (7 +3i)(4— 9i)(2—i)  B32. (5 + 2i) (6 — 7i) (9 + 3i) 
B33. (-8 + 3i)(3 +7i)(6+5i) B34. 1 2-4 
e (Q— EILS L L . 
-948i | —7—3i 
249i pai 1-9: | —3— di 
B35. he eo 
—6+9 dx +i 847i 
547i | 8—5í 1—7i | —544i 
B37. + i " 2 B38. H DP 
7 — 8i —9+42i 9 — 2i 3+i 


In Exercises B39—48, graph and/or describe the set of complex numbers 
that satisfy the given condition. 
B40. 1 <Z(z) 3 B4. |3z —4| =5 
B43. |z| 2 |z +i] B44. |z| = 2|z + 3| 
B46. |z +5 —7i| = |z — i| 
B48. |z — 2i| = |z + 1| + 4R(2) 


B39. Z(z) 23 

B42. |3z —4| <5 
B45. |z| = Z(z) - 3 
B47. |z —243i| 2 |z - 1] - 8 
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The Function v = f(z) = z? 


Complex Functions 


An important component in any study of complex variables is a study of the behavior of 
complex functions of the form w = f(z). Such functions map the complex z-plane to the 
complex w-plane. 

If z = x + iy is a complex variable, then the function f(z) can be written as f(z) = 
u(x, y) + iv(x, y), where u(x, y) is called the real part of f and v(x, y) is called the 
imaginary part of f. In this and the following six sections, we will explore properties of 
the elementary functions of the calculus extended to the complex plane and illustrate the 
decomposition of these functions into their real and imaginary parts. 


Real and Imaginary Parts of f(z) =z? 


The real and imaginary parts of f(z) = z? are found by writing f(x + iy) = (x + iy)? as 
x? — y? + 2xyi, from which it follows that u(x, y) = x? — y? and v(x, y) = 2xy. 


Graphing f(z) =z? 


Because w = f(z) isa mapping of the z-plane to the w-plane, it is difficult to draw a simple 
graph representing the function. Hence, we will draw several different plots, each of which 
captures some aspect or other of the action of a complex function. Figure 35.2 shows a 
graph of the magnitude-surface 


jw) 2 If @l = vit +0? =x? + y? 


Figure 35.3 shows (in the plane of w = u + iv) images of the grid lines in the z-plane, 
namely, the lines x = constant and y = constant, under the mapping induced by the function 
w = f(z). The curves opening to the left are the images of x = constant, while the curves 
opening to the right are the images of y = constant. For reasons to be revealed in Section 
36.6, this graph is called a conformal plot for f(z) = z?. 


lw] 


3 


FIGURE 35.2 Magnitude surface for f(z) = z* 


Figure 35.4 shows, in the xy-plane, the inverse images of the rectangular grid lines in the 

w =uv-plane. This graph therefore shows the contours (level curves) for u(x, y) = constant 

u and v(x, y) = constant, contour lines that “live” in the xy-plane. The (solid) hyperbolas 

FIGURE 35.3 Conformal plot for x? — y? = constant are the contours of u(x, y), while the (dotted) hyperbolas xy = constant 
fQ=2 are the contours of v(x, y). 


FIGURE 35.4 Inverse images of u = 
constant (solid) and v — constant (dotted) 
for f(z) 2 z? 


FIGURE 35.5 Riemann surface generated 
by f()-2z 
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Action of the Mapping Induced by f(z) = z? 


If the function f(z) = z? is expressed in polar notation, its action as a mapping of the z-plane 
to the w-plane has a simple geometric interpretation. Since the complex number z = x + iy 
can be written as z = r(cosÓ + i sin@), we have for f(z) = z? the corresponding form 

w = (r(cos0 + i sin 0))? = r?[(cos? 8 — sin? 0) + 2i cos 8 sin 0] = r?° (cos 20 + i sin 20) 
Thus, the magnitude of z is squared and the argument of z is doubled, in conformity with 
our earlier discussion on multiplication. 


For example, the complex number zı = —10 + i has a magnitude of 4/101 and an 
argument, in degrees, of 174.29. The magnitude of w; = f (zi) is then 101, which is |zi|?. 


The argument of w; = f (zi), in degrees, is — 11.42. The function z? doubles that to 348.58, 
an angle in the fourth quadrant, converted to an angle in the range (—zr, 7 ] by the arithmetic 
348.58 — 360 = —11.42. 


Riemann Surface for z? 


Because of the “doubling” property of w = z?, points in the upper half of the z-plane 
where 0 < Argz < x have their argument doubled and are mapped onto all the w-plane. 
Similarly, the lower half of the z-plane will also map onto all of the w-plane. Thus, the 
z-plane is mapped onto the w-plane twice. Two different points in the z-plane are thus 
mapped to the same point in the w-plane. The two points r cis 0 and r cis(0 + x) are both 
mapped to 


r? cis20 =r? cis(20 + 27) 


The polar forms of two complex numbers with the same magnitude and arguments differing 
by 2z evaluate to the same complex number in rectangular form. Hence, the rectangular 
form of a complex number has a primacy that allows us to think of the point as the complex 


number a + bi and the numbers p cis(ó + 2kz), k = 1,2,..., as copies of the primary 
point. 
To account for the numbers r? cis 20 and r? cis(20 +27) in the mapping w = z?, create 


two copies of the w-plane and stack them one above the other. As z ranges over the upper 
half of the z-plane, let the images fall in the first copy of the w-plane. As z ranges over the 
lower half of the z-plane, let the images fall in the second copy of the w-plane. If crossing 
the negative real axis in the z-plane corresponds to passing from one copy of the w-plane 
to the other, the range of w — z? will be an open connected set. (An open set is connected 
if each pair of points in it can be connected by a polygonal path lying completely in the set. 
The interior of a disk is an example of an open connected set.) A graph of this set is called 
the Riemann surface generated by z? and is shown in Figure 35.5. 


The Inverse Map z = yw 


Since “squaring” amounts to squaring the magnitude and doubling the argument, finding the 
square root amounts to halving the argument and taking the square root of the magnitude. 
However, the function w = f(z) = z? is a two-to-one mapping of the z-plane onto the w- 
plane. Consequently, the mapping back from the w-plane to the z-plane is not a function 
since itis one-to-two. However, by defining two distinct branches of the square root function 
and associating each branch with a sheet of the Riemann surface generated by z?, two single- 
valued functions for z = ,/w are obtained. 

A “geometric” point in the w-plane has two “numeric” representations, one above the 
other, on the two sheets of the Riemann surface generated by w — z?. The inverse image 
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of the point on the upper sheet lies in the upper half of the z-plane, and the inverse image 
of the point on the lower sheet lies in the lower half of the z-plane. 
For example, if w, = 4+ 3i = Scis(arctan 3), then zı = J/w; should be the complex 


number 4/5 cis(3 arctan 2), for which the magnitude is the square root of |w; |, and the argu- 


ment, 1 


=f 


Arg(w;). Thus, we have 


zi = 5 [cos (1 arctan 3) + i sin (4 arctan 3)] vilis 
1 ; aretan 2 1 — cos (arctan 3 
E / + cos Ss an i) r e i) (35.4b) 
1+4 [1-3 
a fat (35.4c) 
T 
6+) (35.4d) 


JB 


What about the square root that lies in the lower half of the z-plane? How is that to be 
found? Since the Riemann surface identifies the two numbers r? cis 20 and r° cis(20 + 277), 


the inverse image of the first is r cis0, just computed as zı = Fu 


345 1 
= +D whereas the inverse 


image of the second is r cis(0 + zr). Thus, the arguments of the two square roots of w, differ 
by zr, and the second square root of w; is —z1. 


EXERCISES 35.2—Part A 


A1. Verify the calculations in (35.4a)—(35.4d). 


m 
= z] 


A2. Let zı = —1 + i, and express w 
form w =r cis0. 


in rectangular form and polar 


A3. Find z2 Æ zı for which 25 = W, where w is as computed in 
Exercise A2. How are zı and zz related? 


EXERCISES 35.2—Part B 


A4. If ij is as computed in Exercise A2, obtain /w = Jr cis(0/2). Is 
this zı or z2? 


AS. Obtain ./r cis paan, How is this related to v Ùw? 


B1. The function w = z? takes a point on the circle |z| = 1 to a point 
on the Riemann surface in Figure 35.5. The circle x = cos f, 
y — sint, 0 € t < 2x, can be mapped onto this surface by 
drawing the space curve u = cos2t, v = sin2t,h = y = sint, 
0 < t < 2x, where h is “height” on the Riemann surface. Using 
appropriate technology, obtain a graph of this path on the Riemann 
surface generated by z?. Why did we choose h proportional to y? 


For the complex numbers z in Exercises B2-11: 


(a) Obtain |z| and 0 — Arg z. 


(b) Obtain z? in the form o = a + bi, and then write o in the 
form r cis o, where w = Argo. 


(c) Show that r = |z|? and w = 20 + 2kzt, where k is chosen so 
—m «oti. 


(d) Plot both z and z? on the same Argand diagram. 


(e) Obtain rı = yz] cis $ and r; = /|z|cis($ + 7), the two 
square roots of z. 


(f) Plot z and its two square roots on the same Argand diagram. 

(g) Compute z?? = |z|? cis(3 Arg z), r}, r3, and 
V2 = Iz? cis(4 Arg 2°). If the first number is the principal 
value of z?"?, which of the other three numbers is in 
agreement? 

(h) Compute z? = |z|5/? cis(3 Arg z), rĵ, r5, and 
V25 = |z|" cis(I Arg z5). If the first number is the principal 
value of z??, which of the other three numbers is in 
agreement? 
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B2.—1—-2i B3.-4-5i  B4.8-i BS5.6+5i (c) Compute d E [| cis 5, where t = Arg z; — Arg z2 + 
B6. —7 — 11i B7. —11 + 2i B8. —11 + 12i B9. 12— 11i 2kz, with k = 0,+1,..., chosen so that —7 < t «7r. 
y 1 zZ zıl cis 1 rgz 
B10. 1+4i Bil. —1 — 6i (d) Compute V = aod m and compare to part (c). 
For each pair of complex numbers z; and z; given in Exercises BI221: $12. 8.1 6j, 10i B13. —10 +2i,3 — 5i 
(a) Compute J/ziz; = v |zız2| cis $, where o = Argzi + B14. —7— 7i,4—6i B15. —7 — 7i, 3 + 3i 
Arg Z2 + 2kzt, with k =0,+1,..., chosen so that B16. 1+11i,-8+12i B17. 3— 8i, 112 - 5i 


-N «ox. 


(b) Compute J/z;,/z; = 4/Izilcis(3 Arg zi) Iz2] cis (3 Arg z2), B20. 3 — 8i, —6 — 5i 


and compare to part (a). 


2 
1 T 
v 0 
=] "- 
-2 — 
-2 -1 0 1 2 
u 
FIGURE 35.7 Conformal plot for 
fo =z 
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-3 -2 =l 0 


FIGURE 35.8 Inverse images of u = 
constant (solid) and v — constant (dotted) 
for f(z) =z? 


B18.—1—i,3—7i B19. 3 — 6i, —9 + 8i 


B21. 2 — 10i, —11 + 2i 


T The Function w = fius? 


Real and Imaginary Parts of f(z) 2 z 
Separation of f(z) = (x + iy)? into its real and imaginary parts gives, respectively, 


u(x, y) 2x?—3xy? and v(x,y) = ax^y — y? (35.5) 


FIGURE 35.6 Magnitude surface for f(z) = z? 


Graphing f(z) = z? 


Figure 35.6 contains a plot of |w| = Vu? + v? = (x? + yy. Figure 35.7 contains a 
conformal plot showing how grid lines in the z-plane map into the w-plane. Curves opening 
left and right are the images of x — constant, whereas curves opening toward the top or 
bottom of the graph are images of y — constant. Figure 35.8 shows, in the xy-plane, the 
inverse images of the rectangular grid lines in the w-plane where w = u + iv. The (solid) 
curves are the contours (level curves) for u(x, y) — constant and the (dotted) curves are the 
level curves for v(x, y) — constant. 

3 


Action of the Mapping Induced by f(z) =z 
Writing z = x + iy as r cis 0, we find that 

w=z7 = r° (cos 30 + i sin 30) 
Thus, under the mapping induced by the function f(z) = z^, the magnitude of z is cubed 
and the argument of z is tripled. For example, given the complex number zı = —10 + i = 
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FIGURE 35.9 Riemann surface 
generated by f(z) = z? 


FIGURE 35.10 
w; =44+3i 


The three cube roots of 


/101 cis 3.042, the magnitude of w; = f (zi) is then |z,|> = 101/101 and the argument 
of w is 2.842 = 3(3.042) — 27. 


Riemann Surface for z^ 


On the unit circle |z| = 1, the arcs determined by 
2 2 
ss c Nd ob tn 
3 3 3 3 


are each mapped by w = f(z) = z? to the complete circle |w| = 1 in the w-plane. The w- 
plane is covered three times by the mapping w = z?. Three different points in the z-plane 
are thus mapped to the same point in the w-plane. For example, the three points 


: . 27 . 4x 
r cis 0 r cis (e r cis ipis 


are all mapped to r? cis(30) = r? cis(30 + 27) = r? cis(30 + 47). 

To account for these numbers in the mapping w = 2°, create three copies of the w- 
plane and stack them one above the other. As z ranges over the sector of the z-plane given 
by0 <6 < 2 let the images fall in the first copy of the w-plane. As z ranges over the 


= X 0 < =, let the images fall in the second copy of the 


sector of the z-plane given by = 
w-plane. As z ranges over the sector of the z-plane given by E X 0 < 2x, let the images 
fall in the third copy of the w-plane. If the three copies of the w-plane are connected along 


the positive real axis, the result is the Riemann surface seen in Figure 35.9. 


The Cube-Root Function 


The function w = f(z) = 2° is a three-to-one mapping of the z-plane onto the w-plane. 
Consequently, the mapping back from the w-plane to the z-plane is not a function since 
it is one-to-three. However, by defining three distinct branches of the cube-root function 
and associating each branch with a sheet of the Riemann surface for z^, three single-valued 
functions for z = w!/? are obtained. 

A "geometric" point in the w-plane has three “numeric” representations, one above 
the other, on the three sheets of the Riemann surface for w — z?. The inverse images of 
three points lying one above the other in the w-plane will fall into the separate sectors 
0x0 -« an a x0- Hot <0 < 2m in the z-plane. 

The cube root of w; = 4 + 3i = Scis(arctan 2) is w^ = 51/3 cis(1 arctan 2), for ex- 
ample. Since mapping the z-plane to the w-plane by w — z? cubed the modulus and tripled 
the argument, the inverse mapping consists of taking the cube root of the modulus and 
dividing the argument by three. 

What about the cube root that lies in the sector = «0c a of the z-plane? How is that 
to be found? Since the Riemann surface identifies the three numbers r? cis(36 + 2kr),k = 
0, 1, 2, the inverse image of the first is r cis(0), as just seen, whereas the inverse image of 
the second is r cis(0 4- 2r), Similarly, the cube root that lies in the sector E x0 «2z-z 
of the z-plane is given by r cis(0 + H ). These three cube roots are shown in Figure 35.10, 

2m 4x 


along with the rays 9 = 0, =, =. 


DeMoivre’s Laws 


A generalization of the process of finding square roots and cube roots of complex numbers 
is given by DeMoivre’s law (Abraham DeMoivre, 1667—1754). For an integer n > 0 we 


have 


831 


35.3 The Function v = f(z) = 2 


0 2k 
w!” = [r cis0]"/" = [r cis(0 + 2kzx)]"" = r!” cis E + =) k 20,1,...,n—1 


n n 


Thus, to obtain an nth root of a complex number, realize first that the function z" maps 
the z-plane onto n copies of the w-plane. For example, the function z? takes the wedge 
0 < 0 < 7X onto the whole w-plane. Hence, if we let z? map the whole z-plane to the 


2 


w-plane, each point in the w-plane is a recipient of three different points in the z-plane. The 


9 9. 
sectors 0 < 0 < ra fe 


<@<= 


E , and zu X 0 < 2z each map onto the whole w-plane. 


To keep these three images in the w-plane distinct, three copies of the w-plane are stacked 
over each other and the w-points whose arguments differ by 27 are identified with each 
other. Then, when it's time to invert, each of the three points sitting one above the other is 
independently pulled back to the z-plane, one to each of the three sectors of size 2 

A generalization of DeMoivre's law, for any integer m > 0, is 


w” = [r cis0]" = r” cis mo 


Combining both laws we would have w"/" = r"/" cis(“0 + "2kz), k 20,1,...,n— 1, 
where both m and n are integers. 


EXERCISES 35.3-Part A 


A]. Verify the results in (35.5). 
A2. If z = x + yi, show that |2| = Ju? + v? = (x? + yy? É 
A3. Express the cube roots of w; = 4 + 3i in rectangular form. 


EXERCISES 35.3—Part B 


A4. If zı = 1 +i, obtain w; = zj in both rectangular and polar forms. 


A5. If zı and w; are as in Exercise A4, find z2 and z3, both different 
from zı and each satisfying z; = wi, k = 2,3. 


B1. Obtain the three cube roots of i. 
For the complex number z in each of Exercises B2-11: 


(a) Obtain |z| and 0 — Arg z. 

(b) Obtain z? in the form o = a + bi, and then write ø in the 
form r cis o, where w = Argo. 

(c) Show that r = |z|? and that o = 30 + 2kz, where k is chosen 
So0—z «ots. 

(d) Using DeMoivre's law, compate the three cube roots of z and 
plot them on the same Argand diagram. 

(e) Let r,, k = 1, 2, 3, be the three cube roots of z. Compute 
TA = |z|2/3 cis(= Arg z), 8,72, and 4/2? = 
Iz? cis(4 Arg z?). If the first number is the principal value of 
27/3, which of the other four numbers is in agreement? 

(f) Compute 25/3 = |z|V? cis(3 Arg z), rf, r3, r3, and V5 = 
[z [5 cis(4 Arg z°). If the first number is the principal value of 


25/3, which of the other four numbers is in agreement? 
B2.3—5i  B3.—;— ji  B4.8—9i  B5.7-5i 
B6. t- ji B7.-9+5i  B8.7—8i B9. $— 3i 


B10. 55i  Bl1.—-I- ii 


For each pair of complex numbers z and z; given in Exercises B12-21: 


(a) Use DeMoivre's law to compute 4J/ziz» and 4/z; 4/z;. Do the 
results necessarily agree? 


(b) Use DeMoivre's law to compute |? T and Ya. Do the results 


necessarily agree? 


B12. 4+i,5—3i B13. 4—8i,2 + $i B14. $+ ii, 8 5i 
B15. 9—2i,5+4i B16. —8 +3i, $ — ši B17. 5 — 21, 8 — 4i 
B18. —2 — 7i,8+3i B19. L—243- 7i 

B20. 9+9i,2+9i B21. 2 — 5i, $ — $i 

B22. Use DeMoivre’s law to compute 


(a) the four fourth roots of 1, —1, and i. 
(b) the five fifth roots of 1, — 1, and i. 


Show that a circle with center at zo has an equation of the form 
— Zoz +a = 0, where a is real. What is the radius of the 


B23. 


BE m= Zoz 


circle? 
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B24. Show that the line joining the points z; and z2 is perpendicular to (a) the centroid, the intersection of the medians, is located at 


£1—22 


the line joining the points z3 and z4 if the number A = 3-2 is 3 (21 + Z2 + 23). 


pure imaginary. 


B25. Using (cis 6)” = cis m6, show that cos 50 = 16cos? 6 — 


20cos? 0 + 5cos 0. 


23—24 
(b) the centroid divides each median in the ratio 1:2. 


In Exercises B31—35, the given values of p, q, and r determine the cubic 
equation z? — 3pz? + 3qz — r = 0, whose three roots are the vertices of 


In Exercises B27—30, derive the indicated trigonometric formulas. a triangle in the complex plane. Show that the centroid of the triangle is 


the point corresponding to p. 


B26. cos? 0 + sin 0 = 4[cos 30 + 3cos0 — sin 30 + 3sin6] 


B27. cost 6 + sint 0 = 1[cos 40 + 3] 


B28. cos? 0 + sin 6 = 4[cos 56 + 5cos30 + 10cos6 + sin 50 — 


5 sin 36 + 10 sin 0] 
B29. cos* 6 + sinf 0 = 1[3cos40 + 5] 


B31. p 2—i-2iq =3 + i,r = 12 — 44i 
B32. p = } — 3i,q = $ + 6i, f = 26 — 22i 
B33. p = į +i,q =7 + $i,r =39 — 91i 

B34. p = > + 2i, q = $ + i,r = 17 — 33i 


B30. If zi, z2, and z3 are the vertices of a triangle in the complex plane, B35. p = —1 + i,q = -2 + 9i, r = 60 — 40i 


show that 


FIGURE 35.11 Magnitude surface for 
f(z) = e& 


The Exponential Function 


Euler’s Formulas 


The exponential function, e^, is a very important component of complex function theory. 
This importance derives, in part, from Euler's formulas, which state e? = cis 0. In greater 
detail, we have e^ = cos@ +i sin0 and e^? = cos 0 — i sin 0. Consequently, the complex 
number e’? has magnitude 1, and argument 0. The points that satisfy e/^ = 1 comprise a 
circle with radius 1 and center at the origin. 

Another consequence of Euler's formulas is 


x+iy 


e = e*e? = e” (cos 0 +i sin0) 


Hence, the polar form of a complex number z is easily replaced by the exponential form 
z= izle! Arg(z). 

Euler's proof of the identity e^ = cos + i sin6 was based on the Taylor series ex- 
pansion e* = $`} o x^/K!. Just as this series was used to define e^' for a matrix A, so too 
is it used to define e*. In particular, e^ = Y 7 9 (i0)*/!, where 


. . 2 . 4k 4-3 . Ak . 
jH 4+2 j2] j*39.2j j+ -ij^21 


i --—i i 
The four values i, i? = —1, i? = —i, i^ = 1 are cyclic, and the terms in the series alternate 
between real and imaginary. Hence, the series can be rearranged to 
" Y (—1)*62* si 99 (—19?c 
e — ——————— 1 ————— 
Ik)! ! 
rae (2k)! "ww (2k + 1)! 


On the right, the first series is the expansion of cos 0 and the second of sin 0. Of course, we 
have worked formally and have not considered questions of convergence. Typically, texts in 
complex variables define e* by Euler's formula and then later in the course show the series 
representation is valid. 


Real and Imaginary Parts of e* 


The function w = e* can be written in the form u(x, y)+iv(x, y), where u(x, y) = e* cos y 
and v(x, y) = e* sin y. 


FIGURE 35.12 Conformal plot for 
f(z) =e 


EXAMPLE 35.3 


FIGURE 35.13 Portion of the Riemann 
surface for f(z) = e* 
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Magnitude Surface for e* 


Figure 35.11 exhibits a graph of |e*| = |e* "| = Je*e*"| = e*| cis y| = e", the magnitude 
of w = e. 


Conformal Plot for e* 


The conformal plot for w = e* in Figure 35.12 shows, in the w-plane, the images of the 
grid lines of the z-plane. This graph suggests that the fundamental strip —r < y < x inthe 
z-plane is mapped by w — e* to all of the w-plane less the origin. Indeed, the grid line 
x-—l,—m«yctzm,mapstoacircle with radius e and center at the origin. As x varies, the 
circle increases or decreases in radius. Consequently, as x varies in the z-plane, w attains 
all values except w = 0. Indeed, every horizontal strip of width 27 in the z-plane will map 
onto the w-plane less its origin. With Arg(z) in the range (—z, 7 ], the horizontal strips of 
width 27 are bounded by the lines y = (2k + yr, k = 0, +1, +2,.... 

Therefore, the map w = e? is “infinitely many"-to-one, and the Riemann surface for 
the exponential function has an infinite number of sheets. Figure 35.13 shows a small portion 
of this Riemann surface. 


Law of Exponents 


The “law of exponents,” familiar from real-variable calculus, also holds for complex num- 
bers. Thus, we have 


git ost ua (35.6) 
If zı = 2 + 8i and z2 = 4 — 7i, then e? *? = ef cos4 — ief sin 4 = e? e, e 


Derivation of the Law of Exponents 
We wish to show ete? = e*»12*?HY. can be transformed into e^^7, Euler's formula 
gives 

e" e"? (cos yj cos y? — sin y; sin y2) + ie" e? (sin y; cos y? + cos y; sin y2) 


and combining the trigonometric terms using the standard identities for the sum of two 
angles gives 


e^ e? cos(y; + y2) + ie? e? sin(yi + y2) 
Combining the real exponentials and factoring then gives 


e^ ** [cos(y1 + y2) +i sin(yi + y2)] = e? *? 


The Reciprocal Rule 


The reciprocal rule e~* = 1/e* follows from (35.6) by setting zı = z and z2 = —z since 


gi ul uud, 


Conjugation 

The exponential of the conjugate is the conjugate of the exponential, as made precise by 
the identity e? = e. In fact, if z = x + iy, then e? = e? = e* cos y — ie’ sin y. 

The Equation e = 1 


The solution set for the equation e? = 1 is precisely the setz = (2kzri), where k is an integer. 
Clearly, z = 0 satisfies the equation. By the following argument, the remaining solutions 
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EXAMPLE 35.4 


EXERCISES 35.4—Part A 


are found on the imaginary axis in the complex plane. Write 

et = et? = e* cos y -- ie* sin y =1+0i 
and equate real and imaginary parts. From e* sin y = 0, we determine y = kz, where k is 
an integer. From e* cos y = 1, we then obtain te* = 1, which forces us to choose x = 0 


and k even. 
If e*! = e?, then e? ? = 1, so zı — z2 = 2kzii, that is, the complex exponents differ 


by an integer multiple of 277. 


Ifz=2+3i = /13ei srctan3/2). then 2 = [z^ e? arctan(3/2) — |z|" cis(5 arctan 3 = 169413 


[cos(5 arctan 3) + i sin(5 arctan 3)] = 122 — 597i. "e 


DeMoivre's Laws 


Example 35.4 uses DeMoivre's law, namely, the rule [e/?]" = e'"?, where n is an integer. 
Since e'* = cis x, the exponential function therefore subsumes DeMoivre's law. 


Exercises Al-6 use z; = 1 +i andz; = 1 + i3. A4. Verify that eh = e. 


Al. Write z; in exponential form. 
A2. Verify that e?! = 1/e*!. 


AS. Using the exponential formalism, obtain both square roots of z;. 


A6. Using the exponential formalism, obtain all three cube roots of z;. 


A3. Verify that e?! /e = e 72, 


EXERCISES 35.4-Part B 


B1. By computation, show that e+!" = —1 fork = 0, +1, +2, -3. B12. 4+i,5—3i B13. 4—8i, 2 - $i. B14. É+ 14,84 5i 
B15.9—2i,5--4i B16. -8--3i,$— 3i B17. —3 — 21, 8 — 4i 
B18. —2 —7i,8+3i B19. $ — 253— 7i 

B20. 9+9i,2+9i B21. 2 — 5i, $ — $i 


For each z = x + iy given in Exercises B2-11: 


(a) Verify computationally that e = (e?)* fork = 2,..., 5. 


—2xy 


(b) Verify computationally that le? | =e 


(c) Compute e**?**! for k = 0, +1, £2, 3. In Exercises B2231: 
(d) Obtain "d = exp(exp(z?)) and (a) Write each of the given functions in the form u + iv, thereby 
(e* y = e% = exp(exp(z)). Are these the same? obtaining u(x, y) and v(x, y), the real and imaginary parts, 


, . ae respectively. 
(e) Obtain z = |z|e/ ^7. ere ae 


(f) Use the exponential form to obtain both square roots of z, and 
express them in rectangular form. 


(b) Obtain in the w-plane, a graph of the images of grid lines in 
the z-plane. 
(c) Obtain in the z-plane, a graph of the pre-images of grid lines 


Use the exponential form to obtain all three cube roots of z, : à : 
(g) P in the w-plane. (Hint: Obtain contour plots of u — constant 


and express them in rectangular form. 
and v — constant.) 


je 3 TM i . =< TM 1 j . — 1 . ` j 9: ^ 
B2 5i B3. -;—;i  B4.8-9i B5. 7 4- 5i B22. f(Q=ze B23. fee BA f) =le 
B6.i— ji B7.-9+5i  B8.7—8i  B9.i —3i e g e 
B10. 55; B11. —} + Łi ee a ee Um Bg 
For each pair of complex numbers z; and zz given in Exercises B12-21, B28. f(z) = ze B29. f(z) = ze 


obtain, in rectangular form: , 
B30. f(z —e^ JB31. f(z) = — 


ea 2122 


(a) (b) (c) ze? + ne! (d) 


ea ea + e? eaa 


EXAMPLE 35.5 


EXAMPLE 35.6 
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The Complex Logarithm 


Complex Logarithm as Inverse to w — e* 


We will define the complex logarithm In z as the function inverse to f(z) = e*. However, 
€*, the exponential function, is “infinitely many"-to-one. Hence, the complex logarithm 
will be one-to-“infinitely many" and will require careful definition of branches to yield a 
“function.” 

It is usual to consider two versions of the complex logarithm, log z and Log z, as 


log z = In |z| + i Argz + 2kzi Logz = In |z| +i Argz 
where k is an integer, In x is the real natural logarithm from elementary calculus, and Arg z, 
lying in the interval (—zr, zr], denotes the principal value of the argument of z. The second 
formula defines Log z as the principal value of the logarithm and is the single-valued branch. 


The first formula defines log z as a multivalued logarithm. Specification of a particular value 
of the integer k then yields a single branch of this multivalued function. 


The principal logarithm maps the points wg, k = 1,2,3, in Table 35.1 back to zg in the 


z-plane. The arguments of zz, k = 1, 2, 3, all lie in the fundamental strip —m < argz < m. 
4 


w z = Log w = In |w| + i Arg w 
w =i zı = Logi = i 
w =5+i z2 = Log(5 + i) — In v26 + i arctan $ 
ws; —2-— 13} z3 = Log(2 — 13i) = ln 4/173 — i arctan E 


TABLE 35.1 Principal value of the logarithm for the three points in 
Example 35.5 


The points z4 = 1, z5 = 1 4-2zi, zé = 1d-4zti, z7 = 14- 671i, lie ona vertical line segment 
in the z-plane, each in a successive strip of width 2x. The function w = e* maps each of 
these points to e. Consequently, the principal logarithm will return each image back to 1. 
To obtain the preimages from which each copy of e came, the multivalued logarithm must 
be used. Thus, using loge = In |e| + i Arge + 2kzti = 1+ 2kmi,k = 1,...,3, we get 


zs = lne +i Arge +2ri  zg-—lne-ciArge-c4zi 7z7=Ine+iArge+ 6zi 
D 
Laws of Logarithms 


With a real and x and y both positive, Table 35.2 lists the “usual” rules for working with 
the real logarithm. If a is not real, or if x or y fail to be positive, and the logarithm is Log, 


å Inx = Inx^ Multipliers become exponents 

Inxy — Inx 4- In y log of a product is the sum of the logs 

In = lnx —Iny log of a quotient is the difference of the logs 
Ine = e"* =x e* and In x are inverse functions 


TABLE 35.2 Properties of the real logarithm, where a is real, and x, y, are 
positive 


EXAMPLE 35.7 


EXAMPLE 35.8 


EXAMPLE 35.9 


EXAMPLE 35.10 
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the principal complex logarithm, then four of the five "rules" in the table fail to be true 
in general. (We have counted the two expressions for inverse functions separately, since 
e187 — z is always true but Log e? ¥ z in general.) 

The following examples verify the failure of the familiar “laws” of logs learned for rea 
logarithms in calculus and precalculus. 


For any z, we always have e/°8* = z. However, if z; = 1 + 10i, then |e? | = e but Arg e^ = 
10 — 47 because the 10 in e! means 10 radians, an argument that must be expressed as 
an angle in the interval (—7., 2]. Hence, 


Loge? =Ine+i(10 — 47r) 214 i(10 — 4x) 
so Log e!*!?' 4 1 + 10i. In general, therefore, Log e z z. > 


This result should not be so surprising since its analog exists even for the real trigono- 
metric functions of calculus and precalculus. For example, the functions tan x and arctan 
are inverse to each other. But because tan x is “infinitely many”-to-one, arctan x is one-to- 
“infinitely many,” thereby requiring the same definition of a principal branch as does the 
complex logarithm. Consequently, while it is true that tan (arctan x) = x, it is also the case 
that arctan (tan x) Æ x. For example, arctan (tan 10) = 10 — 3z, not 10. 

Thus, for any “infinitely many”-to-one function f(x), the inverse g(x) will always 
require defining a principal branch, and this same phenomenon, namely, f(g(x)) = x. but 
gCf (x)) Æ x, will occur. 


If the "familiar" rule Loge? = z fails for the principal complex logarithm, then there is 
no reason to expect the "rule" Logz” = w Logz to hold either. For example, we have 
Log i^ = Log 1 = 0, but for the alternative we have 4 Logi = 4(In 1 + £i) = 2zi. Thus 
even in the simplest of cases, for the principal complex logarithm, “multipliers become 
exponents” is not a valid operational rule. > 


If zı = —5 + 2i and z2 = —6 + i so that zız2 = 28 — 17i, then Logz; = 1.68 + 2.76 
Log zz = 1.81 + 2.987, and Log(z;z2) = 3.49 — 0.557. "The Log of the product equals the 
sum of the Logs” fails for these numbers since 


Log zi + Log zz = 3.49 + 5.74i zz 3.5 — 0.557 = Log(ziz2) 


and, hence, is not true in general for the principal complex logarithm. 


To demonstrate the failure of the rule “the Log of a quotient is the difference of the Logs. 
consider the complex number zı = —1 + i and its complex conjugate z2 = —1 — i. Then 
we have the principal logarithms 


1 3 g 
j1n2— jri Log — = Log( A i 


l 3 
Log zi mii n ee Log z2 = 


logarithm, it is not in general true that “the Log of a quotient is the difference of the Logs." 


ka 
1 


for which we see Log zı — Log z2 = 3zi # —£i = Log 2, Thus, for the principal comples 


Salvaging the Laws of Logarithms 


The following are valid for the complex logarithm, provided they are interpreted to hold for 
some branch. 


loge? =z logz” = wlogz 


log(ziz2) = log zı + log z2 
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When working with the principal complex logarithm, the following are valid. 


Loge =z + Qzi)ni (35.7a) 
Logz” = w Logz + Qzri)n» (35.7b) 
Log(ziz2) = Log zı + Log z2 + (2zi)n3 (35.7c) 
Log 4. — Log z, — Logz; + zri)n4 (35.7d) 


Z2 


In each case there is an integer ng for which the statement is true. More precisely, i = nı (z), 
that is, nı depends on the complex number z; n? = n»(z, w), that is, n2 depends on both w 
and z; and similarly, both n3 and n4 will depend on z; and z2. Clearly, the ną must be chosen 
so that the complex numbers on the right sides have arguments in the interval (—z, 7 ], just 
like the principal logarithms on the left sides. Explicit formulas for ng, k = 1,...,4, are 


explored in the exercises. 


EXAMPLE 35.11 


In Example 35.7 we saw that for zı = 1 + 10i, the law Log e? = z; failed because the left 


side evaluates to 1 +7(10 — 477). Consequently, we must have n; = —2 in order for (35.7a) 


to be valid in this case. 


je. 
€ 


EXAMPLE 35.12 In Example 35.8 we saw that for z = i and w = 4, the law Log z” = w Log z failed because 
the left side evaluates to 0 but the right side evaluates to 277i. Hence, n? = —1 makes (35.7b) 
valid in this case. 

EXAMPLE 35.13 In Example 35.9 we saw that for zı = —5 + 2i and z2 = —6 + i, the rule “the Log of the 


product is the sum of the Logs" failed because the Log of the product is 3.49 — 0.55i but 
the sum of the Logs is 3.49 + 5.74i. Choosing n3 = —1 makes (35.7c) valid in this case. 


EXAMPLE 35.14 


3. 
v 


In Example 35.10 we saw that for zı = —1 + i and its conjugate z2 = —1 — i, the rule “the 


Log of the quotient is the difference of the Logs" failed because the Log of the quotient is 


— Fi but the difference of the Logs is imi. Hence, taking n4 — —1 makes (35.7d) valid in 
this case. 4e 
EXERCISES 35.5—Part A 
Exercises Al-6 use z; = 1 +i, z2 = —2 +i, and zi = —10 + i. A4. Determine the branch (that is, determine the integer 3 in (35.7c) 


AIT. Obtain Log zı, Log z2, Log(ziz2). Log =. 


z3 
A2. Obtain log £l» log Z2, log(zız2), log L 
e eo e e 


23^ 


A3. Obtain Log zı + Log z2 and compare to Log(z;z»). 


EXERCISES 35.5—Part B 


. Obtain Log zı — Log zz and compare to Log ++ 
A6. 


for which Log zı + Log z2 = Log(ziz?). 


23' 


Determine the branch (i.e., determine the integer k) for which 


z xc z1 
logz; — log z2 = log P: 


B1. Compare Log æ to z for z = —2 + 3i and z = —2 + 4i. 
Define the function Mı (z) = [1-29 
function. Then, for z given in each of Exercises B2-11: 


(a) Compute Log e* and compare to z, determining empirically 


the value of the integer nı for which the law Log e* = 
z + Qzi)n, is valid. 


], where [-] is the greatest integer 


B2. —2 + 8i 
B6. 10— i 


(b) Compute N;(z) and compare to 71. 

(c) Compute z, = z + 2kzri, k = +1, +2, +3, and show 
&* = e = w. Then, obtain each z, from log w, the 
multivalued logarithm. 

B3. 3 — 6i 

B7. —9+ 1l 


B4. -4— lli 
B8. —10 + 9i 


BS. 1 + 10i 
B9. 5 — 8i 
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B10.8 —2i Bll. 11 — 12i B26. zı = —12 — 9i, z2 = —7— 7i B27. z1 =7+3i, z2 = —1— 8 

Define the function N5(z, w) = [4 Zing) RA], where again, B28. zı = —3 + 2i, z2 =8 +6i  B29.;,— —6 — 9i, 27; = —2— 4i 

[-] is the greatest integer function. Then, for z and w given in each of B30. zı = —6 — 4i, z2 = —4— 8i B31. z; = —11 + 9i, z2 = —3— 

"r1 bs alo d E 
Exercises B12-21: -1 7 < Argzı — Arg z2 < 27 
(a) Compute Logz” and compare to w Log z, determining Define the function N4(zi, z2) = 0  —z < Argzi — Argzo < 7 
empirically the value of the integer n? for which the law 1 -—2x < Argzı — Argz? < -n 
Logz” = w Logz + Qzri)n; is valid. Then for the complex numbers zı and z2 given in each of Exercises 
: B32-A1: 


(b) Compute N»(z, w) and compare to n5. 


: . : . (a) Compute Log = and compare to the difference Log zı — 
B12. z = —12 — 9i, w = —5 + 4i B13. 2 = 6 + 8i, w = —2 — Ti 22 


Log z2, determining empirically the value of the integer n4 for 


B14. z = 11 + 10i, w —24—3i B15. z = —2— 6i, w = —9 + 8i which the law Log = = Log zi — Log z2 + (27 i)n4 is valid. 
B16. z = 2 — 12i, w = —7 —3i B17. z = —6 + 10i, w = —9— 8i (b) Compute N4(zi, z2) and compare to n4. 
B18. z=4+1li, w =9+9i B19. z = —6 — 4i, w = 7 — 4i B32. zı = 12 — 10i, z2 = —9 + 5i B33. z; = —4 + 3i, z2 2 2-2 
B20. z= -11 —10i,w=2+3i B21. z=-8-4i,w=2—-4i B34, z1=5+1li,z=4+6i B35. zı = 1+ 1li, z2 = —4 — 9i 

=i m < Argz; + Arg z? < 27 B36. zı = —7 — 7i, z1 = —1 +6i B37. zı = 5 + 9i, z2 = —7 — 4i 
Define the function N3(z1, z2) = 0  —z «Argzi + Argz? < n ] . "5 : 

1 —Br « Arex) +Atez, S =T B38.:, = 12 + 5i, z2 = —4—i B39. z; = —11 + 5i, z2 = —7 + 

Then for the complex numbers zı and zz given in each of Exercises B40. z; = —8 — 3i, z2 = —2 + 9i B41. zı = —1 — 3i, z2 = —8 + 


B22-31: 


(a) Compute Log(z;z2) and compare to the sum Log zı + Log z2, 
determining empirically the value of the integer n3 for which 
the law Log(ziz?) = Log zi + Log z2 + (2zti)ns is valid. 


For each of Exercises B42—51, form the complex number z = pe'? from 
the given pair of real numbers (p, 0). Show that Arg z = 0 +2x[5 
where [ - ] is the greatest integer function. 

B42. (11, —12) B43. (8,-9) B44. (10,4) B45. (8, —3) 
B46. (11,—5) B47. (6,—2) B48. (5,7) B49. (10, —8) 
B50. (9, 7) B51. (11, 4) 


(b) Compute N3(z;, z2) and compare to n3. 
B22. zı = 2 — 5i, z2 = —5 — 4i B23. zı = —9 + 12i, z2 = 2 + 5i 
B24. z, =3 — iz =6-— 7i B25. zi = —9 + ŝi, z2 = —3 + 7i 


.& Complex Exponents 


DEFINITION 35.1 


Complex exponentiation is defined in terms of the logarithm by the equations 


The first is the general multivalued exponentiation, while the second is the principal 
value for exponentiation. In a purely formal sense, if the logarithmic rule for moving mul- 
tipliers to exponents were valid, the definition of complex exponentiation would reduce tc 
the tautology z^ = e°!8% = elogz = 2°. 


The following examples explore the range of possibilities for complex exponentiation 


EXAMPLE 35.15 To compute (1 + i)? by the definition z^ = e° 182 = ecln zl Argz+2kxi] | write 


i: sud fats 25/2 sai "xi NI 
gun J2-^-xi /442kri] = e? ei/Agl0ri - 25/2 cis (22) 


= 43 ( 


id) 


EXAMPLE 35.16 


0.5 = 


Imaginary 
axis 


Real axis 


FIGURE 35.14 Argand diagram of the 
first 8 values of 3!/7*1/10 


EXAMPLE 35.17 


EXAMPLE 35.18 
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This is nothing more than evaluating the polynomial z? at z = 1 + i. We should not expect 
multiple values, and we should not expect polynomial arithmetic to yield a different result. 


D 
To compute (1 + i)!? by the definition z^ = e° 8? = ecn |z|+i Arec+2k7i] | write 


5 2-- (i /4)i -2kzi 2/10 mi/20--2kzi 
ei /^Un J/2-r (xi /4)i -2kzi] - e” Pul 0--2kzi/5 


2 2 
= 21/10 E (5 + s) +isin (5 + Ska) | 


As k varies from 0 to 4, the five fifth-roots of 1 + i that emerge from (35.8) are listed in 
Table 35.3. $ 


(35.8) 


31/10 (cos 5 +isin 5) 1.059 + 0.168i 
9 9 
21/10 (cos = Jish =) 0.168 + 1.059; 
21/10 EU IT. —0.955 + 0.487i 
7 ° 20 20 i 
aof 1 i —0.758 — 0.758i 
” Wa of BEEN 
7 
21/10 (cos i sin x) 0.487 — 0.955i 


TABLE 35.3 The five fifth-roots of 1 + i 


clogz 


c Ez —e 


— es dad — € [ln |z|+i Arg z4-2kzri 
If z = 3 and c = ;5 + i5, then computing z^ = e c[In |z|-+i Arg z+2kxi] 


many values zz. Indeed, since Arg3 = 0, we have 


yields infinitely 


36 = g 1/74/10) 0n342kxi) _ 5 0n3)/7-kz/5 cis In3 n 2kz 
10 7 

In floating-point form, the first several values of 3° are 1.163 + 0.1287, 0.333 + 0.5281, 
—0.109 + 0.315i, —0.168 + 0.0597, and —0.080 — 0.050i. Figure 35.14 is a plot of the 
values corresponding to k — 0, 1,..., 7 and shows that as k increases, 3° tends to spiral in 
toward the origin because 3^ contains the factor e~**/>, which tends to zero with increasing k. 

D 
Surprisingly, i’ is real, as we see from 


+i j im /24-2kzi 
i= egi Un 1+in/2+2kxi) 


$ 


SEN = «.. ka 


pen 7 Eb 
—e 2/25 2kz 


Laws of Exponents 


Because complex exponentiation is defined in terms of the complex logarithm, the rules for 
complex exponents and for powers of complex numbers seem to be the most difficult. Many 
of the familiar properties of real exponents of positive real quantities fail in the complex 
case. The leftmost column of Table 35.4 lists five valid rules for exponents. The first and 
fifth have already been seen but are listed here for the sake of completeness. The middle 
column of Table 35.4 lists five rules that, in general, are not valid. The rightmost column of 
Table 35.4 lists valid counterparts for three of the invalid operations in the center column. 
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EXAMPLE 35.19 


EXAMPLE 35.20 


Valid Invalid Valid 
ELE =z (zw)! x z^ uw (zw d ous z“ w^ e2tian3 
yi E. - ofl 
ated — cd (=) = ee (=) = 2 eriam 
DNUS w wi w w^ 
at 
Ses ged (z^? z „ab zË = zb o2 ibny 
Fa e Z Z Z =z 
zi b F a 
(z^) z (z^) (z ^y" ae, 
Z =7z 
Integer n > 0 
2,nil/n = 
piod ad (z) zz 


za Integer n > 0 


TABLE 35.4 Valid and invalid manipulations with complex 
exponentiation 


From [69], the integer n»(z, a) is given by 
|: Z(a)ln tem] 
n:(z,a) = = 


2 27 


(35.9) 


where [-] is the greatest integer function, and (35.9) is N»(z, a), defined for Exercises 
B12-21, in Section 35.5. 

The integer n3 is chosen so that Arg z + Arg w + 2zt 5 lies in the interval (—z, 7]. 
The integer n4 is chosen so that Arg z — Arg w + 27n; lies in the interval (—7r, 2]. Hence. 
na(z, w) = N3(z, w) andn4(z, w) = N4(z, w), where N3 and N4 were defined for Exercises 
B22-31 and B32-41, respectively, in Section 35.5. Thus, we have 


—1 m < Argz + Arg w < 27 

n3(Z, w) = 0 -—-ma < Argz +Argw <m (35.10a) 
] —2r < Argz + Arg v < —7 
—] x < Argz — Arg uw <2z 

n4(z w)—4 0 —r «Argz— Argw <m (35.10b) 
] —2z < Argz — Arg v < -r 


If z= —10+ i and w = —11 + i, then 
(zw)! = —0.00341 — 1.210i z zw! = —0.637 x 10? — 0.00226i 


. . . A ^mi? 
The incorrect number on the right can be rendered correct by multiplying by e^"' "5, where 
n3 is determined by examining 


Arg z + Arg w + 2ztn3 = 27 — arctan a — arctan E + 2zn3 = 6.093 + 6.28n3 


from which we determine n3 = —1. Hence, the appropriate multiplicative factor is e?" and 


we find z'w'e27 = —0.00341 — 1.210i = (zw). 


If z 2 —104- i and w 2 z = —10— i, then (£)! = emtan@0/) — 1.221, and z!/w! = 
e2arctan(1/10)—27 — 0.00228. The first number is correct. The incorrect second number is 


rendered correct if multiplied by the factor e. where ng is chosen so that 


Arg z — Arg w + 2ztn4 = 20 — 2arctan m + 2zn4 = 6.08 + 6.28n4 


EXAMPLE 35.21 


EXAMPLE 35.22 


EXAMPLE 35.23 


EXERCISES 35.6—Part A 
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lies in the interval (—z, 2]. Hence, n4 = —1 and the appropriate multiplicative factor is 
e, SO zi/wi = glarctan(1/10)-2z 921. — | 321. D 


If z 2 —10 +i, a =3 + 2i, and b = 2 — i, then 
sı = (z^) = 1.049 + 17.297 
s2 = (z^)" = 10!°(8.63 + 1421) 


s3 =z = 10°(3.0+ 49.6i) 


Each of these three numbers is different, whereas for real exponents and positive z they 
would have been the same. 

To test the equality (27)? = ze?!" determine m by (35.9), obtaining [—1.69] = 
—2, so that sje ^^ = sı. To test the equality (z^)" = z*^e?/e":, determine n» by (35.9), 
obtaining [—0.101] = —1, so that s3e 774! = s». o 


As a more practical example of the interplay between roots and powers in the complex 


plane, let z = —1, a = 2, b = 5 and observe that z^^ = (—1)20/2! = —1. Note further 
that (z1)? # z% = (z^)" because 
[C19] ^ 2 41- l + [9f =? =-1 E 


Consequently, we infer that if n is a positive integer, then (z!/")" = z #4 (z")!/" and 
articulate this with the phrase roots before powers. Thus, if the root is taken before the power, 
then the exponents may be multiplied. If the power precedes the root, then the exponents 
cannot be multiplied. 


As a final example of the interplay between roots and powers, letn = 2 and take z = —1 +i. 
Then, direct computation gives 


[n =| (Vos - ie 2) | - ei: 
[2] ^ 2 22i -1- i2 -2 £z 


. . . . ^ C2 
which is consistent with the adage roots before powers. v 


Al. Obtain all values of 2/. 


A2. Obtain all values of (2i)'. AS. Evaluate ((—1 — i)?) 


1/3 


A3. Obtain all values of (2) . — A4. Obtain all values of (2'). 


EXERCISES 35.6—Part B 


Bl. Leta = —1 + i,z = —1— i, and w = 2 — 5i. Compare the 
principal values of (zw)^ and z^w^. 


For each complex number z given in Exercises B2-11: 


(a) Verify that els = z, where Logz = In |z| + i Arg z. 


(b) Verify that (ie) =z forn =2,...,5. Also, show that for 
the majority of these examples, (z”)!/" 4 z for the principal 
value of the nth-root function. 

B2.3—5i  B3.—;— ii  B4.8—9i  B5.7-45i 
B6.1— i B7. —9 + 5i B8. 7 — 8i B9. iji 


"4 10 7 
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B10. -5--5i  Bl1.—1- ji B24. z = —7 — 7i, w = 1 £ 2i, a 22 + 5i 
B25. z = —4 — 5i, w =8 + 6i, a =9 + 5i 
B26. z 27 — 5i, w = —8 — 6i, a = —2 — 9i 
B27. z 2 7 + 4i, w = —6 — Ai, a = 3 — 6i 


For the complex numbers z, c and d given in Exercises B12-21: 


(a) Verify that zzz = z^*7. (b) Verify that z°/z4 = z^. 
y 


Bash Ben? i eon B28. 254 4-2i,w 2 2— 6a — —1 — 9i 

BIS. z= 2-550 8-95 d = 5 — yi B29. z = —6-- 4i, w = —1 — 4i, a — 2 — 4i 

HIE Acsi Bep B Reset LUI SIC t B30. z = —5 —9i,w —7 —5i,a — 8 — Ti 
. de a > a 2: 

Br see c Engins qne B31. z = —2 + 3i, w =4-9i,a =5—i 


B16. z = 1 + 5i, c = —3 + 5i, d = —5 + 4i 
B17. z = 8 — 4i, c = —2— Ti, d = 8 + 3i 
BIS. g = —5+Ti,c = 7 —-Bi,d = § — 3 (a) Compare z^ to both (z^) and (z’)". 


For the complex numbers z, a, and b given in each of Exercises B32—41: 


B19. z = —3 + 3i,c =9 —6i,d = 1 —2i (b) Determine empirically the integer nz for which 


„ajb — „ab j2zibna " 
B20. :—9 —5i,c = -7 +3i,d =7 — 8i at pee iun 
BL ep —33,c09—5-- 81 —3-L5i (c) Using (35.9), determine n2(z, a) and compare to part (b). 


(d) Determine empirically the integer nz for which 


For the complex numbers z, w, and a given in each of Exercises B22-31: y = 74 e?riam holds. 
(a) Compare (zw)? to z^w^. (e) Using (35.9), determine n2(z, b) and compare to part (d). 
(b) Determine empirically the integer n3 for which the law B32. z = —1—Si,a=2+ 61,b —1—3i 
(cw)? = z^ w'e?'?5 is valid. B33. i-h—4aci-Lb--48— 
(c) Using (35.10a), compute n3(z, w) and compare to n3 B34, z= 548i. 945i, b 2 24i 


determined in part (b). "DA 
(d) C m "o : B35. z = —4--9i,a 29—3i,b = 5 + ži 
ompare (4) toz^/w^. = 
bane coa B36. z = —3 + 5i,a ed + 4i,b = —9 + 3i 
(e) elle empincaliy the integer n4 for which the law B3.:—3-24a—i-lib--5-5i 
(£) = z*e?ri?n^ Iw is valid. 3 6 


W g=-8 E E E E p=] 2433 
(£) Using (35.10b), compute n4(z, w) and compare to n4 B38. z = -3 +i a = -3 — gb b = —g + i 
determined in part (e). B39. z = 9 — 4i, a = —1 — 5i,b =2 + Ji 
B22. z =2—7i, w = —1 —3i,a =3 - 3i B40. z =—1 -ia =3+3ib=4+3i 
B23. z = —5 — 4i, w = —4 + 9i, a = —5 + 8i B41. z = —3 +i a = į + $i, b = —1 — 4i 


Trigonometric and Hyperbolic Functions 


The Trigonometric Functions 


In the complex plane, the elementary trigonometric functions are defined in terms of the 
exponential function. Because the exponential function defines an “infinitely many”-to-one 
map of the z-plane to the w-plane, the elementary trigonometric functions will do likewise. 
Any complications in the behavior of these functions can be traced to the behavior of the 
complex exponential function. 


The Function w = sin z 


The real and imaginary parts of sinz = u + iv are found from the identity 


sin(x + iy) = sin x cos(iy) + cos x sin (iy) 


N) 
ftant 
if EO 


lwl 


ANS, 
S WY Ly 


2 = 
3-2 
FIGURE 35.15 Magnitude surface for 
f(z) = sinz 


f(z) =sinz 


FIGURE 35.17 Portion of the Riemann 
surface generated by f(z) = sinz 
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after using the simplifications 
T l ag EER - vey "T 
sin(iy) = > (e 4» — eC) 2 isinhy and cos(iy) = : (e €» +e”) = cosh y 
Zl 
Consequently, we have u(x, y) = sin x cosh y and v(x, y) = cos x sinh y. 


Graphing w — sin z 


Figure 35.15 shows a graph of | sin z| = ysin? x + sinh? y, the magnitude of sin z. Along 
y = 0 we have | sin z| = | sin x|, so the zeros of sin z are just the real zeros of sin x along 
the real axis. Figure 35.16 is a conformal plot for sin z, showing in the w-plane, the images 
of grid lines in the z-plane. The hyperbolas are the images of the lines x — constant, and 
the ellipses are the images of the lines y — constant. 

Figure 35.17 contains a portion of the Riemann surface for sin z. The Riemann surface 
is "climbed" as a horizontal line in the z-plane is traversed from left to right. A vertical 
strip of width 27 in the z-plane maps to a sheet of the Riemann surface in the w-plane. 
The Riemann surface is drawn as a parametric surface whose height is determined by the 
variable in which the function w = f(z) is periodic. For w = e* the height on the Riemann 
surface was determined by y, whereas for w — sin z the height is determined by x. 


The Function w — cos z 
The real and imaginary parts of cos z = u + iv are found from the identity 
cos(x + iy) = cos x cos(iy) — sin x sin(iy) 
after using the simplifications 
sin(iy) =isinhy and cos(iy) = cosh y (35.11) 


Consequently, we have u(x, y) = cos x cosh y and v(x, y) = — sin x sinh y. 


Graphing w — cos z 


Figure 35.18 shows a graph of | cos z| = y cos? x + sinh? y, the magnitude of cos z. Along 
y = 0 we have | cos z| = | cos x|, so the zeros of cos z are just the real zeros of cos x along 
the real axis. Figure 35.19 is a conformal plot for cos z, showing in the w-plane, the images 
of grid lines in the z-plane. The hyperbolas are the images of the lines x — constant, and 
the ellipses are the images of the lines y — constant. Figure 35.20 contains a portion of the 


lwl 


FIGURE 35.48 Magnitude surface for FIGURE 35.19 Conformal plot for 
f(z) =cosz f(z) =cosz 
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FIGURE 35.20 Portion of the Riemann 
surface generated by f(z) = cosz 


Riemann surface for cos z. The Riemann surface is “climbed” as a horizontal line in the 
z-plane is traversed from left to right. A vertical strip of width 27r in the z-plane maps to a 
sheet of the Riemann surface in the w-plane. 


The Function w —tan z 
If k is an integer and z + 17, we can define tan z = sinz, By the “usual” techniques, we 


can obtain the real and imaginary parts of the function f(z) = tan z, finding 


sin x cos x sinh y cosh y 
and u(x, y) = — —— 
COS? x + sinh* y 


Lx, Vv) = (35.12) 


. 2 
cos? x + sinh? y 


Graphing w —tan z 


7 
cos? x—cosh? y 


Figure 35.21 shows a graph of |tanz| — , the magnitude of tan z. Along 


1—cos? x—cosh? y 
y = 0 we have | tan z| = | tan x|, so the zeros of tan z are just the real zeros of tan x along 
the real axis. Interspersed with these zeros are the singularities of tan z occurring at the 
zeros of cosz on the real axis. Thus, tanz is periodic across vertical strips of width z. 
Figure 35.22 is a conformal plot for tan z, showing in the w-plane, the images of grid lines 
in the z-plane. The lines that look like longitudes on a globe are the images of the lines x = 


constant, whereas the lines that look like latitudes are the images of the lines y = constant. 


lwl * 


FIGURE 35.21 Magnitude surface for FIGURE 35.22 Conformal plot for 
f(z) = tanz f(z) = tanz 
Hyperbolic Functions 


Like the trig functions, the hyperbolic functions sinh z, cosh z, and tanh z are defined in 
terms of the complex exponential function. Hence, they will be “infinitely many”-to-one 
functions, with inverses that are one-to-“infinitely many.” 
The Function w = sinh z 
To determine the real and imaginary parts of sinh z = u + iv, use the expansion formula 
sinh(A + B) = sinh A cosh B + cosh A sinh B 

to write 

sinh(x + iy) = sinh x cos y + i cosh x sin y = u(x, y) + iv(x, y) 


(e* — e7*) = i (e? — e12)/2i = 


From the definition of sinh z, we also have sinh(iz) — 
i sin z. 


Nie 


FIGURE 35.24 Conformal plot for 
f(z) = sinhz 


FIGURE 35.25 Portion of the Riemann 
surface generated by f(z) = sinh z 


FIGURE 35.27 Conformal plot for 
f(z) = coshz 
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FIGURE 35.23 Magnitude surface for 
f(z) = sinh z 


Graphing w = sinh z 


Figure 35.23 shows a graph of |sinhz| = ysin? y + sinh? x. Along x = 0, we have 
| sinh z| = |sin y|, so the zeros of sinh z are the real zeros of sin y but located along the 
imaginary axis. Figure 35.24 is a conformal plot for sinh z, showing in the w-plane, the 
images of grid lines in the z-plane. The ellipses are the images of the lines x — constant, 
and the hyperbolas are the images of the lines y — constant. Figure 35.25 contains a portion 
of the Riemann surface for sinh z. The Riemann surface is “climbed” as a vertical line in 
the z-plane is traversed from bottom to top. A horizontal strip of width 27 in the z-plane 
maps to a sheet of the Riemann surface in the w-plane. 


The Function w — cosh z 
To determine the real and imaginary parts of cosh z = u + iv, use the expansion formula 
cosh(A + B) = cosh A cosh B + sinh A sinh B 
to write 
cosh(x + iy) = cosh x cos y + i sinh x sin y 


From the definition of cosh z, we also have cosh(iz) = 1 (e? + e7*) = cos z. 


FIGURE 35.26 Magnitude surface for 
f(z) = coshz 


Graphing w = cosh z 


Figure 35.26 shows a graph of |coshz| = cos? y + sinh? x. Along x = 0, we have 
| cosh z| = |cos y|, so the zeros of cosh z are the real zeros of cos y but located along 
the imaginary axis. Figure 35.27 is a conformal plot for cosh z, showing in the w-plane, the 
images of grid lines in the z-plane. The ellipses are the images of the lines x — constant, 
and the hyperbolas are the images of the lines y — constant. 
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Figure 35.28 contains a portion of the Riemann surface for cosh z. The Riemann surface 
is “climbed” as a vertical line in the z-plane is traversed from bottom to top. A horizonta 
strip of width 27 in the z-plane maps to a sheet of the Riemann surface in the w-plane 


The Function w = tanh z 


If k is an integer and z 4 %} xi, we can define tanh z by tanh z = Am. By the "usus 
techniques, we can obtain the real and imaginary parts of the function f(z) — tanh- 
finding 

sinh x cosh x sin y cos y 


u(x, y) — and v(x,y)— 


FIGURE 35.28 Portion of the Riemann 


=A EPI api 
l H sinh* x + cos^ y 
surface generated by f(z) = coshz i 


P jJ 
sinh* x + cos? y 


Graphing w = tanh z 


cosh 2x—cos 2y 


OKORI? the magnitude of tanh z. The zer 
of tanh z are along x = 0, coincident with the zeros of sinh y. Interspersed with these zeros 
are the singularities of tanh z, occurring at the zeros of cosh y on the imaginary axis. Thus 
tanh z is periodic across horizontal strips of width zr. 


Figure 35.29 shows a graph of | tanh z| = 


lwl 


FIGURE 35.29 Magnitude surface for FIGURE 35.30 Conformal 
f(z) = tanhz plot for f(z) = tanh z 


Figure 35.30 is a conformal plot for tanh z, showing in the w-plane, the images of grid 
lines in the z-plane. The curves that open toward the left and right are the images of the 
lines x = constant, whereas the curves that arc from left to right are the images of the lines 
y = constant. 


EXERCISES 35.7—Part A 


A1. Verify the identities in (35.11). — A2. Verify the results in (35.12). A4. sinz = sinz — AS. cosz = cosz 
A3. Verify the results in (35.13). A6. sinh z — sinhz A7. cosh z = cosh z 


Write z = x + iy and establish the identities in Exercises A4—7. 


EXERCISES 35.7—Part B 


35.8 Inverses of Trigonometric and Hyperbolic Functions 847 


B1. Use (35.12) to establish | tan z| = 


For the magnitudes given in each of Exercises B2—5, determine, on 
z| = 1, the extreme values and their locations. Hint: Use the parametriza- B16. sinh 


tion z = cos 0 + i sin 8. 


B2. |sinz| B3. 


cos Z| B4. |sinh z| 


B14. sinh2z = 2 sinh z cosh z 
B15. cosh 2z = cosh? z + sinh? z = 2 cosh? z = 1 = 1 + 2 sinh? z 
z [coshz — 1 z coshz + 1 
= = ,/————___ B17. cosh = = ,/ ——— — 
2 Y 2 2 2 
B5. | cosh z| In Exercises B18—21, obtain a graph of the w-plane image, under the 


given mapping w = f(z), of the z-plane curve 


In Exercises B6—17, use the exponential definitions of the relevant func- 


tions to verify the given identity. 


B6. cos? z + sin? z = 1 


B7. sin(z; + z2) = sin zı cos z2 + cos z; sin z2 


B8 


B9. sin 2z = 2sinzcosz 


cos(z; + z2) = cos zi cos Z? F sin zı sin zz If 


(a) y=x? (b) 9x7 +.4y? = 9 
B18. f(z) = sinz B19. f(z) =cosz 
B20. f(z) =sinhz B21. f(z) — coshz 


fA = 2 + 3i, evaluate in rectangular form, the expressions given in Ex- 
ercises B22-31. 


CONCORD GT dI 1190155 d B22. sin(LogA) B23. Log(sinA) B24. cos(sin 4?) 
B11. cosh? z — sinh? z = 1 B25. Asini B26. cosh* } B27. sinh(cosA) B28. tanh(A*) 
B12. sinh(z, + z2) = sinh zı cosh z; + cosh z; sinh z; B29. cosh(AsinA) B30. tan vì? — 1 B31. sinh e^? 


B13. cosh(z, + z2) = cosh zı cosh z; + sinh z; sinh z2 


EXAMPLE 35.24 


FIGURE 35.31 Solving the equation 
Snx = i for x 


aaa a0 


Inverses of Trigonometric and Hyperbolic Functions 


Inverse Trigonometric Functions 


Along the real line, the inverse trig functions on the complex plane must reduce to the familiar 
real-valued inverse trig functions. However, the complex trig functions are defined in terms 
of the “infinitely many"-to-one exponential function. The inverses are then defined in terms 
of the complex logarithm. The energy expended in understanding the Riemann surface for 
the exponential function and in mastering the complex logarithm was the appropriate capital 
investment for this examination of the inverse trig functions. 

As with the complex logarithm, there will be a multivalued inverse trig function and 
a principal inverse function. A further complication arises from the dependence of these 
functions on an appropriate branch of the square root function. Although it’s only along the 
real line, the following example is revealing. 


Find all real solutions of the equation sin x = 1. s 


Past exposure to trigonometry and calculus suggests computing, even with a calculator, 
5| = arcsin i = €. the first-quadrant solution from the principal branch of the arcsine func- 
tion. Another solution, s2 = 7 — 2 = a is in the second quadrant. Figure 35.31 shows 
where to look for additional solutions. It contains graphs of sin x, the line y — 1, and, as 
a black segment, that portion of sin x corresponding to the principal branch of the arcsine 
function. The first solution, sı, is labeled a at the intersection of the graphs of sin x and the 
line y = 1. The second solution, s2, is labeled b. Additional solutions are labeled from c to 
f. Solutions f, a, and c are all generated by sı according to the recipe s; + 2kzr, where k is 
an integer. Solutions e, b, and d are all generated by s2 according to the recipe s2 + 2kz. 
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FIGURE 35.32 Solving the equation 
sinz — 3 (cosh 1 o i3 sinh 1) for z in the 
complex plane 


Thus, there are two infinite sets of solutions, one generated by s; and one by s». Within each 
set, the members are separated by 271, corresponding to the periodicity of sin x. 


The Function w — arcsin z 


The complex function w — sin z takes a vertical strip of width 27 in the z-plane to the whole 
w-plane. (Recall the Riemann surface for sin z, Section 35.7.) If zı = a +i = 0.524 + i 
is mapped by sinz to the w-plane, we obtain wı = sin zı = 3 (cosh 1 +iv3 sinh 1). In 
fact, because of the periodicity of sin z, we also have sin(z; + 2kzt) = w for any integer k. 
Consequently, the arcsine function must map w back to the infinite collection zı +2kx, k = 
E e E = A 

To visualize the inversion, write sin z = sin(x + iy) = u + iv and simultaneously solve 
the equations 
cosh 1 V3 sinh 1 
and v(x, y) = Z(wi) = ———— 
2 2 
Figure 35.32 contains graphs of the curves defined implicitly by each of these two equations. 
The dotted curves are defined by the first equation; the solid by the second. The intersection 
points are solutions of the equation sin zı = w41; and it appears that, just as in the real case, 
there are two sets of solutions, one of the form zı + 2kz and one of the form z2 + 2kz, 
where k is an integer. 

The standard definition of the arcsine function is 


arcsin z = —i log (iz shall E (35.14) 


as derived shortly. There are two possible values for the square root and an infinite number 
of values for the multivalued logarithm. The square root is given by 


u(x, y) = R(wi) = 


(1 _ p^ = e(1/2) log(1—z”) = gi /2Un |1—27|+i Arg 22) 2n] = | u 2 


& 


1/2 (i/2) Arg(1—z2) „k 
eU» Arg g ) kai 


where the first two factors on the right define the principal square root and the third factor 
is either 1 or —1 depending on whether k is even or odd, respectively. Thus, we can replace 
the definition of arcsin z with the two functions 


asin; z = —i log (iz +v1— 2) and asin z = —i log (iz —.1- gj (35.15) 


Each function generates an infinite set of values when the multivalued logarithm is 
used. If the principal complex logarithm is used, we can also define the two functions 


Asin; z — —i Log (iz Jal = "3 and Asin) z = —i Log (iz sil os 2) 


with which we obtain zı = Asin; w; = 0.524 + i and z2 = Asin; w; = 2.618 — i. The 
first is the principal value, and the second is the analog of A the second-quadrant solution 
corresponding to arcsin 1 = % when working on the real line. Corresponding to z; there 
would be an infinite set of solutions of the form zı + 2ksr, and corresponding to zz there 
would be another infinite set of solutions of the form z2+2kz.. These infinite sets of solutions 
arise from the use of the multivalued logarithm in the definition of the arcsine function. Thus, 


we would have asin, w; = zı + 2kz and asin» w; = z2 + 2kzt, where k is an integer. 


Derivation of the arcsine Function 


We conclude this discussion of arcsin z with a derivation of the expression for computing 
the arcsine function. Start with the equation w — sinz — E (e'* — e~"*) and solve for z = 


z(w) = arcsin w. To do this, multiply through by 2i, and set r = e^? so that e^'* = L, The 


EXAMPLE 35.25 


FIGURE 35.33 Solving the equation for 
cosx = i for x 


FIGURE 35.34 Solving the equation 


tan X = 


2 


in Example 35.26 


EXAMPLE 35.26 
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equation becomes 2i w = r — L, which is actually the quadratic equation r?—2iwr —1 = 0. 
The solution for r is 


r= = i (2iw + V-Aw? +4) —iwczXV/l-—wu? 


' 2 a : 1/2 
The two radicals represented by +v 1 — w? are expressed with the single term (1 — w?) m 
where we have already seen how this evaluates to two separate complex numbers. Then, 
solving for z, we have 


1 ; 241/2 ; ; 2) 1/2 
z = = log (i (1— u?) ) or z = —i log (iw + (1 — w°) ) 
Interchanging the variables z and w then gives (35.15), which is what (35.14) really means. 


The Function w = arccos z 


The inverse cosine function, defined by 
arccos z = —i log (z +ivl— g) (35.16) 


can be extracted from the solution of the equation w — 5 (el +e"), (See Exercise A1.) 


Let w2 = cos zı = 1 (V3 cosh 1 —isinhl). Then, by the periodicity of the cosine, 
cos(z, + 2kz) = cos zı = w for every integer k. To find all possible solutions of the equa- 
tion w2 = cos z, compute 


arccos w = —i |Log (us +i,/1— 5 + 2d = 2kmz +z 


consistent with the behavior of the cosine function on the real line. Indeed, Figure 35.33 
shows graphs of cosx and the line y = » the intersections of which are solutions of 
cosx — 1. The black portion of the cosine curve is the part used in the definition of the real 
principal arccosine function. For the intersection at a we write x; = 3, the principal value 
of arccos 4, and for b write x = — =, the fourth-quadrant companion. The intersections at 
b, d, f on the “back side" of the wave are of the form x» + 2kzr, while the intersections at 
a, c on the "front edge” of the wave are of the form x, + 2kz. Finally, note that the set of 


solutions {x2 + 2kzr} is equivalent to the set {2k — xı} because x? = —x1. 


The Function w = arctan z 


The inverse tangent function, defined by 


Ad 4 


arctan z — > log (: t 3 (35.17) 


can be extracted from the solution of the equation w = tan z = }(e'* — e**)/(e* + e`") 
by solving for e'* and, hence, for z. (See Exercise A2.) 
Dix ; + temic. Then, by the periodicity of tanz, we have 
tan(z; + kz) = ws for any integer k. To find all possible solutions of the equation w3 = 
tan z, namely, the infinite set zı + kz, use the multivalued logarithm to write arctan w3 = 
P[Log(293) + 2nzi] = zi + kz, where k = —n is any integer. 

Comparing the behavior on the real line with the behavior in the complex plane, Figure 
35.34 shows graphs of tan x and the line y — 1, the intersections of which are solutions 


of tan x = 1. The line y = 1 intersects each branch of the tangent function just once, and 


Let w3 = tan zı = 
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FIGURE 35.35 Solving the equation 
sinh z = sinh 1 cos 1 +i cosh 1 sin 1 for z 
in the complex plane 


the intersections are an integral multiple of z apart. The black branch is the one used in the 
definition of the principal branch of the arctangent function. s 


Inverse Hyperbolic Functions 


The complex hyperbolic functions are defined in terms of the complex exponential function. 
Hence, they, too, are “infinitely many”-to-one functions. Their inverses are then one-to- 
“infinitely many” mappings, just like the complex inverse trig functions. However, for the 
inverse hyperbolic functions, the periodicity is across horizontal, not vertical, strips. And 
like the inverse trig functions, the inverses of the hyperbolic functions are given in terms of 
the complex logarithm. 


The Function w = arcsinh z 


The complex function w = sinh z takes a horizontal strip of width 27 in the z-plane to the 
whole w-plane. (Recall the Riemann surface for sinh z given in Section 35.7.) If z4 = 1+i 
is mapped by sinh z to the w-plane, we obtain w4 = sinh 1 cos 1 +i cosh 1 sin 1. In fact, for 
z4 + 2kri, k an integer, we have, because of the periodicity of sinh z, sinh(z4 + 2kzi) = 
sinh z4 = w4. Consequently, the inverse hyperbolic sine function must map w4 back to the 
infinite collection z4 + 2kmi,k = 0, +1, €£2,.... 

Figure 35.35 helps with visualizing the inversion process since it shows the intersection 
of the curves defined implicitly by the equations 


u(x, y) = sinh x cos y = R(w4) and v(x, y) = cosh x sin y = Z(u4) 


The dotted curves are defined by the first equation, the solid by the second. The points of 
intersection are solutions of the equation sinh z = w4. It appears that, just as in the real case, 
there are two sets of solutions, one of the form z4 + 2kzri and one of the form 2kri — zz. 
where k is an integer. 

The standard definition of arcsinh z is given by 


arcsinh z = log (z +yz + 1) (35.18) 
There are two possible values for the square root and an infinite number of values for the 
multivalued logarithm. The square root is given by 
(2 A jy = e( 1/2) log(z?+1) = e}/2[Log(z? +1)+2kri] - g/2 Log? 1) kri 
The first factor on the right is the principal square root of z? + 1, and the second factor 


is 1 for even integers k and —1 for odd integers k. Thus, we can replace the definition of 
arcsinh z with the two functions 


asinh; z — log (z +yz? + 1) and asinh2 z = log (z — yz? + 1) 


Each expression generates an infinite set of values when the multivalued log is used. 
If the principal complex logarithm is used, we can define the two functions 


Asinh; z = Log (z + 2+1) and Asinh; z = Log (z — 2+1) 


with which we obtain z4 = Asinh; w4 = 1 +i and z5 = Asinh» w4 = 2zti — z4. Corre- 
sponding to the principal value z4 there would be the infinite set of solutions asinh; w4 = 
z4 + 2k7i, and corresponding to zs there would be another infinite set of solutions asinhz 
w4 = 2kzi — z4. 


EXAMPLE 35.27 


EXAMPLE 35.28 
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Derivation of the Hyperbolic arcsine Function 


To derive (35.18), start with the equation w — sinh z — l(e* — e~*) and solve for z = 


z(w) = arcsinh w, obtaining log(w + vw? + 1). An interchange of w and z and a proper 
understanding of the square root yield (35.18). 


The Function w — arccosh z 
The inverse hyperbolic cosine, defined by 
arccosh z — log (z +yz? -1 ) 
can be extracted from the solution of the equation w = 1 (e? + e^*). (See Exercise A3.) 
If ws = cosh z4 = cosh 1 cos 1 + i sinh 1 sin 1, then, for any integer k, cosh(z4 + 2kzi) = 


cosh z4 = ws by the known periodicity of cosh z. To find all possible solutions of the equa- 
tion ws = cosh z, write 


log (us Æ y we —1 ) = Log (us $ yus —1 ) + 2kzi = 2kri + 74 
where k is any integer. % 


The Function w = arctanh z 


The inverse hyperbolic tangent is defined by 


1 LHZ 
arctanh z = = log (G T j (35.19) 
which can be extracted from the solution of the equation w = (e? — e^*)/(e* + e^*). (See 
Exercise A4.) 

sinh 1 cosh 1 sin 1 cos 1 


If wg = tanh z4 = an Teen? 1 Mak? deos] then, for any integer k, tanh(z4 + kai) = wg 


by the known periodicity of tanh z. To find all possible solutions to the equation wg = tanh z, 


write 
1 1 1 1 ) 
log ( Teg = ~ |Log T cTAkzi|-—za-ckmi 
2 1 — Wo 2 l — W6 


where k is any integer. $ 
EXERCISES 35.8—Part A 
Al. Solve w = cos z = t (e +e) for r = e!* and, hence, for z, AA. Solve w = tanh z = (e? — e *)/(e* + e?) for r = e* and, hence 
thereby obtaining (35.16). Hint: e * = L, for z, thereby obtaining (35.19). 
A2. Solve w = tanz = ;(e" — e*)/(e® + e") for r = e and, AS. Find all solutions of sin x = 32. 


hence, for z, thereby obtaining (35.17). 


A3. Solve w — coshz — HG -Fe*) for r = e* and, hence for z, 
thereby obtaining arccosh z = log(z + vz? — 1). 
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EXERCISES 35.8- Part B 


B1. Find all solutions of cos x = 1. B15. Define cschz = 3x and obtain 


Given the complex number ¢ in Exercises B2-9, obtain all solutions of (a) the real and imaginary parts of cschz. — (b) | csch z| 


the equation f(z) = ¢ if f(z) is In Exercises B16—21, express, in terms of the complex logarithm, the 
(a) sinz  (b)cosz (©) tanz inverse functions. 
(d) sinhz  (e)coshz  (f)tanhz B16. arccotz B17. arcsecz B18. arccscz 


B19. arccothz B20. arcsechz B21. arccschz 


B2.1—3i  B3.i4ii  B4.7-9i BS. 2+4i 
; (015,9; ; "rv B22. Obtain the real and imaginary parts of 
B6. —5 + 8i B7. 5 + 7i B8. 8 + 3i B9. —2 + 5i : 


B10. Define cotz = —— and obtain 


tanz 


(a) arccotz (b) arccothz 


(b) | cot z| Given the complex number ¢ in Exercises B23-30, obtain all solutions 


(a) the real and imaginary parts of cot z. 
of the equation f(z) = ¢ if f(z) is 


B11. Define sec z = = and obtain 
j (a) cotz (b) secz (c) csc z 


(d) cothz (e)sechz  (f)cschz 
B23. 6+5i  B24.—;— i B25. ł-— ii  B26. 746i 


(a) the real and imaginary parts of seez. (b) | secz| 


B12. Define cscz = a and obtain 


(a) the real and imaginary parts of cscz. — (b) | cscz| 6 27 3 
zm d ; B27.9 —5i  B28.2--2i  B29.—242i B30.7+4+3i 
B13. Define cothz = ziz and obtain i 34 +4 T3 
(a) the real and imaginary parts of cothz. (b) |coth z| 
B14. Define sechz = ca and obtain 
(a) the real and imaginary parts of sech z. (b) | sech z| 
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Differentiation 


A complex function f (z) is said to be differentiable and has derivative f'(zo) at zo provided 
f (z) is defined in a neighborhood of zo and lim; o Dummies exists as a limit in the plane 
(independent of direction of approach). The complex number h approaches 0 in the plane, 
so the direction of approach must not affect the value of the limit. 

The differentiation rules of the calculus (linearity, the power, product, quotient, and 
chain rules) all apply. In addition, the formulas for the derivatives of the trig functions 
and their inverses, and the hyperbolic functions and their inverses, almost agree with their 
counterparts from elementary calculus. However, there are simple complex functions for 


which no derivative exists. 


EXAMPLE 35.29 The function f (x) = Z, the conjugate of z, has no derivative To verify this claim, let zo = 
Xo + iyo be a fixed point in the complex plane and attempt to compute, by formal definition, 
the derivative of z at this point. Thus, evaluate the limit 


. Xo d- iyo +h — xo + iyo 
lim 


(35.20) 
h-0 h 


Now take the limit from two different directions. In the plane, for a limit to exist, it 
must be directionally independent. If the limit is different along two different paths, it does 
not exist. (This is akin to the behavior of a limit on the real line when the limits from the 
left and right do not agree and we conclude that the limit does not exist.) 


Trigonometric 
f f 
sinz COS Z 
COS Z —sinz 
tanz sec? z 
cotz — csc? Zz 
sec z sec z tan z 
CSC z — cesez cotz 
Hyperbolic 
f f 
sinh z cosh z 
cosh z sinh z 
tanh z sech? z 
coth z — csch? z 
sech z — sech z tanh z 
csch z — csch z coth z 


TABLE 35.5 Derivatives of the complex 
trigonometric and hyperbolic functions 
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Along a line parallel to the x-axis we have h = t and (35.20) evaluates to 1. Along a 
line parallel to the y-axis we have h = it, and (35.20) evaluates to —1. Since the limit is 
not path independent, it does not exist and f(x) = Z is not differentiable. $ 


Differentiating the Elementary Functions 


Powers Formally, differentiation of polynomials proceeds exactly as in real-variable 
calculus. Thus, 4-z* = kz! is valid for integers k. It is also true that £z = ex?! for 
an arbitrary complex number c. Since z^, defined in terms of the logarithm, is multivalued, 
the differentiation formula requires that the same branch of the function z^ be used on both 


sides of the equal sign. 


THE EXPONENTIAL Function The derivative of e*, as in elementary calculus, is again e*. 
In fact, the differentiation rules £68) = e$? g'(z) and £c = c* logc both hold. In the 
second formula, c* is defined in terms of a branch of the logarithm. Hence, the same branch 
of the logarithm must be used on both sides of the equal sign. 


Tue Locaritum The derivative of any logarithm obeys the familiar rule, namely, L logz 
= l. Thus, for any branch of the logarithm, and in particular the principal branch, the “rate 
of change" of the logarithm is the same. It is the familiar +. 


THE TRIG AND HYPERBOLIC TRIG Functions The first column of Table 35.5 lists the six 
complex trigonometric functions and the second, their derivatives. The third column lists 
the six complex hyperbolic functions and the fourth, their derivatives. The results in the 
complex plane agree exactly with the real-variable results for elementary calculus on the 
real line. 


THE INVERSE TRIG AND HypPerBouic Functions Columns 2 and 3 in Table 35.6 list the 
derivatives of the inverse trigonometric functions. Column 2, headed by the symbol f’(z), 
gives the form of the derivative valid over the whole complex plane; and column 3, headed by 
the symbol f'(x), gives the form of the derivative found in the typical real-variable calculus 
text. On the real line, the domain of validity of the derivatives of arcsin x and arccos x would 
be |x| < 1, but for arcsec x and arccsc x it would be |x| > 1. For the derivatives of arcsec z 
and arccsc z, the square roots are not simplified because they require more care than on the 
real line. For example, evaluating the derivative of arcsec z at z = 1 + i gives the complex 
number -B5 =2 + iv A/5 + 2), whereas evaluating the expression for the derivative 
of arcsec x at the same point gives Ay /5 = du 5 2). AS floating-point numbers, 
the first is —0.109 — 0.460i, whereas the second is 0.249 — 0.4021. 

Columns 5 and 6 in Table 35.6 list the derivatives for the inverse hyperbolic functions. 
Column 5, headed by the symbol g’(z), gives the form of the derivative valid over the whole 
complex plane, and column 6, headed by the symbol g'(x), gives the form of the derivative 
found in the typical real-variable calculus text. In the standard calculus text, the domain for 
the derivative of arccosh x is | — x; for the derivative of arctanh x, |x| < 1; and for the 
derivative of arcsech x, 0 < x < 1. Column 5 is correct for the whole complex plane. 

For example, consider the derivative of arcsech z at z = —3. This is clearly outside the 
domain for the formula from elementary calculus, but if working in the complex plane, the 
formula must be replaced with, for example, the one from column 5, which then yields Zi 
as opposed to — 32i from the formula in column 6. 
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Inverse Trigonometric Functions Inverse Hyperbolic Functions 
f FE) Fœ) g g'(z) g(x) 
. l l ‘oh 1 l 
arcsin z — arcsinn z 
1 — 2? V1 — x? 24] x? +1 
l 1 h 1 1 
arccos z = m —— arccosn z 
1-z V1 =x? z—ly/z4l x2—] 
l l 1 1 
arctan z = arctanh z 3 
l1 4-z* 1+ x? ] =z ] — x+ 
l I l l 
arccot z E - — : arccoth z 
1+ z? 1+ x? 1 — z? 1— x? 
1 1 i ] 1 
arcsec z — arcsech z ———————— — 
21-4 Ix x? — 1 gjicqiiqi xJ/1 — x? 
l 1 h 1 1 
arccsc z arccscn z ———— SS 
42. P — A |x| Vx? — 1 2/144 |x|J/1 — x? 


TABLE 35.6 Derivatives of the real and complex inverse trigonometric and hyperbolic functions 


The Cauchy-Riemann Equations 


We next state two important theorems about complex differentiation. The first theorem gives 
some consequences when a function f(z) has a derivative, whereas the second theorem is 
nearly a converse to the first. 


THEOREM 35.1 


At any point z = x + iy at which f(z) = u(x, y) + iv(x, y) is differentiable, 
1. the partial derivatives u,, Vy, Uy, Vy exist. 
2. the derivative is given by f'(z) = ux(x, y) tiv, (x, y) = vy (x, y) — iuy(x, y). 


3. the Cauchy-Riemann equations ux = vy, Uy = —v, hold. 


The Cauchy-Riemann partial differential equations (CRPDEs) are a consequence of 
the two expressions for the derivative in the second conclusion of the theorem. The equality 
of the real and imaginary parts of the expressions for the derivative yields the CRPDEs. 

The CRPDEs alone are not enough to guarantee the existence of the derivative. For 
example, consider the function 


0 ge 
f(z) = 2 i 
izt Z z 0 
for which the CRPDEs are satisfied at z = O but the derivative f’(0) does not exist. The 
à S . 3 è 1 —f " 5 . 
derivative at z = 0 is determined by limp_,9 DO D = limo ah = limy_.o Wa. The 


limit must be path independent, but for h = te^, t real, the limit is the complex number 


EXAMPLE 35.30 


EXAMPLE 35.31 
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e**. which is not independent of direction. Hence, the limit does not exist and f (z) is not 
differentiable at the origin. 
To show the CRPDEs are satisfied at z = 0, obtain the real and imaginary parts of f (z) 


as 
x(x* — 10x2y? + 5y^) y(5x^ — 10x?y? + y^) 
u(x,y)-— = and v(x, y) = 5 
(x? + y2) (x? + y? 
respectively. At z = 0, the partial derivatives appearing in the CRPDEs are then 
0+h,0) — u(0,0 I 
zd, = fis A = ee es] 
h>0 h h>0h 
0,0+h) — v(0,0 } 
pme OSTA dine S esed 
: h—0 h h>0h 
0,0+h) — u(0,0 0 
uid üjcg d cS oa eg 
* h—0 h h>0 h 
0+h,0) — v(0,0 0 
iui = ty SETS oic ei 
h—0 h h>0h 


Thus, the CRPDEs are satisfied at z = 0 but f(z) does not have a derivative at z = 0. 
Consider the polynomial function f(z) = z? whose derivative is simply 2z = 2x + 2yi 
and whose real and imaginary parts are 
u(x, y) 2x? — y? and v(x, y) 2 2xy 
respectively. Then, 
Hy —2X v=2y  uy—-—2y  vj-2x 


from which we see that the CRPDEs are satisfied. Using 


f'(z) = ux(x, y) tiv, (x, y) = vy(x, y) — iuy(x, y) (35.21) 
to find the derivative again gives 2x + 2yi. $ 


The derivative of f(z) = sinz = u +iv, where 


u(x, y) =cosxcoshy and v(x, y) = cosx sinh y 


cos z = cos x cosh y — i sin x sinh y (35.22) 
The derivatives appearing in the CRPDEs are then 
ux = Cos x cosh y Vy = —sinxsinhy uy = sin x sinh y vy = cos x cosh y 


from which we can see that uy = vy and uy = —v,. Thus, the CRPDEs are satisfied. Using 
(35.21) to find the derivative again gives (35.22), so once more we see that the real and 
imaginary parts of a differentiable function satisfy the Cauchy-Riemann equations. $ 


Derivation of the CRPDEs 


The derivation of the Cauchy-Riemann equations is mechanical. If f(z) is differentiable 
at z, then the limit of the difference quotient, f'(z) = lim; ,9 L[E*W-S@ exists and is 
independent of direction of approach. Evaluating this limit along two different paths, one 
parallel to the x-axis ( h = t) and the other parallel to the y-axis (h = it), gives two different 
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but equal expressions for the derivative. If we write f(z) = u(x, y) + iv(x, y), then the 
difference quotient along a horizontal line (h = t, t real) becomes 


u(x +t, y) — ux, y) i v(x +t, y) — v(x, y) 


i 


t t 


which, in the limit as ft goes to zero, gives f'(z) = Uy +iv;. 
Repeating the process along the vertical path defined by h = it, we have the difference 


quotient 


i " 
1 


u(x, yct)—u(x,y) 


v(x, y +t) — v(x, y) 
it it 


which, in the limit as tf becomes zero, gives f'(z) = vy — iu,. Equating the real and imag- 
inary parts of these two representations of f’, we then get the Cauchy-Riemann equations 


Hy = Uy, My = —Uy. 


THEOREM 35.2 


In an open connected set, the Cauchy-Riemann equations, plus continuity of the 
partial derivatives, guarantees f(z) is differentiable. 


Theorem 35.1 showed that the real and imaginary parts of a differentiable function 
necessarily satisfied the Cauchy-Riemann equations. We also saw a counterexample that 
showed the CRPDEs alone are not sufficient to guarantee the existence of the derivative. 
Theorem 35.2 gives a sufficient condition, which, along with the CRPDEs, guarantees a 
complex function has a derivative. A proof of this theorem can be found in almost any 
complex variables text. See, for example, [69]. 


EXERCISES 35.9—Part A 


Al. If f(z) and f(z) are both differentiable on the open connected set 
R, apply the Cauchy-Riemann equations to each to show that f(z) 
must be constant on R. 


EXERCISES 35.9—Part B 


In Exercises A2—5, show that the real and imaginary parts of the given 
function f(z) satisfy the Cauchy-Riemann equations. 


2 


k* 
A3. z+ — 


A2. 23 A4. cosz A5. sinhz 


B1. Show that in polar coordinates, the Cauchy-Riemann equations 


ðv ðv ) 
become # = 129 and # = — 136, 
ar r 00 ör r 00 


In Exercises B2—4, apply the result of Exercise B1 to verify that the given 
function is differentiable for r > 0,0 < 0 < 2z. 


0 0 
B2. f(z) = Jz- oF (cos = +isin 4 
n n 


Z x—iy cosÜ .sinO 
i 


B3. f(z) = — 


Iz x +y? EE r 


B4. f(z) =z =e "(cosLogr +i sin Logr) 
In each of Exercises B5—20, show that the real and imaginary parts of the 
given function f(z) satisfy the Cauchy-Riemann equations. 
2g—3 


5:47 
B11. cscz 


B15. sech z 
B19. arctanh z 


B5. «Je B8. tanz 
B9. cotz 
B13. tanhz 


B17. 


Bo. /z; B7 
B10. secz 


B14. coth z 
B18. arccot z 


B12. coshz 
B16. csch z 
B20. arccoth z 


arctan z 
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Analytic and Harmonic Functions 


Analytic Functions—Definitions 


In Section 35.9 we defined differentiability of f (z), calling f(z) differentiable at z if f'(z), 
the derivative, exists at z. We showed that the function f(z) = z is not differentiable for 
any value of z, so there exist nondifferentiable functions. The function f(z) = |z|? = 
x? + y? is differentiable only at z = 0 because that is the only point at which the Cauchy— 
Riemann equations are satisfied. Examples like this suggest we need a condition stronger 
than pointwise differentiability, and that condition is analyticity. However, we first need the 
following. 


DEFINITION 35.2 NEIGHBORHOOD 


A neighborhood of a point Zo in the complex plane is an open set containing Zo. 


It suffices to think of a neighborhood of zo as an open disk with center at zo and radius 
ë 0. 


DEFINITION 35.3 DOMAIN 


A domain is an open connected set. 


As we saw in Section 35.2, the interior of a disk is an open connected set. 


DEFINITION 35.4 


A function f(z) is analytic at a point zo if f (z) is differentiable in a neighborhood 
of the point zo. 


Thus, analyticity is a point property, but it requires differentiability in a neighborhood 
of the point. A function can have an isolated point of differentiability but not of analyticity. 
The very definition of analyticity at zo completely surrounds zo with enough points of 
differentiability that close neighbors of zo can, in turn, be surrounded by a neighborhood 
of differentiability. 


DEFINITION 35.5 


A function f(z) is analytic in a domain D if it is analytic at every point in D. 


This definition is equivalent to saying that if f(z) is differentiable in a domain, then it 
is analytic in that domain. Thus, the intermediate concept of analytic at a point is handy 
but not strictly necessary. 
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EXAMPLE 35.32 


EXAMPLE 35.33 


EXAMPLE 35.34 


EXAMPLE 35.35 


EXAMPLE 35.36 


EXAMPLE 35.37 


Analytic functions are also called regular or holomorphic. 


DEFINITION 35.6 


A function f(z) is analytic at z = oo if F(¢) = JUD is analytic at¢ = 0. 


Thus, the function z = i maps the origin to infinity and the point at infinity to the 
origin. Behavior at z = co is determined by behavior at ¢ = 0. 


DEFINITION 35.7 


Functions that are analytic (or equivalently, differentiable) on all of the finite complex 
plane are called entire. 


The functions f(z) = z and |z| are not analytic anywhere because they are not differentiable 
anywhere. ^ 


The function f(z) = |z|? is not analytic anywhere because it is differentiable only at the 
single point z = 0. $ 


The function f(z) = x? + iy? is not analytic anywhere even though it is differentiable all 
along the line y — x. The points of differentiability do not form an open set in the plane, so 
there is no point of anya To see why this function is differentiable only along the line 
y = x, write u = x? and v = y? and apply the CRPDEs, obtaining 2x = 2y and 0 = 0. 
Thus, the CRPDEs are only satisfied on the line y — x. $ 


The function f(z) — z? is analytic everywhere in the finite complex plane and is thus 
an entire function. For each finite z, the derivative is simply f'(z) — 2z. This HIREHOD is 
not analytic at z = oo. To see why, “invert” the complex plane by mapping z to} z, thereby 
obtaining F(Z) = iG ) e 2 z. Clearly, F (¢ ) is not differentiable at¢ = 0,so f (z ^is deemed 
not to be differentiable at Z = oo. “ 


Do 


The function f(z) = 1 is analytic for z 4 0, since, for each such z, the derivative is the 
familiar f’(z) = uni 


The function f(z) — e* is entire because it is analytic (differentiable) everywhere in the 
finite complex plane. This function is not analytic at z = oo because F(¢) = fG) zog 


is neither defined nor differentiable at ¢ = 0. $ 


THEOREM 35.3 LioUVILLE'S THEOREM 


Functions that are both bounded on the finite complex plane, and entire, are neces- 
sarily constant. 


EXAMPLE 35.38 


FIGURE 35.36 Example 35.38: The level 
curves of u — x? — y? are orthogonal to the 
level curves of v = 2xy 


35.10 Analytic and Harmonic Functions 859 


The proof of this theorem is best given after obtaining the profound results of integration 
theory. (For example, see [69].) Presently, we simply contrast the situation in the complex 
plane with that on the real line. The real function f(x) = sin x is both differentiable and 
bounded everywhere, yet is not constant. The complex function f(z) — sinz is entire but 
not bounded. Off the real line, sin z becomes unbounded as |z| — oc. 


Harmonic Functions 


As we saw in Section 21.5, a scalar function ®(x, y) with continuous second partial deriva- 
tives satisfying Laplace's equation, namely, VE = Pa + ®,, = 0, on a domain D, 
is called a harmonic function. The Cauchy-Riemann equations tell us that differentiable 
functions in the complex plane cannot have their real and imaginary parts chosen arbitrarily. 
The real and imaginary parts of an analytic function are linked by the Cauchy-Riemann 
equations. The resulting constraints force each part to satisfy Laplace's equation. Thus, the 
real and imaginary parts of an analytic function are necessarily harmonic. We formalize 
this observation in the following theorem. 


THEOREM 35.4 


Both the real and the imaginary parts of the analytic function f(z) = u(x, y) + 
iv(x, y) are harmonic. The function v(x, y) is called the harmonic conjugate of 
u(x, y). 


This result follows from the Cauchy-Riemann equations. Indeed, if f = u 4- iv is 
analytic, then uy = v, so Uxx = v,, and uy = —v, SO Uyy = —v,,. Continuity of the second 
partial derivatives means v, = Uxy, SO Uxx + Uyy = Vry — v, = Q. 


For the analytic function f(z) = z?, we have u(x, y) = x? — y? and v(x, y) = 2xy. For 
both the real and imaginary parts we have V?u = V?v = 0. Each is harmonic, and the real 
and imaginary parts of an analytic function satisfy Laplace’s equation. 

The CRPDEs so constrain the relationship between u(x, y) and v(x, y) that the level 
curves of each are mutually orthogonal. We can see this in Figure 35.36, where the level 
curves of u(x, y) = y= y? (solid lines) and the level curves of v(x, y) = 2xy (dotted 
lines) are shown. That these curves are orthogonal is easily demonstrated by showing that 
the gradient vectors Vu = 2xi — 2yj and Vv = 2yi + 2xj are themselves orthogonal since 
the dot product Vu - Vv is zero. (See Exercise A2 for a general proof of this result.) 

Finally, we show that v(x, y) = 2xy can be recovered from u(x, y) = x? — y? bya 
variety of techniques. First, if u(x, y) is harmonic at (xo, yo), then v(x, y) is given by the 
formula 


UHH) —6 «f ux(x, t) dt — I uy (t, yo) dt (35.23) 
yo Xo 


where c is a constant. (The harmonic conjugate is always determined up to an additive 
constant.) In this example, we would have 


y x 
c «f 2x dt — / —2yo dt = c + 2xy — 2xoyo 


yo Xo 


If the constant c is taken as 2xoyo, then v(x, y) = 2xy will have been recovered. ~ 
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This formula is equivalent to the following algorithm, which starts with 
Ux y / Vy (x, y) dy + g(x) 


where, because x is held constant during the integration, the additive constant becomes 
g(x), a function of x. Now, by the Cauchy-Riemann equation u, = vy, we have 

v(x, y) = ; ux(x, y) dy + g(x) = h(x, y) + g(x) (35.24) 
for some function h(x, y). By the Cauchy-Riemann equation v, = —uy, we have v, = 
hx + g'(x) = —uy, from which g(x) is then determined. 


EXAMPLE 35.39 


Consider the analytic function f(z) = sin z so that the real and imaginary parts are 


u —sinxcoshy and v = cosx sinh y (35.25) 


Each of the real and imaginary parts are harmonic since V2u = V?v = 0. The real and 
imaginary parts of the analytic function f(z) = u(x, y) + iv(x, y) both satisfy Laplace's 
equation and are therefore called harmonic functions. The mutually orthogonal level curves 
x | Ofu(x, y) and v(x, y) are the dashed and solid curves, respectively, in Figure 35.37. The gra- 


FIGURE 35.37 Example 35.39: The level 
curves of u — sin x cosh y are orthogonal 
to the level curves of v = cos x sinh y 


EXERCISES 35.10-Part A 


A1. Show that lim; | sin z| = œ along the path z = iy, y > 0. 
Hence, sin z is analytic for all finite z but is not bounded. 


A2. Let f(z) = u + iv be analytic. Use the Cauchy-Riemann 
equations to show that Vu - Vv = 0. 


EXERCISES 35.10—Part B 


dient vectors Vu = cos x cosh yi + sin x sinh yj and Vv = — sin x sinh yi + cos x cosh yj 
. 2, 
are therefore mutually orthogonal since Vu * Vv = 0. ka 


A3. Show that the real and imaginary parts of f(z) = z? are harmonic. 


A4. Let u(x, y) be the real part of f(z) = z?. Use the algorithm 
embodied in (35.23) to recover v(x, y), the harmonic conjugate. 


AS. Repeat Exercise A4 with the algorithm embodied in (35.24). 


B1. The real and imaginary parts of f(z) = sin z are given by (35.25). 


The function u(x, y) solves the Dirichlet problem V?u = 0, 
u(0, y) = u(a, y) = u(x, 1) = 0, u(x, 0) = sin x. The flow lines 
for u are the solutions of & = =. Show that the level curves of 


ae 
v(x, y) satisfy this equation for the flow lines of u. Hint: Use 
implicit differentiation and the CRPDEs. 


For the functions f(z) given in Exercises B2-20: 


(a) Verify that the real and imaginary parts satisfy Laplace’s 
equation and are, therefore, harmonic. 


(b) Superimpose graphs of the level curves of the real and 
imaginary parts of each function. Use a scaling that 


demonstrates the orthogonality of the level curves of u(x, y) 
and its harmonic conjugate, v(x, y). 


(c) Construct the imaginary part from the real part using the 
algorithm contained in (35.23). 


(d) Construct the real part from the imaginary part using the 
alternative algorithm embodied in (35.24). 


1 22 —3 
B2. z+ : B3. /: B4. /z Bs 5:47 B6. cosz 
B7. tanz B8. cotz B9. secz B10. cscz B11. sinh z 
B12. cosh z B13. tanh z B14. cothz B15. sechz 
B16. csch z B17. arctan z B18. arccot z 


B20. arccoth z 


B19. arctanh z 
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Integration 
Indefinite Integrals 


On the real line, the indefinite integral is often identified with the antiderivative. We review 
the distinction. 

A function F(x) is said to be an antiderivative of f (x) if F'(x) = f(x). The definite 
integral of f (x), interpreted as the area between the graph of f (x) and the x-axis, is given by 
the limit of a sum of areas of rectangular areas lying ina < x < b. Appropriately specifying 
Xk, the evaluation points, Ax;, the widths of the rectangles, and the way in which the limit 
is to be taken, the notation and definition of the definite integral is typically written as 


b N 
| fG)dx = lim. 2, f Gu) Ax 


The Fundamental Theorem of Calculus declares E f(x)dx = F(b) — F(a), where F(x) 
is an antiderivative of f(x). Because of this theorem, the notation f f(x) dx is used to 
represent an antiderivative of f (x). Moreover, if b, the right endpoint, is allowed to vary, 
then the definite integral defines the "area function" F(x) — L f (t) dx whose derivative, 
F'(x) = f(x), is given by a modification of the Fundamental Theorem of Calculus. There 
are then two interpretations of these results. 

First, to find an area, find an appropriate antiderivative. Second, to construct an an- 
tiderivative, evaluate the “area function.” The first interpretation leads to drill and practice 
in applying the rules of “integration,” which are really the “rules” of antidifferentiation. 
The second interpretation leads to “functions defined by integrals,” functions such as I (z), 
the gamma function; erf (x), the error function, and sn(u), cn(u), and dn(u), the Jacobian 
elliptic functions. 

For complex functions, antiderivatives clearly exist. In fact, the typical theorem on the 
existence of antiderivatives will state something like 


if f is defined and analytic on a simply connected region A, then there is an ana- 
lytic function F, defined on A, and unique up to an additive constant, for which 
F'(z) = f(z) for all z in A. We call F the antiderivative of f on A. 


However, without an appropriate “Fundamental Theorem,” there is no justification for 
writing f f(z) dz for the antiderivative of f(z). What is available, though, is the contour 
integral fe f (z) dz, which is actually a line integral along the curve C in the complex plane. 


Contour Integration 


LINE INTEGRALS IN THE PLANE—A Review Recall from Section 19.1 that the work done 
by the force F, as it acts on a particle of unit mass moving along the curve C, is given by 
the line integral jo F - dr, where r is the radius vector describing the curve. For example, 
if F = xi + y?j and the curve C, a circle with radius 2 and center at the origin, is described 
parametrically by the equations 


x(t) 22cost y(t)=2sint O<t<27 (35.26) 


then 


[rn] ex ya f 4sintcost(2sint—1)dt=0 (35.27) 
G 0 0 
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"mn Simple 


smooth 
Simple 
closed 


Not simple 
not closed 


Closed 
not simple 


Loo ^ Not smooth 
FIGURE 35.38 Examples of contours 


“EXAMPLE 35.40 


EXAMPLE 35.41 


Contours Paths in the complex plane along which line integrals are computed are called 
contours, and the resulting line integrals, contour integrals. A contour is a piecewise- 
smooth curve, defined as follows. A curve is a continuous map of a real interval [a, 5] 
into the plane, realized by z(t) = x(t) + iy(t). The curve is piecewise-smooth if [a, b] 
can be divided into a finite number of subintervals a = dg < a, < +++ < a, = b for which 
z' (f) exists on the open subintervals (aj, a,41) and is continuous on the closed subintervals 
[ax, a¢+1]. Continuity of z’(t) on Laz, ay 41] means the one-sided limits z(a,+) and z(ay..1 —) 
exist. If z’(t) is continous on [a, b], then the curve is called smooth. 

Curves that never cross themselves are called simple. Specifically, for a simple curve, 
when f; Æ f are in (a, b) then z(t,) 4 z(t), so that different parameter values guarantee 
different points in the plane. If the initial and terminal points on the contour coincide, the 
contour is called closed. Thus, for a closed contour defined by z(t), a < t < b, we would 
have z(a) = z(b). 

Closed contours are said to have positive orientation if an increase in the parameter 
value causes the path to be traversed with “the left hand pointing to the interior.” For a 
circle, the positive orientation is consistent with traverse in the counterclockwise direction. 
(The same convention was adopted in Section 19.2 for line integrals defining flux.) 

We rely on Figure 35.38 to clarify the interactions of these terms. From top to bottom, 
the first contour is simple and smooth. The second contour is simple, closed, and also 
smooth. The third contour is neither simple nor closed. However, it is smooth. The fourth 
contour is closed but not simple. It, too, is smooth. The fifth contour is simple, not closed, 
and not smooth. The two arcs that comprise it form a cusp at their junction where the 
tangent, instead of turning continuously, jumps from one orientation to another. Hence, the 
contour is piecewise-smooth. 


CONTOUR INTEGRALS IN THE COMPLEX PLANE If f(z) = u(x, y) +iv(x, y) and z(t) = 
Es --iy(t),a < t € b, define a contour C in the complex plane, the contour integral of 
(z) along C is given by 
b 
d figdz- EOLO dt = | [u(x(t), y() + iv(x(), yeI + iy) dt 


a 
b 
(ux' — vy) + i(vx' + uy’) dt 


a 


We illustrate with the following examples. 


Let f(z) = e*, and take the contour Cı as the straight line from the origin to the point 
2+ re Pens C; as z(t) = (24-7 ri fs 0 x t < 1, and obtain 


Í — x e 
f =f seo Od = f eil (24 Li) dt = i+ i 
Ci ‘ a 0 ( 4 ) J& i 
(35.28) 


9$. 
i a 


Using the function f(z) = e* and the endpoints from Example 35.40, we obtain the contour 
integral along the parabola y = 7 
z =x +iy(x) is realized by z(t) = t + ar, 0 x t € 2, where x, the obvious parameter, 


has been renamed 7. The desired contour Diegi is then 


b 2 
f@dz= z(t))z (t n= | mmens (v. T ‘ar= Sa —1 
fs a : FECA (t) a i e : zí i) 
(35.29) 


x?. For this contour C», a parametrization of the form 


EXAMPLE 35.42 


EXAMPLE 35.43 


EXAMPLE 35.44 


EXAMPLE 35.45 


EXAMPLE 35.46 


EXAMPLE 35.47 
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which just happens to be the same value as the integral along the contour C;. We will have 
more to say about this shortly. % 


Let f(z) = z? and C3 be the contour z(t) = t + S(t — 1),—1 <t < 3, a straight line 
l 


connecting zı = —1 — i to z2 = 3 + i. The contour integral fe. f (z) dz is then given by 
b 3 i 3 i 
f(z(t))z'(t) dt = Í (: + mil — D) (: + ;) dt = 8 + 24i (35.30) 
a —1 ex m 73 
“~~ 


With f(z) = z? as in Example 35.42, let the contour C4 be the parabolic path defined 
by x = y? + 2y. The parametrization x = t? + 2t, y = t, —1 < t < 1, gives z(t) = x(t) + 
iy(t), so that z(—1) = zı = —1— i andz(1) = z2 = 3 + i. Thus, C4 connects the same two 
endpoints as C3 and the contour integral f. f(z) dz = i f (z(t))z (t) dt becomes 


1 
/ (Par pay (2t 4-2 - i) dt = 8 + 24i (35.31) 
= 


As with Examples 35.40 and 35.41, the contour integrals connecting the same endpoints 
with different contours are equal. We will have more to say about this momentarily. e 


If f(z) = z and the contour Cs is the (lower) semicircle connecting the points (—1, 0) 
and (1, 0), the contour integral f... f(z) dz can be computed by parametrizing Cs with 
z(t) = cost -- i sint, z <t € 2z. Then we have 

b 2z 
f(z()z (dt = / (cost —isint)(—sint +icost)dt = zi (35.32) 


a m 
" 
od 


With f(z) — z as in Example 35.44, let the contour Cg be a parabola through (—1, 0) and 
(1, 0), the same endpoints as in Example 35.44. The parabolic contour y — 1 — x? can be 
parametrized by z(t) = t + (1 — 1?)i, —1 < t < 1, so that the contour integral m f(z)dz 
becomes 


b =] 
f(z(t))z (0) dt =f (t —i(1 — 00) a — 2it) dt = ŝi (35.33) 
a 1 j 
The value along the parabola differs from the value along the semicircle! kd 
Let f(z) = — and the contour C; be a circle with radius R and center at zo. To evaluate 


the contour integral of f(z) about the closed contour C7, parametrize the curve by z(t) = 
zo + Re”, 0 < t < 2z, so that we have 
b 2n 
f@@dz= f (tz (t) dt = Í idt = 2zi 
C; a 0 
Note that in this example, the contour integral around a closed contour did not evaluate to 
Zero. kd 


With the contour still as the circle C7 from Example 35.46, take f(z) = 1/(z — zo)", where 
n is an integer other than 1. Then the contour integral of f (z) around the closed contour C7 
becomes 
ý , ES i Re" : pl—n = i(1—n)t 
f@dz=] f@)z@dt= —_dt=iR e dt =0 (35.34) 
[s a o (Re) 0 


:$. 
ksd 


0 


FIGURE 35.39 Example 35.48: The 
closed contour formed by the curves in 
Examples 35.40 and 35.41 
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EXAMPLE 35.49 


EXAMPLE 35.50 
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CaucHy—GoursaT THEOREM The various behaviors seen in Examples 35.40—35.47 are 
illuminated by the historic Cauchy-Goursat theorem. (Some texts call this the Cauchy 
Integral theorem; others, just the Cauchy theorem.) The following statement of the theorem 
is based on [69]. 


THEOREM 35.5 CAUCHY-GOURSAT 


1. f(z) is analytic in the interior of the open connected set D. 
2. Cisaclosed contour lying in D. 


= | foa= 
C 


Thus, analytic functions have a "closed contour integral" property whereby the contour 
integral of an analytic function is zero on a closed contour. Recall Section 21.5 where we 
saw that for conservative vector fields, the "closed line integral" property was equivalent 
to “path independence." By a similar argument based on the Cauchy-Goursat theorem, we 
can show that if f(z) is analytic in D and if C; and C» are contours connecting zı and z2 
in D, then r^ f(dz- Jus: f (z) dz. Thus, a contour can be deformed without changing 
the value of a contour integral, provided the deformation process does not carry the contour 
through a point where f(z) is not analytic. 

The Cauchy-Goursat theorem can be thought of as giving the "closed contour integral" 
property for analytic functions f(z), a property that is equivalent to “path independence" 
for contours that remain in the domain of analyticity of f(z). 


The contours C, and C; from Examples 35.40 and 35.41 connect the same initial and 
terminal points. Hence, together they form a closed contour C, provided the direction on C; 
is reversed, as shown in Figure 35.39. The value for the contour integral along the parabolic 
arc in Example 35.41 was sud +i) — 1. Along the straight line in Example 35.40, the 
contour integral had the same Ruins because of path independence for analytic functions. As 
for line integrals in Unit Four, reversing directions on the contour C, gives 5 +i)+1 
for this integral, and the sum is zero. ks 


The contours C3 and C4 connect the same initial and terminal points in Examples 35.42 
and 35.43, so together, provided the direction is reversed on C4, they form the closed 
contour C shown in Figure 35.40. The value for the contour integral along both C3 and 
C4 was 8 4- 24i, as predicted by the path-independence property of analytic functions. If 
the direction of integration along C, is reversed, then the value of the contour integral is 
—8 — 24i and the integral around the closed contour C is zero. $ 


The contours Cs and Cg connect the same initial and terminal points in Examples 35.44 and 
35.45, so together, provided the direction is reversed on Cs, they form the closed contour 
C shown in Figure 35.41. The value for the contour integral along Cs was zi, whereas the 
value along Cg was ži, Reversing the direction of integration on Cg negates the ir of 
the contour integral, so the integral around the closed contour C would be (x — =)i Æ 0. 


The contour integral around C is not zero because f(z) = Z is not analytic oe $ 


FIGURE 35.40 Example 35.49: The 
closed contour formed by the curves in 
Examples 35.42 and 35.43 


FIGURE 35.41 Example 35.50: The 
closed contour formed by the curves in 
Examples 35.44 and 35.45 


C 
E Op 


FIGURE 35.42 Contours C; and C5 


surrounding isolated singularities of f (z) 


lying inside the contour C 
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DEFINITION 35.8 


If N is a neighborhood of zo from which zo itself has been removed, then N is called 
a deleted neighborhood of zo. 


An example of a deleted neighborhood of the origin would be the points satisfying 
0 < |z| < £ for e positive. 


DEFINITION 35.9 


An isolated singularity of f(z) is a point zo at which f(z) is not analytic but for 
which f(z) is analytic in a deleted neighborhood of zo. 


In Example 35.46, the function f(z) = E is analytic everywhere except at z — zo. 


The circular contour C7 encloses the isolated. singular point zo, so the Cauchy—Goursat 
theorem does not apply. The contour integral around C; evaluates to 277i Æ 0. 

In Example 35.47, the function f(z) = 1/(z — zo)" is analytic everywhere except 
at z = Zo. The circular contour C; encloses the isolated singular point zo, so again the 
Cauchy-Goursat theorem does not apply. That the contour integral around C; evaluates to 
zero is, in this case, a coincidence, not a consequence of the Cauchy—Goursat theorem. 


THEOREM 35.6 GENERALIZED CAUCHY-GOURSAT THEOREM 


L COGO 


2. C1 Cx are contained inside C in such a way that no C; is inside or on any 
other C; fori £ j. 


3. f(z) is analytic on C, on all the C;, i = 1,..., 
C but exterior to all the C;. 


= [ro«-X[ f (dz 


i=l 


C; are k + 1 positively oriented, simple closed contours. 


k, and at each point that is inside 


Loosely speaking, this theorem says the contour integral around a "large" contour inside 
of which there are small contours surrounding isolated singularities of f(z) is the sum of 
the contour integrals around each of the small contours. 

The following sketch of the proof for the case k — 2 shows how the Cauchy-Goursat 
theorem is used to establish the general result. In Figure 35.42, C contains two smaller 
contours C, and C3. Points A and D on C are connected to points B and E on C, and Co, 
respectively, by the paths Lı and L3. The points B and A are connected by another path 
La and E and D are connected by L4. The contour integrals inward along L, and outward 
along Lə have the values /; and —/,, respectively. Similarly, the contour integrals inward 
along L3 and outward along L4 have the values /; and — Jp, respectively. 

The positive orientation around C, and C; is counterclockwise. Consider the contour 
T that consists of Lı from A to B, C; in the clockwise sense, L from B to A, along C to D, 
along L3 to E, around C; in the clockwise sense, along L4 from E to D, and around C to 
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EXAMPLE 35.51 


EXAMPLE 35.52 


A. Inside and along this contour, f(z) is analytic, so the Cauchy-Goursat theorem applies. 
It gives 


[remos [ras] faz+ | fdz4] fdz+ fa- | fa- | fdz 
p E Li L L3 La Ci Cy 


o= [ fda+h-n+h-h- fdz— f dz 
C Ci C» 


o= f faz- fdz- | faz 
[4 Ci Cz 


from which we get fe f dz = fe, fdz + Jo, f dz. 


5 


To evaluate Ic < dz, where C is the circle |z| = 2, note that the integrand has two isolated 


+ 
singularities, namely, the points (0, i./2) and (0, —i4/2), and both lie within the contour 


C. The parametrization z(t) = 2cost + 2i sint, 0 < t < 2x, leads to 
af” i(2cos?t + 1) — 2 cost sint 
0 


dt = 4ri 
8cos^t + 1 


The generalized Cauchy—Goursat theorem suggests surrounding (0, i 4/2) with C1, a 
small circle of radius, say 1 and surrounding (0, —i4/2) with C5, also a circle of radius i. 
The parametrizations 


Za(t) = 4 cost +i (v2+ isinr) and zj(r) = +cost +i (-v2+ 5 sin 1) 
and Theorem 35.6 lead to fe f(z) dz = le f()dz4 le f (z) dz, where 


fod af” (15 4- 24/2sin t)i + 6/2 cost 
zdzc2 
e 0 31 — 842i cost 


Í Füllen r (15 — 24/2sinr)i — 6/2cost 
e 0 31 + 8J2i cost 
Thus, by the generalized Cauchy-Goursat theorem, we again obtain 477i for the value of 
the original contour integral. 

However, a more elegant solution can be constructed from the partial fraction decom- 
position 


dt = 2zi 


t= 201 


1 1 
= I 
gt? i z+iv2 
Instead of integrating f (z) around C, and C», integrate fı (z) + fo(z) around each of C, and 
C2. Inside Ci, f2(z) is analytic and does not contribute to the integral. Inside C2, fi(z) is 
analytic and does not contribute to the integral. Hence, we need only evaluate the integrals 


l 1 
— ——— dz —2mi and Í dz = 271 
E C z +iv2 
9. 


where the evaluations are transparent in light of Example 35.46. Kd 


f(z) 


Evaluate the contour integral fo +4, dz, where the contour C, shown in Figure 35.43, 


consists of the line segments connecting points P,, P5, P2, P4, in that order. Thus, the lines 
cross at Ps, thereby forming two simple contours, Ca and C;. The contour C, is the triangle 
P» Ps P3, whereas contour C; is the triangle P; Ps P4. Contour C, has a positive orientation, 


(71, -1) (2,-1) 
P, P, 


FIGURE 35.43 The contour C of 
Example 35.52 
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but contour C, has a negative orientation. The equation of the line P; P3 is y = 5#, 
whereas the equation of the line P» P4 is y — 2 
Using the parametric representations 
i i 
zi) — 1430-20 tti ag) = t+ ier T) —lets2 
z2(t) 2 2-it -l<t<l za(t) =it —1 —l<t<l 


the contour integral around C is given by 


p 1 
Í fena odi | f (z2(t))z5(0) dt 
-1 -1 


—1 1 
+ foao d+ f Ff (Za(t))z4(t) dt = Ami 
2 -1 


Confirmation of this result can be obtained if the contour C is decomposed into the two 
simple closed contours C, and C;. Then, these two triangles can be deformed continuously 
to the disjoint circles zs (t) = 5(e ^ — 1) and ze(r) = 1+ 1e, where, for 0 < t < 27r, each 
retains the orientation induced by C and one is centered at the singularity z = —1 while 
the other is centered at the singularity z = 1. The contour integral on C is then given by 


i — Lf Gs) 25) + f Gs()z,(O] dt = Ami 
0 


Each of these two solutions rely on brute-force integrations that are extremely tedious 
to carry out “by hand.” A simpler solution follows from the partial-fraction decomposition 


3 5 
f= ids + "w^ fi) + RE) 
Again, deform the triangular contours C, and C; into disjoint, positively oriented (coun- 
terclockwise) circles C1 and C2, centered respectively at the isolated singularities z = —1 


and z = 1. In the contour integral of f(z) around Cj, f2(z) makes no contribution; and in 
the contour integral around C5, fı(z) makes no contribution. The required contour integral 
is then given by 


l6z— 1 
Í > i dz= fi (z) dz «f fo(z) dz = —3Qzi) + 5Qzmi) = 400 
prd f= Ci C2 


The minus sign in front of the integral over C; arises from the clockwise orientation imposed 
by C. 

The intended conclusion for this example is the realization that careful analysis and 
clever technique can sometimes be far superior to brute-force computation. % 


Indefinite Integrals and Antiderivatives 


Indefinite integrals can be defined for analytic functions since contour integrals of analytic 
functions are path independent. This means the value of a contour integral of an analytic 
function depends only on the endpoints and not on the path. Provided the path does not go 
through any singularities, we can use the definite integral to construct an antiderivative. 

If f(z) is analytic in a simply connected domain D and if z and a are points in the 
region where f(z) is analytic, we can define F(z) = f f (£) d£, where the integration is 
on any contour lying completely in D and connecting the fixed point a with the varying 
point z. Since the integral is path independent, the value of F (z) is well defined. In addition, 
it can be shown that F'(z) = f(z), so F(z) is an antiderivative for the function f (z). 
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EXAMPLE 35.54 


EXAMPLE 35.55 


The definite integral h cos ¢ d£ defines the function F(z) = sin z — sin 1 whose derivative 
is cosz. Thus, F(z) = sinz — sin 1, an antiderivative of f(z) = cos z, is constructed, at 
least in principle, by a contour integral. e 


iur definite integral o = "E. z di defines the function da ) = 2,/z — 4 whose derivative 


—. Thus, F(z) = 2,/z — m antiderivative of f(z = J is constructed, at least in 
Jz 
de by evaluating a contour integral. The sense in int. F(z) is an antiderivative is 
shown in the evaluation of the integral 4 = tee Z, where z, = e™37i/4 = -5 +i), z 


e*ri/ — 5. (1 — i), and C is the arc z(t) = e”, —ĝri < t < $i. 


First, evaluate À via the antiderivative F(z), obtaining F (z2)— F (z1) = 2iV2 + /2= 
sı. Then, evaluate A as a contour integral on C, obtaining A = AN OIN e! dt = sı. Thus, 
F (z) can be used to evaluate a contour integral that does not cross a branch cut. On the other 
hand, if the formula for the antiderivative were not known, the path-independent contour 
integral o defines the antiderivative. 

Finally, we force the contour integration to cross the branch cut by integrating along 
z(t) = zı + (zo — z1)t, 0 < t < 1, the straight line from z; to z2. Interrupting the integral 
at the branch cut, we have 


1/2 4 1l. 2f 
E a t+ ZO D (v2+v2-2"") zs 
0 


2 JV z(t) 


Deliberately crossing Ae cut results in a value that is not consistent with the value 
obtained with the antiderivative. ES 


Let zı and z2 be the same points, on the same circular arc C, as in Example 35.54. Let z(t) 
be the same straight line connecting the points zı and z2. An antiderivative for the integral 
o= hb £ is F(z) = Logz — Log 2, where Log z is the principal logarithm. The sense in 
which F a is an antiderivative is shown in the evaluation of the integral 


“a dz " At. 
= — = F(a) - F(z) = 57i = sı 


y E 


Then, evaluate as a contour integral on C, obtaining A = Lau idt = sı. Thus, F(z) can 
be used to evaluate a contour integral that does not cross a branch cut. On the other hand, 
if the formula for the antiderivative were not known, the path-independent contour integral 
o defines the antiderivative. 

Finally, we force the contour integration to cross the branch cut by integrating along 
z(t), the straight line from z; to z2. Interrupting the integral at the branch cut, we have 


1/2: sh ] Vs 
f d i / OUD pis X si 
o z() 1/2 Z(t) 2 


Deliberately crossing the branch cut results in a value that is not consistent with the value 
obtained with the antiderivative. $ 


Cauchy Integral Formulas 


If f(z) is analytic inside and on C—a positively oriented, simple, closed contour—and zo 
is any point inside C, then the Cauchy AK 


4. JE 


27zi CZ Zo 


fo) = l de (35.35) 


expresses the value of f (zo) in terms of the values of f (z) along the enveloping contour C. 


EXAMPLE 35.56 


EXAMPLE 35.57 


EXAMPLE 35.58 
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This single formula is one case of the Cauchy integral formulae for derivatives 


27i 


n n! f 
f" o) = 5 [ Eu (35.36) 


The Cauchy Integral Formula 


The Cauchy integral formula (35.35) is typically used to obtain the value of a contour integral 
without actually evaluating the integral. Thus, the value of the contour integral p 1G gz is 
27i f (zo). The contour integrals in Examples 35.56 and 35.57 will be evaluated numerically 
and then exactly by the Cauchy integral formula. The contour integral in Example 35.58 
will be evaluated exactly by contour integration and by the Cauchy integral formula. 


Let C be the contour given by z(t) = 2e", —z < t < x, a circle |z| = 2, having center at 
the origin and radius 2. Then, by numeric integration we get 


H ptt 


et n ee 
[= (a= = 2 f : dt = 17.079i 
z n 2e! —] 


Since the circle C encloses zo = 1, if we take f(z) = e*, we can apply the Cauchy integral 
formula, obtaining 


fE 


CZ= ZO 


) dz —2mif(l) = 2rie 2 17.079i kd 


Let C be the contour z(t) = e, —: < t < x, a circle centered at the origin and having 
radius 1. Then, by numeric integration we get 


zZ m e" it 
=m" zz T dica; (35.37) 


222 —5z +2 24 2e?!! — Seit 42 


If we write f(z) = e*/(2(z —2)) and F(z) = f <i then F(z) has two isolated sin- 
gularities, one at z = 2 and another at z = 4. The singularity at z = 2 is outside the circle 
|z| = 1, and hence, the factor (z — 2) can m be" ‘grouped with" the numerator. Thus, we let 
zo = i and apply the Cauchy integral formula to the contour integral in (35.37), obtaining 


| m F(z)dz= fO e A =~ i 
c 2z°—Sz+2 C TE ^ ` 


:$; 
“ee 


Let C be the contour z(t) = 2e, —z < t < x, a circle centered at the origin and having 
radius 2. Then, by direct contour integration we find 


T X ot ity pit 
/ = = dz =2i f Sine tidal (35.38) 


2e! — 1 


To evaluate (35. € with the Cauchy integral formula, let f(z) = sin z. Since zo = 1 is 


within the circle |z| = 2, the Cauchy integral formula applies, giving 277i f (1) as the vu 
of the integral. With f(z) = sin z, the value for the contour integral is clearly 27i sin 1. 4$ 


The Cauchy Integral Formulae for Derivatives 


The hypotheses required for the derivative formulae are the same as those needed for the 
Cauchy integral formula, namely, that f (z) is analytic within and on the positively oriented, 
simple closed contour C surrounding zo. 
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As an illustration of these formulae, verify that for f(z) = e? 


3! fie. 


oxi Jc Qus dz gives f" (1) = ie 


, the contour integral 
= 1.4715, if the contour C, a circle with radius 1 and 


center at z = i, is parametrized by z(t) = i +e", —r « t <m. By numeric integration we 


find 
3! 


F(z) 3 


UV as 
(i-re "o 3it dt = 


27i 


EXERCISES 35.11—Part A 


c= 


1.4715 


is JK 


A1. Verify the result in (35.27). 
A3. Verify the result in (35.29). 


A2. Verify the result in (35.28). 
A4. Verify the result in (35.30). 


EXERCISES 35.1 1—Part B 


AS. Verify the result in (35.31). 


B1. Verify the result in (35.32). 
B3. Verify the result in (35.34). 


B2. Verify the result in (35.33). 


In Exercises B4—18, apply the generalized Cauchy—Goursat theorem and 
the Cauchy integral formula to evaluate each of the given contour inte- 
grals, where 


(a) C is the circle z(t) = 15e”, 0 < t < 27. 
(b) C is a square with side 10 and center at the origin. 


(c) possible, obtain corroboration by integrating along the 
contour in part (a), directly, either exactly or numerically. 


1z sin Z 
B4. [ss : B5. E IUS 8b UJ | -de 
GE 249 > z^ + 25 cz 2 4 2+ 16 


iz 
B7 | — : B8. 
c z2? — 182 +85 c ERES FA 
B9. | — 3 dz m [orisa dz 
Jo z2 —62 +34 c 2 4- 10z +61 
1z z 
pu. | — c 6cosz 
cz? 4 4z 429 4-29 Gs 2-2:424 
16 sinh z h 2z 
B13. f " e [mM e 
c z^ — 6z +25 >4 14z +98 
z z— 4+ 12i 
Bis. | <2 r4 pie. | de 
cz cT 8z4-32 c Z^ — 3z + 32 — 30i 
z 4i 
B17. | : TomH - dz 
c Zt (-245i)z -9— 7i 
e 40i 
pis, | ESEA dz 
c 2° — 8z + 37 — 20i 


In Exercises B19-23, let C be a circle with appropriate radius and center 
at the appropriate zo, and use (35.36) to determine the indicated deriva- 
tive. Corroborate your answer by direct computation. 


B19. f"(2 n. $55 = z 
9. f"(2+3i), f(z) ans 
z-r4 
2+2z+3 
B22. f" (5 — ii), f(z) = 2 


B23. f' (2 + 3i), f(z) — zsinz 


B20. f"(—1—i), f(z) = 


B21. OG), Ft = = — 


For the indefinite integrals /^ f(¢) d£ given in Exercises B24—28, find 
an antiderivative and use it to evaluate the definite integral i Ff) dc, 
where z; and z are as given. Then, being careful about singularities and 
branch cuts, connect zı and zz with a line segment or a polygonal path 
that does not cross the branch cut and evaluate the definite integral as a 
contour integral along this path. (Hint: The line segment from 7, to c 
can be parametrized as z(t) = £i + (£j —&)t,0 € t < 1.) 


B24. i te dt;z 1+ 2i, z2 = —1—3i 

B25. f. 
td 

B26. |  — —— ee 
E34 
td 

B27. f LOUER IT 
1 


B28. f Log dé; zi = 2 = 3i z =—12 +i 
3i 
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Series in Powers of z 


Power Series 


A power series is a sum of the form 
oo 
la — zo) (35.39) 
k=0 
where the complex numbers a; are the coefficients, the complex number zo is the fixed point 
about which the series is constructed, and z is a complex variable. If this sum is evaluated 
at z = zo, the first term is a90°, which we interpret as ao. 
The following statements summarize some of the important properties of a power series. 


1. If lim,-x Tri ay(z — zo)* = f (z) exists pointwise, we say (35.39) converges to 

f (2). 

2. If (35.39) converges for zı # Zo, then it converges absolutely for all z in the disk 
|z — Zo| < |z1 — zol =r. 

3. "The radius of the largest disk for which (35.39) converges 1s R, the radius of conver- 
gence. 

4. The radius of convergence can be found by the ratio test. 

5. The power series (35.39) converges absolutely in |z — zo| < Randuniformly in |z — zo 
<r<R. 

The limit function f(z) is analytic. 

7. If (35.39) converges to f(z), then a, = f® (zo)/k!. 

Thus, if a power series converges, it converges inside a disk called its circle of con- 
vergence, and converges to an analytic function. Conversely, the analytic function f(z) 
has a power series expansion about any point of analyticity. This is the content of Taylor’s 
theorem, which establishes the existence of Taylor series, the name of power series created 
under its aegis. 


THEOREM 35.7 TAYLOR'S THEOREM 


If f(z) is analytic in an open connected set D and zo is in D, then 


os (kK) (- 
jo V) (e — zo) 


k! 
k=0 


converges absolutely inside the largest circle about zo for which f(z) is analytic. 


Thus, if you start with an analytic function and apply Taylor’s theorem, a power series, 
called the Taylor series, results. If you start with a power series that converges, the limit 
function is analytic and the power series is the Taylor series for that function. 


At zo = 0, the Taylor series for the complex function f(z) = ; is 2 z^. It is just the 
geometric series of elementary algebra. “ 
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EXAMPLE 35.62 


EXAMPLE 35.63 


FIGURE 35.44 Example 35.63: The 
partial sums $7 4(1 4- i) 


EXAMPLE 35.64 


EXAMPLE 35.65 


At zo = 0, the Taylor series for the function g(z) = sin z is 5; 9(— 1) z^ /Qk + 1)!. ** 


At zo = 0, the Taylor series for the function A(z) = cos z is a(R ES 
At zo = 0, the Taylor series for the function w(z) = e* is bnt zk Jk. s 
Atz = $(1 + i), the Taylor series f(z) = 74 = Proz“ becomes ? 4-91 + i)*/2*, 
which converges to 1 + i, which is the value of nes ). On the other hand, if z = 1 + i, 
to what will the partial sums S, = ^; (1 + i)* converge? The first few partial sums, 


1,243-i, 2 4- 3i, 5i, —4+ 5i, —8 +i, —8 — 7i, —15i, 16 — 15i, 32 + i, 32 + 33i, graphed in 
Figure 35.44, seem to be moving away from the origin, suggesting that perhaps this series 
does not converge for z = 1 +i. 

Thus, for some values of z such as z = +#, the power series » 7: , z^ converges. For 
other values such as z = | + i, the series diverges. In general, convergence takes place 
within a circle called the circle of convergence. The circle is centered at z = zo, where zo 
is the point about which the Taylor series was computed. The radius of this circle is R, the 
radius of convergence. The circle of convergence is typically denoted by |z — zo| « R. 

The circle of convergence expands outward from zo and grows until it hits the first point 


for which f(z) is not analytic. For the function f(z) = i this first singularity is at (1, 0) 


on the real axis. That z = Hi is inside |z| = 1 while z = 1 + i is outside this circle can 
be seen by computing the magnitudes 5 and 4/2, respectively. At the first point, within 
V2 


the circle of convergence, we observed convergence. At the second, outside the circle of 
convergence, we saw evidence of divergence. This information is summarized in Figure 
35.45, which shows the circle of convergence, the point z = 1 where f(z) is not analytic, 


and the two points z = | and z = 1 +i, one inside, and one outside, the circle. e 


Ratio Test 


As in Section 9.2, we can use the ratio test to determine the radius of convergence of a 
power series. 


For the geometric series 3 77: , z^, the coefficients are a, = 1,k = 0,1, .... Hence, we 
examine the absolute value of the ratio of two successive terms but carry through the powers 
of z, obtaining |z^*! /z*| = |z|. The “test number" in the ratio test, namely, L, must be less 
than 1 for convergence. The ratio of two successive terms is |z| in this example. Hence, 
we seek those values of z for which L = limzż—>ə |z| < 1 and conclude that the geometric 
series converges for z satisfying |z| « 1. This is what we mean when we say R, the radius 
of convergence, is 1 and that the circle of convergence is given by |z| < 1. % 


Although the coefficients in 77: ; z“/k!, the power series expansion of f(z) = e', are 
ak = ib the ratio test is to be executed with z*/k! as the general term. The absolute value 
of the ratio of two such successive terms is then 


eso lel 


kl 


z*(k +1)! 


EXAMPLE 35.66 


FIGURE 35.45 Example 35.63: The 
circle of convergence, along with the 
points z = 1, iu +i), and1 +i 
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The ratio test says the series converges provided L = limg-.o0 Gl < 1. Isolating |z|, we 
find the condition for convergence to be |z| < lim; o5 k + 1 = œ. Thus R, the radius of 
convergence, is infinite and we have the circle of convergence defined by |z| « oo. % 


Find R, the radius of convergence for 


: (=1)" 2k+1 
sın z = > SS 
= (2k + 1)! 


The general term of this power series is (—1)*z***!/(2k + 1)!, so the absolute value of the 
ratio of two successive terms is 


(—1)F+1 2243 (2k + =| | z 


(—-D*z2e Ok + 3)! 2(k + 1)(2k +3) 


We are looking for those values of z for which L = lim;..5; pM « ]. Isolating 
|z?| = |z|? before computing the limit yields |z|? < lim; 44 2(k + 1) (2k + 3). The circle 
of convergence is therefore defined by 


lz| < lim V2  DQk +3) = R = oo 


The series for sin z converges in the whole finite plane, and the radius of convergence is 
described by R — oo. ^ 


Why Are Power Series So Useful? 


Inside the circle of convergence, a power series represents an analytic function and the 
operations of termwise addition, subtraction, multiplication, division, differentiation, and 
integration are all valid. Moreover, the coefficients in a power series are unique. Hence, in- 
side the circle of convergence, an infinite power series can be manipulated like a polynomial. 


Taylor Series and the Cauchy Integral Formulae 


Taylor’s theorem tells us that the coefficients a; in the power series f(z) = eet a(z — zo)“ 
are given by a = f(zo)/k!. We also know from Section 35.11 that the Cauchy integral 
formulae for derivatives give f (zo) = JE: f (f (z)/(z — zo)**') dz, where C is an ap- 
propriate simple closed positively oriented contour surrounding zo. Thus, the coefficients in 
the power series are now given, not by derivatives, but by integrals! Indeed, the coefficients 


are now 
1( k! f(z) Mi f(z) 
k aale | 2ri Je (z — zo)! 


where the contour C can be taken as a circle about zo. 


The function f(z) = = zh is analytic everywhere except where the denominator is zero, 


that is, except at the points z = —3, 1. If we expand f(z) in a Taylor series about zo = 0, 
we obtain 

1 & 1-3-3} , i 5 14$, ña Bl4 g 

= —., 2 = C— =z a z L4 O(z 

6 2; (—3)* 3 9 27 81 243 THEM 
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FIGURE 35.46 Analytic continuation in 
Example 35.68 


EXAMPLE 35.69 


Since the singularity closest to zọ = 0 occurs at z = 1, we choose for the contour C, the 
circle z = e /2, 0 < t < 2m, which has radius 4 and center at the origin. Thus, C does not 
enclose any singularity of f(z) and we compute the value of the integrals 


T 2x loit 4. 1) git 
-f Ie ue f PP PUN dt k=0,1,...,4 
2ri Jc Z — zo) 0 2 (1e?! + e! — 3) (5e) 


1 5 13 dl 
to be ds =p 35 gr: and aaa X 


Analytic Continuation 


We next investigate the relationship between two power series for f(z) developed in two 
overlapping circles of convergence. The transition from one circle to the other is known as 
analytic continuation. 


< 1 we have f(z) = 4L = } goz“, a power series about the point 


zo = 0. Expanding about zo = 2 gives the series 


9 (4 2H TC 
a=) (is) (<-5) 


Inside the circle 


& 


k=0 
The circle of convergence “expands out" from zo = 1 until it hits the singularity at z = 1, 
as confirmed by the ratio test. The ratio of two successive terms simplifies to J |1 = il 
from which we obtain |1 — i| z A = R. In fact, |1 — i| = c 
Expanding f(z) about zo = TL gives the series 
(100 90 V" MA 
05 = x. reir nier A 
181 181 10 
k=0 
Again, the circle of convergence expands out from zo = ii until it hits the singularity at 
z = 1. Repeating the ratio test, we find R = x = ji = 1|. 


Now, the point zı = 5i is outside the circle |z| = 1, but inside the circle |z — i| = 
UM as shown in Figure 35.46. Computation then shows f (zi) = o; (z1) = uu + 61), j= 
1,2, so f(z) is represented by a host of Taylor series. Some of these series have circles 
of convergence that overlap. If two different series are valid at a point, both series have to 
produce the same value for f(z). However, there may well be points not common to the 
different circles of convergence. The “new” series is then used to compute values outside 
the “old” circle of convergence but inside the “new” circle of convergence. That is how the 


values for a function are “continued analytically” beyond the original circle of convergence. 
ae 


Laurent Series 


The function f(z) = e*/z? does not have a Taylor series about zo = 0 where f (z) is clearly 
not analytic. However, expanding e? at zo = 0 and dividing termwise by z? gives the “series” 


E357 1 1 11 1 1 1, 
2; US 3. Had X3 77 
k=0 ! 


While the function f(z) is not analytic in a disk |z| « R, it is analytic in the annulus 
(washer) r « |z| « R. A series of this form, with negative integer powers of z, is called a 


Laurent series, for which it is useful to distinguish between the two cases r = 0 andr > 0. 
e 
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THEOREM 35.8 — LAURENT'S THEOREM 


1. f(z) is analytic in the annulus r < |z — zo| < R. 


2> 
1. Inside this annulus f(z) has the unique representation 
Ioa = X cx(z — zo) = y 5G —z)*4 Ya — zo)* 
kz—oo k=1 k=0 
(z IFR! z 1 Z 
2. r0 3 y ol 3 i 
k! k! [2zi Jc (z — zo)! 2zi Jc (z — zo)**! 


The coefficients b; are interesting, especially b; = ES fe f (z) dz, which is a multiple 
of the contour integral of f(z) around the positively oriented, simple closed contour C lying 
inside the appropriate annulus and containing zo in its interior. The coefficient 5; is called 
the residue of f (z) at zo and is typically found, not by integrating, but by other devices. The 
theory of using Laurent series to evaluate contour integrals is called the residue calculus; 
and Section 35.13 is devoted to its study. 

When r = 0 so that the annulus is 0 < |z — zo| < R, the following hold. 


1. The series iw bi. (z — zo) ~* is called the principal part of f (z) at zo. 

2. Ifthe "last b" is by, the function f(z) is said to have a pole of order N at zo. If N = 1, 
f(z) is said to have a simple pole at zo. 

3. If there are an infinite number of b’s, then f(z) has an essential singularity at zo. An 
essential singularity has unique properties, captured in the following two theorems that 
we merely state. (See [61] for a proof of the first theorem and [93] or [23] for a proof 
of the second.) 


THEOREM 35.9 — CASORATI-WEIERSTRASS THEOREM 


In any neighborhood of an isolated essential singularity zo, the function f(z) comes 
arbitrarily close to every value. 


THEOREM 35.10 PiCARD'S LITTLE THEOREM 


In any neighborhood of an isolated essential singularity, f (z) attains every possible 
complex value with at most one exception. 


A function that has an essential singularity at z = O is f(z) = e! = cos! + i sin 1. 


The oscillatory behavior of cos + and sin + on the real line should make it plausible that 
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EXAMPLE 35.71 


EXAMPLE 35.72 


FIGURE 35.47 The three regions of 
Example 35.72 


in the complex plane, this function would oscillate wildly enough for both these character- 
izing theorems to be realized. 


The Laurent series representation of f(z) — limig valid in the annulus 0 < |z|, is 


" " po (—1 yer 72k . " 1 
zT? ————g +z ->+ 
ij *2. (2k + 3)! 3 35 7! 
found by termwise dividing the Taylor series for 1 + sin z by z?. Thus, z = O is a pole of 
order 3 and the principal part of f(z) at z = Oisz ^? + z 7. e 


In the annulus 0 < |z|, the Laurent series for the function f(z) = eis Yo C D*/ ktz?*, 
obtained by replacing x ine* = 7; 9 x / k! with — 4. Thus, z = Qis an essential singularity 
of f(z). D 
The function f(z) = ae has singularities at z = 1 and z = —2. Hence, series expan- 
sions for f (z) can be constructed in powers of z in each of the three regions A = {|z| < 1}, 
B — (1 < |z| < 2}, and C = {|z| > 2} shown in Figure 35.47. In region A, f(z) is given 
by the Taylor series 7-9 z^ ((—2) * + 2)/6. In region C, f(z) is given by the asymptotic 
series 


1 1— j P TERT à 
5722 4-2 +2)“ = -z7 +z 3z H 
k=0 


a Taylor series constructed about the point zo = oc. 

Obtaining a series valid in region B, the annulus 1 < |z| < 2, requires the most work. 
Write AG) = i E and faz) = Peet so f(z) = fi(z)+ f2), a partial fraction de- 
composition. A Taylor series would represent fı inside the circle |z| < 1, but we want a 
representation for f (z) valid outside this circle. Hence, the expansion representing fı must 


be the asymptotic expansion —+ ) ;* z *-!. The Taylor series 4 )77° 9 (zy represents f^ 
inside the circle |z| < 2. Consequently, the sum 1 375, ($2)* — 1 ZLo z ^*^! represents 
f(z) in the annulus B. 

Finally, note carefully that the annulus 1 < |z| < 2 is of the formr < |z —zo| < Rand 
r #0. So, although the resulting Laurent series has an infinite number of b’s, the origin is 
not an essential singularity for f(z). The terms pole of order N and essential singularity 


are reserved for cases where the annulus is of the form 0 < |z — zo| < R. “ 
EXERCISES 35.12 
1. Obtain the Taylor expansion valid in region A in Example 35.72. (c) Where possible, use the ratio test to confirm the value of the 
Hint: Look for the geometric series in the partial fraction radius of convergence. 
decomposition of f (z). z+1 ze 
2. Obtain the series expansion for f(z) in region C in Example 35.72. 3. fR) = Pie 0 4 /@= 2go aT 0 
Hint: Look for the geometric series in the partial fraction z : z+3 
de T 37e 5: f@= 5 zo=2i 6 f(z)— Zo = | 
ecomposition of f(z). Z2 416 5 
In Exercises 3-12: 7. f(z BT, o—10 8 fíg e E 1 zo = 0 
—-5'" DM 2-1 


(a) Obtain a power series representation of f(z) at the indicated zo. 


(b) Determine the radius of convergence geometrically by finding 
the distance to the singularity nearest to zo. 
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£032 z z+9 z+8 
11. f(z) = —————:zo—-1 12. f(z) = ——— ——;zo-i 25. f(z) — 26. f(z) = 
Pa age tg di Pei og ui Ta ds Pee icu 
In Exercises 13-22, determine all zeros and poles of the given functions. 27, f(z) = — 28. f(z) = =? 
Indicate the multiplicity of the zeros and the order of the poles. z+ 6z+5 ` ze FA 
, 1 
13. f(z) = Tz =z- e fO = 3 — A413 sia fO = ay e425 
z? + (7 — 21i)z* — (149 + 114i)z — 507 + 279i TEMPE: : 2. f . 
( à i ] i H i For each function f(z) and each region given in Exercises 31-36, obtain 
14. f(z) = 9c + 5z + a Laurent series expansion in powers of z. 
z? + (4 + 3i)z? + (69 — 42i)z + 378 + 171i i 
5z? —6z-5 m z) = ——; e x : = z , 
15. fO 2 5 E. : 31. f(z) Zi. p {|z| < 35 B = {3 < |z| < 4}; 
z? + (14 iz-( -6i)-15-4 5i E eia ne d] 
16. f(2) = —6z" = 9z =6 | 1 
sek’ 3 — (10 + 13i)z2 + (12 + 116i)z + 264 — 372i 32. f(z) = — i24 ^ = {|z| < 5}; B = {5 < |z| < 8}; 
"lw z 3z 
17. fj 4 — ÓÀ — C — ; C = {|z| > 8) 
z* + (19 + i)z? + (162 — 6i)z? + (604 — 172i)z + 728 — 504i 1 
32? --5z 4-5 33. f(z) 2 — ;A— (Iz| < 2}; B = {2 < |z| < 5}; 
18. f - LL x^ | | FO 3— ^7 ld «2: B= «Id <5} 
z^ + Aiz? + (8 + 48i)z? — (96 — 24i)z + 288i — 540 C= dig] oe) 
423 +927 +52+6 D 
19. f zt + (20 — 18i)z? — (66 + 246i)z? — (1932 — 296i)z — 3648 + 7468i 34. f()2 — um z` A = {|z| < 2}; B = {2 < |z| < 4}; 
572 —72—5 di “z — 
ah fie z4 + (4 — 10i)z3 — (159 + 46i)z? — (406 — 638i)z + 4592 + 1794i C = {\z| > 4} 
- 3-222 5:46 t Jt M z <2% B= z : 
21. fe) z5 + (6 + Si)c* + (17 + 12i)? + (74 + 33i)z? + (96 + 40i)z + 184 — 36i 35. f@) = 22497414’ A= {lz| < 25 B= {2 < |z| <7}; 
de f 92? -3z +5 C z tz 7 
22. fi - z5 — (9 + 2i)z* + (74 — 18i)z? — (378 — 46i)z? + (965 — 630i)z — 2925 + 1100i at l 
The functions in Exercises 23-30 have simple poles at z; and z2. For each 36. f) = 22 — 14z IA. A= [je] «S B= DS = lel = 8s 
k, k = 1, 2, obtain a Laurent series expansion valid in 0 < |z — z;| < Rx C = {|z| > 9} 


and determine the largest possible value of Rx. 


2. O= 3% r9 


z —6z48 


24. f(z) = 


DEFINITION 35.10 


The Calculus of Residue 


What is a Residue? 


RESIDUE 


Let f(z) be analytic, except for a pole of order m at z = zo. The residue of f(z) at 
zo is the complex number b4, the coefficient of the + term in the Laurent series for 


f (z) constructed at z 


= Zo. 


As we saw in Section 35.12, if f(z) has a pole of order m at z = zo, then it has a 


Laurent series of the form 


fe)= DE —z) + X akz — zo)* 
k=l k=0 


valid in the annulus 0 < |z — zo| < Rforsome R > 0. The coefficients in the Laurent series 
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are given by the formulas 


1 Z 
ak = 7) fG dz => 0. 1... 
2zi Jc (z — zo)?! 
1 Z 
by = f fo ndez RSL Dp 
ani Je (z —29)'7* 
where C is a positively oriented, simple closed contour lying in the annulus 0 < |z—zo| < R 
and having zo in its interior. In particular, the coefficient 


l l 
bj = ami L f(z)dz 


called the residue of f(z) at z = zo, is denoted Res( f(z), zo). 
If the Laurent series is known by some means other than integration, then knowledge 
of bı yields the value of the integral f/. f(z) dz as 27iby. In fact, we have 


f f(z) dz = 2zib, = 2zi Res(f (z), zo) 
C 


Thus, we have the remarkable result that an integral can be evaluated by obtaining a coef- 
ficient in a series expansion of the integrand. 


Let C be the positively oriented contour z(t) = je", —z <t x z,and f(z) = 9X. Toeval- 


uate o = fe 9 dz by the use of residues, note that cot z = 5, so the only singularity of 
f (z) inside C is zo = 0. The Laurent series for f (z) = z?cotzisz?—4iz |— z+ 
so z = 0 is a pole of order 3, b; = Res(f(z),0) = —4, and o = 2xi(—}) = -$mi = 


—2.0944i. A corroborating f^. 2i cot(;e)e i! dt = —2.0944i is obtained by numeric 
evaluation of the contour integral. < 


The Cauchy Residue Theorem 


The generalized Cauchy-Goursat theorem of Section 35.11 concludes with the integration 
formula 


k 
(z) dz = Í (z)dz 
[ir : 2. MIS 


where, loosely speaking, C;,i = 1,..., k, are “small loops” encircling singularities of f (z) 
inside the larger positively oriented, simple closed contour C. If each integral on the right 
is evaluated using the appropriate residue, we then have the following theorem. 


THEOREM 35.11 CAUCHY RESIDUE THEOREM 


1. Except for singularities at z1, z2,..., zi. f (z) is analytic inside and on the posi- 
tively oriented, simple closed contour C 


k 
= | faz = mi Y Rest). 2) 
C 


i=l 
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EXAMPLE 35.74 If C is the circle z(t) = 5e", -m < t < z, and f(z) = ai, evaluate the contour 


integral A = fe f(z) dz. Factoring the denominator of f (z), we find (z + 1)(z — 3)(z +4), 
so f(z) has simple poles at —1, 3, —4, all lying inside C. A direct (but tedious) computation 


gives 
7 25e”! + 10e" — 3)e" 
A= si f ; i 2; H dt = 2zi 
= 125e3it + 50e2!t — 55eit — 12 
Atz = —1, 3, —4, we have the Laurent series 


i 
fQ =} -3 + i EH 


fo=H=Fe+4!-B-HE+t+-- 


respectively. Hence, the residues are rj = 3,72 = 2, and r3 = = 


3, respectively, and the 
Cauchy residue theorem gives the value of the contour integral as 27r i (4 + : + i) —2mi. 


i? 
ksd 


A Formula for Residues 


If f(z) is known to have a pole of order k at z = zo, it is possible to compute a residue 
without resorting to the Laurent series. A formula for doing this is 


Res( f(z), zo) = qu 


lim [(z — zo f (z)] (35.40) 


| 
(k — 1)! zozo 


When k = 1, the formula indicates we are to take the derivative of order 0, which is inter- 
preted to mean “take no derivative." We illustrate all this with an example. 


EXAMPLE 35.75 Find the poles and residues of the function f(z) = —~—4,—. Thus, f(z) has a simple 


(z—1)(z—3)^ (2+4)? 
pole at z = 1, a pole of order 2 at z = 3, and a pole of order 3 at z = —4. The computation 
of the residues at these three poles is summarized in Table 35.7. e 
Pole zo Principal Part of f(z) at zo Residue 5, 


z=- i i 
| e- ime- DIO = s 


500 
(z—3) = 13(z — 3)7! NM VEM 
) 686 9604 lim[(z — 3 f (OY = — 5g 
+A? V4)?  194(z4-4) b : 3 peny — __194 
^ 245 8575 300125 i lim. a4[G + 4? f()]' = — 


TABLE 35.7 Residues in Example 35.75 
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EXERCISES 35.13-Part A 


Al. Verify the residues given in the rightmost column of Table 35.7. 


In Exercises A2—5, let C be the contour z(t) = 3e",0 < t < 27, and, 


for the given function f(z), evaluate Je f(z)dzby 
(a) the Cauchy integral formula(s) applied to the first form of the 
function. 


(b) the Cauchy integral formula(s) applied to the second form of 
the function. 


(c) the Cauchy residue theorem. 


A2. f(z) 7—z = 2. 3 
UU C (z—-10G-2 g-i z-2 
11 4- 5z - 22? 2 3 
A3. zZz) = 5 = 
fe (z— D(z—2)0» z-1 (z42Y 
14-87 — 32 2 3 
A4. (z) = = 
fe (z—1Y(z42) (-—17» 2+2 
AS. f) 5+ 142-2? 2 3 
UU (2 = D(z +2)?  (—-1? (z42» 


EXERCISES 35.13—Part B 
rgy and then use 


B1. Determine the poles of f(z) = —7 25 
(35.40) to obtain the residues at each singularity. 


In Exercises B2-16: 


(a) Evaluate the given contour integral using the Cauchy residue 
theorem, computing the residues with (35.40) or with an 
appropriate software tool. 


(b) Compute each residue by obtaining an appropriate Laurent 
series and selecting the coefficient b,. 


B2. Exercise B4, Section 35.11 B3. Exercise B5, Section 35.11 

B4. Exercise B6, Section 35.11 B5. Exercise B7, Section 35.11 

B6. Exercise B8, Section 35.11 B7. Exercise B9, Section 35.11 

B8. Exercise B10, Section 35.11 — B9. Exercise B11, Section 35.11 
B10. Exercise B12, Section 35.11 B11. Exercise B13, Section 35.11 
B12. Exercise B14, Section 35.11 B13. Exercise B15, Section 35.11 
B14. Exercise B16, Section 35.11 B15. Exercise B17, Section 35.11 
B16. Exercise B18, Section 35.11 


For each function given in Exercises B17—26: 


(a) Obtain the complete Taylor expansion about zo = 1. 

(b) Obtain the Taylor coefficients at zo using the Cauchy integral 
formulae for derivatives, (35.36), of Section 35.11. Evaluate 
the integrals in (35.36) by the Cauchy residue theorem. 


B17. f(z) = 3z? +5z2+5z+5 B18. f(z) = 62? — 3z? +3z +2 
B19. f(z) 282 — 9z? — 4z —6 B20. f(z) 24) +z? —9z +2 


B21. f(z) 222-62 +z+4 

B22. f(z) = 7z* + 623 — 3z — 9z — 4 
B23. f(z) = 9z* + 52 — Az) + 7z +3 
B24. f(z) = 4z* — 37 — 7z? —z -9 
B25. f(z) = 824 — 52 +422 +9z +5 
B26. f(z) = 9z 4-2 --32-47:-5 


In Exercises B27-36, use the Cauchy integral formulae for deriva- 
tives, (35.36), Section 35.11, and the Cauchy residue theorem, to obtain 
f™ (zo) for the given function f(z) and the indicated n and zo. Verify 
the result by evaluating the appropriate derivative. 

B27. f(z) 2ze *;n22;z9 2-2 

B28. f(z) = sin(z? — 1); n = 3; zo = 2i 

B29. f(z) = tanh z?; n = 2; zo =i 


T 
B30. f(z) = arctan sin z; n = 1; zo = n 


B31. f(z) = Incoszin = 3; zo = = 
tanz 
B32. f(z) = LT n=2;%=1+i 
iB fuot lacia: 
.f()- imne3:29252 
z+ I ° 


B34. f(z) = zarcsinh z; n = 2; zo = 2 
B35. f(z) = vz? + 1; n = 3; 2 = 0 


B36. f(z) = cos? sin z; n = 1; Zo = = 


Chapter Review 


Let zı = 2+ 3i, z2 = —3 +i, z3 = —5- i. 
1. Obtain zı + 22, z2 — 23, 2123, 2. 
Ls, 


2. Express zg, k = 


3. Obtain zj, z2, and z3. 


2, 3, in exponential form. 


4. Obtain both square roots of z;, Z2, and z3. 


5. Obtain the three cube roots of z1, z2, and z3. 

Write each of the following functions in the form u(x, y) + iv(x, y). 
6. f(z) —sinz 
8. f(z) = sinhz 


Use the results of Questions 6—9 to obtain the rectangular form of each 
of Questions 10 and 11. 


10. sin z;, cos z; 11. sinh zi, cosh z3 


Obtain the rectangular form of each of Questions 12 and 13 using the 
appropriate formulas. 


12. arcsin z2, arccos z3 13. arcsinh zı, arccosh z2 
2 3 1 


14. Define both the multivalued log z and Log z, the principal value of 
the complex logarithm. 


15. In what sense is a formula like log z;z? = log zi + log z2 “true” in 
the complex plane? 

16. Evaluate Log z;. 

17. Evaluate Log z1z3 and compare it to Log zı + Log zs. 

18. Evaluate Log z?? and compare it to z2 Log z1. 


19. Evaluate Log a and compare it to Log z2 — Log z3. 


20. Evaluate Log e? and compare it to z2 Loge = z2. 


723 423 


21. Evaluate (z;z2)** and compare it to z} z; 


22. Evaluate (£-)? and compare it to z? /z?. 


2223 


( 
( 

23. Evaluate (z;?)* and compare it to z? 
( 


z2 


24. Evaluate (7) and compare it to (z) ^. 


25. 


26. 
27. 


28. 


29. 


30. 


31. 
32. 
33. 
34. 
35. 


36. 


37. 


38. 


39. 


40. 
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Evaluate (z3) ^^, (3)'^, and (3) ^. 

Evaluate (z!/?)^, (PY, and (<}°)°. 

Let f(z) ^ z^. 

(a) Write f(z) in the form u(x, y) + iv(x, y). 

(b) Verify that u and v satisfy the Cauchy-Riemann equations. 
(c) Show that u and v are harmonic functions. 


What is an analytic function of a real variable? What is an analytic 
function of a complex variable? How do these differ? 


If f (z) = 2’, obtain the value of the contour integral f, f(z) dz 
when 


(a) C is the parabola y = x?, —1 <x < 1. 
(b) C is the straight line connecting (—1, 1) with (1, 1). 


Explain why the two contour integrals in Question 29 have the 
same value. 


What does the Cauchy-Goursat theorem say? 

What does the generalized Cauchy-Goursat say? 

What is the Cauchy integral formula? 

What are the Cauchy integral formulas for derivatives? 

What are the integral formulas for the coefficients in a Laurent 
series? 

Use the generalized Cauchy-Goursat theorem to evaluate the 


contour integral f, e*/(2z? — 5z + 2) dz, if C is the contour 
z 23e',—m <t <n. 


Evaluate the integral in Question 36 by using Cauchy's residue 
theorem. 
State the content of Laurent's theorem for Laurent series 
expansions. 

E . : c boa 9z+7 
Find all zeros and poles of f(z) = zc ROINA A 
Indicate the multiplicity of the zeros and the order of the poles. 
If f(z) = v. obtain a Laurent series in powers of z, valid in 
the region 
(a)lz| «1. (i1«iz«3  (olz >3 


Chapter 36 


Applications 


INTRODUCTION This chapter contains a representative collection of practical 
applications of complex function theory. The suite of tools and techniques upon which this 
chapter rests was assembled in Chapter 35. 

A variety of real integrals can be evaluated using the complex plane as an ally. Generally, 
the real integral is interpreted as a contour integral, a closed contour is formed in the complex 
plane, the contribution from the added contour is shown to be negligible, and the resulting 
integral is evaluated by Cauchy's residue theorem. Although it might be tempting to call 
this technique “contour integration,” the reality is that all integrals in the complex plane are 
contour integrals. Certain contours can be deformed so that the Cauchy residue theorem 
applies, and it is residue theory that really evaluates the integrals. 

The Bromwich integral formula for inverting Laplace transforms is a contour integral 
in the complex plane, with the contour being a vertical line. In some cases, the integral 
can be evaluated directly, and in other cases the contour must be closed so that Cauchy's 
residue theorem can be applied. This is the analog of the inversion formula for the Fourier 
transform in Section 30.3. In that section we inverted some Fourier transforms by brute- 
force integration. We can also evaluate these inversion integrals by contour integration and 
the Cauchy residue theorem. 

The root locus is a graph used in the design of feedback control systems. In Chapter 12, 
the stability of a system of linear differential equations is seen to depend on the location of 
the characteristic roots. If all the characteristic roots have negative real parts, the roots lie 
in the left half of the complex plane. The roots of a control system under design typically 
depend on a parameter, called the gain. Thus, the location of the characteristic roots depends 
on this parameter. A graph of the location of the characteristic roots as a function of the 
gain is called the root locus. 

The Nyquist stability criterion, based on two concepts, the winding number and the 
principle of the argument, is another concept arising from the design of feedback control 
systems. The winding number of a contour is the number of times it winds around a given 
point. The principle of the argument relates the number of poles and zeros a function has 
inside a contour to the winding number of the contour. Hence, by looking at the deformation 
of a contour under the action of a complex map, the winding number can be determined, and 
from that, the number of poles and zeros the mapping has inside the contour. Articulated as 
a way of determining the number of zeros in the left half-plane, the extended principle of 
the argument becomes the Nyquist stability criterion. 

Roughly speaking, the conformal property of analytic functions amounts to the local 
preservation of angles. If two curves that intersect at a particular angle in the z-plane are 
mapped to the w-plane by an analytic function, their images in the w-plane will intersect 
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at the same angle. Consequently, the mappings induced by analytic functions are called 
conformal maps. The mapping action of a number of simple analytic functions is cataloged. 
Because complex functions map the plane, it is not possible to describe their action by a 
simple graph. Various devices are used to show how the function maps regions in the z-plane 
to regions in the w-plane. These studies are collected and go under the heading of conformal 
mapping. 

The important conformal map called the Joukowski map transforms certain circles in 
the z-plane to shapes in the w-plane, which resemble airfoils, the cross-sectional view of 
an airplane wing—hence, the phrase Joukowski airfoil and the interest this particular map 
generates. 

The Dirichlet problem in the plane is solved by transforming it with a conformal map 
to an equivalent problem on a simpler region. The Dirichlet problem consists of Laplace's 
equation on a region on whose boundary the value of the unknown function has been 
prescribed. Using separation of variables, this problem has been solved for the rectangle in 
Chapter 26 and for the disk in Section 29.1. Chapter 30 contains examples of the Dirichlet 
problem being solved by integral transforms. In the conformal mapping method a conformal 
map is used to transform the given region to a more tractable one, one for which the solution 
of Laplace's equation is more readily obtained. 

The first of two sections devoted to solving fluid-flow problems via complex variables 
begins with a brief formulation of the planar fluid-flow problem and then details several 
simple flows in the z-plane. Several flow problems are solved by conformal mapping tech- 
niques. In some cases, a complex flow in the z-plane is mapped to the w-plane, where it 
admits a simpler solution that can then be mapped back to the z-plane. In other cases, this 
technique fails because of the algebraic complexity of the inverse map. Hence, a known 
flow in the z-plane is mapped to a complex flow in the w-plane, and the flow in w-plane is 
declared to be solved by the simpler flow in the z-plane. This subtle reversal of the roles of 
the two planes must be recognized, lest the reader misunderstand some of the applications. 


: Evaluation of Integrals 


Introduction 


After being converted to contour integrals in the complex plane, a number of definite inte- 
grals along the real axis can be evaluated by the Cauchy residue theorem. In this section we 
will examine several classes of such integrals and the conditions under which they can be 
evaluated by contour integration. 


Integrals of the Form | F (cos 0, sin 0) d0 


Let F(u, v) be a rational function, that is, a ratio of polynomials in u and v. The change 
of variables z = e/^ will convert integrals of the form m F (cos0, sin 9) d@ to contour 
integrals of the form Je f(z)dz, where C is the positively oriented circle |z| = 1. The 
contour integrals can then be evaluated using residues, and 
2n k 
j F (cos 0, sin 0) d0 = 2zi X Res(f C). Zn) 
0 


n=l 


884 


Chapter 36 Applications 


EXAMPLE 36.1 


EXAMPLE 36.2 


where z,, = 1,...,k, are the poles of f (z) inside the contour C. The change of variables 
z = e"? is implemented using cos @ = }(z + +), sind = 4 (z — +), and 40 = &. 


To obtain 


2x — sin?0 1 
d0 = —(V21 — 3) = 0.828635 
i 5 +2cos 20 6 ( 


make the change of variables z = e/?, and use z? = e”? = cos20 + i sin 20, so cos20 = 
1 (c3 4 5), to obtain the integrand f(z) = X IET The simple poles, their magnitudes, 
and the associated residues are listed in Table 36.1. The first three poles are inside |z| = 1, 


and the sum of the associated residues is (v21 — 3) = 0.828635. 4 
k Pole at z = zi Izel Res( f (2), zk) 
i 
1 0 0 — 
, 4 
2 “(V7 — v5) 0.46 i 
3. -ZWi-43) 046 -iA 
4 s(V7+V3) — 22 ji 
5 -5v7 45) 22 pa 


TABLE 36.1 Poles and residues of f(z) in Example 36.1 


The Poisson integral formula 


2. 2 p2n 
u(r,0) = ——— Í f@) 
0 


27 c? — 2rccos(0 — o) +r? 
provides the solution to the Dirichlet problem V-u(r, 0) = 0,u(c, 0) = f (8) on the disk 
of radius c. (See Section 29.1.) Unfortunately, this is a difficult integral to evaluate. For 
example, if we take c = 1 and f (0) = sin? 6, the integrand in the Poisson integral formula 


would be F = zz- sagas): The change of variables z = e'^ leads to the new integrand 
2 2 
(2-1) 


z^re-i? = 31 + r?) + zrei? 


i 
J= d 


which has a pole of order 2 at z = 0 and simple poles at z = re and 4e!”. Since 0 <r < 1 
inside the disk, only the first two poles are inside the contour. Adding residues at these two 
, and simplifying, we obtain 


p[1+r? (Pee —1y 0-523 1 , 
u(r, d) == ES * ) Qniy (=) = 5 (1-1? 00826) ^ 


2 


B . . l-r 
poles, multiplying by the factors 277i and = 


4| re r2e219 (r2 — 1) 


(a) 


(b) 


FIGURE 36.1 The positively oriented 
contours C, and C; are shown in (a) and 
(b), respectively 


EXAMPLE 36.3 


36.1 
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Evaluation of Integrals 


Integrals of the Form f^... f (x) dx 


If f(x) has no singularities on the real axis, then in i f(x) dx = limg—oo Mys 
fig f (x) dx, the limit on the right defines the improper integral on the left. It can be shown 
that if the limit on the right exists, then so does the less restrictive Cauchy principal value, 
namely, lim g..55 la f (x) dx, and the two limits are equal. So, any condition that guaran- 
tees the existence of the first limit then allows us to evaluate it by computing the second 
"easier" limit. The sufficient condition we will impose on f (x) will allow us to “complete 
(or close) the contour" in the complex plane and evaluate the improper integral by invoking 
Cauchy's residue theorem. 

Let C, be the positively oriented contour consisting of the interval [—R, R] on the real 
axis and Cg, the upper half of the circle |z| = R in the complex plane. (See Figure 36.1(a).) 
In the upper half-plane, let f (z) be analytic, except for isolated poles, and let | f (z)| decay 
sufficiently rapidly on Cg so that limr+o fo, f(z) dz = 0. Then [ss f(x) dx is given by 


R k 
jm f. f(x)dx + Jim. f. f(z)dz = jum Í. f(z)dz = 2xi 2 Rest FC), Zn) 
where z1, ..., zg are the poles of f(z) in the upper half-plane. 

Precisely, if as |z| — oo wehave f(z) = O(|z| ?), with p > l,sothat| f(z)| < K/|z|? 
for some positive constant K and large enough |z|, then the improper integral exists and 
f(z) makes a negligible contribution to the contour integral along Cr. (A formal proof can 
be found in [69].) 

Finally, note that if the contour is completed in the lower half-plane, then Ie f(x)dx = 
—2mi 3s Res( f (z), Zn), where z1, ..., zj are the poles of f(z) in the lower half-plane. 
To understand the minus sign on the right, let C; be the positively oriented contour con- 
sisting of the real interval [—r, r] traversed right to left and C,, the lower half of the circle 
|z| = r in the complex plane. (See Figure 36.1(b).) The positive (counterclockwise) orien- 
tation on C2 means that the integration along the real axis is from right to left. Hence, the 
contour integral gives the negative of the desired real improper integral. 


Let f(x) — CADET’ with simple poles at +i and —2i. There are no poles on the real 

axis, one pole in the upper half-plane and two poles in the lower half-plane. The integral 
oo zi T s A x 

T me f (x) dx evaluates to — > using the antiderivative 


1 x?+1 2i 
F(x) 2-1 
udin m E 


lfíx—2i x-—2i 

3 (5 +1 =) 
Since f(z) = O(|z| ?), the real axis may be closed to the contour C in the upper half-plane 
and the Cauchy residue theorem applied, giving 277i Res( f (z), i) = 277 ( 3) = E , With 
z — i being the single pole in the upper half-plane. 

It would also be possible to close the contour in the lower half-plane by adjoining to 
the real axis the lower semicircle |z| — r. The positively oriented contour C, consisting of 
the real axis between x — r and x — —r, and the semicircle, is traversed counterclockwise. 
However, that causes the x-axis to be traversed from right to left and, therefore, induces a 
minus sign in front of the sum of residues when applying the Cauchy residue theorem. The 


i X 
arctan x + = arctan — 
3 2 


obtained by writing f(x) as 
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EXAMPLE 36.4 


residue at z = —i is 1, whereas the residue at z = —2i is —1. The value of the integral 


2° 3- 


is then —2z i times the sum of the residues in the lower half-plane, or -E, as computed 
earlier. ^ 


If f(x) is an even function, then 


o k k 
SS [ fe 27i 
ji f(x)dx = al fœ)dx = —— X Res(f (2), Zn) = xi X Res(f (2), Za) 
0 TETES ~ nal n=1 
where again, z;,..., Zz, are the poles of f(z) in the upper half-plane. For example, if 
fx) = De with antiderivative 


J3x +x? +1 
Ap x = 1 
then i f(x) dx = lim, F(x) — F(0) = $. On the other hand, f(z) has poles at the 
six roots of z = —1, namely, at +i, e*7//6, e+57i/6. At the three poles in the upper half-plane 
we then find Res( f (z), i) = —£, Res( f(z), e7'/6) = -4 (v3+i), and Res( f (z), e5%‘/5) = 
53 — i), so xi times the sum of the residues is again 3. $ 


F(x) = } arctan x+ i arctan(2x — 4/3) + t arctan(2x 3-3) + f3 In 


Integrals of the Form f ^... e'™* f (x) dx 


Let f(z) be a meromorphic function, that is, a function that is analytic, except for isolated 
poles. In addition, let f(z) = O(|z| 7), p > 0, hold for |z| large. If z1, ..., zx and £1, ..., ¢; 
are the poles of f(z) in the upper and lower half-planes, respectively, then 


k 
. # 
5; imz £(4Y 7 
"" 27i X Res(e f@),%n) m>O0 
Í e"* f (x) dx — E 
DES —2mi y Res(e™”? f(z), fn) m <0 


n=l 
When m Æ 0, the behavior of e/"* in the complex plane allows f(z) to obey a less 
restrictive condition than in the case m = 0. If m > 0, let C, be the positively oriented 
contour consisting of the interval [— R, R] on the real axis and Cg, the upper half of the 
circle |z| = R in the complex plane. On Cg where z = Re”, the magnitude of e/"* is 


imRe' imR(cos t--i sint —mR sint imR cost —mR sint 
[ete | = es LIC | [e] =e 


Thus, if m > 0 and 0 < sin: because 0 < t < x on Cg, the exponential will go to zero as 
R — co. 

On the other hand, if m « 0, the contour is completed to C2, consisting of the real 
interval [—r, r] traversed right to left, and C,, the lower half of the circle |z| — r in the 
complex plane. Then on C, where z = re’, the magnitude of e/"* is 


imre" imr(cost+i sint —mr sint imr cost —mr sint 
le | G ( | = e e =e 


Because m < 0, to have decay of the exponential term, we must have sint < 0 on C,, which 
is exactly what happens form < t < 27. If the contour is completed in the lower half-plane, 
the positive (counterclockwise) orientation of C» means the integral along the real axis is 
from right to left. Thus, the contour integral will yield the negative of the real improper 
integral, thereby explaining the minus sign in front of the sum of the lower half-plane's 
residues. 
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EXAMPLE 36.5 To evaluate the integral [a4 e?* /(x? — 8i) dx, determine the poles of f(z) zzy to be 


z = —2i and z =i + 4/3. Since m = 3 > 0, close the contour in the upper half- distor: and 
find the residues of the two poles in that half-plane. Thus, the value of the integral is 


e / eu 
2mi (Res (m + 45) + Res (ay — v3)) 
Z Z i 


-xutl( (1 — iV 3)e9P + (1 -- 14/3)e 3I 5 


+, 
~~ 


= = : (cos 34/3 + 4/3 sin 34/3) = —0.0278i 


Integrals of the Form ^ sed f (x) cos mx dx and I f (x) sin mx dx 


Since e/"* = cos mx + i sin mx, integrals of the form 
J f(x)cosmxdx and Í f(x) sinmx dx 
—co —oo 


can be evaluated by taking the real and imaginary parts of f°, f (x)e/"* dx. 


EXAMPLE 36.6 — To obtain 


?? x sin 5x i 
5 =e 
66 X +9 


determine the Dies of f(z) = 5 to be z = +37. The required integral is the imaginary 
part of IS 9iz f(z) dz in which m = 5 > 0 suggests completing the contour in the upper 
half-plane where z — 3i is the only pole of f (z). Since 


ze" [as 
2zi Res | =——, 3i | = 277i | ~e i 
"aa 2 
the value of the integral is ze ^^. $ 


EXAMPLE 36.7 To obtain 


© 2cos?x T i 
——— dx = — (l + 5e `) 
0 pues 32 


Dura | 9 c noo eo cos 2x dx 

use cos^ x = 5(1+cos 2x) to write h ai x M^ dio - Each of these two integrals has 
l dx cos2x dx dx 

even integrands, so we have 5 ; [^s cs LESE T 3 : f n.n each of these two integrals, 


close the contour in the upper half-plane thereby forming Cpr, and evaluate 5 Jc. diim T 
Je, cos*z . For the first integral we have, by the Cauchy residue theorem, 


LDR l oi \ = xi PX a 
juam) es xay sxi- =g 


where z = 2i is the only pole the integrand has in the upper half-plane. For the second 
integral, we have 


1 2iz 1 5 5 
-R [2zi Res | ————5.2i = 5^ (^3 49 5 i)= M 4 
2 (442) 5 32 32 


and for the original integral, we have £ + £e ^ = Z(1 + 5e). kd 
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-=R 


FIGURE 36.2 
Example 36.8 


l-r l+r R 


Indented contour for 


Indented Contours 


Suppose f(z) satisfies the following conditions: 


On the real axis, f(z) is analytic except for simple poles at ai, ..., aj. 
2. Inthe upper half-plane, f(z) is analytic except for isolated poles at z1, .. . , Zz. 
3. f(z) =O(\z|-”), p > 1, for |z| large. 


Then, by the Cauchy residue theorem, we have 


58 k j 
/ f(x) dx = 2zi > Res( f (z), Zn) +i >| Res( f(z), an) (36.1) 


e n=l n-l 


Along the real axis a semicircular detour is made around each singularity. In the limit 
as the radius of the detour goes to zero, the contribution to the contour integral is half the 
residue ordinarily expected. This is illustrated in the following example. 


If f(x) — cem verify that A = P aed f(x)dx = —z. The integrand has a simple 
pole at x — 1 on the real axis and at z — i in the upper half-plane. Accordingly, 


A = 2zi Res(f (z), i) + zi Res(f(z), 1) = 3 — D2zi + zi = =x 


The integral is evaluated by closing the contour in the upper half-plane but indenting 
it around the simple pole at x — 1. Thus, consider the contour C, shown in Figure 36.2 and 
consisting of the interval [—R, 1 — r] on the real axis, the semicircular arc C, with center 
at (1, 0) and radius r, the interval [1 + r, R] on the real axis, and the semicircular arc Cp 
with center at (0, 0) and radius R. 

Except for the poles at z1, . . . , zy, f(z) is analytic inside C. Thus, the Cauchy residue 
theorem applies and we have 


oo l-r R 
Í f(x)dx = lim lim |f f(x)dx + Í f(z)dz + f(x)dx + f(z) az 
—00 FOROS |. Jn 6 l+r 


Cr 


k 
= 2ni ) " Res( f(z), zn) 
n-l 
Since for |z| large, f(z) = O(|z| 7), p > 1, holds, we again have lim R% Je, f(z)dz — 0. 
On C,, the small “indented” contour, we will show that we have lim,.9 fe f(z)dz = 
—mzi Res( f(z), 1). Consequently, we then have 


ss k 
/ f(x) dx — wi Res(f (z), 1) = 2zi y Res( f(z). Zn) 


n=1 


from which we conclude 


s k 
J f (x) dx = 2ri M Res(f (2), zn) + i Res(f (2), 1) 
ce n-l 
By generalizing the process of contour-indentation, if there are simple poles aj, ..., aj 
along the real axis, then we sum the residues at these poles and obtain the formula (36.1). 
The integral on C, is evaluated as follows. First, isolate the part of f (x) that is singular 
at x — 1. This can be done by computing a Laurent series about x — 1 and getting 


f@)=@-1'-14+3@-D+-- 


FIGURE 36.3 The contour C for 
Theorem 36.1 
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or by computing the partial fraction expansion of f (x) and getting 
1 x+1 . 
fœ) = m = fi(x) + f) (36.2) 
»-1l ^1 
In either case, we can see that the residue of f(z) atz = 1 is 1. For our purposes, it is more 
convenient to work with the partial fraction decomposition (36.2) because that keeps the 
part analytic at x = 1 “together” as a single fraction. 
The contribution of fı = 4 to the integral on C,, parametrized as z(t) = 1+re", 0 < 


t < rt, is obtained directly as p idt = —iz. Of course, if Res( f(z), 1) were something 
other than 1, the value of this integral would be —zi Res( f (z), 1). 

We next argue that since f(z) = a es is analytic (and therefore continuous) in a 
neighborhood of z = 1, it is bounded, say by M, in that neighborhood. Then, on C,, the 
integral of f; can be estimated as M T rdt = —Mnr, a bound that goes to zero as r goes 
de 


to zero. 


Integrals of Multiple- Valued Functions 


For integrals of the form p^ x? f (x) dx, where £ is not an integer, we state the following 
theorem taken primarily from [69]. 


THEOREM 36.1 


1. £ is areal constant different from an integer. 


A=fBH+1 
3. (z) is analytic except for simple poles at a;, . . . , a; on the positive real axis, and 
y p pie p j p 
poles at z1, .. . , z; anywhere in the complex plane exclusive of the nonnegative 
real axis. 


4. f(z) =O(\z|"”), p > A, for |z| — co, or equivalently, lim; . s; |z| | f(z)] = 0. 
5. f(z) =O(\zl’), p > —A, for |z| — 0, or equivalently, lim;;..o |z|* If (z)| = 0. 
6. Fo(z) = ef “2 f (z), where Logz = In |z| + i Arg z is the principal logarithm, 
and —z < Argz <7. 
A E Fo(z) 0 < T(z) 
7) — pblLog(—z)+ri] NL i .0 
Te F(z) =e f(z) T | e27!B Folz) T(z) <0 


=> 


p` ^Tt 


AE k j 
CPV ji x? f(x) dx = —— X Res(F (2), Zn) — 2 cot am Y ^ Res(Fo(z). an) 


0 sin Ax : 


tz] n-l 


where CPV denotes the Cauchy principal value of the integral on the left. 


The CPV arises when each indentation circle such as those illustrated in Figure 36.3 are 
all taken to have the same radius r. Of course, whenever the integral exists as an improper 
integral, the principal value also exists and is the same number. Figure 36.3, which shows 
the positively oriented, closed contour C, will help in our discussion of Theorem 36.1. 

When £ is not an integer, the origin is a branch point for x^. Since x? is defined in terms 
of the logarithm, the behavior of the logarithm is crucial to the choice of contour along which 
to integrate. Closing the contour to C so as to indent around the representative singularity 
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T + Arg(z) 


“Ly 
(b) 
FIGURE 36.4 If Z(z) > 0 as in (a), then 


Arg(—z) = Arg(z) — x. If T(z) < 0 as in 
(b), then Arg(—z) = Arg(z) + 7. 


EXAMPLE 36.9 


EXAMPLE 36.10 


at x = a on the positive real axis, we include the poles of f(x) inside C. Therefore, the 
logarithm used to define x? must be analytic inside C, a region that includes the negative 
real axis. Thus, we must have the discontinuity in the argument of the logarithm occur 
across the positive real axis. 

The principal logarithm, Logz = In |z| + ¿Arg z, is analytic for —r < 0 < x. Thus. 
Fo(z) = eP'^8* f(z) uses the principal logarithm and is analytic across the positive real 
axis. At simple poles along the positive real axis, residues are computed using this function. 

Inside C, F(z), as given by hypothesis 7, is analytic for 0 < 6 < 2x. There are two 
claims being made here. First, we need to verify that the second equality in hypothesis 7 is 
indeed valid; and second, we need to check the analyticity across the negative real axis. 

To show the validity of the equality, let z be in the upper half-plane so that Z(z) > C 
and let Arg(—z) = Arg z — x . For example, if z = 4/3 + i, then Arg z = % and Arg(—z) = 
—2n = Arg(z) — zt, as illustrated in Figure 36.4(a). On the other hand, let z be in the 
lower half-plane, so Arg(z) « ? and Arg(—z) = Arg(z) +7. pnm using an example, let 

3 — i so that Argz = —% and Arg(—z) = Argz tz = 2m, as illustrated in Figure 
36. A). 
Since Logz = In |z| + i Arg z defines the principal logarithm, for Z(z) > 0 we have 


Log(—z) + zi = ln |-z| + i Arg(—z) + zi 
= In|z| + i(Argz — x) 4 ri 
= ln |z| + i Argz 
= Logz 
but for Z(z) « 0 we have 
Log(—z) + zi = In|—z| +7 Arg(—z) + zi 
= ln |z| +i(Argz + 7r)+ ri 
= ln |z| +i Argz + 2zi 
= Logz + 2zi 
Thus, when T(z) < 0, eflLog(—2) +27] - e? Log zg2nif and F(z) = ePlLogl-a+ri] f(z) = 
eP LOB? F(z) e27!B = Fo(z)e7778. 
If a < 0, then 
Jim F(a+ib)= im F(a 4- ib) 
5—0* 5—0- 
showing F(z) is continuous across the negative real axis. If a > 0, then 


Jim F(a + ib) — lim F(a + ib) = a? f (a) — e^) 


so F (z) is continuous across the positive real axis only if £ is an integer, whereby e77' = 1. 


To obtain 
f dx T 0 
-— e > 
Jx(x+e) Je 
note that B = —} so that B+ 1 = j =A. Since f(z) = 4 = Ollz |P), |z| — oo, with 
polseA- L, and since c > 0, the only pole of f(z) inside the contour C is at z = —c. 
There are no poles on the positive real axis. Define F(z) = e 1/2lLog -O*7il / (7 + c) and 


obtain the value of the integral as — 3—- Res(F(z), —c) = (zi) =) = Je 4 


Nom 


The integral I does not exist as an ule Se integral because of the simple 


Jx(x UE 5) 


pole at x = 5 on the real axis. However, the CPV is —15, as can be determined from the 


antiderivative 


by computing 


lim g(x) — lim g(x) + lim [g(5 — c) — 
x00 x—0* c—0* 
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J 


(x) P tan 2/5 tanh 2 
x)= —— arc = ——À— AM 
$ 9 3. °° NS 


s(5--ee 


18 
Alternatively, note that since 8 = —5, we have 8 + 1 = 1 = i. Then define the func- 
tions 
eC V2ILogC- 2i] 1 
F(z) = — — —— —c— and F(z) = ———— ———— 
Gc 46-5 UU ele AG-5 


and compute the residues 


ri = Res(F(z), —4) = — 


J/5 


and rz = Res(Fo(z), 5 
18 2 = Res(Fo(z), 5) = "45 
The CPV of the integral is then —z7r, i5- Tr cot 7 —zn( ic j= eee. ye 
EXERCISES 36.1—Part A 
A1. Make the change of variables z = e in Lin? 2 dé to obtain A3. Evaluate {>~ iem dx 
Jc f (z) dz, where C is the contour defined by |z| = 1. AA, Evaluate fs 2ix i js. 


à 
A2. Use residues to evaluate Feli i dx. 


EXERCISES 36.1-Part B 


AS. Evaluate f° 1+5 cos2x dx and f^. 45 sin2x dx. 


oo 14x27 oo 14x? 


B1. Evaluate f^ e" Ge ; dx by completing the contour as in Figure 
36.1(a) and as in Figure 36.1(b). Of course, the value should be 
the same in each case. 


[In Exercises B2-16, evaluate by conversion to contour integrals. Where 
possible, verify by consulting a table of integrals, using a computer al- 
gebra system or integrating numerically. 


" ? — dg " 
a «l B3. —————,a^ «1l 
o l-asinO 


2x 10 
BS. Í m 
o 7--2sin8 
2x dé 5 
B6. «f a b B7. Í —— ge b 
0 rey o a+bsiné 
2x 2x dé 
B8. 1 B9. Í — —_ 
Fry 0 o 2-5sin^0 
2x do 
B10. B11. Í ————— 
o a-rbsin^0 


dix [ sin? 0 d0 a 
o a+bcosé 


7. 


zr d0 
B2. ETÀ 
o 1 +acosd 


0 cin 


l RU 0 
sin? 0 d0 


B12. [ > |b} > 0 
34-2cos6 


B14. [ cos? 50 d 
0 7 —3cos 


x 10 
B15. Í nn (Hint: Use symmetry or 0 = 27 — t to establish 


; Hi nt: If z = e? , then e”? = 2^, etc.) 


7"  dó p dé ) 
JO 342cos0 ^ Ja  342cos0* 


dá dO 
B16. —— 
Í (a + cos? 0)? 


In Exercises B17—26, evaluate by conversion to contour integrals. Where 
possible, verify by consulting a table of integrals, using a computer al- 
gebra system or integrating numerically. 

oo 

8x — 

B17. / = 

o; (x? — 8x um 7:554 

4x — 

B18. f. redi 

i EP GG — 7i) 

6x? — Ax +5 

B19. d. 
L (x? + 2x + 50)(x? — 6x34 


oo x^ 
ih] — aw 
Í x* 4 18x? 4-162 ^" 
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B22 [ dx 
U Je x4 — 8x2 432 ^ 


B23. | — : die 
s (2 — 18x + 162)(x — 8 — 5i) 


« = 
B24. io ca. — dx 
9 (3 — 2x + 2x 4- 9i) 


eo 7 6: 5 
Bas. | Crit dx 
oo (X? + 10x + 89) (x? — 6x + 18) 


co x? =f 
B26. f py 
0 (x^ + 2)" 


In Exercises B27—36, evaluate by conversion to contour integrals. Where 
possible, verify by consulting a table of integrals, using a computer al- 
gebra system or integrating numerically. 


oo 2x?— x 4 Six 
B27. f e RN 
-o (X^ + 12x + 117)(x + i) 


oo x? 8x —3 a EL 
B28. / ne ee — dx 
-oœ (x? + 16x + 145) (x — 5 + 7i) 


oo 3 3.2 Ax l)e 
B29. Í bn. Mee a dx 
oo (X? + 12x + 52) (x? — 6x + 45) 


© (y2 9 —Six oo 3 56ix 
B30. I Ir dx B31. f a 
o X^- 14x? 4-85 o x4— 16x? 4- 89 
oo 2; 2 2x —4 —Tix 
B32. f E xoc a AN 
-oœ (x? — 18x + 82)(x — 2 + 5i) 
I (8x? — 5x — 9)e?' 
-œ (x? — 14x + 113) (x + 9i) 
oo 3 S P p—3ix 
B34. i Bs + 5x x = 4)e 
Loo (x? + 12x + 40) (x? — 6x + 25) 


oo x? 5 Six oo x? — 5x —4ix 
i Ce dk OM i Bn AN 
o x*—6x2+18 o x4+ 18x? 4- 145 
In Exercises B37—46, evaluate by conversion to contour integrals. Where 


possible, verify by consulting a table of integrals, using a computer al- 
gebra system or integrating numerically. 


B33. 


B35. 


337, F as — 4x — 6) cos(9x) ii 
-oœ (X? — 4x + 68) (x — 6 — 9i) 

— f. pe — 6x + 6) sin(7x) odii 
-æ (X? — 14x + 58) (x + 6 — 3i) 

B39. IN us = Sy? +h Set 3) cos(x) es 
-o (x? — 4x + 5) (x? + 4x + 29) 

B40. L. er + 7x? + 4x + D sin(Sx) |. 
-oœ (x? — 8x + 52) (x? — 2x + 37) 


PO naf 
f SOMA e BAD. [3 
0 x? +2 


B43. f (x* + 9) cos(4x) 
0 


B41. xsinx 


dx 


x sin(3x) 


oo 
I ANO da Md pO 5. iie 
x + 18x? 4-130 ^^ h x -2x1426 ^ 


* (x — 4) sin(3x) © (x +9) cos(2x) 
B45. dx B46. M tmo 
E x2— 10x +89” I. x2 — 8x +65 


Obtain the Cauchy principal value of the integrals in Exercises B47—56 


7x —3 
B47. 
f.s 3-448567 
B48. f. 5x? — 9x — 1 sie 
(x? do (x2 — 8x + 97)x 
3 — 8x? 49x — 4 
B49. dx 
[z Ee +22 +10@—1) 
© 6x? —4x +4 
B30. | ae dx 
o; (x? — Ax + 5) (x? — 4) 
m 5x —8 
B51. ]: : dx 
s; (x? + 4x 4-53) (x — 6) 
oo 3x? — pg 
B52. J: z me. dx 
oo (x? — 6x dead 4x + 13)(x + 3) 
B53. f. 3 — 3x? + 5x43 
aA ee xi 16x + 145) @ 42) ^ 
B54. IN Ax? 4- 9x +5 
s; (x? + 16x + 89) (x? — 9) 
s 4x? + 7x 43 
BSS. ue mb ks dx 
oo (X? + 18x + 106)? (x? — 16) 
oo 3x? 4x — 9 
B36. | PT dx 
o; (x4 — 12x? + 85) (x? — 1) 
Obtain the Cauchy principal value of the integrals in Exercises B57—66 
as. | cs : dx 
— 16x DENT — 3) 
o x. 12 (3 2. Y. 
B58. [a m - 
0 — 4x? + 85)(x — 
eo x8/3 
B59 f dx 
+ 8x + 25)(x2 — 8x +7) 
oc x 
Boo. [| — j^ 
0 24 12x + 100) (x 
oo 1/4 (5 2 e um 
B61. [a Ss dx 
x4 — 12x? + 37) (x 3 
oo x 7/4 
B62 f — - dx 
0 — 12x a 12x + 27) 
Bos. [ 
n Ss LIA T (x —3) 
oo x6/5 2 _ 4; 3 
pos. | > Caes ia 
x^ — 18x? + 90) (x — 2) 
00 x 13/5 
Bos. | - dx 
x MIL x2 —2x +1) 
x 25x +6 
B66. [a m iy 
o (x n + 5)(x — 2) 
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The Laplace Transform 


The Laplace Transform Revisited 


The Laplace transform, F (s) = L[f(t)] = h f (He dt, an integral transform that maps 


a well-behaved function f(t) to F(s), its Laplace transform, was studied in Chapter 6. 
For example, if f(t) = t, the transform, an integration along the real line, is given by 


F(s) = Jo e di = i. In Chapter 6, the inversion of Laplace transforms was done with 
partial fractions, the four operational laws, and pattern-recognition. 


Bromwich Integral Formula 


The following theorem taken from [21] provides the Bromwich integral formula by means 


of which F (s), the Laplace transform of f (t), is "inverted" or mapped back to f(t). 


THEOREM 36.2 


1. 
2. 
3. 
— 


1. 


f (t) is of exponential order O(e^'). 
f' (t) is piecewise continuous over each interval 0 < t < T. 


c-aands-cdiy. 


Tt) — E T F (s)e*' ds, where this improper integral along the vertical line 
s = c + iy is interpreted as the Cauchy principal value lim;., 4 p F (s)e*! ds 
and is called the Bromwich integral formula. 
If f(t) is discontinuous at fo > 0, then the Bromwich integral converges to 
HF (to +0) + f(t — 0)]. 

f (40) 


At t = 0, the Bromwich integral converges to “> 


For t « 0, the Bromwich integral converges to 0. 
Also found in [21], the following alternate theorem places sufficient conditions 
on F(s) rather than on f(t). 


THEOREM 36.3 


| = o 


F(s) = O(s™*), k > 1, and is analytic for s = x + iy in the half-plane £ < x. 
F(x) is real when x > £. 

yzp 

t is real. 

x iid F (s)e' ds converges to a continuous function f(t) that is of expo- 


nential order O(e*') and vanishes for t < 0. 
Lf (t)] = F(s) 


EXAMPLE 36.11 


EXAMPLE 36.12 


cc ib 


c-ib 


FIGURE 36.5 Closed contour for 
evaluating the Bromwich integral by the 
Cauchy residue theorem 
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In practice, if F(s) is analytic to the right of x = £, then the Bromwich integral can 
be calculated along any vertical line x — c > f. 


We verify the inversion integral for the function f (t) = 1 for which the Laplace transform is 
F(s)= L, Since the only singularity of F (s) = 1 is ats = 0, choose c = 1 and parametrize 
C, the vertical line, as s = 1 + iy. The Bromwich contour integral, 


1 1 b e(itty)t : t> 0 
— | F(s)e'ds = lim / i —dy={>z t=0 (36.3) 
2zi Jc b—oo27zi Ja l-iy 0 1-0 


is evaluated with great difficulty using an antiderivative found, for example, by Maple 
(See Exercises A1—5.) Shortly, we will learn how to evaluate such integrals by the Cauchy 
residue theorem. $ 


We verify the Bromwich inversion integral for f(t) = t, for which the Laplace transform 
is F(s) — 4. Again, the only singularity of F(s) is s = 0, so we can use for the contour 
C, the same vertical line s = 1 + iy as we used in Example 36.11. Thus, we have 


1 l 1 b p(1+iy)t 

— | F(s)e'"ds = lim J As — dy = B Feu (36.4 
2zi Jc boo 27zi Jp (1 +iy)? 0 t«0 

where again the integral is evaluated with an antiderivative provided, for example, by Mapie 

(See Exercise B1.) Since f (2-0) = f(0) = 0, there was no need to examine the integral 

for the case t = 0. $ 


Evaluating the Bromwich Integral by the Cauchy residue theorem 


Examples 36.11 and 36.12, in which direct evaluation of the Bromwich integral could only 
be done by recourse to a computer algebra system, motivate the more productive strategy 
of closing the contour so that Cauchy's residue theorem can be used. 

Suppose the vertical line s = c + iy, |y| € b, became part of a closed path, a path 
for which the additional contribution to the Bromwich integral along the new part of the 
contour went to zero as b — oo. Then, by evaluating this closed contour integral, in the 
limit as b — oo, we'd simply be computing the value of the integral along the original 
vertical line. 

One such closure for the contour C is shown in Figure 36.5, where the curve is an are 
from a circle with radius R and center at the origin. As the radius R — oo, with c held 
fixed, we have to have b — oo also. So having R — ov is equivalent to having b > ox 
provided c remains fixed. 

If the value of the Bromwich integral along the curved arc tends to zero as R > œc 
then we can complete the contour as in Figure 36.5, and evaluate the integral as a closed 
contour integral via an appeal to residues. Any singularities of F(s) are to the left of the 
vertical line and, thus, 


c+ib 
f(t) = — lim f F(s)e* ds 


k k 
l ] S ^ "T. 
= 5,; Qn) ) jRes(e !F(s),5,) = Y Res(e" F(s), sn) 


n=l n-l 


where 5;,..., s, are the poles of F (s) in the half-plane R(s) < c. 
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To invert F(s) — L, note that s = 0 is a simple pole, and the only pole, of e F (s). The 


residue at s = 0 is 1, the value of the Bromwich integral when t > 0. $ 


EXAMPLE 36.14 


To invert F(s) — 5, note that s = 0 is a pole of order 2, and the only pole, for e” F (s). 


i$; 


The residue at s = O is t,the value of the Bromwich integral when t > 0. kd 

EXAMPLE 36.15  Toinvert F(s) — s note that there are simple poles at sı = ic and s2 = —iw. Hence, 
2 

fi Y Res(e" F(s), $4) = teo + sem = cos wt $ 


EXAMPLE 36.16 


nel 


To invert the Laplace transform F (s) = 1 tanh 55, the poles, s = 0 and the zeros of cosh 2$, 


must be determined as 0, +i, +37, +5i, .... Since Res(e* F (s), 0) = 0 and Res(e™ F (s), 
cni) = = (ri cosnt + sinnt), n = 1,3,5,..., we find 


2 
fO=- 


T 


4 
" 


oo 


P» 


oo oo . 
1. 4 sin(2k + 1)t 
= t= 

>. -sinnt = — b» XE 


1 
— [(—i cos nt + sinnt) + (i cosnt + sinnt)] 
n 


=1,3,5,... k=0 


This is just the Fourier series representation of the square wave f(t) = 1+2 5 ,(-1)" 


f 
H 
0 | t 
Aid 
FIGURE 36.6 The graph of f(t) in 
Example 36.16 


= IL» 
8 30.312 


[ON 


of f (t). 


EXERCISES 36.2-Part A 


H(t — n7), the odd periodic extension of g(t) = 1,0 < t < z, where H(t) is the Heaviside 
function. Indeed, the Fourier coefficients 


n even 


0 
2 T 
-z[ sinnt dt — 4 
m Jo — n odd 
nm 


are exactly the coefficients in the Fourier sine series for f (t). Figure 36.6 contains a graph 


9. 
hS 


Al. Show that f^, e**?'/(1-4- iy) dy =e f^ iisleos ry + 
ysinty + i(sinty — ycosty)] dy. 

A2. Without computing, reason to the conclusion that the imaginary 
part of the right-hand integral in Exercise A1 is zero. 


A3. If t > O implies that f^^. 592 dy = f^^ 29m» dy = 


oo 14-5? -œ 14y? 


zt (cosh t — sinh t), obtain the result for t > 0 in (36.3). 


EXERCISES 36.2—Part B 


A4. If t < 0 implies that /^^. 932 dy = — f^^. 2382 dy = 


—oo [iy —co TE? 


zt (cosh t + sinh 7), obtain the result for t < 0 in (36.3). 
A5. Obtain the result for t = 0 in (36.3). 


B1. Obtain the result in (36.4) as follows. First, integrate by parts 
once, taking u = e? in f udv = uv — f v du. Then use the 
results and techniques in Exercises A1—4. 


For each Laplace transform F (s) given in Exercises B2-11, obtain f (t) 
using the Bromwich inversion formula. Evaluate the relevant integrals 


using the Cauchy residue theorem. Where possible, verify the result by 
consulting a table of transforms or using a computer algebra system. 


s+3 


B2. F(s) = ee Db UN 
(s) s? -- 6s + 13 


G2) B3. F(s) = 
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B4. F(s) = —— Bs. F(s) = ILS. For the Laplace transforms given in Exercises B12-17: 
2 "m 3 
g^ o 9-346 (a) Obtain f(t) by using the Bromwich inversion integral and the 
B6. F(s) = Em ue Cauchy residue theorem, summing an infinite series of 
s — 
] residues. 
s+ — 8s? — 126s? + 568s + 41 
B7. F(s) = 6 : E x E T es (b) Expand F(s) in powers of e^?, and invert termwise to obtain 
on (s^ — 4s + 29) f(t). 
sj 
: -———— 1 1 
B8. F(s) (2 — 4y B12. F(s) = ————— BB. F(s) = ——— 
2 (5? — 13) s(1 + e) s(e% — 1) 
52 — 
A c. 2N B 1 l 
B9. F(s) (2 — 4s + 13) G? + 4s + 13) B14. F(s) = Nic; = B15. F(s) = , coth 2s 
s — e? (e-5(s — 4) + eS(s 4- 4)) l l 
B10. F(s) = 2(s? — 16) B16. F(s) = -sech2s B17. F(s) = —csch2s 
PA M = S S 


5? + 2a? 


B11. F(s) = ———_— 
‘s) s(s? + 4a?) 


Fourier Series and the Fourier Transform 


The Fourier Series 


TRIGONOMETRIC Form In Chapter 10 we saw the trigonometric form of the Fourier series. 
Recall that for a function f(t) defined on the interval [—L, L], the Fourier trig series is 


given by 
= t mt 
i) = - + dt cos 77 +b, sin 
where 
rE 
a= f(t)cos — dt n=0,1,2,... 
=f 
1 25 
b. — p f(t)sin —— dt n=1,2 
=E 


EXPONENTIAL Form Inthe applications, it is common to use the exponential form of the 
Fourier series. Thus, if f(t) is defined on the interval [—L, L], it has the representation 


oo 
fO= Y ad^ n0, 311,22,... 
n--—oo 


where 


D p ! 
e. m ar Í füye n". dt = 0, :51, EDS usus 
2L J-L 


In light of Euler’s formulas, namely, e*'* = cos x +i sin x, the trig and exponential forms 
of the Fourier series are ultimately identical, as we will shortly show. 


EXAMPLE 36.17 The exponential form of the Fourier series for 


l —] 
d ED 


IA IA 


I^ O<t 


EXAMPLE 36.18 
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valid on the interval [—1, 1], is Y. ,, c, e", where 
Í | f(t) dt 7 
Cn = => = — 
"Rl 12 


1-310" ,,(-D"-1 
iD, t- -— 


1 f! ; 
Cn = 2 f. fü dt — 


2n?z? n?n 


Applying Euler’s formulas to 5... c, e" gives 

oo 
] —39(-D^ 2 — 
p= 5 *Y (uec emm sd - CD sinn ) 


the Fourier trig series for f(t). d 


EQUIVALENCE OF Forms To show that the exponential form of the Fourier series is equiv- 
alent to the trig form write 


] f? -— 
n = — "(f —inzt dt 
c ^L f. f (te 


1 [ moa nzt di i r fos nmi iy l bn) 
pod Bo AT Sin —— al = Zan — llOn 
2L J L 2L J L ges 


Since n is both positive and negative, that is, n = +k, k > 0, write c, e" *!/L as the two 
terms 


" " 1 m 1 i 
epe "E + g pe EL par 5 e = ine oh 5 e m he o 


= Gk (pikat/L 4 eie) 4. -T — ev ikat/L) 
i 


krt nm krt 
= d COS —— sin —— 
UR CA 


where a_; = a; because the cosine is even and b- = —b; because the sine is odd. For the 
= cot il L _ a 
case n = 0 we have co = 5; J f(t)dt = 9. 


Fourier TRANSFORM In Section 30.2 the Fourier Integral Theorem f(x) = 
L SS, S e" f (Bye? dB da, used to solve boundary value problems on infinite and 
semi-infinite domains, was stated. In Section 30.3, this theorem was the basis for the defini- 
tion of the exponential form of the Fourier integral transform F (œ) = [S fine? dB 
and the inversion formula f (x) = + f^, F(@)e'** da. In Section 30.3, F (a) = ID the 
Fourier transform of the function f(x) = e~*!, was computed by direct integration and the 
inversion integral was evaluated, with some difficulty, by direct integration. Alternatively, 
since the inversion integral is computed along the real line (where « is a real variable), it 
is generally possible to “close the contour" and evaluate the integral by the Cauchy residue 
theorem, as per Section 36.1. 


By using the Cauchy residue theorem, we can invert F (a) = im the Fourier transform 
of f (x) = e. Now the Cauchy residue theorem states that 


k 
| f(z) dz = 27i )  Res(f (2), zn) 
C 


n-l 
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EXAMPLE 36.19 


so the Fourier inversion integral becomes 


o k k 
] f” ; 2xi T" ox 
fe) gc] Fee" da= x E» Res(F(a)e"*, a) =i Y strane", o) 
(36.5; 
There are two simple poles of F (o), one in the upper half-plane at œ = i and one in the 
lower half-plane at a = —i. 


As in Figure 36.1(a), let C; be the positively oriented closed contour consisting of the 
real axis and Cr, the upper half of the circle |a| = Re/?. As in Figure 36.1(b), let Cz be 
the positively oriented closed contour consisting of the real axis and C,, the lower half oi 
the same circle. On C}, the positive orientation means a counterclockwise traverse of the 
semicircle and a passage from left to right along the real line. However, on C2, the positive 
orientation (and consequent counterclockwise passage around the contour) means the real 
axis is traversed from right to left, against the natural direction of integration. This will 
induce a minus sign in the contour integral along C2. 

On either contour, the Cauchy residue theorem applies if we can show the contribu- 
tion of the integral along the semicircles goes to zero as R — ov. In particular, along 
a = Re? we have |e'**| = |e/* "| = e*® Sin? The decay of this magnitude for large 
R requires x sin > 0. When x > 0, this condition is satisfied when 0 < 6 < z because 
then, sin > 0. When x < 0, this condition is satisfied when m < 6 < 27 because then, 
sin@ < 0. Thus, when x > 0, use contour Cı, which contains the one simple pole of F (œ) 
ato = i. When x < 0, use contour —C2, which contains the one simple pole of F (œ) at 
& = —i. (The minus sign on contour Cz appears because on it, the integration along the 
real axis is from right to left.) Therefore, the residues at each pole are 


rı = Res(F(a)e/,i) = —ie^* and ro = Res(F(o)e/*, —i) = ie 


When x > 0, the inversion integral is 7 times the residue r;; and when x < 0, the inversion 
integral is i times —r2. Hence, the value of the inversion integral is e* when x < 0 and 
e * when x > 0. When x = 0, the integral on the left in (36.5) is 1, as we see in Exercise 
A]. Hence, the inversion integral, computed by the Cauchy residue theorem, reconstructs 
fæj= eml. 

The contour integration technique used in this example requires the contribution to the 


integral along either semicircle to go to zero as R — oo. Since |F(o)| < |i x 


Me lap" 
we can use the discussion in Section 36.1 to conclude that the contributions from C; or C, 
tend to zero. In this example, m = x > 0 in the upper half-plane but m = x < 0 in the 
lower half-plane. On C», the positive orientation forces integration along the real axis to be 


from right to left, so the value of the contour integral is —2zri times the residue at a = —i. 
D 


The Fourier transform of 


"TEN ES X. o. ea 
f@)= bs x29 te Ho) (36.6) 
where H(x) is the Heaviside function, is F (œ) = Ty and has a pole of order 2 ata — i. 
Since |F (œ)| = laus = p the Fourier inversion integral can be evaluated by the 


Cauchy residue theorem according to the equation 
I E ia 2ri jax > : iox + 
f(x)2-— F(aje'™ da = ——Res(F(a)e' , i) = iRes(F(a)e'™, i) 
2x 27 
— 2 


On the contour C, from Example 36.18, the integration is counterclockwise, encloses 
the pole at æ = i, and has the residue rı = Res(F(a)e'™, i) = —ixe~*. The contour C; 
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from Example 36.18 encloses no poles of F (o), so the sum of residues inside C» is zero. 
Thus, if x < 0 so that contour C» is used, f(x) = 0. If x > 0 so that contour C is used, 
f(x) = xe^*. Hence, we have (36.6). 


EXERCISES 36.3-Part A 


i$. 
kd 


A1. Show that when x = 0, the Fourier inversion integral in (36.5) 
evaluates to 1 in Example 36.18. 


A2. Obtain the trigonometric form of the Fourier series for f(x) = |x], 


A4. Show the series in Exercises A2 and 3 are actually the same. 


AS. Use the Cauchy residue theorem to evaluate the Fourier inversion 


integral for F(a) = 


1 


2+ia* 
—-l<x<l. 
A3. Obtain the exponential form of the Fourier series for the function 
in Exercise A2. 

EXERCISES 36.3—Part B 
For the function f (x) specified in each of Exercises BI-10, obtain the B13. F(@) = : B14. F(a) = | 
exponential form of the Fourier series and show that it is equivalent to (b + ta)? (b — ia? 
the trigonometric form. Compare a graph of a partial sum of the " _ ge a 
exponential form with a graph of the function itself. Bs, Fu 1 +g? RE. Mia} (b2 + a2? 

B1. Exercise B19, Section 10.1 B2. Exercise B20, Section 10.1 (b? — a?) - 

B3. Exercise B21, Section 10.1 B4. Exercise B22, Section 10.1 B17. F(a) = (b? +a?) B18. F(a) =e 

B5. Exercise B23, Section 10.1 B6. Exercise B24, Section 10.1 B19. F(a) = wel B20. F(a) = e ba? 

B7. Exercise B25, Section 10.1 — B8. Exercise B26, Section 10.1 2 sin ba 

. . . ] B21. F(a) = ae“ B22. F(a) = 

B9. Exercise B27, Section 10.1 B10. Exercise B28, Section 10.1 
In Exercises B11—25, use the Cauchy residue theorem to evaluate the B23. F(a) = = — sin = B24. F(a) = 1 md 
inversion integral for each of the following Fourier transforms. Where a(b? — a^) e 
the parameter b appears, impose the restriction b > 0. B25. F(a) = 4 

i 1 +a* 
1 
B11. F(a) = - B12. F(a) = : 
bh J- ia b—ia 
The Root Locus 
Introduction 


In the study and design of feedback control systems, engineers make use of the root-locus 
diagram, which shows the variation of eigenvalues as a function of a system parameter. The 
eigenvalues are actually found as poles of an appropriate transfer function, a function of the 
complex variable s arising from the Laplace transform of the differential equations of the 
system. For each value of the system parameter, the poles are plotted in the complex plane. 
The resulting locus of points in the complex plane is called the root locus. 

This section will give some mathematical insight into the construction of a root-locus 
diagram. We begin with a study of the "locus of roots" and reserve the phrase "root locus" 
specifically for the case pertinent to controls engineering. (For a more complete engineering 


perspective, see [70] or [31].) 
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EXAMPLE 36.20 


FIGURE 36.7 Example 36.20: The 
eigenvalues as a function of the parameter 
c (solid curve is à+, dotted curve is A_) 


Im 


c=-2 


FIGURE 36.8 Example 36.20: In the 
complex plane, the locus of roots 
determined by A. (curve in black is A, 
while curve in color is A...) 


EXAMPLE 36.21 


À 
A 
15+ Ne 
10+ 
A OT CAS 
-> —— e 
-10 7 5 10 15 20 
=o 
^ -104 


FIGURE 36.9 Example 36.21: The 
eigenvalues as a function of the parameter 
c (solid curve is à+, dotted curve is A_) 


In Chapter 12, the mixing-tank problem led to x' — Ax, the first-order linear system of 
ordinary differential equations with constant coefficients. The solution is given by e^'xo, 
where xo = x(0) and e^ is the fundamental matrix. The eigenvalues of A determine stability 
of the equilibrium point at the origin. 

Suppose the matrix A contains the parameter c, making the system performance de- 
pendent on the value of c. For example, the eigenvalues à+ of the matrix A given in (36.7) 
are graphed as functions of c in Figure 36.7 


8 1 
a=; (|>= itv (36.7) 


The solid curve is A+, the dotted, A_. Forc < — 3, the eigenvalues are complex with positive 


real part, so the equilibrium point at the origin is unstable. For -i <c< 4, there are two 


positive real eigenvalues, the origin is a node (out) and is again unstable. For c > t, one 
eigenvalue is positive and the other is negative, so the origin is a saddle, again unstable. 

We have just seen that when c causes both eigenvalues to fall into the left half of the 
complex plane, the origin is an asymptotically stable equilibrium point but that when c 
causes at least one eigenvalue to fall into the right half of the complex plane, the origin 
is an unstable equilibrium point. A plot of the eigenvalues as points in the complex plane 
is an important tool in the design of feedback control systems that also can be modeled 
with systems of linear differential equations. In the complex s-plane, the curve traced by 
the eigenvalues as they vary with an appropriate parameter of the system is called a root 
locus. Figure 36.8 shows, for this example, the locus of roots as c varies in the interval 
[—2. 4]. (Our parameter c is not one that would be found in a typical problem in controls 
engineering.) 

The initial and terminal points on each locus are indicated on the graph. The curve 
in black is the locus of A, whereas the curve in color is the locus of A_. When c = —2, 
both eigenvalues are complex. In fact, they are complex conjugates. As c increases toward 
eS —3, the two eigenvalues approach the real axis. For -i <c< $, the eigenvalues 
remain along the positive real axis. For c > $ à+ remains on the positive real axis, but A_ 


is now found on the negative real axis. $ 


Figure 36.9 contains a graph of à+, the eigenvalues of the matrix A given in 


c —5 1 l 
— L=- 2 BE A z 
A E | > Ax c+t2+ 5 Vc 8c — 44 (36.8) 


2 


The solid curves are branches of A,, the dotted, of A_. There are definitely values of 
c for which the eigenvalues are of opposite sign. There are also values of c for which 
the eigenvalues are complex. It is not yet clear if there are values of c for which both 
eigenvalues remain positive. Thus, we compute lim,_,..A_ = 4 to determine if, for large c, 
the eigenvalue 4... remains positive. Hence, for c large enough, both eigenvalues are positive. 
From c? — 8c — 44, the discriminant of the characteristic polynomial 


A? — (c 4- 4) 4- 4c 4-15 


we find c = 4 + 24/15 as the values for transition between real and complex eigenvalues. 

Figure 36.10 shows the locus of roots for —5 < c < 15. For c in the range —5 < c < 
4 — 24/15, X. (in black) is along the positive real axis but A_ (in color) is along the negative 
real axis. For c in the range 4 — 2/15 < c < 4 2/15, the eigenvalues are complex 
conjugates. The locus of roots consists of the upper and lower halves of a circle with radius 


x’ =x+2y 
y 2 —Kx t 4y -3f(t) 


sX — X -rF2Y 
sY =-KX+4Y+3F 


X =GıY 
Y = -K GX + G3F 


TABLE 36.2 Example of a linear 
feedback system 


FIGURE 36.11 Block diagram for the 
linear feedback system whose equations 
appear in Table 36.2 
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Im 


FIGURE 36.10 Example 36.21: In the complex 
plane, the locus of roots determined by à+ (curve 
in black is 4, while curve in color is A_) 


4 and center at (4, 0). For c > 4 4-24 15, both eigenvalues are on the positive real axis. We 
have already seen that A_ tends toward the point (4, 0). The locus of roots indicates that as 
c — oco, the eigenvalue à, also tends to infinity along the positive real axis. e 


Transfer Functions and Block Diagrams 
Recall that for a differential equation of the form y" + 2y’ + 10y = f(t), with the inert 
initial conditions y(0) = y'(0) = 0, the Laplace transform leads to 
F(s) 
82 4-2s +10 


The function f(t) is an “input” to the system, providing the system with a driving force or 
excitation function. The solution y(t) is the system “output,” so the function 


s?2Y +2sY+10Y =F and Y(s)= 


PO) = ae 10 

is the transfer function for the differential equation. Since Hd — T, the transfer function 
is characterized as the ratio of Laplace transforms of the system output over the system 
input. (See Section 6.11 for a determination of the transfer function by means of the Dirac 
delta function.) Written as Y (s) = T (s) F(s), the transfer function T (s) determines how 
the action of the input, f (t), will be transferred into the output, y(t). 

The engineering approach to feedback control systems is couched in the language of 
transfer functions and block diagrams. To illustrate this approach, consider the first-order 
linear system on the left in Table 36.2 The system parameter K is often called a gain in the 
controls literature. The Laplace transform of each equation, in concert with the inert initial 
conditions x (0) = y(0) = 0, leads to the equations in the center of Table 36.2. Solving the 
first of these equations for X and the second for Y gives the equations on the right in Table 


36.2, where 


are transfer functions. 

This form of the differential equations is modeled by the block diagram in Figure 36.11. 
The circle is a junction node, the squares are "blocks" representing the transfer functions, 
and the secret to reading the diagram is to realize that F and X represent a system input 
and output, respectively. The loop containing the blocks representing G, and Gz is the 
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FIGURE 36.12 Root locus for Example 
36.22 


Im 0--—— 


Re 


FIGURE 36.13 Root locus for Example 
36.23 


EXAMPLE 36.22 


EXAMPLE 36.23 


feedback loop. The surprise is that inhomogeneous first-order systems arising from mixing- 
tank problems and studied in Chapter 12 can be interpreted as feedback systems. Hence 
feedback is inherently found in the coupling of the differential equations and not necessarily 
in an array of sensors and amplifiers. 

Finally, solve for X (s) and Y (s) in terms of the transfer functions, obtaining 


G3G\F G3F 
= ——— and Y= — 
1+ KG,G2 1+ KGG: 
The transfer function connecting the input f(t) to the output x(t) is then 
G3G| = 
T(s) = i 


DG GS IT K-— lea 


The poles of T (s) are values of s for which the denominator of T (s) vanishes. The equation 
whose roots are the poles of T (s) is 
2K (s — 1)(s —4) 4-2K 


021-2 KGj,G5 —1 = 
+ eee tt-—D-4) (s— D (s — 4) 


The numerator of the fraction on the right leads to the equation 
s°—5s+4+2K =0 


which is the characteristic equation for the system matrix A given on the left in 


s AE 9 K 36.9 


The denominator of T (s) therefore vanishes for s = A+, the eigenvalues of A, which are 
given on the right in (36.9). The poles of T (s) are precisely the eigenvalues of A. Thus, the 
stability of the system is determined by the location of the poles of the transfer function 
because these poles are the eigenvalues of the system matrix. 


Suppose the denominator of a transfer function for a feedback system is 1 + kh(s), where 
h(s) — E . Figure 36.12 shows the root locus, drawn by solving the equation 1+ EHD =0 
fora number of values of k and graphing, in the complex plane, the resulting solution points. 
The values of k corresponding to the four oe d the locus can be determined by solving 


1 +kh(s) = 0 fors = s+ (k) = —lk + 1/2 — 4k. (See Exercises A1—5.) 
Another approach to studying the na of the charaeteriste roots on the gain k 
is to solve the equation 1 + S=} us +D = 0 fork = "Mad = rather than s = s(K). But in 


the complex plane, s is the complex variable s = x + iy, ^g 


k = k(x + iy) = 


. 2 3 ? ? 2 2 2 
x nU x pe Ce v (x + j*--2x 
(x e EU a +x y ; y x +y cm (36.10) 
l+x+iy x242x +1+ y? x?42x +1+ y? 


The equation Z(k) = 0 implicitly defines a curve y = y(x), which, in this example, is 


e. 


(x +1)? + y? = 1, the equation of a circle. E 


For h(s) — ul , the root locus, that is, the curve s = s(k) defined implicitly by the 
PPS 1+ Eh (s) = 0, is seen in Figure 36.13. The characteristic equation is the cubic 

3 + ks +k = 0, for which an exact, but tedious, solution exists. The root locus in Figure 
36.13 was drawn numerically, by plotting as discrete points and for various values of k, 
solutions of the characteristic equation. (See Exercises A6 and 7.) $ 
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A]. In Example 36.22, solve the equation 1 + kh(s) = 0 for s4 (k). 


A2. In Example 36.22, show that lim, 4, s_(k) = —oo, thereby 
tracing, in Figure 36.12, the solid black line segment to the left. 

A3. In Example 36.22, show that lim... s, (k) = —1, thereby tracing, 
in Figure 36.12, the dotted black line segment toward the right, 
inside the circle. 

A4. In Example 36.22, show that the upper half of the circle, the solid 
portion in color, is traced by s (k), 0 € k < 4. 


AS. In Example 36.22, show that the lower half of the circle, the dotted 
portion in color, is traced by s4 (k), 0 € k < 4. 


EXERCISES 36.4- Part B 


A6. In Example 36.23, the equation s? + ks + k = 0 has three 
branches, as shown in Figure 36.13. Obtain numerical evidence 
that the branch drawn in color is traced between s — 0 and s — —1 
as k varies from 0 to infinity. 

AT. Obtain numerical evidence that in Figure 36.13, the two branches 
drawn in black (both solid and dotted curves) are traced as k varies 
from 0 to infinity. Provide evidence that these branches are 
asymptotic to the vertical line s = i. 


B1. In (36.10), Z(k) = 0 and R(k) = k determine x = x(k) and 
y = y(k). For example, Z(k) = 0 can be solved for y = y(x), 
and that substituted into R(k) = k to obtain x = x(k), from 
which y = y(x) = y(x(k)) = y(k). Use this strategy to obtain the 
locus of roots for the equation s? + k(1 +s) =0. 


For the matrices A in Exercises B2—9: 


(a) Obtain the eigenvalues à+ as a function of the parameter c. 

(b) Plot the eigenvalues as functions of c. 

(c) From the graph in part (b), analyze the stability of the linear 
system x' — Ax. 

(d) Plot, in the complex s-plane, the locus of roots determined by 
the eigenvalues à+. 


4 -6 12 6 
ns. [* 36] wo. [2 4 
In each of Exercises B10-19, given the rational functions G;(s),k = 


1/2), 3: 


G3G| 


(a) Form the transfer function T (s) = KGI 


(b) Find all poles of T (s). 


(c) Plot a root-locus diagram. 


(d) Based on the root locus, analyze the stability of the control 
system associated with T (s). 


l j l 
B10. G, = ,G,— , G3 = L—— 
6s +6 8s +1 8s +1 
1 5 I 
B11. G; = G2 = , G3 = —— 
8s —5 4s +9 4s +9 
1 s+9 1 
B12. G; = Cas „G= 
I m9—8 — 2s2+9s—8' ^ 2s249s—8 
1 5 1 
B13. G; = —— a = = 73 = 3 
5s+1 3s? +45 3s? + 4s 
1 6s —5 1 
B14. G; = be ro &= = 
s+3 8s2 —5 8s? —5 
| 4s +6 1 
WIS. Gps tig -— — 
4s — 8 8s? -- 7s +9 8s? -- 7s 4-9 
4s -1 l 3 
HIE e im Fm 
6s? +s 4-6 6s 4-7 6s +7 
BI7.G, = 4s — 6 G = 1 p 5 
UU Ost ig — 8 CU TCC 
1 s? +45 +5 
B18. G, = = : 
1 9s 42 E 953 — 652 +95 — 2 
Gs um 
37 953 — 652 +95 — 2 
B19. G, = 1 G = 2s? — 5s +6 
UM Sed | 88757 SER 
G; = 


8s? + 7s? — 8s +8 


The Nyquist Stability Criterion 


The Winding Number 


The circle z = e/?^, 0 < @ < 2x, encircles, or wraps around the origin, once. The closed 
contour described by z — e? 0 « 0 < Az, is a circle traced twice and, therefore, encircles 
or wraps around the origin twice. In general, if C is a closed contour, the number of times 
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EXAMPLE 36.24 


EXAMPLE 36.25 


FIGURE 36.14 The limaçon of Example 
36.25 


EXAMPLE 36.26 


C wraps around the point z = ¢ is called the winding number of C with respect to ¢ and is 
given by 


1 dz 
v(C,£) — — (36.11) 
21i Jc z— € 
The integral in (36.11) reflects such a geometric property of the contour C because the 
antiderivative is a branch of the logarithm. The integral in (36.11) actually measures the 
change in the argument of the logarithm. If C wraps around ¢ once, the argument of the 
logarithm will increase (or decrease) by 277. Hence, the number of times C wraps around c 
is reflected by the change in the argument of the logarithm generated by the antiderivative 


for (36.11). 


Let C be the circle z(t) = e, 0 < t < 2m, and take ¢ = 0. The winding number is then 


v(C,0) — xz ^ i dt = 1 since C encloses z = 0 once. This would be the result for any 
4 1+i 


other z inside C. For example, the winding number about z = ^ is 


(c x) 1 [ ie" dt i 
v 3 = - = = 
2 2zi Jo elf — (1 +i) 


The integral defining the winding number is easily computed by Cauchy’s residue theorem, 
since we have 


1 . l 
WE, g) = 2; Bes (= c) el 


mi 


whenever C is a simple closed curve enclosing ¢ just once. «t 


Let C be the limaçon defined in polar coordinates (r, t) by r (t) = 1 + 3cos t, a distinguish- 
ing feature of which is the way it loops over itself, as seen in Figure 36.14. We write C as 
z(t) = r(t)e", and compute the winding number about z = 1, a point inside the “inner” 
loop, as 


=2 


1 2x i(1 3 it it dt 
wena | i(1 + 3e")e 
0 


zi (1--3cost)e!! — 1 
indicating that the limaçon wraps twice around z = 1. The winding number about ¢ = 3, 
a point inside the limaçon but not inside the inner loop is 
1 [ i(1 + 3e/*)et dt 

o (143cost)eé! —3 — 


v(C, 3) = 5 1 


2zi 


:$. 
he d 


indicating that the limaçon wraps around z = 1 but a single time. 


Let C be the closed contour in Figure 36.15, consisting of four semicircles taken from the 
circles 


z(t) =14+3e" z(t)=24+2e 2(t)=lte”  z4(t)= 2e" 


Inside C there are points that are enclosed twice by the contour. The winding number about 
z= lis 


1 9 ™ ie! dt 0 7 ie" dt 
C,1) 2 — i dt - i dt - =2 
"e. L) z;|/ «f 2-22 i «f i] 


indicating that the contour C wraps around z — 1 twice. The point z — 3 is inside C but 


- 


FIGURE 36.15 The closed contour of 
Example 36.26 


EXAMPLE 36.27 
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not inside the “inner” loop. Thus, the winding number about z = 3 is 


C,3- 1 [ Bie" dt | "ied, 9 ied | ™ Jie! dt - 
Wm iil bao d Al jauU3 js Beas 


indicating that the contour C wraps around z — 3 but once. 


9$. 


The following is called "the principle of the argument." 


The Principle of the Argument 


D is a simply connected domain. 
G (z) is analytic in D, except, perhaps for a finite number of poles. 
C is a simple closed positively-oriented contour in D. 


G (z) has neither poles nor zeros on C. 


SY xg y 


G (z) has N zeros and P poles inside C with N reflecting the multiplicity of each zero 
and P reflecting the order of each pole. 


Q4 [295 — 
2zi c G(z) T 


A proof of this result can be found in [69], or in any similar text. The following example 
contains the key ideas from which the proof is typically constructed. 


The points zı = 2 + 3i, z2 = 4 — i, z3 = —5 + 2i are a zero and two simple poles, respec- 
- ` 1 = z—2—3i 
tively, for the function G = (4445-21) * Then 

G' z2—A4z — 6iz + 13 — 14i 


G &€-2-3)-44i) 45-2) 
has simple poles at all three points that lie within C, the circle |z| — 7. The Cauchy residue 
theorem then gives 


3 
1 G'(z) 2mi ~ G' 
i;2—— V Re[-lu)-ü-1-02N-P--2--1 
- ae" ani L s(S J ! — 


thereby verifying the principle of the argument in this case. E 


The following combines the constructs of the winding number and the principle of the 
argument. 


The Principle of the Argument—Extended 


The positively oriented, simple closed contour C is described by z = f (t), & < t < p. 
H (z) is analytic on C; inside C, H (z) may have a finite number of poles. 

H(z) Æ ¢o on C. 

I, in the plane of ¢ = u +iv, is the image of C under H; that is, I is given by ¢ = F(t) 
=H(f(t)),a<t<B. 

5. Inside C, the function H(z) — £o has N zeros and P poles, counted with respect to 
multiplicity and order. 


Beppe 


6. v(T, o) is the winding number of I about the point Zo. 
=> vT, fo) =N -P 
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FIGURE 36.16 The closed contours C 
and T of Example 36.28 


EXAMPLE 36.28 


EXAMPLE 36.29 


EXAMPLE 36.30 


In essence, this principle says that N — P for the function H (z) inside C is the winding 
number for I’, the image of C under the mapping induced by H(z). To find out something 
about the number of poles and zeros H(z) has inside C, obtain the winding number for 
T, the image of C under the mapping of w = H(z). If the winding number of F can be 
obtained geometrically, without resort to integration, then the principle gives a geometric 
tool for counting poles and zeros of H (z). 

If H (z) is a polynomial, it has no poles in the finite complex plane. Furthermore, if the 
winding number v(T', Z9) were known, then this extension of the principle of the argument 
yields N, the number of zeros H(z) — £o has inside C. 

The proof of this principle is straightforward. Starting with the definition of the winding 
number, we have 


(T. 63 1 | dt 1 [f F'(t) dt 
v ; = — 
w= Fri Ip t—% Ini dy F-ü 


Si H'( Ff (0) dt m 
a H(ft)-i  2ri Jc H(z) - i 


and the last integral is just N — P, a result that follows by setting G(z) = H(z) — £o in the 
principle of the argument. 


axi 


Let C be the contour consisting of the right half of the circle |z| = R and that part of the 
imaginary axis satisfying —i R < z < iR. This is the D-shaped curve shown on the left in 
Figure 36.16. If H(z) = z — 3, the equation H(z) = 0 has one solution, z = 3, in the right 
half-plane. Thus, H(z) has one zero and no poles in the right half-plane. The image of C 
under the map H (z) is the contour I, shown on the right in Figure 36.16. Both C and F are 
traced in the counterclockwise (positive) sense. The contour I encircles the origin once, 
so the winding number with respect to ¢ = 0 is v(T, 0) = 1. Hence, H(z) has exactly one 
zero in the right half-plane. We verify this by computing 


1 H'(z) dz 1 '(z) dz Zz s 
vT, 0) = = (z)d _ TE - =| d 24 PA 
2zni Jc H(z) čo  2zi Jc H(z) 2zi Jc 


N 
| 
U 


Let C be the contour defined in Example 36.28, and let H(z) = (z — 2)(z — 3), a function 
with two zeros, z — 2 and z — 3, both in the right half-plane. The image of C under the 
mapping induced by H(z) is T, as shown in Figure 36.17. The contour F encircles Zo = 0 
twice, so the winding number is v(T', 0) = 2 and the function H(z) — £y = H(z) has two 
zeros in the right half-plane. Since 


H'(z) az —35 I " I 

HE) @-2)@-3) 2-2 2-3 
the winding number is v(T, 0) = Zi [Res( T, 2) + Res( 7, 3)] = 2. * 
With C again as in Example 36.28, let H(z) = bz +z? + 9z + 4, a function with the 


three zeros —0.468, —4.77 + 7.93i, all in the left half-plane. There are no zeros in the right 
half-plane. Consequently, I", the image of C under the mapping induced by H(z), should 
not encircle zo = 0. Figure 36.18 shows T when R = 12. Careful observation shows the 
large loop (solid curve) is traced in the counterclockwise sense, whereas the small loop 
(dotted curve) is traced in the clockwise sense. Thus, there is no net encirclement of zy = 0 
by T and the winding number is correctly determined to be v(T, 0) = 0. e 


FIGURE 36.17 Example 36.29: Under 
H = (z —2)(z — 3), the image of the 
contour C in Figure 36.16 


FIGURE 36.18 Example 36.30: Under 
H= ae +z? -- 9z +4, the image I of the 
contour C in Figure 36.16 (solid portion of 
T is traced counterclockwise, whereas the 
dotted portion is traced clockwise) 
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The Nyquist Stability Criterion 


In 1932, Harry Nyquist (1889—1976), an engineer at Bell Telephone Laboratories, articulated 
the use of the extended principle of the argument for determining where the poles of a 
transfer function in a linear feedback system are located. This usage has since been called 
the Nyquist stability criterion. 

The transfer function of a feedback system (see Section 36.4) arises from a Laplace 
transform of the system. The poles of the transfer function are actually the eigenvalues or 
characteristic roots of the differential equation governing the system. If any of these poles 
(or eigenvalues) have positive real part, that is, if any pole is located in the right half-plane, 
the solution may contain exponential terms that grow without bound as time increases. Thus, 
determining whether or not there are poles of the transfer function in the right half-plane is 
tantamount to determining the stability of the feedback system. 

If the transfer function of the feedback system is a completely reduced rational function 
of the form T (z) = ne the poles of T (z) are the zeros of B(z). Determining the location 
of the zeros of B(z) is equivalent to determining the poles of T(z); and the poles of T (z) 
are the eigenvalues, or characteristic roots, of the system. The solution of the differential 
equation underlying the feedback system will contain multiples of exponential terms whose 
exponents contain the eigenvalues. If any ofthe eigenvalues have positive real parts (because 
they fall in the right half-plane), the solution might grow unbounded as time increases. Thus, 
poles of T (z) falling in the right half-plane means the feedback system could be unstable. 

Engineering texts on feedback control (e.g., [70] and [31]) contain additional detail on 
the use of the Nyquist stability criterion. In addition, we even find complex variables texts 
such as [99] discussing the notion of feedback systems and the Nyquist stability criterion. 


A1. Let C be a square of side 2, centered at the origin. Compute the A3. Evaluate xd ë ue dz, thereby verifying the principle of the 
winding number v(C, 0) = 1. argument for the contour C and function G (z) in Exercise A2. 

A2. Let C be the circle z = 2e", 0 < t < 2m; and let G(z) = +. A4. The polynomial G(z) = (z — 1) (z — 2) has exactly two zeros and 
Determine N — P, where N and P are, respectively, the number of no poles in the right half-plane. Verify N — 2 using the principle 


zeros and poles G(z) has inside C. 


EXERCISES 36.5—Part B 


of the argument. 
AS. Repeat Exercise A4 for G(z) = (z — 1) (z — 2)’. 


B1. Let C be the circle z = 3 + 3e, 0 < t < 27, and G(z) be the For the rational functions G (z) in Exercises B2-11: 


polynomial in Exercise A5. The principle of the argument gives 


(a) Determine its zeros. 


v(C, 0) 2 3 = N. The extended principle of the argument gives 


v(C, 0) — xz ^ co dz = v(T, 0), where T is the image of C (b) Determine its poles. 
under G(z). Obtain a graph of I. Does it wrap around ¢) = 0 (c) Evaluate (even numerically) the contour integral 


three times? 


= fe € 'O dz, where C is the “D-shaped” path 


2zi G(z) 
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consisting of zı (f) — it, —R < t < R, and z;(t) = Re", 
—- <t < 5. traversed in a counterclockwise sense with R 
large enough so that C encloses all zeros and poles in the 
right half-plane. 


(d) Show that v — N — P, where N is the number of zeros of 


G (z) inside C and P is the number of poles of G (z) inside C. 


(e) Sketch T, the image of C under the mapping G(z). Does I 
wrap N times around £y = 0? 


For the polynomials G (s) in each of Exercises B12-21: 


(a) Interpret G(s) as the denominator of a transfer function T (5) 
and determine the poles of T (s) by finding the zeros of G(s) 


(b) Use the Principle of the Argument to verify the number of 
poles of T (s) in the right half-plane. Thus, evaluate (even 
numerically) the contour integral v = z} f. £€ dz, where 


G(z) 
C is the “D-shaped” path consisting of zı (t) = it, 
—R < t < R, and z(t) = Re", —€ «t < £, traversed ina 


z? 4+3z-4 72 —4z4+1 counterclockwise sense with R large enough so that C 
Hee Gig 6z? — 8z? —11z — 12 B3: CRIES 4z? — 1 encloses all zeros and poles in the right half-plane. 
B4. G(z) = 11z? — 12z — 10 BS. G(z) = 22 —5 (c) Sketch I, the image of C under the mapping induced by G (z) 
OU 34322472 —1 COT UU 1223 +722 —9z +3 Does I wrap the appropriate number of times around Zo = 0° 
73 72 Zz 9 js] 
B6. Giz) = — TA UI 3c -2 - B12. G(s) 275? —5—1 B13. G(s) = 35? — 4s +6 
n - < " x H "i B14. G(s) 2105? -s +3 B15. G(s) = 25? — 11s? +7s +9 
B7. G@) = —— ——— — . G(s) = 105? — 3s? + 2s 
e 9z4 — 42? + 6z? — 12z +3 B16. Gils) tis : TarH 
" i 573 4. 372-4. T9 B17. G(s) = 9s° — 2s- — 12s +6 
»G@)= 6z4 + 523 — 82 + 5z —3 B18. G(s) = 5? + s* — 5s — 3 
62 —122 — 5z — 1 B19. G(s) = 7s* + 6s? + As? + 10s +4 
B9. Gi) — : : 0 s) S i i s+ 
3z* — 62? — Tz? + 4z — 10 B20. G(s) = 5s* + 75? — 9s? + 125 + 8 
Bi RD hp 3 
Hi BR. 4e Pam B21. G(s) = 105* + 7s? — 3s — 4 
7Tz^ + 11z3 — 2z? — 2 
228 +27 —4z+5 
B11. G(z) = T t 


7z* + 6z? + 42? + 10z +4 
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Conformal Mapping 


Complex Functions as Mappings 


The complex function w = f(z) defines a mapping of the z-plane to the w-plane. A point 
z = x + İy in the z-plane is mapped by f(z) to the point w = u(x, y) + iv(x, y) in the 
w-plane. We have already seen how, for example, f(z) — e* maps a horizontal strip of 
width 2z onto the whole w-plane except for w = 0. In particular, we are interested in how 
a complex function treats the angle between two intersecting curves. 


The curves sı(t) = e” and s(t) = 1+ e!',0 < t < 2x, intersect twice, since they 
are the intersecting circles shown in Figure 36.19. The uppermost point of intersection is 
P=5s\(3)= ; + i /3), found by equating real and imaginary parts of sı (t1) and s(t). 
At P, vectors tangent to s; (f) and s» (t) are v; = 1(—4/31 +j) and v; = —L (Bi + j and 
the angle between them is 0 = 4. ' | 

Now consider the mapping defined by w = f(z) = z? = u +iv = x? — y?  2xyi. 
Figure 36.20 shows, in the w-plane, the images of the circles s; (t) and s2(t). The image 
of Pis P = ic1 + i v3), and vectors tangent to the images at P’ in the w-plane are 


vi = —(v3i + j) and v, = —2j. The angle between v| and vj is again 7, as is seen in 


Figure 36.20. The angle between curves intersecting in the z-plane is the same as the angle 
between the images under the map induced by w = f(z) = z?. e 


" 


MI 


-1 


FIGURE 36.19 
Example 36.31 


Intersecting circles in 


FIGURE 36.20 


Image, under f(z) = z, 
of the circles in Figure 36.19 


EXAMPLE 36.32 


EXAMPLE 36.33 
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DEFINITION 36.1 


The mapping of the z-plane to the w-plane defined by the function w = f(z) is said 
to be conformal at zo if the angle between any two curves intersecting at zo is the 
same as the angle between the w-plane images of the two curves. A mapping that is 
conformal at every point in a domain is said to be conformal in that domain. 


THEOREM 36.4, THE CONFORMAL MAPPING THEOREM 


An analytic function f(z) is conformal at every point zo for which f'(zo) Æ 0. 


Proor A constructive proof along the lines of Example 36.31 is straightforward. In the 
z-plane, let the two curves 


z() =x1(t) + iyi() and Z(t) = x2(t) + iy2(t) 
intersect at zo = Z1 (t1) = Z2(t2). At zo, construct tangent vectors 
vi =x,i+ yj and v = xi + yj 
respectively, so that the angle 0 = arccos( TENTER j) is measured between them. The images of 
the curves under w = f(z) are w1 (t) = f (zi(t)) and w2(t) = f (z2(t)), and at wo = f (zo) 
vectors tangent to the images are V; = f'(zo)vi and V2 = f'(zo)vo, "omg by the 
chain rule. Provided f'(zo) Æ 0, the angle between V, and V» is then arccos( n me MIVD = 


f'Yvwv \ 
arccos( iori iiD = O 


A Dictionary of Conformal Maps 


It is typical in complex variables texts to build intuition about conformal maps by studying 
a short “Dictionary of Conformal Maps." The following collection of examples is given in 
that spirit. (There is an actual “dictionary” of conformal maps [50] in print!) 


The function w = f(z) = z?, studied in Section 35.2, is analytic and has a nonvanishing 
derivative at every point except z = 0. The mapping of the z-plane to the w-plane induced by 
this function is conformal at every point except z — 0. The accompanying Maple worksheet 
contains several animations showing the images, in the w-plane, of regions in the z-plane 
being mapped dynamically by this function. e 


The mapping defined by the function f(z) = i =u+iv= z Py z ic is called an 
inversion because it maps the interior of the unit circle to the exterior of the ‘circle and the 
exterior of the unit circle to the interior, as suggested by Figure 36.21. 

In addition, Table 36.3 summarizes the effect of f(z) on circles and lines in the z-plane. 
Lines through the origin and circles not through the origin map to “the same things,” that 
is, to the same geometric object with the same property. Lines not through the origin and 
circles through the origin map to “double opposites,” that is, to the other geometric object 
with the other property. Alternatively, arbitrary lines map to objects through the origin and 
arbitrary circles map to objects not through the origin. 
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z-plane 
n D 
n o > n 


(a) 


(b) 


FIGURE 36.21 Example 36.33: The 
inversion effected by f(z) = } 


u 


Q 


FIGURE 36.22 Example 36.33: Image, 
in the w-plane, of the grid lines in the 
z-plane 


Line Circle 
Through origin Line through origin Line not through origin 
Not through origin Circle through origin Circle not through origin 


TABLE 36.3 Example 36.33: Effect of the mapping f(z) = 1 on lines and circles 


Lines through Origin Lines through the origin in the z-plane map to lines through 
the origin in the w-plane, as can be seen by obtaining the equations of the inverse mapping 
from the w-plane to the z-plane. Solve the equations u = u(x, y), v = v(x, y) for x = 
x(u, v), y = y(u, v), obtaining x = ES y= Dh so that the line y = mx becomes 
v mu 


=z = py» Or v = —mu in the w-plane. 


Lines not through Origin Lines not through the origin in the z-plane map to circles 
through the origin in the w-plane, as can be seen by writing the equation of a line not 
through the origin as ax + by +c = 0, where c Æ 0. The equation of this line's image in 
the w-plane is then y — wes +c = 0, from which au — bv + cv? + cu? = 0 follows. 
Division by c, valid since c 4 0, gives ^u — by +v? +u? = 0, which we recognize as the 
equation of a circle through the origin in the w-plane. 


Circles through Origin A circle through the origin in the z-plane maps to a line not 
through the origin in the w-plane, as can be seen by writing the equation of a circle through 
the origin of the z-plane as x? + ax + y? + by = 0, provided that a and b are not both zero. 
The equation of the w-plane image is then 


u? P au ái v? bv — 
(w2+v2)2 ` u?+u? o (S asp 
which leads to —bv + 1 + au = 0, recognized as the equation of a line not through the 
origin in the w-plane. 


Circles not through Origin Circles not through the origin in the z-plane map to 
circles not through the origin in the w-plane, as can be seen by writing the equation of a 
circle not through the origin as x? + y? -- ax + by +c = 0, where c 4 0. The equation for 
the image in the w-plane is then 


2 2 
u^ v^ au bv 


+ +> ;tc-0 
(u?--v2)? (u24-v2)? u2+v2 u24-v? 


from which follows cv? — bv + au + 1 + cu? = 0, the equation of a circle not through the 
origin in the w-plane. In fact, dividing by c 4 0 and completing the square gives 


( AE b guum 0 
u + — v = 
2c 2c 4c? 
Evaluating at (u, v) — (0, 0) in the left-hand side gives i Æ 0, so the image circle does not 
go through the origin in the w-plane. 


Grid Lines Grid lines not through the origin in the z-plane will map to circles through 


the origin in the w-plane, as shown in Figure 36.22. Arcs crossing the u-axis are images of 
lines x — constant, while arcs crossing the v-axis are images of lines y — constant. Only 


EXAMPLE 36.34 


B r, 


u 


FIGURE 36.23 
Example 36.34 


Mapping of a crescent in 


FIGURE 36.24 A crescent mapped by 
f(z) = 4 in Example 36.34 


FIGURE 36.25 Under f(z) = “+, the 
image of the crescent in Figure 36.24 
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those parts of the circles are drawn in the w-plane that correspond to the line segments used 
in the z-plane. The images cross at right angles in conformity with the conformal property 
of the map. (See Exercises A5 and 6.) e 


The inversion f(z) = i in Example 36.33 is a special case of the linear fractional trans- 
formation (also called the Moebius or bilinear transformation), defined by f(z) — ait? 
where ad —bc 4 0. The condition on the coefficients a, b, c, d prevents f (z) from reducing 
to a constant because it prevents the numerator from being proportional to the denominator. 


bc 


Indeed, if ad — bc = 0, then, for example, a = 7 and f(z) = p. The inverse of the mapping 

w = f(z)isz = — zi , again a linear fractional transformation (LFT). With respect to 

lines and circles, the LFT behaves much like the inversion of Example 36.33, except that 
d 


the origin is replaced by the pole, z = $. 


€ 


Upper Half-Plane to the Upper Half-Plane If a, b, c, d are real and ad — bc > 0, 


the LFT f(z) = ac) maps the upper half of the z-plane to the upper half of the w-plane. 


Indeed, if y > 0, then 


y (ad — bc) 
eed wey 


I(w)-—I(fG-ciy)- 
which, in light of the assumptions on y and ad — bc, is positive. 


Upper Half-Plane to Interior of Circle If Z(zo) > 0, that is, if zo is in the upper 
half of the z-plane and o is real, then the LFT w = f(z) = pe maps the upper 
half of the z-plane to the interior of the circle |w| = p. Indeed, the real axis is a line not 
through the pole z = Zo, so it maps to a circle through the pole because a calculation shows 
|w| = |f(x)| = p. Since z = zo will map to w = 0, the upper half-plane maps to the 
interior of the circle |w| = p. 


Interior of Circle to Interior of Circle If « is real, and |zo| < p, then the LFT 


w= fz) = pei 
KOK: — 
maps the interior of the circle |z| = p to the interior of the circle |w| = p. Indeed, a cal- 
culation shows |w| = | f (pe/^)| = p. 


Crescent to Angle The LFT w = f(z) = pe'* i where p is positive, o is real, 


and z,,k = 1,2, are the points of intersection of two circles, maps the crescent-shaped 
region between the circles C, k = 1, 2, to the wedge-shaped region between the two rays 
Ly, k = 1, 2, shown in Figure 36.23. Circle C; maps to line Lz, with P, the angle between 
the intersecting arcs, being preserved in the w-plane. 

As an example take f(z) — E so that zı = —1 and z2 = i are the intersections of 
the circles x? + y? = 1 and (x + 1? + (y — 1)? = 1 shown in Figure 36.24. At zı = —1, 
the angle between C, and C» is P. The images of the circles C, and C; are shown in Figure 


36.25. Since 


TIED _ I(fü—1te)) _ 

R(f (e")) R(f G — 1-4 en) 
the images are the lines v = u and v = —u, respectively. Clearly, the angle between Lı 
and L is 5. 4e 
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EXERCISES 36.6—Part A 


Al. Let s; and vz, k = 1, 2, be as in Example 36.31. If f(z) = z^, 
obtain v;, k = 1, 2, and show the angle between these vectors is 
still £. 

3 


A2. Find the image of the line y = x under the mapping f(z) = i, 


A3. Verify that under the mapping f(z) = 1, the image of the line 
x+y+1=Ois the circle u? +u + v? — v = 0. 


EXERCISES 36.6—Part B 


A4. Verify that under the mapping f(z) = ^. the image of the circle 
z—1-4e',0 <t < 2r, is the vertical line u = "n 

AS. Verify that under the mapping f(z) = 1, the image of the line 
x = c is the circle (u — iy +0 = zr. 

A6. Verify that under the mapping f(z) = i the image of the line 


y = c is the circle u? + (v + +} = t. 


— aztb, — AÇ+B " aJ T T IS 
Bl. Let ¢ = 7 and w = $5 be two bilinear maps with the 
composition w(¢(z)) = 4€. Show that 
E d = lé d * ji the product of two matrices of 
coefficients. 
B2. Find the (acute) angle of intersection of the curves y, = x? and 
1 
yj zi 


E 


In Exercises B3-12, let yz, k = 1, 2, be the curves given in Exercise B2. 


For the given function f(z), 


(a) obtain Y; and Y>, the images of y, and y; under the mappin 
w = f(z). 
(b) obtain the angle of intersection of Y; and Y2, showing it is 


the same as the angle between y, and y», as computed in 
Exercise B2. 


2z 4-3 
B3. f(z@)=z B4. fz)=e BS f(9- — i 
B6. f(z) = TT. B7. f(z) —sinz B8. f(z) =cosz 


B9. f(z —tanz B10. f(z) = sinhz 
B11. f(z) 2coshz B12. f(z)—tanhz 


B13. Given the linear fractional transformation w — Ll, where 
w =u +iv, 


(a) find all fixed points, that is, all points for which w(z) = z. 


(b) show that the line y = 0 maps to the line v = 0. 


(c) show that the points satisfying |z + 2| < 1 map to the region 


determined by u 2. 


(d) show that the region y < 2(x + 1) maps to the region 
v x 2(1 — u). 


(e) show that the region x < 0 maps to the region |w| > 1. 


(f) show that the region |z — 1| < 1 maps to the region 
|w + il x 2, 


2z+1 


B14. Given the linear fractional transformation w = are where 


w =u +iv, 


(a) find all fixed points, that is, all points for which w(z) = z. 


(b) show that the region |z| < 1 maps to the region v < 3 — 2u. 


(c) show that the region y > x — 1 maps to the region v > 3u — 6. 


(d) show that the region |z| < 2 maps to the region 


|w — 1(84- | = 25. 


(e) show that the region y < x maps to the region 
lw- 3(1 4D] > Ji. 
B15. Given the linear fractional transformation w = =], where 
w-u-civ, 
(a) find all fixed points, that is, all points for which w(z) — z. 
(b) show that the region y > 0 maps to the region v > 0. 


(c) show that the region x < 0 maps to the region |w — 


| 
Nin 


(d) show that the region |z| < 4 maps to the region u < 
(e) show that the region x > —2 maps to the region |w| < 1. 
(f) show that the line x = —4 maps to the line u = 1. 
B16. Given the linear fractional transformation w — 4c, where 
w =u +1, 
(a) find all fixed points, that is, all points for which w(z) = z. 
(b) show that the region |z| < 2 maps to the region |w| < 2. 
(c) show that the half-plane x < 4 maps to the half-plane u < 4. 
(d) show that the half-plane x > 0 maps to the region 
jw = $123 


5* 


A linear fractional transformation taking z to wg, k = 1,2,3, can be 
found by writing f(z) — ant? using substitution to form three equations 
in the four unknown parameters a, b, c, d, and solving. Should any of 
the z or wy, be oo, the point at infinity, use a finite point such as r, taking 
the limit as r — oo after solving the resulting equations. In Exercises 
B17—21, find the linear fractional transformation taking the given zę to 


the given wz. 
B17.2; 22,2; — 1, z3 = 0 —> w = 1, w = 3, w; = —5 
B18. z; =i, z2 = 3, z3 = 525 w; = 0, w 


B19. z; = 5, z2 = —1, z3 = 1 > w; = 2, w = —1, w3 = 4 


B20. z; = œ, z2 = 1 +i, z3 = 2 — 3i > w, = 0, w, = i, w; = 1 — i 
1 


, Z2 = ©, Z3 = 0— wi = œ, w = 3 + 4i, w = i 
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B22. Find a linear fractional transformation that maps the region B24. Show that the linear fractional transformation w — £i maps the 
|z| € 1 to the region R(w) > 0, the right half-plane. Hint: A region A = {|z| > 1N |z — a> - 3} to the region 
linear fractional transformation will map a circle through the pole B= {i< < |w| < 1}. The region A is the complement of the 
to a line. Let z = 1 be the pole, and let the points z = —1 andi interior of two circles, and the region B is an annulus centered at 
map to w = 0 and i, respectively. w=0. 

B23. Find a linear fractional transformation that maps the region B25. If w = f(z) = 2Vz + 1 + Log( VeI-1) where w =u + iv, 


m 
(a) show that f(z) takes the upper half-plane y > 0 to the region 
(0xvzxm,uc0)U(u20,v2» 0) 


T(z) < 0, the lower half-plane, to the region |w — 3| < 2. Hint: 
First, find some LFT that maps the line y = 0 to the circle 

|w| = 2. For example, let z = 0, oo, —1 map to w = 2i, —2, —2i, 
respectively, thereby determining the LFT. Then, translate in the (b) find z,, k =1,..., where f(z) = wg, and w; = —5, 
w-plane. w = —5 + Ti, w; = Ti, w4 = 10i, ws = 5. 


The Joukowski Map 
The Forward Map 


The Joukowski map 


z-plane w = f(z) =z - 


is of special interest in the application of complex variables to plane fluid flows. The real | 
and imaginary parts of f(z) = u + iv are 


++t+++++++ 
*RGROROROR GR AG A 
*okR RR GR GR GR 


x ) 
ux, y.) m m +S and v(x, y) = y- —— 
uid x24-y? UO £e py? 


Peteeeeeeet 


= 
gm ae T oa a, HA respectively. The w-plane image of z — e'?. the unit circle in the z-plane, is w = 2 cos 8. 
0000000 00000000 As 0 varies through any range of 277, w varies between —2 and 2. Hence, the unit circle in 
° o : : o T T T: : o T T the z-plane maps to the segment —2 < u < 2 in the w-plane. The unit circle in the z-plane 
2800000 THE becomes a slit in the w-plane. Figure 36.26 shows what the map does to the rest of the 
2000000 00000 


z-plane. 

The interior of the unit circle in the z-plane maps onto the w-plane. The upper half of 
the unit disk maps onto the lower half of the w-plane, while the lower half of the unit disk 
w-plane maps onto the upper half of the w-plane. In addition, the upper half of the z-plane exterior 
to the unit circle maps onto the upper half of the w-plane, and the lower half of the z-plane 
exterior to the unit circle maps onto the lower half of the w-plane. Thus, the Joukowski map 
is not one-to-one, and the inverse mapping is multivalued. 


The Joukowski Airfoil 


(a) 


ORGROR GR BR Gk x ae 
OROGROROR BR GB BR GR v 
++++++++++ 
++444++++++ 


Zn 55e Bo wed The Joukowski map takes circles that contain z — 1 in their interiors and pass through 
oo - 

000 OIo/6 69 og 0-010 z — —], to "airfoils" in P w-plane. Pigwa 36.27 shows, on the left, the circle through 
ooo oooooooooo 

ode B16 18 Bro 1810836 z = —1, with center (1, 1) and radius 22. On the right in Figure 36.27 is the image of 
ooo 0000000000 5*5 

pond ios d1oioi0í070 this circle under the Joukowski mp A HN general version of the Joukowski airfoil is 


generated by the map f(z) = z+ es where k > 0. In this case, circles passing through 

(b) z = —k and containing z = k in their interiors are mapped to Joukowski airfoils. If the 
FIGURE 36.26 The effect of the circle passes through z = k and contains z = —k in its interior, the airfoil will face in the 
Joukowski map applied to the z-plane opposite direction. 
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w+2 


-2 0 


N 


FIGURE 36.29 Geometric basis for the 
square root used to define the inverse of the 
Joukowski map 


y 
A g applied to |» —2| 2 1 
14 
bd 
A 0 x 
3 
edt 
>x (a) 
-2 -TI 2 
M 
^ A g applied to lw- 2| 2 5 
(a) 
v 
A 


(b) (b) 


FIGURE 36.27 The Joukowski airfoil FIGURE 36.28 Under g(w), inverse 
generated when the Joukowski map is image of |w — 2| = 1 in (a) and 
applied to the circle z = ia +i)+ |w — 2| = 5 in (b), when the principal 
Je] square root is used. Discontinuity is not 


restricted to —2 < u < 2, v = 0. 


The Inverse Map 


The inverse of the Joukowski map is obtained by solving the equation w = f(z) = z+ i for 
z. Since this map is two-to-one, we obtain z — j(w + yw? — 4) and define the inverse by 


g(w) = iw + Vw? — 4) 


with the square root defined so that its discontinuity is along the line segment —2 < u < 2, 
v = 0, where w = u + iv. The principal square root does not satisfy this constraint, as 
shown in Figure 36.28 where, under z = g(w), the inverse images of the circles |w —2| = 1 
and |w — 2| = 5 can be seen. The image of the smaller circle (which cuts through the seg- 
ment —2 < u < 2, v = 0) is on the left and is continuous. The image of the larger circle 
(which does not pass between u = +2, v = 0) is on the right and is discontinuous! 

The appropriate definition of the square root is 


; /2 ^ TOP] c(1)4-2 
w—4- |w? —4 PIE 2)+Arg(w+2)] 


where Arg w is the principal argument, so that —z < Arg w < x. Figure 36.29, witha = 
Arg(w + 2) and B = Arg(w — 2), interprets this definition geometrically. Finally, Figure 
36.30 shows in the z-plane, the pre-image of the w-plane under this branch of the inverse 
Joukowski map. It is consistent with our findings for the (forward) Joukowski map, w = 
f@=z+t. 
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FIGURE 36.30 


EXERCISES 36.7 


In the z-plane, the pre-image of 
the w-plane under the inverse of the Joukowski map 


In Exercises 1-18, f(x) =z + 4. 


1. 


Un 


. Let w = f(z) 


Show that C}, the circle zı (f) = —2 + 2i/5 + 6e”, =m < t < 7, 
passes through z, = 2 and contains z = —2 in its interior. 


Kb = 4 


. Since C, passes through z, = 2, it intersects C», the circle 


z3(0) = 2e"? , —m < 0 < x, at least once. Find za, the second point 
where C, and C; intersect. 


. Find those values of t, and t, (not 0) for which the two circles C; 


and C; intersect at za and z,, respectively. 


. Show that for t, < t < tp, the corresponding arc on C; lies 


inside C5. 


z + * define a Joukowski map, where w = u + iv. 
Show that f(z) takes circle C; to the Joukowski airfoil J. 


6. Show that B = f(z») is the cusp on the Joukowski airfoil J. 


7. Show that A = f (za) is the intersection of J with u-axis in the 
w-plane. 
. Show that f(z) maps the arc in Exercise 4 to that portion of J lying 


12. 


. For f (z) as defined in Exercise 5, show that z 


. Define g} (w) = i(w +y |w? — 


between A and B. 


i(wzc Jw? — 16). 


16|ei/2IArsQo—4-rArg(w-]) and show 


that it is discontinuous across the branch cut —4 < u < 4, v =0. 


. Show that g,(w) maps the w-plane back to that part of the z-plane 


defined by {|z| > 2} U {|z| = 2, v > 0}, which is therefore outside 
the circle C? except for the portion of the circumference lying in the 
upper half-plane. 


Let J’ be that portion of the Joukowski airfoil J complimentary to 
the arc BA. Show that g, (w) maps J’ to that portion of circle C; 


13. 


14. 


15. 


16. 
17. 


18. 


19. 


that is exterior to circle C2. For example, show that g- ( f (zi(1))) 
for t in [t,, zt] U [—, ta] is the appropriate portion of C}. 

Define g- (w) = $(w — y |w? — 16|e//2l^reto-9-ArgQi-9]) and 
show that g_(w) maps arc AB on the airfoil J to that portion of 
circle C; lying inside C2. For example, show that g.. ( f (z1 (t))) for t 
in [t,, tp] is the appropriate portion of C}. 


Let c, k = 1, 2, denote the upper and lower intersections of circle 
C; with the imaginary axis in the z-plane. Find the points 

wy = f (tx), k = 1,2, on the airfoil J. For k = 1,2, find tz, the 
values of t for which zı (tk) = c£. 


Let £5 denote the leftmost intersection of circle C, with the real axis 
in the z-plane. Find the point ws = f (Z3) on the airfoil J. Find 15, 
the value of t for which z: (t3) = £3. 


For k = 1,2, 3, use g4 (w), as appropriate, to map w; back to 7. 


Find w4 and ws, the upper and lower points, respectively, where the 
airfoil J intersects the imaginary axis in the w-plane. Find we, the 
leftmost intersection of J with the real axis in the w-plane. 


For k = 4,5, 6, use g+ (w), as appropriate, to determine ¢;, the 
pre-image of wz. 

Repeat Exercises 1-18 for C4, the circle given by 

zi (t) = —1 4- 3i + 5e", —m <t < zt, and for C», the circle given 
by z2(0) = 3e?^, —z < 0 < x. Make all appropriate changes, 


taking, for example, z; = 3 and f(z) =z 2. 


5(0, y) 2 b 


FIGURE 36.31 
36.35 
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EXAMPLE 36.35 


X 
ax, 0) =a 


The BVP of Example 


Solving the Dirichlet Problem by Conformal Mapping 


Introduction 


The Dirichlet problem on an irregular planar region in the z-plane can be solved by mapping 
the region conformally to a “nicer” region in the w-plane where the transformed Dirichlet 
problem can be more easily solved. Suppose the mapping is given by w = f(z) = u(x, y) + 
iv(x, y), and suppose that the solution found in the w-plane is the harmonic function 
ó (u, v). Then, w(x, y) = (u(x, y), v(x, y)) is harmonic and, thus, solves the Dirichlet 
probiem in the z-plane. Indeed, by direct calculation, we find 


9 5 
Vx = Quis + QuU xx T QU; F [UMS 25 26,,u, Ux 


Wy = Pun + dyUyy + Puy + hyVyy + 20, uv, ele) 
so that | | 
Vow = uV U + by V?v + bun (uà + u?) + Puy (v2 + v?) + buy (us vy + uy vy) 
= (v? + v?) V?9 (36.13) 


? n . i . . 
where V?°u = V?v = 0 because the real and Imaginary parts of an analytic function are 
harmonic, ur -— ur = v? -— v2, and u,v; + uv, = 0 by the Cauchy-Riemann equations. 
Since ¢ is harmonic, V7 = 0. 


We will solve the Dirichlet problem consisting of Laplace's equation on the first quadrant 
and the boundary conditions s(x, 0) — a and s(0, y) = b, where a and b are constants. 
Figure 36.31 summarizes the problem. 


SOLUTION BY FOURIER SINE TRANSFORM Taken with respect to x, the Fourier sine trans- 
form (see Section 30.7) converts s,, (x, Y) + sy, Gr, y) = 0, Laplace's equation, to 
[à j 
ey —s(0, y) — °S (a, y) + S, (d, y) 20 
= Y; 


Applying the boundary condition s(0, y) = b gives 


E 2 
o | —b — a*S(a, y) + Sy, (o, y) 20 
= y) 


This, along with S(a, 0) = E the transform of s(x, 0) = a, and the condition that P (y) 


T 


remain bounded as y — oo, is solved as an ordinary differential equation in S(a, y) = 


P(y), yielding 
T 52 : 
S(a, y) = —/ — (b + (a — b)e *) 
az 


2 x 2 ] 
s(x, y) = b + — (a — b) arctan Zn a — —(a — b) arctan 2 (36.14) 
T y T X 


with inverse 


The second form of the solution arises from the first by an application of the trig identity 
arctan + = > — arctan u. 


SOLUTION By INsPECTION The real and imaginary parts of the analytic function f(z) = 
u(x, y) + iv(x, y) are each harmonic functions. The imaginary part of the analytic func- 
tion f(z) = Logz is v = Argz = arctan ~. Since v(x, 0) = 0 and v(0, y) = 5. we can 


s(0O, y)=b 


FIGURE 36.32 
36.36 


EXAMPLE 36.36 


s(x, 0) =a 1 


The BVP of Example 
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immediately write the solution to the given Dirichlet problem as 2(b — a) arctan 7. + a, 
which is equivalent to the solution in (36.14). 


SOLUTION By CONFORMAL Mappinc The following solution, obtained by mapping the 
first quadrant to the upper half-plane, is more complicated than the solution obtained by in- 
spection. However, it illustrates the key points in solving the Dirichlet problem by conformal 
mapping, so it is a fitting introduction to the ensuing examples. 

The mapping w = f(z) = z? conformally maps the first quadrant to the upper half- 
plane. The positive x-axis maps to the positive x-axis, whereas the "positive part" of the 
imaginary axis maps to the "negative part" of the real axis. Along the horizontal axis, the 
boundary condition s(x, 0) = a is imposed. Along the vertical axis, the condition s(0, y) = 
b is imposed. Along the positive portion of the u-axis, the boundary condition o (u, 0) = a 
is imposed on the transformed harmonic function o (u, v). On the negative portion of the 
u-axis, the condition o (0, v) = b is imposed. 

By inspection, o (u, v) = i(b — a)Arg v +a, so 
2xy 


1 1 
s(x, y) = —(b — a)Argz? +a — a + —(b — a) arctan — 5 
T T KA = ys 


Getting this solution to match that in (36.14) is a stiff exercise in trigonometric transforma- 
tions. The difference of the solutions, 1 (a — b)(arctan = — 2arctan*), should vanish. 
The relevant factor is of the form A — 2B, where f 


2xy 2xy 
> =>tanA = — 
y? x? 


A = arctan 


y y 
; and B = arctan = > tan B = — 
j“ x x 


gt — 

Replacing tan A and tan B with their equivalents in the numerator of 

tan A tan? B + 2 tan B — tan A 
tan? B — 2tan A tan B — 1 


and simplifying yield zero. d 


tan(A —2B) = (36.15) 


If the region R is that quarter of the unit disk lying in the first quadrant, we next solve the 
Dirichlet problem summarized by Figure 36.32 wherein a, b, c are constants. 

The conformal map A = g(z) = z? will transform the quarter-disk to the half-disk, and 
the subsequent conformal map ¢ = h(A) = (1) will take the half-disk to the upper half- 
plane. Alternatively, the composition 


142 2 
w= f= hec) = ( = ) 


maps the quarter-disk to the upper half-plane, directly. In either event, the solution in the 
upper half of the ¢-plane is then found by inspection. 

Since the boundaries of the quarter-disk map to the u-axis and the boundary values are 
constants, the solution of the transformed Dirichlet problem is available by inspection. As 
in Example 36.35, write 


a 


=g p- 
Arg w + ats (Arg(w — 1) — Arg w) 
T - 


W(w) =c + 


The solution in the z-plane is then 


5 


j a—b 14z " b—c 2z ^ 
W(w(z) = WAR) 2 TG) -cet — Are ( ) ace (5 z) 


1 = z2 


(36.16) 


EXAMPLE 36.37 


Ü To X 


FIGURE 36.33 Level curves (in black) 
and flow lines (in color) for the solution of 
the Dirichlet problem of Example 36.36 


EXAMPLE 36.38 
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Write z = re", 0 < t < 2, and seta = 100, b = —50, c = 25 to obtain 


25 
H (r, t) = —(6arctan(o, a2) — 3 arctan (œ1, ra3) Tz) 
T 


where 
a= 4r*(1— r*sin2t a=1-— Ar^ +r +2rfcos4t a3 = 4(r* —1) cos? t — 8r? 


and arctan(o, B) is the two-argument arctangent function. Figure 36.33 contains a graph of 
the level curves of H (r, t) (in black), and the flow lines (in color), solutions of R'(p) = 
—VH, with R = x(p)i + y(p)j. * 


We will find the steady-state temperatures between two concentric circles if on the inner 
circle of radius r; the temperature is held constant at $; and if on the outer circle of radius 
ry the temperature is held constant at ġo. 


SOLUTION BY SEPARATION OF VARIABLES In Section 29.1, we used the technique of 
separation of variables to solve the Dirichlet problem on the disk. In that solution, we 
worked in polar coordinates and allowed the boundary data to vary with the angle 6. The 
data in our present problem is independent of 6, so the solution will consist of just the 
(constant) eigensolution corresponding to the eigenvalue à = 0. All other eigenfunctions 
contain 0 and cannot appear in the solution to the present problem. 

Substitute (r, 0) = R(r) into Laplace's equation in polar coordinates to obtain the 
ordinary differential equation R" 4- IR = 0, the solution of which is R(r) = a + blnr. 
After applying the boundary conditions, we then have 


®(r) =o + (do — $i) (Inr — Inri) 


(36.17) 
In ry — Inri 


SOLUTION BY CONFORMAL MaPrrNG The function 
w = logz = ln |z| + iArgz + 2kzi 


which we write as w = u + iv so that u = In|z| and v = Arg z + 2kz, maps the annulus 
to the infinite vertical strip Inr; < u < In rọ, —oo < v < co. Indeed, since the inner circle 
is given by z = r;e’? and the outer circle by z = roe’’, with —z < 6 < x, we have for the 
images of these circles, the vertical lines In r; + i(0 + 2kz) and In ry +i(6 + 2kz). 

Now H = c + du is a function that varies linearly from ¢; to $ as u varies from In r; 
to In ro, where solving the equations c + d Inr; = $i, c + d Inr, = ġo for c and d lead to 
(36.17) if we set u — Inr. ^ 


We will find the steady-state temperatures exterior to the two circles |z| = 1 and |z — 2| = 3 
if the boundary of the first circle is maintained at a temperature of Øo and the boundary of 


the second at ¢;. The region exterior to the two circles is pictured in Figure 36.34. 


The linear fractional transformation w = f(z) = ES maps the region exterior to 
the two circles to an annulus centered at the origin. Computation shows | f (e?)| = 1 and 


[fo + 5e'^)| ES i so the smaller circle becomes the outer boundary of the annulus and 
the larger circle becomes the inner boundary. 

The solution to the Dirichlet problem on the annulus was found in Example 36.37. 
Hence, we write W(w) = $; + (do — ¢i) In(5|w|)/In 5, so 


(bo — 6) In (5 | Z3 |) 


(z) = d$ 
wet In 5 


(36.18) 
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is the solution to the original Dirichlet problem. In terms of x and y, we have 


P(x, y) = Po + 


If $; = 100 and ġo 


Oi (x, y) = 25 


$0 ~ Fi 5, ( ES Ra ) (36.19) 


21n5 9x?—6x + 1+ 9y? 


25, the solution becomes 


75 ( tr +549" ) 
n 9 
21n5 9x?—6x + 14- 9y? 


Figure 36.35 shows the isotherms in black and the flow lines in color for the solution ®,. 


i$. 
hS 


cer 


FIGURE 36.34 The region for 
Example 36.38 is exterior to both these 


circles 


EXERCISES 36.8—Part A 


FIGURE 36.35 Isotherms (in black) and 
flow lines (in color) for Example 36.38 


Al. Verify the calculations in (36.12) and (36.13). 
A2. Verify the trig formula in (36.15). 
A3. Verify the calculations in (36.16). 
A4. Show that (36.19) is a consequence of (36.18). 


EXERCISES 36.8—Part B 


AS. If z = x + iy, show that u(x, y) =a + £-* Arg z is the solution of 


the Dirichlet problem for the sector 0 < Argz < 0 < zt, where 
u =a along Argz = 0 and u = f along Argz = 0. 


B1. Ifz = x + iy: 


(a) Show that u(x, y) = œ + Et Arg(z — xo) is the solution of 
the Dirichlet problem for the upper half-plane, where 
. [04 X > Xo 
u(x, 0) = f aud, 
(b) Show that Arg(z — xo) — arctan(y, x — xo). 


(c) Leta = 3, B = —2, and xo = 1. Obtain a graph of the 
solution surface for the resulting solution u(x, y). 


(d) Obtain the level curves (equipotentials or isotherms) for the 
solution in part (c). 


(e) Obtain the flow lines for the solution in part (c). 
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B2. 


B3. 


B4. 


B5. 
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Ifz=x+iy: 


(a) Show that u(x, y) = a@ + “== Arg(z — xo) 
+ 22-7 Arg(z — Xi) is the solution of the Dirichlet problem 
Qo X» Xo 
for the upper half-plane, where u(x, 0) = {œ} xi« x < xo. 
Qo ağ 


(b) Let æo = 5,0; = —3, a) = 1, xo = 4, xy = —1, and obtain a 
graph of the solution surface for the resulting solution u(x, y). 


(c) Obtain the level curves (equipotentials or isotherms) for the 
solution in part (b). 

(d) Obtain the flow lines for the solution in part (b). 

(e) Generalize to u(x, y) = o + i Y. +1 — Œk )Arg(z — xy). 


If z = x + iy, solve the Dirichlet problem on the first quadrant, 


ay 0O<x< Xo 


with u(0, y) = o» and u(x, 0) = . Thus: 


Qo xX > Xo 


(a) Use w = z? to map the first quadrant to the upper half of the 
w-plane, and apply the results of Exercise B2. 

(b) Let t9 = —1, a; = 2, o» = 1, and obtain the level curves of 
the resulting solution V(x, y). 


(c) Let ay = 3,0, = l1, and obtain the level curves of 


the resulting solution V(x, y). 
(d) Let o = 2, o; = 0, a = 1, and obtain the level curves of the 
resulting solution V (x, y). 


2, 05 = 


Let R be the lens-shaped region bounded by the circular arcs 
al) =ite®, —* «s <0, and (t) 2 14 e, € « t « zr, 
which intersect at zi = 0 and z; = 1 +i. On R, solve the 
Dirichlet problem for V (x, y) if Y (¢1) = a, and V(Z;) = a; on 
the boundary of R. 


(a) Sketch the region R, and verify the intersection points. 


(b) If w = u + iv, find a linear fractional transformation of the 
form w = f(z) = e? —- that maps R to the first quadrant, 
with the arc £; (s) mapping to the nonnegative u-axis and the 
arc c»(f) mapping to the nonnegative v-axis. (See Section 
36.6.) 


(c) Use Exercise A5 to obtain y(u, v), the solution to the 
transformed Dirichlet problem. 

(d) Obtain W(x, y). 

(e) If o; = 1 and œ = 0, obtain the level curves of the resulting 
solution V (x, y). 

e EMIT -— is = "S 

"pes a —% «s <0 with ¢ as in Exercise B4 

(a) Use Exercise B3 to solve the Dirichlet problem on the region 
R from Exercise B4. 

(b) If, in addition, a, = 2, a; = 3, 9; = — 1, obtain the level 
curves of the resulting solution V (x, y). 


(c) Superimpose on the level curves found in part (b), the flow 
lines of the solution V (x, y). 


B6. Repeat Exercise B5 for 
( = a E Cag = -1 5-2 sz 
V (£i) e -Ž <s <0 (4| ,@ = 2, Q2 
B7. Repeat Exercise B5 for 
E cei 
W(o)) = a asi ó. a, =0,a. =5,a, = —3 
a -<s <0 
B8. Repeat Exercise B5 for 
"MEE D Li 
= a S = 3. = —2, = 1 
V (£1) ^ -£ peü a1 a» 0» 
Let the circle C; = {|z — a| = r} lie completely inside the circle C; = 
{Iz — A| = R}, where, obviously, R > r. If zı and z» satisfy the equa- 
tions z2 = ns + A and z; = = + a, then the linear fractional trans- 


formation w = f(z) = = maps Q, the region between C, and C3, 
to an annulus centered at w = 0. The points zı and zz are on a line that 
simultaneously passes through both A and a, and f(z) maps z; tow = 0 
and z2 to w = oo. If zı is outside C;, then C; will become the inner 
boundary of the annulus, else it will become the outer boundary. For the 


set of parameters in each of Exercises B9-13: 


(a) Sketch C, and C;. 


(b) Determine z;, z2 and the LFT f(z) that maps the region Q to 
an annulus, the image of C; becoming its outer boundary. 


(c) Find R’ = | f (Ci)| , the outer radius of the annulus. 
(d) Find r' = | f (C5)] , the inner radius of the annulus. 


(e) Solve the Dirichlet problem on Q, where u(x, y) assumes the 
value u; = 1 on C, and uy = 2 on C5. 


(f) Obtain a graph of the level curves of u(x, y). 


(g) Obtain a graph of the flow lines for u(x, y). 


B9.R —5,r22,A2-—Laz-l 
B10. R=5,r=2,A=3,a=1 
Bll. R=6,r=2,A 1,a21 
B12. R =5,7 =3,A =0,a= 1 
B13. R=7,r=1,A=-—2,a=2 
Let the circles C; = {|z — A| = R} and C; = {|z — a| =r} be com- 
pletely disjoint, and let z; and zz satisfy the equations z = L +A and 
2 = + a. Then, the linear fractional transformation w = f(z) = 
zl 


—. maps Q, the region exterior to both C, and C3, to an annulus cen- 
tered at w — 0. The points z; and z» are on a line that simultaneously 
passes through both A and a, and f(z) maps zı to w = 0 and z; to 
w = oo. If z; is inside C;, then C, will become the inner boundary of the 
annulus, else it will become the outer boundary. For the set of parameters 


in each of Exercises B14—18: 
(a) Sketch C; and C3. 


(b) Determine z;, z2 and the LFT f(z) that maps the region Q to 
an annulus, the image of C; becoming its inner boundary. 


(c) Find R’ = | f (C5) , the outer radius of the annulus. 


(d) Find r’ = | f (Ci) , the inner radius of the annulus. 
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(e) Solve the Dirichlet problem on Q, where u(x, y) assumes the B15. R=3,r=1,A=—-—2,a=3 

value u; = —3 on C; and u; = 5 on Cy. B16. R3, r—1,A-—2-2,4 4 
(f) Obtain a graph of the level curves of u(x, y). BI. Rc32,or23.A2—94255 
(g) Obtain a graph of the flow lines for u(x, y). Bis R2l1rzc34A4Z-2a26 


B14. R25, r—2,A—-—lLa-S8 


Planar Eluid Flow 


Preliminaries 


The concepts and techniques of complex function theory prove efficacious in describing the 
planar flow of fluids. We therefore begin this discussion with a rephrasing of key concepts 
from Unit Four. 

Let V = p(x, y)i + q(x, y)j beacontinuous vector field in the plane. ff V = Vó(x, y), 
that is, if V is the gradient of the scalar function $ (x, y), we say that V is conservative. 
Contrary to the usage of Unit Four, we do not take V as the negative of the gradient of ®. 

In the theory of fluid flows, V represents the velocity vector for an inviscid, incompress- 
ible steady-state planar fluid flow. An inviscid fluid experiences no friction, experiences no 
viscosity, and does not adhere to boundaries. An inviscid fluid would therefore slide along 
a boundary. An incompressible fluid has constant density. 

A field for which the curl vanishes is said to be irrotational. If V has continuous partial 
derivatives, then being conservative is equivalent to being irrotational. (In Section 20.4 we 
saw that the curl of the gradient vanishes identically. In Section 21.5 we saw that irrotational 
fields of requisite smoothness were necessarily conservative.) 

If the scalar potential (x, y) satisfies Laplace's equation, that is, if $,, + yy = 0, 
then it is called harmonic. 

A field for which the divergence vanishes is said to be solenoidal. In Section 21.5 
we saw that a conservative field is solenoidal exactly when the scalar potential $ (x, y) is 
harmonic. (See Figure 21.13.) 

The circulation c around a closed contour C is defined for the field V, as in Section 
19.1, by the line integral of the tangential component of V around C. Thus, c — f- V-dr 
and the line integral would be called work if V were a force field. If the circulation vanishes 
for every closed contour C, then V is said to be circulation-free. If V is sufficiently smooth 
and irrotational on a simply connected domain, then it is conservative and the line integral 
of the tangential component around every closed path vanishes. (See Section 21.5.) Thus, 
irrotational flows will be circulation-free if the domain of the field is simply connected. 

The flux F of V across the closed contour C is defined, as in Section 19.2, by the line 
integral of the normal component of V around C. Thus, flux is given by the line integral 
F=f c V: Nds, where N is a unit outward normal along C and s, the parameter along 
C, is arc length. If the flux through every closed contour C is zero, then V is said to be 
source-free. In Section 19.2 the divergence of the field V was shown to represent the flux of 
V through C, per unit area within C, in the limit as C was shrunk to a point. Hence, if a field 
is solenoidal, it will be source-free, provided the domain on which the field is solenoidal is 
simply connected. 

If V is a conservative velocity field with continuous first partial derivatives, it is nec- 
essarily irrotational. (See Sections 20.4 and 21.5.) On a simply connected domain, V will 
be circulation free. On a multiply-connected domain, V could exhibit nonzero circulation 
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for contours that cannot be shrunk to a point in the domain. If $ (x, y), the scalar potential 
for V, is harmonic, then V is solenoidal, or divergence-free, as well. (See Section 21.5.) 
If $ (x, y) is harmonic on a simply connected domain, then V is source-free. If @(x, y) is 
harmonic on a multiply-connected domain, then V could be locally divergence-free but still 
not be source-free. 

Let V be conservative so that V = V@¢(x, y). The level curves (contours) of (x, y) 
are defined by $ (x, y) = constant. Orthogonal to these “equipotentials” are the flow lines, 
the integral curves of the gradient field. These flow lines are the solution of the equations 
A = Pes - = $,. If these solutions are given implicitly as y = y(x) by the function 
w(x, y), then the level curves y(x, y) = constant are the flow lines for the field V. If 
V (x, y) is also harmonic, then it is called the harmonic conjugate of $ (x, y). 

If the harmonic function $ (x, y) is the real part of an analytic function F(z), then 
V (x, y), the imaginary part, is the harmonic conjugate and the level curves of each harmonic 
function are mutually orthogonal. If V = V4, with $ harmonic, then there is an analytic 
function F(z) = $ -- i v for which y is the harmonic conjugate of $ and for which the level 
curves are the flow lines of the field V. The function F (z) is called the complex potential for 
the field V, and the function v (x, y) is called the stream function because its level curves 
(contours) are the flow lines for the fluid. In this context, the contours of the stream function 
are called streamlines. The velocity vector V is tangent to the streamlines, so fluid does not 
cross a streamline. Therefore, fluid boundaries must fall along the streamlines of the flow. 

The following theorem from [69] gives necessary and sufficient conditions for the 
existence of a complex potential for a planar flow. 


THEOREM 36.5 


The functions p(x, y) and q(x, y), continuous on a domain D, define V = p(x, y)i + 
q(x, y)j as a source-free and circulation-free flow in D if and only if there exists in D, 
a single-valued analytic function F(z) = $(x, y) +iw(x, y) for which F'(z) = 
p — iq. 

If the analytic function F(z) = $ +i exists and F' = p — iq, then by the defi- 
nition of a complex derivative F' = $, + iv, and by the Cauchy-Riemann equations 
F' = $, — igy. Consequently, p = $, and q = $, and V = F'(z). The derivative 
F'(z) is called the complex velocity, even though V, the velocity vector, is obtained 
from the conjugate of this derivative. 

For a closed contour C, the circulation and flux integrals can be computed as the 
real and imaginary parts, respectively, of the integral 


o- | Fd: = | o - itx +idy) | pax+qdy+i | pdy -ads 
C C (6 C 


The real part is recognized as the circulatiog integral, and the imaginary part as the 
flux integral. (See Sections 19.1 and 19.2.) 

Finally, the magnitude of the velocity vector is called the speed and is denoted 
by v = |F’(z)| = IVII. 


All these relationships are illustrated in the following examples of inviscid incompress- 
ible planar flows. 


EXAMPLE 36.39 


EXAMPLE 36.40 
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Elementary Inviscid Incompressible Planar Flows 


The following examples illustrate elementary inviscid incompressible planar flows. In Sec- 
tion 36.10, more complicated flows will be obtained by applying conformal maps to these 
elementary flows. 


The flow defined by the complex potential F(z) = Az, where A > 0, exhibits parallel 
streamlines. To see this, obtain the real and imaginary parts, @ = Ax and y = Ay, respec- 
tively, so the velocity vector is V = V = Ai. Figure 36.36 shows the equipotentials (in 
color) and streamlines (in black) for the case A — 2. A single arrow shows the direction of 
the flow. 

The complex velocity is then F'(z) — p — iq — A. The conjugate of the complex 
velocity is V = A, and the speed is v = A, computed both from | F’(z)| and ||V ||. Let the 
contour C be the circle z(t) = re, 0 < t < 27, so 


2x 
o- [ Fd = ar f ie! dt 2-0 
E 0 


and both the circulation and flux for C are zero. 


$. 
«e 
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=l l 
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FIGURE 36.36 Streamlines (in FIGURE 36.37 Streamlines (in 
black) and equipotentials (in color) black) and equipotentials (in color) 
for the flow in Example 36.39 for the flow in Example 36.40 


The flow defined by the complex potential F(z) = Ae'*z, where A > 0, exhibits parallel 
but slanted streamlines. To see this, obtain the real and imaginary parts, ¢ = A(x cos A — 
ysin A) and yy = A(x sin A + y cos A), respectively; so the velocity vector is V = Vo = 
A (cos Ai — sin Aj). Figure 36.37 shows the equipotentials and streamlines for the case A = 
% and A = 2. The streamlines are the black lines and the equipotentials are the color lines. 
A single arrow shows the direction of the flow. (Notice that in the complex potential F(z) 
the factor e’ appears but the streamlines make an angle of —A with the horizontal.) 

The complex velocity is F'(z) = Ae^^, its conjugate is V = Ae "^, and the speed is 
v = |F'(z)| = ||V|| = A. If C is the circle z(t) = re^, 0 < t < 2x, then 


a=} F(G)dzo Av | ie dt =0 
[o 0 


S. 
KS 


and both the circulation and flux for C are zero. 
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EXAMPLE 36.41 


EXAMPLE 36.42 


FIGURE 36.38 Streamlines (in black) 
and equipotentials (in color) for the flow in 
Example 36.41 


EM 


FIGURE 36.39 Streamlines (in black) 
and equipotentials (in color) for the flow in 
Example 36.42 


EXAMPLE 36.43 


The flow defined by the complex potential F(z) = Az?, where A > 0, models a flow per- 
pendicular to a wall. To see this, obtain @ = A(x? — y?) and w = 2Axy, the real and 
imaginary parts, respectively, of F(z). The velocity vector is V = Vd = 2A(xi — yj). 
Figure 36.38 shows the equipotentials (in color) and streamlines (in black) for the case 
A = 2. Arrows in the direction of V are included by graphing the gradient field for @. 

The complex velocity is F’(z) = 2Az; the speedis v = |F'(z)| = ||V|| = 2A x? + y?. 
If C is the circle z(t) = 2i + re^, 0 < t < 2x, then 


2x 
Q= Í F'(z)dz — zar f i(2i +re")e” dt =0 
C 0 
and both the circulation and flux for C are zero. kd 


The flow defined by the complex potential F(z) = Alog(z — a), where A > 0, models 
flow emanating from a source located at z — a. To see this, use the principle logarithm and 
obtain 
$ —iAln(x—a) y") and y = Aarctan(y, x — a) 
the real and imaginary parts, respectively, of F(z). The velocity vector is then 
x—a iu y i) 
? 1 Pi " 
(x—aP4c4y? (x-a? + y! 
Figure 36.39 shows the equipotentials and streamlines for the case A = 2,a = 1. The 
streamlines, which appear to be radial lines emanating from z — a, are in black; and the 
equipotentials, which are concentric circles centered at z — a, are in color. A single arrow 


shows the flow is radially outward. 
The complex velocity is F'(z) — +. and the speed is 


A 
Far from z = a, the limiting value of V = F'(z) is clearly 0. If C; is the circle z(t) = 
3+e",0<t x 2z, so that a = 1 is not enclosed by it, then 
e" dt 


= F'(z)dz=iA ! - —0 
of Panam” oe 


v-ve-a( 


v = |F'(z) = IVI = 


suggesting that if the contour C does not enclose z = a, then the circulation and flux, around 
and through C, respectively, vanish. If C; is the circle z(t) = 1 + e, 0 <t « 2z, so that 
a = | is now enclosed by it, then 


g=] Pod=ia f dt —2niA 
C2 0 


suggesting there is a flux of 27A through contours that enclose z = a. Such a flow is said to 
be circulation-free but with a flux of 27A through contours enclosing z = a. For A positive, 
the flow is said to have a source of strength 27A at the point z = a; while for A is negative, 
the flow is said to have a sink at z = a. Ed 


The flow defined by the complex potential F(z) = —i Blog(z — a), where B > 0, models 
a flow with a point-source of circulation at z — a. To see this, obtain 


b = Barctan(y, x — a) and w= —iB In((x — ay? + y?) 


FIGURE 36.40 


N 


Streamlines (in black) 


and equipotentials (in color) for the flow in 


Example 36.43 


EXAMPLE 36.44 
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the real and imaginary parts, respectively, of F (z). The velocity vector is 


v-ve-s( — E si) 
(x — a) + y* (x — a)^ by? 


Figure 36.40 shows the equipotentials and streamlines for the case B = 1, a = 1. The 
black curves are streamlines, concentric circles centered at z — a, and the lines in color are 
equipotentials. Arrows in the direction of V show the flow is in a counterclockwise direction 
around the circles. 

The complex velocity is F'(z) — -#, and the speed is 
B 


Far from z = a, the limiting value of V = F'(z) is clearly 0. If C, is the circle z(t) = 
3 -- e, 0 <t < 2r, so it does not enclose a = 1, we have 


Q- pi jd -8 f" e! dt = 
E Ci inci 0 2e 


v = |F'(z)) = IIVI = 


suggesting that if the contour C does not enclose z — a, then the circulation and flux, around 
and through C, respectively, vanish. If C2 is the circle z(t) = 1 + e",0 < t < 2x, so that 
it does enclose a — 1, we have 


2z 
o-[ F@dz=B | dt = 27B 
C5 0 
suggesting the circulation around a contour that encloses z = a is c = 27B. Thus, this flow 


is flux-free but exhibits a circulation of 27 B around a contour enclosing z = a and is said 
to have a vortex of strength 2z:B at the point z = a. e 


The flow defined by the complex potential 


PFUS 24 demi a - 
(2) = 3 og : m og(z — a) = 


where m > 0, has a source of strength m at z = a and a sink of strength m at z = 0. To see 
this, obtain r 


ġ = In er —#) ua and y — ” arctan 
4r x je 27 


p) 


ay y“ = Gk ap y? 
x2 + y? L x24 y? 

the real and imaginary parts, respectively, of the complex potential F (z). The velocity vector 
is 


am 
2x (x? + y?)((x — a)? + y?) 
Figure 36.41 shows the equipotentials and streamlines for the case m = 1,a = 1. The 
streamlines are the black lines, and the equipotentials are the lines in color. Arrows in the 
direction of V are included by graphing the gradient field for $. 
The complex velocity and the speed are given, respectively, by 


V=Vo= ((x? — ax — y”)i+ y(2x — aj) 


F'(2) am d am 
zZz) = ———— an v= 
2m z(z — a) 2n x? + y? (x —ay4y? 


Far from z = a, the limiting value of V = F’(z) is 0. If a Cı does not enclose z = 0 
Or z = a, then the circulation and flux, around and through C;, respectively, vanish. If a 


926 


Chapter 36 Applications 


EXAMPLE 36.45 


FIGURE 36.41 Streamlines (in black) and 
equipotentials (in color) for the flow in Example 
36.44 


contour C» encloses z = a but not z = 0, then the circulation around C» vanishes but the 
flux through C; is m. If a contour C3 encloses z = 0 but not z = a, then the circulation 
around C3 vanishes but the flux through C3 is —m. Thus, z = a is a source of strength m 


and z = 0 is a sink of strength m. For example, take a = 1 and on Cj, k = 1,..., 3, take 
0 € t < 2z, obtaining the results summarized in Table 36.4. $ 
; m [? ie" dt 
C z(t) =3'+ e =| F'(z)dz= f - — = 
l (t) e Q , (z) mh Ge) el) 


6; 
: i , m [? idt . 
C5 z(t) 2 14 ze" Q= F' (z)dz = - —im 

2 © 27 Jo le 


2x . 
m i dt . 
o- | F'(z) dz = Í = = —im 
Co 2m Jo =e — 1 


TABLE 36.4 Circulation and flux for the contours in Examle 36.44 


C3 z(t) = je 


The flow defined by the complex potential F(z) = —oe'*/27z exhibits, at z = 0, a doublet 
of strength a , with doublet-axis along the ray through the origin defined by e^. To see this, 
obtain 
o XCOSÀ T ysinA o xsinà — ycosA 

o - 0 and V = 9 : ? 
2x ese ye 20 FY 


$ — 


the real and imaginary parts, respectively, of F(z). The velocity vector is 


V — Vó 


Oo 
(On + y?) 


5 [((x? — y?) cosa + 2xy sin à)i + ((y? — x^) sin à + 2xy cos 4j] 


Figure 36.42 shows the equipotentials and streamlines for the case o = 1,4 = 3. The 
streamlines are the black lines, and the equipotentials are the lines in color. Arrows in the 
direction of V are included by graphing the gradient field for $. 
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FIGURE 36.42 


Streamlines (in black) and 


equipotentials (in color) for the flow in Example 


36 


45 


The complex velocity is F'(z) = oe!* /2z:z?, and the speed is 


ee Oo 
v = [F'(z)| = IIVI] = mF 


Far from z = a, the limiting value of V = F’(z) is 0. For any contour C not through z = 0, 
Q = fo F'(z) dz = 0. For example, if C is the contour z(t) = 3 + e”, 0 < t < 27, we 
have Q = bw ie! dt/(3 +e")? = 0. If C is the contour z(t) = e", 0 < t < 2x, then 
Q = i 7 ie" dt = 0. Thus, the doublet is locally circulation-free and source-free. In fact, 
Q can be evaluated directly by residues, noting that F(z) is a multiple of + and so F'(z) is 
a multiple of 5. Thus, the residue at z = 0 is zero, and Q = O is the correct result. 

In fact, the doublet is obtained from the complex potential in Example 36.44 by allowing 
the source and sink to coalesce. Thus, the doublet is free of both circulation and flux because 
the source and sink cancel each other out. The exact manner in which the source and sink 
are allowed to approach each other is left to the exercises. $ 


EXERCISES 36.9 


Harmonic functions attain their maximum and minimum on the 
boundary. More precisely, let R be a closed bounded region consisting 
of a domain D (a connected open set) and a boundary B. If u is 
harmonic in D and continuous on B, then on B there are two points zı 
and z2, not necessarily unique, for which u(zi) < u(z) € u(z2) holds 
for all z in R. Let R be the disk |z — a| < 1, where a = 2(1 + i). In 
Exercises 1—5, obtain the harmonic functions $ = R(F) and v = Z(F) 
and show each attains its maximum and minimum on the boundary of 
R. (Graph each as a surface, find extreme points in the interior of R, and 
then find extreme points on the boundary of R by using the Lagrange 
multiplier method (Section 18.4) or by parametrizing the boundary, 
thereby making u on the boundary a function of a single parameter.) 


1. F(z) =aresinz 2. F(z) = arccos z 


S, F@= 


1 
3. F(z) = arcsinh z 4. F(z) = arccosh z = 


For the flow determined by the complex potential F(z) in Exercises 
6-10: 
(a) Obtain the potential function (x, y) and the stream function 
y (x, y). 
(b) Obtain a graph of the equipotentials. 
(c) Obtain a graph of the streamlines. 


(d) Graph the arrows of the gradient field Vo, and compare to the 
graph of the streamlines. 


(e) Demonstrate that V — F'(z), the velocity, is equivalent to 
V = Vọ. 
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(f) Compute the speed v = |F'(z)| and graph it as a surface 8. F(z) = = 9, F(z) = arctan z 10. F(z) = cosh z 


z—1 
defined on the x y-plane. -- , ! 
$ ] -— For each complex potential given in Exercises 11-15: 
(g) Compute Q — tte F'(z) dz, where C is the generic circle 


z(t) =a + be, —x <t < x, and show that (a) Obtain the harmonic function $ (x, y) = R(F). 

R(Q) — js V6 + dr and Z(Q) = f $, dy — $y dx. (b) Show that w(x, y) = $(u(x, y), v(x, y)) is harmonic, if 
(h) Obtain the streamlines from $ (x, y) by integrating the gradient fM=2=utiv. 

field Vo. Eliminate the parameter along the streamline by (c) Show that w(x, y) = (u(x, y), v(x, y)) is harmonic, if 

writing the single differential equation i = y/o, and solving f@=zti=utiv. 

it to obtain a first integral f(x, y) = constant. Show that the ` 

level curves of f(x, y) are equivalent to the streamlines 11. F(z) —tanhz 12. F(z) = arctanh z 

determined by y(x, y) = constant. 13. F(z) = z 14. F(z) = pr 15. F(z) = sinz 


6. F(z) —cosz 7. F(z) =sinhz 


Conformal Mapping of Elementary Flows 


Conformal Maps of Fluid Flows 


Conformal mappings are often used in conjunction with complex potentials when solving 
planar flow problems. To find a flow over a complicated region in the z-plane, a conformal 
map is typically used to transform the region in the z-plane to a simpler region in the w- 
plane. The transformed flow problem is solved in the w-plane and the solution mapped back 
to the z-plane. Sometimes, however, simple flow in the z-plane is conformally mapped to 
a complicated flow in the w-plane. Clearly, this is just a role-reversal between the z- and 
w-planes, but when the conformal map is not easily inverted, this seems to be the prevailing 
usage. 

In either event, the technique is viable because a conformal map of a complex potential 
is again a complex potential. Thus, under a conformal transformation, streamlines in the 
z-plane map to streamlines in the w-plane. To be precise, let w = f(z) be analytic with 
f'(z) # 0 in a domain D. Then (see, e.g., [69] or [53]), f(z) maps D conformally and also 
has a unique inverse for which z = g (w). Let z; = xy + iy,, k = 1,2, be two points on a 
streamline of Y (x, y) so that v (xp, yk) = c, k = 1, 2. Let w = f (Ze) = uj ivy, k = 1,2, 
be the images, in the w-plane, of the two points in the z-plane so that x, = x (uk, vg) and 
Yk = Yyk(Uk, vy) for k = 1,2. Then, for k = 1,2, 

V Que. Ye) = W Gc Qui, Vk), Y Qt, vk)) = Y (ur, VE) = c 
Two points on a streamline in the z-plane map to two points on a streamline in the w-plane. 
The stream functions w(x, y) and V (u, v) have the same constant values on corresponding 
streamlines. The correspondence is a consequence of the existence of an inverse map, itself 
a consequence of conformality. 

Given the principle that conformal transformations map streamlines to streamlines, we 
next depict how a flow behaves under a conformal transformation. Let D, be a domain in the 
z-plane mapped to the domain D,, in the w-plane by the conformal transformation w = f(z) 
= u(x, y) +iv(x, y). Thus, z = x + iy and w = u + iv. Let G(w) = ®(u, v) J- iV(u, v) 
be a complex potential for a flow in the w-plane. Then the complex potential defined by 

F(z) = G(w(z)) = G(f(z)) 
= (u(x, y), v(x, y)) + iY (u(x, y), v(x, y) 
= o(x,y) * iv, y) 


is the complex potential for the pre-image, in D., of the flow in Dy. 


EXAMPLE 36.46 


FIGURE 36.43 Flow around the parabola 
y? 24x 


EXAMPLE 36.47 


QT 
I 
ES 


FIGURE 36.44 Streamlines for flow 
around the parabola y? — 4x 
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In most cases, the domain D. is the complicated one, and D,, is simpler. The flow 
problem is solved in the w-plane by finding G (w), and the solution is brought back to the 
z-plane by writing F(z) = G(f(z)). However, there are some important cases where the 
domain D. is the simpler one, and a flow F(z) is mapped by w = f(z) to D,,, the more 
complicated domain. This is generally the approach taken when the inverse map from the 
complicated domain to the simpler domain is algebraically difficult. 

In the rest of this section, we give examples of these ideas of flow mapping by conformal 
transformations. 


Flow around a parabola This example of flow around a parabola is adapted from [34]. 
The parabola y? — 4x, along with a representation of the flow, is shown in Figure 36.43. 
The mapping w = f(z) = Vz — 1 will transform the parabola y? = 4x into the horizontal 
line v = 1, provided the discontinuity in the square root function occurs along the positive 
real axis. (See Exercise Al.) The principal square root has its branch cut along the negative 
real axis, but an appropriate branch of yz — 1 will satisfy 0 < 0 < 27, where 0 is the 
angle made by the segment z — | and the positive real axis. (If Arg(z — 1) > 0, then 
90 = Arg(z — 1); if Arg(z — 1) < 0, then 6 = Arg(z — 1) + 27. Define the square root by 
Vz — 1 = yjz = Tle’#/*. See Exercises B1 and B2.) 

The complex potential for the flow in the w-plane is G(w) = Aw. Therefore, the com- 
plex potential for the flow in the z-plane is F(z) = G(w(z)) = G(f(z)) = AVz — I, where 
A is determined by the condition that the complex velocity at the vertex of the parabola 
should be V = —i. Thus, the condition F’(0) = —i gives A = —2, and the desired complex 
potential in the z-plane is then F(z) = —24/z — 1. Writing F(z) as (x, y) +iw(x, y), 
the streamlines are the level curves of y (x, y) = Z(F (x +iy)). The streamlines are shown 
in Figure 36.44. (Also, see Exercise B3.) % 


Flow against a parabola This example of flow directed at the vertex of the parabola 
y? = 4x is adapted from [34]. If the square root is defined as in Exercise B2, the function 
f(z) = Vz — 1 maps the parabola to the line v = 1. The negative real axis is mapped to 
v > 1 on the positive imaginary axis. Thus, f(z) maps the z-plane to the w-plane as shown 
in Figure 36.45. 

Since the flow in the z-plane is along the negative real axis and against the vertex of 
the parabola, the flow in the w-plane will be downward and against the “wall” along v = 1. 
The solution for flow against a wall is given in Example 36.41, Section 36.9, provided we 
shift the point w = i in the w-plane to the origin. 

Therefore, define the mapping ¢ = A(w) = w — i, with the complex potential in the 
¢-plane being given by H(¢) = AZ?. Then, the complex potential in the w-plane is 


G(w) = H(h(w)) = G = A(w — I 
Finally, F(z), the complex potential for the flow in the z-plane, is given by 
F(z) = G(w(z) = G(f(z) = A(Vz-1- 1» 


The constant A is determined by the condition that as z — oo, the velocity tends toward, 
say, 1. Thus, the condition lim; 45 F'(z) = 1 leads to A = 1. Writing the complex potential 
F(z) as F(x +iy) = $(x, y) +iw(x, y), we have, in the upper half-plane, 


A 
$ — A(x —-2-- JA —2x +2) and y = —V14 2x — 2(V À — 2x 4-2 — 2) 
2 


where A = 2,/(x — 1)? + y?. In the lower half-plane, $ (x, y) is the same but w(x, y) 
is replaced with its negative. Figure 36.46 shows the streamlines and the velocity field 
(gradients of $ (x, y)) for the case A = 1. b 
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-1 0 1 
(a) (b) 
FIGURE 36.45 Mapping the z-plane by w = /z— 1 FIGURE 36.46 Streamlines 
for flow against the parabola 
y^ = 4x 


EXAMPLE 36.48 Flow past a wedge To determine the flow of a fluid moving from left to right past the 
symmetric wedge shown in Figure 36.47, note that the mapping w = f(z) = z"/^ will take 
the edges of the wedge to the negative real axis in the w-plane. In fact, the lines z = re^ 
both map to the negative real axis since f (ret!) = —r7/^, 

The complex potential for the flow in the w-plane is then G(w) — Aw, so the complex 
potential for the flow in the z-plane is 


F(z) = G(w(z)) = G(f (2) = Az" 
Write F(z) as F(x 4- iy) = $(x, y) J- iv(x, y), where 


1 
$ = A(x? + y?)*/*4 cos (= arctan(y, ») 
a 


p) a) . T 
y = A(x? + y^)*"? sin (= arctan(y, x)) 
a 


FIGURE 36.47 The wedge in Example yne the two-argument arctangent function takes values in [—z, 7]. For the case A = 1, 
36.48 a = ^1, a graph of the streamlines and velocity vector field is given in Figure 36.48. 

For flow from left to right against a wedge, note that replacing z with —z will rotate the 
wedge through an angle of x. Thus, write Fi(z) = A(—z)*/*and obtain the velocity field 
in Cartesian coordinates as the real and imaginary parts of V = F/(x + iy). In particular. 
ifa= z, we find 


4A 
y = 1/3 [ 


3 (x? + y?) 


where À = i arctan(—y, —x). In particular, at z = —1, the velocity vector should be pro- 
portional to the unit vector i. At this point, the velocity vector is actually —FAi, so we will 


(x cos A + y sin A)i + (y cos A — x sin 2j] 


set A = —1. The streamlines and the velocity vectors can be seen in Figure 36.49. $ 


EXAMPLE 36.49 Flow into a closed channel The flow into a closed channel can be found by mapping 
the channel, given in the z-plane as the upper half-plane region = < Riz) < s to the 
w-plane by the function w = f(z) = sin z. The boundaries of the channel map to the real 
axis. Hence, the complex potential in the w-plane is given by the function G(w) — Aw, sc 
the complex potential for the flow into the closed channel in the z-plane is given by 


F(z) = G(w(z)) = G(f(z) = A sinz 


=15 1.5 


FIGURE 36.50 The streamlines and 
velocity vector field for flow into a closed 
channel in Example 36.49 


EXAMPLE 36.50 


EXAMPLE 36.51 
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A 


ie ie ee ee 
=i e ea 


1+ 


> X 


FIGURE 36.48 The streamlines and velocity FIGURE 36.49 The streamlines and velocity 
vector field for flow past a wedge in Example vector field for flow against a wedge in 
36.48 Example 36.48 


the real and imaginary parts of which are 
$ = Asinxcoshy and w= A cos x sinh y 
respectively. The velocity field can be obtained as 
Vo = A(cos x cosh yi + sin x sinh yj) 


or as F'(x + iy). A sketch of the flow when A = 1 is given in Figure 36.50. d 


Flow through a slit The flow through a slit can be determined by mapping the z-plane to 
the w-plane with the function w = f(z) = arcsin z. This function maps x € —1, y = 0 
on the negative x-axis to the vertical line u = —% in the w-plane and maps x > 1, y = 0 
on the positive x-axis to the vertical line u = Z in the w-plane. Consequently, if the slit 
is coincident with —1 < x < 1 on the x-axis, its image under f(z) = arcsin z will be the 
strip — 5 <u x $, —oo < v < œ, in the w-plane. 

The complex potential for the flow in the w-plane is G(w) = —i Aw, A > 0, consistent 
with an upward flow through the channel, since V = G'(w) = iA. The complex potential 
for the flow in the z-plane is then 


F(z) = G(w(z)) = G(f (z)) = —i A arcsin z 
for which the real and imaginary parts, respectively, are 
$ = Acsgn(y —ix)In(a+ B + J(a + B2 — 1) and w = Aarcsin(f — a) 
where œ = I D? 4 y, p= SJ — 1? +y?, and 
1 R(z) > 0or R(z) = 0 and T(z) > 0 
—] R(z) < Oor R(z) = 0 and Z(z) <0 


csgnz = 


For the case A = 1, Figure 36.51 shows the streamlines as determined by w(x, y) and the 
velocity field as determined by $ (x, y). $ 


Flow pasta cylinder The circle |z| = o is the cross-section of a cylinder whose axis is 
perpendicular the z-plane. The complex potential for flow past this cylinder when Vo = 
Ae'^, A > 0, can be found by mapping the z-plane to the ¢-plane to eliminate the slant to 
the far-field velocity and then mapping the ¢-plane to the w-plane by the Joukowski map to 


FIGURE 36.52 The streamlines for flow 
past a cylinder in Example 36.51 


FIGURE 36.53 Example 36.51: Graph of 
V (0, y), the stream function along the 
y-axis 


FIGURE 36.54 Example 36.51: 
Streamlines when A = 0 and A = ø = 1 
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FIGURE 36.51 The streamlines and velocity vector 
field for flow through a slit in Example 36.50 


flatten the cylinder to a line segment. The flow in the w-plane is brought back to the z-plane 
through the ¢-plane. 

In the z-plane, first rotate the flow by the angle —A so that the velocity vector, far 
from the origin, will be just A. This is accomplished by the conformal map ¢ = f(z) = 
ze '*. The circle |z| = o maps to the circle |¢| = c. Map the ¢-plane to the w-plane 
with the conformal map w = g(£) =¢ + x, which takes the circle |¢| = ø to the slit 
—20 <u € 2o0,v = 0, in the w-plane. This slight generalization of the Joukowski map 
appeared in Section 36.7. The rest of the ¢-plane is mapped two-to-one onto the w-plane. 

The complex potential for flow past the slit in the w-plane is then G(w) = Aw, so the 
complex potential in the ¢-plane is 


Gi) = G(w(2)) = G(g(c)) 


and the complex potential in the z-plane is 


E co? e^ 
F(z) = G(gCf(z)) =A (e z+ ) 


Since V = F'(z) = Ae~* — o2e!*/z?, we have V4, = Ae". Determined by F'(z) = 0. 
there are two stagnation points, +oe'*, both on the circle |z| = o, and both diametrically 
opposite each other. Writing F(z) as F(x 4- iy) = $(x, y) J- iv(x, y), the real and imagi- 
nary parts are, respectively, 

- l l gd 

= ;) and V = (cosà — xsin) (1. E z) 
KE "Ve XP y 
On the circle |z| = c, the stream function w(x, y) has the value zero. Figure 36.52 shows 
the flow for the case A = 1, 4 = ei o = 1. The streamlines are the level curves of w(x, y). 
the stream function, and the two representative velocity vectors superimposed on the flow 
are obtained from Vó(x, y). 

Each streamline crossing the y-axis outside the circle |z| — 1 is a contour along which 
the stream function w(x, y) maintains a constant but different value. The variation of the 
stream function along the y-axis is shown Figure 36.53. 

When 4 = 0, the stream function simplifies to y, = Ay(1— D. Then, for the case 
A = l.c = 1, this further simplifies. If polar coordinates are introduced, this simplified 
stream function becomes y, = mi sin 0, and Figure 36.54 shows the resulting flow. <$ 


b = A (x cos A + y sin A) (: — 


EXAMPLE 36.52 


(b) 


FIGURE 36.55 Example 36.52: (a) 
streamlines for c — 10 and (5) for c — 12.6 


FIGURE 36.56 Example 36.52: Graph of 
V (r, 5), the stream function on the y-axis 
above the cylinder 
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Circulant flow past a cylinder If flow past the disk |z — a| = o has nonzero circulation 

c and Væ = Ae’, its complex potential (as found, e.g., in [69]), is 

Zoid A 
) — - log(z — a) 

a 2zi 


m oO 
F(Z=A G a) +- 


let A = 1, 4 = 0, and ø = 1, so that the flow, from left to right around a disk with radius 
1 and center at z = 0, has the limiting velocity Vx» = A. Then, the complex potential 
becomes 


l ë 
F(z) —z-F--z—Logz 
z Ami 
where we have switched to the principal logarithm. For any contour C enclosing the disk 


|z| = 1 in its interior, the flow has circulation c. For example, if C is the circle z(t) = 
2e, 0 <t € 27, then 


o- | P@de= = f (Az e — ze —ic)dt=c 
c T Jo 


2 


On the other hand, the circulation around a contour that does not contain the disk |z| = 1 in 
its interior will be zero. For example, around the circle z(t) = 3 +e", 0 < t < 27, we find 


a c 1d l ' 
= | F'(z)dz =i 1+ - - "dt 20 
Q [ (2c if ( 2zi 34 eit aas). f 


Writing F(z) in polar coordinates as F (re?) = (r, 0) + iy (r, 0), we find the real 
and imaginary parts to be, respectively, 


l j 1 
o= (r + =) cos 0 + = arctan(r sin, r cos) and w= ( — 1) sind — 2 Inr 
m 


r F T 


Figure 36.55 shows the flow for two values of c. On the left, c = 10, while on the right, 
c = 12.6; thus suggesting the stagnation points on the disk move as c is increased, even to 
the extent that the stagnation points move off the boundary of the disk! 

As a function of the circulation c, the location of the stagnation points is determined 
by solving the equation F’(z) = 0, giving the two solutions s. = $ (c + Vc? — 16z?). 
On the boundary of the disk, the stagnation points are distinct except when c = +47. (For 
a disk of radius c, the values of c for which the two stagnation points coalesce are found to 
be +4:r0, as dealt with in the exercises.) In our example, for c > 47r, the stagnation point 
at s4 is actually on the positive imaginary axis and above the disk. If, say c = 57r, then the 
stagnation point is at s} = 2i. 

The variation of the stream function v (r, 09) on contours above the disk can be seen 
in the graph of w(r, 2) with c = 5x, shown in Figure 36.56. The vertical axis represents, 
when the stagnation point is at z — 2i, values ofthe stream function on streamlines crossing 
the y-axis above the disk |z| — 1. On the surface of the disk, the stream function has the 
value zero. Then, the values of y become negative, are negative at the stagnation point, and 
don't become positive until well above the stagnation point. 

At the stagnation point above the disk, Y = Vai = iG —5]n2) = —0.23. Set c = 5x 
and solve W(r, 9) = vi for 9 = 0(r) = arcsin — as one branch of the arcsine 
function and z — 6 (7) as the other. Figure 36.57 shows the streamlines through the stagnation 
point above the disk. The curve in coloris the branch defined by 0 (r); the black, by 7 — 0 (r). 


S. 
Sd 
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FIGURE 36.57 Example 36.52: 
Streamlines through the stagnation point 
when c = 5z (branch defined by 0 (r) is in 
color, while the branch defined by 

x — (r) is in black) 


FIGURE 36.58 Example 36.53: 
Streamlines when A = 1 


EXAMPLE 36.54 
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Flow past a line segment In the plane of z = x + iy, the complex potential F(z) for a 
fluid flowing past the line segment x = 0, —1 < y < 1, and having the limiting velocity 
Va; = Ae’ is found by a series of two mappings. First, the z-plane is mapped to the ¢-plane 
by the function ¢ = f(z) = —2iz, which rotates the segment on the imaginary z-axis to the 
real axis in the ¢-plane. In addition, the segment is stretched so that it lies between ¢ = +2. 
Then, the ¢-plane is mapped to the w-plane by the function w = g(Z) = Iq TE —4), 
which takes the segment between ¢ = +2 to the circle |w| = 1. The observant reader will 
recognize this as the inverse of the Joukowski map. 

Circulation-free flow past this disk in the w-plane has the complex potential G(w) — 
B(e '* w + e" /w). In the z-plane, the complex potential F (z) is given by the composition 


F(z) = G(w(£(z)) = G(gCf (2))) 
=B (e iz +/—z? —1)4 


ee 
-—izt+JV—22 — ;) 


= 2B(Xz? + 1sint — iz cos c) 


The parameters B — i and t = > — À are determined by the condition 


Ae” = Vy = lim F'(z) = 2B(sint + i cos) 
Hence, we have F(z) = A(Vz? — 1 cos — iz sin A). 

At this point, we have typically written F(z) as F(x + iy) = $(x, y) + iv(x, y) 
and obtained, by direct computation, the real and imaginary parts of F (z). However, the 
presence of the square root would force us to determine a proper branch cut, and in this 
instance, the principal square root turns out to be inappropriate. Instead of struggling with 
the definition of this branch cut, we employ an alternate device that works here because the 
radical can be isolated. 

Set A = 1 and F(z) = $ + iy, isolate the radical, square both sides, replace z by 
X + iy, and equate real and imaginary parts to obtain the two equations 


E E S [Qr + (x + y)sinà — $) (Y + (x — y)sinà + 4)] 


~ cos? A 
2 : 

2xy = ——— [(W + x sin A) (6 — y sin à)] 

COS^ À 


which can be solved for $ = $ (x, y, A) and y = w(x, y, A). The resulting expressions are 
large and cumbersome, but for A = 0 the relevant solutions are 


w(x, y,0) = ave + /B,B- and $(x,y,0) = gc 


where œ = y? — x? — 1, B4 = x? + (y +1)”. In the upper half-plane, the complex poten- 
tial is F(z) = $ + iy, and in the lower half-plane it is — F (z). Figure 36.58 shows the 
streamlines for A = L, The accompanying Maple worksheet contains animations of the 
flow field and of the velocity vectors as A varies from 0 to 1. “ 


Flow down a step Flow with complex potential F(z) = Az in the z-plane is mapped 
by the function w = f(z) = iQ z? — 1+arccoshz) to flow down a step in the w-plane. This 


—: 

=! 0 1 
FIGURE 36.60 Streamlines in Example 
36.54 


EXAMPLE 36.55 
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is an example where the simpler flow in the z-plane is mapped to a more complicated flow 
in the w-plane. Because of the algebraic difficulty of writing an expression for the inverse 
map from the w-plane back to the z-plane, the flow is studied in the w-plane. 

In f(z), use the definition 


Dele /|z2 e gi Lrg -- T Arg 0] 


so that the square root is discontinuous (has its branch cut) along —1 < x < 1, y = 0 on 
the real axis. In addition, this root will map the half-ray x « —1, y = 0 to the half-ray 
u «0,v-— 1 in the w-plane. (The principal square root would map the same half-ray to 
the half-ray u > 0, v = 1 in the v-plane. The accompanying Maple worksheet contains 
an extended discussion of the behavior of the square root function in this example.) Figure 
36.59 shows the image, in the w-plane, of the real axis in the z-plane. The real axis becomes 
the "step down" in the w-plane. 


z-plane w-plane 
y v 
1 i 
> X - > u 
=i 0 i] 2 -1 0 l 
(a) (b) 


FIGURE 36.59 The mapping f(z) in Example 36.54 


Analytically, the complex potential for flow in the w-planeis G(w) — F(z(w)), where 
F(z) = Az. However, given the complexity of the mapping w = f (z), itis difficult to obtain 
an expression for z — z(w). If such an expression were available, the complex potential 
in the w-plane would then be G(w) = Az(w). Figure 36.60 shows the streamlines in the 
w-plane, images of the lines y — constant in the z-plane. 2% 


Flow over the Joukowski airfoil Let C be the circle |z — a| = c, passing though z = k 
and containing z = —k in its interior. The Joukowski map w = z + E transforms C to an 
airfoil. Hence, flow past circle C in the z-plane is carried by the Joukowski map to flow 
past the airfoil in the w-plane. The complex potential 


2 pid 


O E 


F(z)=4A (e a) + ) - T log(z — a) 


z—a 
mapped to the w-plane becomes the complex potential G(w) = F(z(w)). Thus, the Jou- 
kowski map must be inverted to provide z = z(w), which is then substituted into F (z). The 
flow around the airfoil is then studied in the w-plane and is not mapped back to the z-plane. 

For example, on the left in Figure 36.61 is z(t) = a + oe", the circle C through z = 
k = 1, witha = -i83 — 4i 4/3) and o = ` V/3. On the right is the image of the circle under 
w = z + 1, the Joukowski map, with k = 1. 

The complex potential for circulant flow past the circle C, with limiting velocity V4; = 
A-—l,is 


o? C 
F@=(z-a+- =) + -Log(z — a) 
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ke 


(b) 


FIGURE 36.61 Example 36.55: With 
k = 1, the Joukowski map takes the 


where now, we use the principal logarithm and the definitions of a and o given above. The 
streamlines for the flow past the airfoil in the w-plane are the images of the streamlines 
for the flow past C in the z-plane. To get the streamlines in the z-plane, write F(z) as 
F(x c iy) = (x, y) t iv G, y), where 


64 By c . 
g= f+ 2B +B + = arctan(f», f) 
64 Bo C 2 i 2 
y = Bo 27 B2 + p2 An In(By T B3) 


with 6) = x + L, Bo =y- v3. Figure 36.62 shows the streamlines, the level curves of 
v, whenc = 1. 


FIGURE 36.62 Example 36.55: For 
c = 1, streamlines in the z-plane 


Write the Joukowski map w = z 
à 


l as w(x +iy) = u + iv, where u = x + =>> 


p. Transform each point in Figure 36.62 by the function T : (x, y) > 
(u(x, y), v(x, y)), thereby obtaining Figure 36.63, showing the image in the w-plane of the 
flow in the z-plane. D 


cylinder in (a) to the airfoil in (b) and v = yz 


FIGURE 36.63 Example 36.55: For 
c = 1, streamlines in the w-plane 


EXERCISES 36.10—Part A 


Al. Define w = f(z) = vz — 1 =u + iv using the principal square 
root. Show that f(z) is continuous across the positive real axis. 
Then show that with this definition, f(z) transforms y* = 4x to 
v = cl. Hint: Write z = x + iy, and obtain (x — 1) + iy = 


. B 2 
u? — v? + 2uvi. Equate real and imaginary parts, set x = 2-, and 


f 
eliminate u. 


A2. In Example 36.47, with A = 1, evaluate V@ at (x, y) = (—1, —1). 
(—1,0), and (—1, 1) . 


A3. 


A4. 


36.10 Conformal Mapping of Elementary Flows 


The two-argument arctangent function appears in Example 36.48. 
Verify that 2 arctan(y, x) = T arctan 7 and that 
x arctan(y, x) — En arctan " 


In Example 36.48, let a — ES and evaluate V6 at (x, y) = (1, 1) 


A6. 


AT. 
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In Example 36.51, let o = 1, A = 1, à = = and evaluate Vó at 
(x, y) = (0, 3). 


In Example 36.53, evaluate y(0, 1.2, 0) and v/(0, —1.2, 0) when 
A =. 


when A = 1. A8. In Example 36.55, let c = 1, A = 1 and evaluate v (0, 3). 
AS. In Example 36.49, evaluate V@ at (x, y) = (4, D when A = 1. 
EXERCISES 36.10—Part B 
B1. Define s(z) = J/|zle’“©/?, where —7z < Argz < 7. Provide ellipse x? + 9y? = 9 to the exterior of the unit circle in the 
numerical, graphical, or analytical evidence, showing that s(z) is w-plane. 
just /z, the principal square root. (d) Show that z = g(w) = 2w + + is the inverse of f (z) and that 
B2. Define S(z) = J|z|e/** 9/7. where 0 < argz < 27. g(w) maps the exterior of the unit circle in the w-plane to the 
(a) Show that S(z) is discontinuous across the positive real axis. exterior of the ellipse x“ + 9y” = 9 in the z-plane. 
Arg z T(z) =0 (e) Since G(w) = Ale ^w + e^ /w] is the complex potential for 
(b) Show that arg z — Qn +Argz T(z) <0 and that flow around a circle in the w-plane, obtain F(z) = G(f (z)) 
as the complex potential for flow around the ellipse 
ae ee aa E A , where s(z) is as defined in x^ 9y* = 9 in the z-plane. 
A "im à (f) If A — 1, obtain a graph of the streamlines (contours of 
Exercise Bl. 3 x x de 
: . ie : VG, y) = ZGF (x + iy))) for each of A = 0, 5. —45,—$. 
(©) Wah this definition. at thesquarerooh shew c | maps (g) Show that the ellipse x? + 9y? = 9 is the streamline for which 
y“ = 4x to v = 1, not v = 1. dite, y) =O 
sud don thesstreamlines shown in Figure 36:44 canbe found os B10. Obtain the complex potential for circulant flow past the ellipse in 
the contours of the function —2Z(F(z — 1)). Thus, by : e i 
aA nan lS à Exercise B9. Obtain graphs of the streamlines for the case A — 1 
distinguishing between the upper and lower half-planes, the : à š ; 
"in T à and A = 0, at various values of c, the circulation constant. 
ordinary square root can be used to define this flow. à : : : : 
ND ] HMM Determine the location of any stagnation points. How do the 
B4. As a function of y, graph V (—2, y), the stream function whose stagnation points vary with c? Can the stagnation points be made 
streamlines are shown in Figure 36.46. to move off the ellipse? 
B5. Obtain and analyze the flow against the parabola y? = x. Graph B11. Define r(z) = V/1z2 + 1[eilreG-o*a 01/2. where 
the streamlines, the equipotentials, and the velocity vector field. —E carg(z +i) < à. 
B6. Obtain and analyze the flow against the wedge —5 < Argz < 4. (a) Show that r (z) is continuous except on the imaginary axis 
Graph the streamlines, the equipotentials, and the velocity vector between +i where it has a branch cut. 
field. ee a i= Arg(z—i)—2zy x<0O,y <1 
B7. Obtain and analyze the complex potential for flow into the closed (b) Show that arg(z — i) = Arg(z — i) else 
ed " s * 2t y = aiana a the (O— eetis salya 
equipotentials, and the velocity vector field. at arg(z + i) = Argíz 4-1) dup 
B8. Obtain and analyze the complex potential for flow through the slit (d) Show that 
—2<x< 2, y =0. Graph the streamlines, the equipotentials, Iz + LeitAee—D+Arc+i)-271/2 y < O, |y] <1 
and the velocity vector field. r(z)= i 
B9. Define eia um ii — 8] = Bfeilaree—2V2)+Are(e+2V2)1/2 where /|z2 + 1 Jei lArelz-i)+Arg(z+i)]/2 else 
=r < Argz < 7. s(z? z : 
E 0n "I (e) Show that r(z) — | " a 1) Ne) =e , Where s(z) is as 
(a) Show that o (z) is discontinuous on the real axis for =s(z* +1) RZ) <0 
—924/2. «'R() « 24/2. defined in Exercise B1. 
s(2—8 R20 B12. The complex potential for flow past the finite segment 
(b) Show that o (z) — —sG—8) R(z) <0’ where s(z) is between ci on the imaginary axis was shown to be 


as defined in Exercise B1. 


(c) Show that w = f(z) = i (z + o (z)) maps the exterior of the 


F(z) = cos Az? + 1 — iz sin À. For A = B: e» and EO obtain a 
graph of the streamlines as the contours of Z( F(x + iy)), where 


r(z) is as given in Exercise B11(e). 
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B13 


B14. 
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. In the upper half-plane, the flow whose complex potential is 
F(z) — z is mapped to the w-plane by the function given in 
Exercise 25, Section 36.6. Graph, in the w-plane, the images of 
the streamlines y — constant in the z-plane. Interpret the flow in 
the w-plane. 


In the upper half-plane, the flow whose complex potential is 
F(z) = z is mapped to the w-plane by the function given in 
Exercise 26, Section 36.6. Graph, in the w-plane, the images of 
the streamlines y — constant in the z-plane. Interpret the flow in 
the w-plane. 


Chapter Review 


1. 


. Using the technique detailed in Question 1, evaluate {> id 


For what class of functions F (o, B) will the substitution z = e? 

. 27 ] F 
transform the integral I T F(cos0, sin 0) dÓ to one for which the 
residue theorem applies? Show how to make the transformation. 


d 
2+cos 0--sin 6 * 


3. What conditions on f (x) will allow the integral IT. f (x) dx to be 


10. 


11. 


12. 


13. 


14. 


. Evaluate f^ 


. Evaluate f 


. Obtain the Cauchy principal value of i 


evaluated by contour integration? Describe the process by which 
the contour is closed and the integral evaluated. 


) x2-] . s d , 
oo EDA dx by the technique detailed in 


Question 3. 


. What conditions on f (x) will allow the integral JS, e"* f (x) dx 


to be evaluated by contour integration? Describe the process by 
which the contour is closed and the integral evaluated. 
OO xe72* dx 


ry; by the technique detailed in Question 5. 


—o0 


. Use residues and an indented contour to obtain the Cauchy 


principal value of f% 


xdx 
UL N 
oo (x*+1)(x-3) 
x!/ dx 
G2 D (x-1) * 


. Invert the Laplace transform F(s) = 5.4 by evaluating the 


Bromwich inversion formula via residues. 


Obtain the exponential form of the Fourier series for 
f(t)i21—2?,—1 «t <1. Showitis equivalent to the 
trigonometric form. 

Obtain the roots of x? — (c + 5)x + 10 = 0, and plot them as a 
function of the parameter c. Then plot the locus of roots in the 
complex plane. 


How many times does the contour C, given by 
z(t) = (2+ 5sint)e", 0 < t < 27, wrap around the point 2i? 
Verify by computing the winding number v(C, 2i). 


State the principle of the argument. Illustrate it with the function 
G(z) = zc anda circle with radius 2 and center at the origin. 

What is the extended principle of the argument? Explain how it can 
be used to determine the number of zeros a polynomial has within a 


B15 


B16. 


15. 
16. 


17. 


18. 


23. 


24. 


25. 


. In the upper half-plane, the flow whose complex potential is 
F(z) — z is mapped to the w-plane by the function given in 
Exercise 28, Section 36.6. Graph, in the w-plane, the images of 
the streamlines y — constant in the z-plane. Interpret the flow in 
the w-plane. 


In the first quadrant of the z-plane, the flow whose complex 
potentialis F(z) — z? is mapped to the w-plane by the function 
given in Exercise 27, Section 36.6. Graph, in the w-plane, the 
images of the streamlines in the z-plane. Interpret the flow in the 
w-plane. 


contour C. Illustrate with the polynomial z? + z + 1 and the 
contour C, which is the unit circle centered at the origin. 
What is the conformal property of an analytic function? 
The linear fractional transformation w — ec) is completely 
specified by how it maps three distinct points. Obtain the LFT that 
maps z = 0, 1, į tow = i, Q, 1. 


Verify that the LFT f(z) = %7, with pole at z = 1, has as its 
inverse, another LFT with a pole at w = 2. 


— 2z+1 
— , 


Verify that the LFT in Question 17 maps: 

(a) z(t) 2 t + (t — Di, a line through the pole z = 1, to a line 
through the pole w — 2. 

(b) z(t) = t + i, a line not through the pole z = 1, to a circle 
through the pole w — 2. 

(c) z(t) = e, a circle through the pole z = 1, to a line not through 
the pole w — 2. 

(d) z(t) = 2e" , a circle not through the pole z = 1, to a circle not 
through the pole w — 2. 


. State the Joukowski map and describe what it does to the z-plane. 
. Describe how to create airfoils with the Joukowski map. 
. Describe how to obtain the inverse of the Joukowski map. 


. Describe how the mapping w — z? is used to solve the Dirichlet 


problem on the first quadrant of the x y-plane when the prescribed 
boundary values are s(x, 0) = a along the x-axis and s(0, y) = b 
along the y-axis. 


For a plane fluid flow, what is the complex potential? What is the 
complex velocity? How does the complex potential capture the 
velocity field and the streamlines (which are the flow lines of the 
velocity field)? 

Why must a streamline for an incompressible and frictionless flow 
fall on a boundary? 


How are the flux and circulation for a plane flow computed from 
the complex potential? 


26. 
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Describe the flow whose complex potential is: 

(a) F(z) = Ae?z, A» 0. (b) F(z) = Az,A» O0. 
(c) F(z) = Alog(z — a), A > 0. 

(d) F(z) = —i B log(z — a), B > 0. 


. Describe how the mapping w = vz — | is used to solve for the 


flow around the parabola y? = 4x. Show how the mapping takes 
the parabola to a simpler geometry in the w-plane where the flow is 
easily obtained. Then show how mapping the flow back to the 
z-plane provides the solution to the original problem. 


. Describe how the mapping w = yz — 1 — i maps flow against the 


parabola y? = 4x to a simpler flow in the w-plane where the 


29. 


30. 


31. 
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complex potential is more easily obtained. Then show how 
mapping the flow back to the z-plane gives the desired solution to 
the original flow problem. 


Describe how the mapping w = sin z is used to solve for the flow 
into the closed channel —= < R(z) < Z. 


Describe how the problem of planar flow past a cylinder is solved 
by conformal mapping to a simpler geometry. 


Describe how the problem of planar flow down a step is solved by 
mapping a simpler flow to the desired “complicated” flow. The 
technique in this case is therefore not the same as the technique 
used in Questions 27-30. 


UNIT EIGHT 


ical Methods 


Ica 


Numer 


Equations in One Variable—Preliminaries 


Chapter 37 

Chapter 38 Equations in One Variable—Methods 
Chapter 39 Systems of Equations 

Chapter 40 Interpolation 

Chapter 41 Approximation of Continuous Functions 


Chapter 42 
Chapter 43 
Chapter 44 
Chapter 45 


As it stands, Unit Eight is by far the longest unit in the text. However, the atten- 
tion devoted to numeric computations is by no means unwarranted. Problems 
solvable “by hand” and even by closed-form analytic techniques are a mi- 
nuscule portion of the spectrum of engineering and scientific analysis. By far, 
the greatest portion of modern applications requires numeric computation of 
some form. For as much attention as we have given numeric methods, we 
have barely scratched the surface. 

The calculators and computers with which we typically execute nu- 
merical methods are fixed-precision machines. Their architecture limits the 
number of digits with which each number can be expressed. This is a source 
of roundoff error in all numeric work. Thus, we must begin with a discussion of 
accuracy so that we can determine if roundoff has invalidated a computation. 
We must also examine the way roundoff error occurs and what steps can be 
taken to prevent or mitigate it. 

Numeric algorithms are judged by their ability to provide accurate re- 
sults with a minimum of computational effort. Viable iterative methods gener- 
ate a sequence of values that converge to the correct result. The rate at which 
this convergence occurs is an important characteristic of all such methods. 

Up to this point in the text, we have freely made use of packaged 
software for numerically solving algebraic or differential equations and eval- 
uating integrals. In this unit we discuss methods for solving single algebraic 
equations and systems, both linear and nonlinear, stressing how to select, 
use, and assess such solvers. A generation ago, use of a numerical method 
required the ability to write computer programs. Today, the typical user of 
a numerical solver will invoke a professionally written package and will not 
write a computer program. However, today's consumer of numerical solvers 
will still need to understand how such solvers work, what their strengths and 
weaknesses might be, and how to interpret their results. 


Numeric Differentiation 

Numeric Integration 

Approximation of Discrete Data 
Numerical Calculation of Eigenvalues 


We then take up the study of methods for passing smooth curves 
through discrete data points. Closely related to this problem of interpolation 
is our discussion of techniques for approximating continuous functions. In 
a sense, if discrete data points are selected along the graph of an unknown 
function, the approximation problem becomes the interpolation problem. This 
is the problem of approximating discrete data. We can pass smooth curves 
through each ofthe data points, either a single curve or a piecewise compos- 
ite of arcs that form a "spline." Alternatively, we can try to represent the data 
points with a least-squares curve, one that passes as near to as many of the 
data points as possible. 

There are two chapters on numeric calculus, both differentiation and 
integration. Our discussion of numeric differentiation introduces the very im- 
portant Richardson extrapolation algorithm that takes two approximations, 
one less accurate, one more accurate, and from them, extrapolates a "best" 
approximation. 

Numeric integration techniques such as the Trapezoid rule and Simp- 
son's rule are generally staples of the elementary calculus course. Hence, we 
review these equispaced methods and embed them in the general family of 
Newton-Cotes quadrature formulas. We describe how an adaptive Simpson's 
rule would be constructed, and we discuss the Gauss-Legendre quadrature 
formulas that are not equispaced. Error is minimized by varying the nodes at 
which the integrand is sampled! 

We conclude the unit with a chapter devoted to the numeric compu- 
tation of eigenvalues. None of the methods used for this task begin with the 
characteristic polynomial. Early in the unitthe problem of computing the zeros 
of a polynomial is shown to be inherently unstable. Modern methods for com- 
puting eigenvalues are iterative and generally involve results from the matrix 
algebra we studied in Unit Six. 
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Chapter 37 


Equations in One 
Variable —Preliminaries 


INTRODUCTION We begin our study of numerical mathematics with a 
discussion of accuracy and error. When any algorithm yields a numeric answer, the shrewd 
practitioner immediately asks “how accurate is this answer?" It is not reasonable to com- 
pute to 20 decimal places an answer that cannot possibly be accurate to more than three. 
Consequently, in a world where access to software tools is so prevalent, the user must bring 
to computation the ability to understand and interpret the outcomes of numeric calculations. 

A first step in this understanding and interpretation is distinguishing between a numeric 
answer being correct to a specified number of significant digits or being correct to a specified 
number of decimal places. Typically, computation is done on hardware devices that can 
compute with only a fixed number of digits. This limitation generates roundoff errors, 
errors attributable to the finite precision of the computing devices being used. Users of 
computer algebra systems that, in software, emulate machines of arbitrary precision cannot 
ignore the issue of roundoff error by deciding that the cure is simply to use more digits. 
No matter the precision with which a computation is executed, the potential for roundoff 
always exists and must be understood and dealt with. 

We use root-finding algorithms to discuss the rate of convergence of an iterative process 
to its limit. It is not enough that a method eventually provides an answer. It must do so 
rapidly. Not only can it be expensive to perform excessive calculation, but the additional 
arithmetic can make the accumulation of roundoff error more likely. Hence, the notion of 
the rate of convergence is the focus of a discussion in which the terms linear, superlinear, 
and quadratic convergence appear. 


Accuracy and Errors 


Introduction 


Although the chapter on numerical methods comes late in this text, we have not eschewed 
using numerical computations because we have relied on computer algebra systems to 
supply easily accessed numerical routines. Thus, we have solved differential equations, both 
ordinary and partial, computed eigenvalues and eigenvectors, and solved both linear and 
nonlinear algebraic equations by invoking numeric algorithms built into modern software 
packages. 


EXAMPLE 37.1 


37.1 Accuracy and Errors 943 


This book is predicated on the conviction that the typical student will not write code 
for implementing numerical methods. The prevalence of readily available high-quality code 
suggests that writing and debugging code for simple tasks like finding roots is akin to 
computing square roots “by hand." However, we recognize the value of having the student 
understand the underlying algorithms and of having the student gain an awareness of the 
potential problems that routinely arise during numeric computations. 


Lest the student falsely believe that access to a numeric solver permits thinking to cease, 
consider the following example tailored after a similar one found in [98] as reported in 
[2]. Start with the polynomial f(x) — It. (x — k), whose roots are exactly the integers 
1,2555 20. In expanded form, the polynomial is 


f(x) = x? — 210x? + 20615x 5 — 1256850x!" + 53327946x 5 — 1672280820x ^ 
+40171771630x'4 — 756111184500x P + 11310276995381x? 
— 135585182899530x'! + 1307535010540395x!° — 10142299865511450x? 
+ 63030812099294896x* — 311333643161390640x7 + 1206647803780373360x° 
— 35999795 17947607200x° + 803781 1822645051776x* — 12870931245150988800x° 
+ 13803759753640704000x? — 8752948036761600000x + 2432902008 176640000 


Subtract 27? = 0.1192092896 x 107 from —210, the coefficient of x!°, a small per- 
turbation, indeed. The zeros of the perturbed polynomial, computed to 30 digits and rounded 
to 25 places, are listed in Table 37.1. 


0.9999999999999999999999990, 2.000000000000000009762004 


2.999999999999805232975829 4.00000000026 1023189249615 
4.99999992755 1537879647781 6.000006943952298574282479 
6.9996972339358890737881 13 8.007267603453442209170021 


8.9172502484881 18660855120 

10.095266 1450674392 1499003 + 0.643500903962301678325 1460i 
11.79363388101464215867614 + 1.652329728287250339820714i 
13.99235813719123104650426 + 2.518830069793763949274017i 
16.73073746610398055504170 + 2.81262489446 1591259362997: 
19.50243940059550307499439 + 1.940330346820607238200480i 
20.84690810162158266985602 


TABLE 37.1 Zeros of the perturbed polynomial in Example 37.1 


A number of complex zeros have appeared, some of which are at a considerable distance 
from a real integer, as can be seen from Figure 37.1, a plot, in the complex plane, of the zeros 
listed in Table 37.1. We have accurately computed the zeros of the perturbed polynomial 
that is very near the original polynomial, but the zeros of each are considerably separated. 


Imag 
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FIGURE 37.4 Zeros of the perturbed polynomial in 
Example 37.1 
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We must conclude that the roots of a polynomial are extremely sensitive to small changes 
in the coefficients. This sensitivity is not caused by the solution technique but is inherent in 
the polynomial. 

The perturbation in a coefficient could easily have been introduced by the very ac: 
of entering the polynomial into a computing device that stores the coefficients with finite 
precision in binary arithmetic. Alternatively, there could have been roundoff in calculations 
leading to the stored polynomial. In either event, the associated solver then accurately 
finds the zeros of the perturbed polynomial. This is but one example of difficulties tha: 
can occur when computing numerically with finite-precision devices. Later in this section 
we will examine numeric errors that can enter calculations performed on such devices anc 
conclude that some basic knowledge of numeric computation is essential for intelligent us 
of all numeric software. Q 


Rounding to k Decimal Places 


To round x, a positive decimal number, to k decimal places, chop x + 0.5 x 107% after the 
kth decimal digit. To round a negative decimal number, round its absolute value and then 
restore the sign. Table 37.2 shows the effect of rounding the numbers 123.0065492 anc 
—123.00654982 to k decimal digits. 


k 123.0065492 —123.00654982 
0 123 —123 

1 123.0 —123.0 

2 123.01 —123.01 

3 123.007 —123.007 

4 123.0065 —123.0065 

5 123.00655 —123.00655 

6 123.006549 —123.006550 

7 123.0065492 —123.0065498 

8 123.0065492 —123.00654982 


TABLE 37.2 Rounding numbers to k decimal 
places 


Accurate to k Decimal Places 


We say that X approximates x to k decimal places provided |x — X| < } x 107%. Asa con- 
sequence of this definition, if both x and X are rounded to k decimal places, then the Ath 
decimals in the rounded versions differ by no more than one unit. 

For example, the two numbers x = 12.34 and X = 12.387 differ by |x — X| = 0.047 < 
0.5 x 107! = 0.05 so X approximates x to 1 decimal place. Rounding x and X to the k = 1 
decimal place, we obtain x, = 12.3 and X, = 12.4, respectively, and x, and X, differ in the 
first decimal place by no more than one unit. When X approximates x to k decimal places. 
we sometimes say that these two numbers agree to k decimal places. However, this does 
not mean that both numbers are necessarily the same when rounded to k decimal places. 


Significant Figures 


The leading (or most) significant figure in a decimal number is the leftmost nonzero digit 
The least significant figure is the rightmost digit. All digits in between are considered 


k Significant 


Digits X = 0.0026450 
l 0.003 
2 0.0026 
3 0.00265 
4 0.002645 
3 0.0026450 
TABLE 373 Significant figures 
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significant. Thus, zeros to the left of the first significant figure are not considered significant 
digits. For example, in the number X — 0.0026450, the first significant digit is 2 and the 
rightmost zero is the fifth significant digit. The result of rounding X to k significant digits 
is shown in Table 37.3. 


Accurate to k Significant Figures 
If |x — X| < 5 x 107*|x|, or equivalently, if 
x—ixl0*|x| < X « x c 1 x 107*|x| 


then the floating-point number X approximates x to k significant figures. Thus, X = x to, 
whereo < } x 10~*|x|; soif x and X are both rounded to k significant figures, their kth sig- 
nificant digits will differ by at most 1. Table 37.4 illustrates this for x = m = 3.141592654. 
As a function of k, the number of significant digits, the error band on either side of x is 
then d(k) = 0.5 x 107*|x|. The number of significant figures is given in the first column. 
The second column contains the intervals [x — d (k), x + d (k)]; numbers interior to these 
intervals approximate z to k significant digits. In the third column, the bounds on that 
interval are rounded to k significant digits, and finally, in the last column, z is rounded to 
k significant digits. 


k [x — d (K), x + d(k)] Interval Rounded x Rounded 
1 [2.984513021, 3.298672287] [3.0, 3.0] 3.0 

2 [3.125884691, 3.157300617] (3.1, 3.2] Sul 

3 [3.140021858, 3.143163450] [3.14, 3.14] 3.14 

4 [3.141435574, 3.141749734] (3.141, 3.142] 3.142 

5 [3.141576946, 3.141608362] [3.1416, 3.1416] 3.1416 

6 [3.141591083, 3.141594225] [3.14159, 3.14159] 3.14159 

y [3.141592497, 3.141592811] [3.141592, 3.141593] 3.141593 

8 [3.141592638, 3.141592670] [3.1415926, 3.1415927] 3.1415927 


TABLE 37.4 Approximating 7t to k significant figures 


For example, the numbers X = 3.1415699864 and x , rounded to 5 significant figures, 
are both 3.1416, but rounded to 6 significant figures, are respectively 3.14157 and 3.14159. 
Thus, X approximates z to 5 significant figures but not to 6. In fact, X lies in the interval 
[3.141576946, 3.141608362], an interval inside of which all members approximate 7r to 5 
significant figures. 


Machine Epsilon 


The typical computer or calculator is a fixed-precision device. The number of digits the 
device can manipulate is fixed by its hardware configuration. Hence, numeric computing 
must take into account the limitations imposed by this architecture. One of these limitations 
is the existence of £y, the machine epsilon, the smallest positive number the device can add 
to 1 while recognizing the sum is different than 1. 

To determine ¢ computationally, find the smallest positive e for which 1 +€ Æ 1. For 
example, if a computing device gives 1.000000001 for 1 + 107? but 1 for 1 + 10719, we 
would conclude that 107!9 < ey < 107? and we would call the device a 10 significant-digit 
device. 
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EXAMPLE 37.2 


A more dramatic example of the effects of finite precision on a calculation is the following 
computation of a derivative by discrete arithmetic. Evaluation of the difference quotient 
ede for decreasing values of can produce unexpected results on a finite-precision 
device. Table 37.5 lists the results of this calculation for the function f(x) = e*, at x = 1, 
with h = 107*, The second column shows the results on a 10 significant-digit device, and 
the third column, on a 15 significant-digit device. 


k 10 digits 15 digits 

1 2.85884196 2.8588419548738 
2 2.7319187 2.731918655787 
3 2.719642 2.71964142253 
4 2.71842 2.7184177470 

2) 2.7183 2.718295419 

6 2.719 2.71828318 

7 2,12, 2.7182819 

8 2.8 2.718281 

9 3.0 2.71828 
10 0 2.7182 
11 2.718 
12 2.718 
13 2.7 
14 2.0 
15 0 


TABLE 37.5 Example 37.2: Loss of significant 
figures when evaluating a difference quotient on a 
finite-precision computing device 


As h gets smaller, the accuracy of the calculation in the second column first increases and 
then decreases dramatically until the value computed for e = f’(1) is completely corrupted. 
In the third column, again, as / decreases, the approximation to e = f’(1) at first improves 
and then worsens until it becomes completely erroneous. With an increase in the number of 
digits available, there is a delay in the onset of catastrophic error. However, no matter how 
many digits are used, at some point, as long as the calculation is performed in fixed-precision 
arithmetic, catastrophic error can occur. < 


Error Propagation 


Numeric computing on fixed-precision devices is subject to roundoff errors attributable to 
the limited number of digits such machines provide. These errors are listed in Table 37.6. 

The existence of a machine epsilon is the source of negligible addition. The example of 
numeric differentiation in the previous section illustrates negligible addition in f (1 + h). 
subtractive cancellation in f (1 +h) — f (x), and error magnification in the division by h. 

To examine each of these errors in detail, define the numbers p = 654.9581, g = 
655.1389, r = 0.014897, s = 128761 and P = 655.0, Q = 655.1, R = 0.01490, § = 
1.288 x 10°, their representations when rounded to four significant digits. Table 37.7 sum- 
marizes five exact arithmetic calculations, the answers to which have been rounded to four 
significant digits. Table 37.8 shows those same calculations performed on a device tha: 
carries just four significant digits. 
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Error Description 

Negligible Adding (or subtracting) two numbers of 

addition sufficiently different magnitudes that the result 
rounds to the larger number 

Creeping The accumulation of error arising from 

roundoff repeated rounding to K significant digits 

Error An erroneous number is multiplied (divided) 

magnification by a large (small) magnitude 

Subtractive Subtracting two nearly equal numbers whose 

cancellation difference resides in significant digits beyond 


the capacity of the computing device to record 


TABLE 37.6 Types of roundoff errors possible on a finite-precision 
computing device 


Exact Arithmetic Rounded to 4 Significant Digits 
p — r = 654.9581 — 0.014897 = 654.943203 654.9 
q +s = 655.1389 + 128761 = 129416.1389 1.294 x 10? 
qs = (655.1389)(128761) = 84356339.90 8.436 x 107 
) 654.958 á 
PL = 43965.77163 4.397 x 10* 
p — q = 654.9581 — 655.1389 = —0.1808 —0.1808 


TABLE 377 Exact arithmetic rounded to 4 significant digits 


Computing with 4 Significant Digits 


P — R = 655.0 — 0.01490 = 655.0 

Q + S = 655.1 + 1.288 x 10° = 1.295 x 10? 
QS = (655.1)(1.288 x 10°) = 8.438 x 107 
& = quus = 4396 x 104 


P—Q9-2655.0— 655.1 = —0.1 


TABLE 37.8 The calculations in Table 37.7 
performed on a device carrying 4 significant digits 


NEGLIGIBLE ADDITION Comparing p — r (rounded) to P — R, we see that roundoff error 
has crept into the fourth significant digit. Comparing q + s (rounded) to Q + S, we see that 
again there is a difference in the fourth significant digit. 


ERROR MAGNIFICATION Comparing qs (rounded) to QS, we find the two answers would 
differ, in absolute terms, by the substantial error of —20000. Comparing ê (rounded) to 2, 
we again find a difference in the fourth significant digit. 


CREEPING Rounporr [n each of the calculations p — r, qs, 2, and q + s, the result of 


r? 


working in four significant digits as opposed to working “exactly” and then rounding is a 
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loss of precision in the fourth significant digit. Each of these calculations illustrates creeping 
roundoff, the gradual loss of precision as repeated rounding errors accumulate. 


SUBTRACTIVE CANCELLATION Comparing p — q = —0.1808to P — Q = —0.1, weagain 
find significant error introduced by working in fixed-precision arithmetic. 


Minimizing Roundoff Errors 


Even implementing familiar “exact” formulas on fixed-precision devices can lead to errors 
For example, the quadratic formula gives —5000 + 4/24999999 as the exact solutions to the 
equation x? + 10000x + 1 = 0. To 10 significant digits, these solutions are —0.000100 and 
—9999.999900, but to 7 significant digits, they are 0 and —10000.00. Thus, the familiar 
exact formula for the roots of the quadratic equation might not be enough to guarantee 
accurate results on a fixed precision device. The problem is the subtractive cancellation. 
which occurs in the first root. 

For use with fixed-precision arithmetic, the familiar quadratic formula can be trans- 
formed (by rationalizing the numerators) into the more accurate 


2c |b| + V b? — 4ac 
2a 


rı = — signum(b) ———— ————— n = — signum(b) (37.1 


|b| + Vb? — 4ac 
if the roots are real. In 7 significant digits, the roots of the given quadratic equation be- 
come, with these new formulas, —0.000100 and —10000.00, respectively. Thus, even on 
a 7 significant-figure device, the modified form of the quadratic formula produces correct 
results, whereas the “usual” form does not. 


EXERCISES 37.1—Part A 


Al. Express sin 1 as a decimal number rounded to 6 decimal digits. AS. Find the interval containing all numbers that approximate 2 to 5 
decimal digits, and then find the interval containing all numbers 


A2. Express tan 2 as a decimal number rounded to 6 significant digits. 
that approximate 2000 to 5 decimal digits. 


A3. Find the interval containing all numbers that approximate e to 7 


decimal digits. A6. Find the interval containing all numbers that approximate 2 to 5 


significant digits, and then find the interval containing all numbers 


A4. Find the interval containing all numbers that approximate e to 7 > d s ge 
= PP that approximate 2000 to 5 significant digits. 


significant digits. 


EXERCISES 37.1—Part B 


B1. Find the machine epsilon for at least one computing device to In the pairs (x, y) given in each of Exercises B12-23, y is an approxi- 
which you have access. mation to x, which is assumed to be exact. 
In Exercises B2-11: (a) Determine the highest number of significant figures to which 


. . y approximates x. 
(a) Round the given number to 2, 3, 4, 5, and 6 decimal places. p . : , op: , 
(b) Determine the highest number of decimal digits to which y 


(b) Round the given number to 3, 4, 5, 6, and 7 significant figures. approximates x. 


B2. 252.7813620 ^ B3. 89.65556978 B4. —1393.357143 B12. (68.73243953, 68.73237080) 
BS. 0.24808182873 B6. —614.9285714 — B7. —20.88039867 B43. (172.0217518. 171.8497300) 
B8. 6.292929293 B9. —5.262836186 B14. (6719.398767, 6786.592755) 


B10. 2097.558824 B11. —0.06886228 


B15. (0.05850096615, 0.05850681625) 

B16. (0.7410299638, 0.7410298897) 

B17. (0.002418045892, 0.002418070072) 

B18. (—190.376626, —190.376816) 

B19. (9777.216670, 9777.216572) 

B20. (—0.0002147347557, —0.0002147347578) 
B21. (—0.429583981, —0.429626940) 

B22. (—19.6505527, —19.6503562) 

B23. (0.0006524736264, 0.0006524736916) 


For the quadratic equations given in Exercises B24—33, find k, the 
smallest number of digits for which a k significant-figure device, using 


a/b? —4ac 


the quadratic formula in the form Eee will compute both roots 
correct to 7 significant figures. Find the smallest k for which (37.1) gives 


both roots correct to 7 significant figures. Use appropriate software or a 
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graph to determine the "correct" roots. 


B24. 
. 37x? — 90x + 0.127127845 x 1077 = 0 
. 80x? + 134266483x — 23 = 0 

. 88x? — 77x + 0.502150031 x 10-5 = 0 
. 40x? — 542501919x — 67 = 0 

. 66x? + 53x — 0.750235777 x 10-5 = 0 
. 81x? — 623851705x + 63 = 0 

. 92x? — 9x — 0.453825812 x 1078 20 
. 65x? + 202356318x +6 20 

. 66x? + 15x — 0.67945509 x 107? = 0 


45x? + 351120470x +8 2 0 


Rate of Convergence 


Linear Convergence of an Iterative Sequence 


Consider the sequence [xo, x1. . . . } generated by the iteration xz+1 = g(x). For example, 
if g(x) = 1+ 5 and xo, the “starting value,” is taken as 2 then the first few members of the 
resulting sequence are listed in the second column of Table 37.9. The third column contains 


the increments Ax; = x;441 — xg, and the fourth column contains the ratios Axty,1/ Ax. 


10? 


k Xk AxXk = Xk41 — Xk Axe 
Ax, 
0 = = 0.9000000000 LH i 
l 2$ = 1.450000000 H i 
2 $$ = 1.725000000 u 1 
3 = 1.862500000 n 1 
- 323 = 1.931250000 E i 
5 $ = 1.965625000 d i 
6 RO = 1.982812500 a I 
y Sue = 1.991406250 E 1 
8 3105 = 1.995703125 as 5 
9 10.22 = 1.997851563 wi I 
10 20.50 = 1.998925781 sum 
1 222 = 1.999462891 


P s j Xk 
TABLE 37.9 Linear convergence of the iterates x,,, = 1+ E 
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Although it would be easy to argue that the sequence {x;,} seems to be converging to the 
fixed point x — 2, the solution of the equation x — g(x), we are presently more interested 
in quantifying the rate at which the sequence converges. 

If the sequence {xg} converges, the increments Ax; in the third column must shrink tc 
zero. (The converse is not true. If x, = ys l thekth partial sum of the divergent harmonic 


series, then x41 — Xk = E so the süremelis Ax, go to zero, but x;, the members of the 
sequence, diverge to infinity.) 

The sequence {x+} is said to converge linearly provided the ratio of increments 
AXjy41/ Axy tends to a constant Cz, where 0 < |C;| < 1. For this sequence, the ratios 
of successive increments, found in the fourth column of Table 37.9, are all exactly Cz; = = 
and the convergence of the sequence to x — 2 is linear. In fact, we call this convergence 
exactly linear since Axx4; = Cr Ax, for all k > 0. 

The sequence{x;} is said to diverge linearly if the ratio of increments Ax;4;/Ax; tends 
to a constant Cz where |C; | > 1. 

The following theorem, whose proof can be found in [60], explains the behavior of 


linearly convergent or divergent iteration sequences. 


THEOREM 371 LINEAR CONVERGENCE THEOREM 


1. X = g(X).so x = X is a fixed point of the iteration xy,1 = g(x). 
2. g'(x) is continuous in a neighborhood of the fixed point X. 
3. 2(X)70 


=> 
1. {x;,} converges to X linearly, with Cz = g'(X) if 0 < |g/(X)| < 1. 
2. {xx} diverges linearly, with Cz = g'(X) if |g’(X)| > 1. 

3. 


[xx] converges or diverges slowly if g'(X) = +1. 


In the preceding example, we found Cz = 1 which is the value of g'(2). 


GENERAL STRUCTURE OF A LINEARLY CONVERGING SEQUENCE lt is informative to deter- 
mine a pattern for a sequence {sx} that is exactly linearly convergent. For example, if s; = 0 
and s, = r, the general term in a sequence that converges exactly linearly with convergence 
constant C is 


c! -1 
=r) car — (37.2) 


(See Exercise Al.) The increments are then As, = sj41 — Sk = rC*; so clearly, the ratios 
of successive increments are precisely the constant C. Appropriate conditions on C and r 
would then guarantee convergence rather than divergence. 


Quadratic Convergence of an Iterative Sequence 


Consider a sequence (xo, x1, ... ) generated by the iteration x41 = g(x), where g(x) = 
2S. a function with fixed points x — —3, 1. Table 37.10 lists, in column 2, the first 


few members of the sequence for which xo = 2. Apparently, the sequence converges very 
rapidly to the fixed point x — 1. Column 3 lists the corresponding increments, and column 
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AX 
k XK AXy = X41 — X ——— 
k k [221 k (Ax 
0 2.0 —0.7777777778 —0.3396226415 
] 1.222222222 —0.2054507338 —0.3947041787 
2 1.016771488 —0.01666046496 —0.3999644756 
3 1.000111024 —0.0001110185766 —0.3999999984 
4 1.000000005 —0.4930049719 x 1075 
5 1.000000000 
: "E 2x? +3 
TABLE 37.10 Quadratic convergence of the iterates x,,; = ibi 
Xk 


4 lists the ratios Axz41/(Ax,)?. The rapid convergence seen in this example is quantified 
by the following definition. 

The sequence {x+} is said to converge quadratically provided the ratio of increments 
Axz+1/(Axg) tends to a constant Cg 4 0, +00. If Axz41 = Co(Axi)? for all k > 0, we 
say the sequence is exactly quadratically convergent. 

Quadratic convergence is much faster than linear convergence because each successive 
increment is proportional to the square of the preceding one. In this example, it appears 
that the ratios Ax,41/(Ax,)* are tending toward the constant Co = -2, confirming the 
quadratic convergence of the sequence {x+} to the fixed point x = 1. 

The following theorem whose proof can be found in [60], explains the behavior of the 
quadratically convergent iteration sequence. 


THEOREM 37.2 QUADRATIC CONVERGENCE THEOREM 


1. X =g(X),sox = X is a fixed point of the iteration x,4,; = g(x;). 
2. g'"(x)is continuous in a neighborhood of the fixed point X. 
Se e (XN = 0 


=> {xz} converges to X quadratically, with Cg = -t g" (X). 


100 
(Ax -1)? 


In the preceding example, we found Cg = -i , Which is the value of g"(x) = 
evaluated at x — 1. 


GENERAL STRUCTURE OF A QUADRATICALLY CONVERGING SEQUENCE It is informative to 
determine a pattern for a sequence {sz} that is exactly quadratically convergent. For example, 
Table 37.11 lists s, As, = 5,41 — sz, and the ratios Asp (Os for a sequence whose 
convergence is exactly quadratic, with convergence constant C, and with starting values 
so = 0 and Sı ZF. 


Aitken's Acceleration Formula 


Aitken’s formula 
(sk — $4»? 


Sk — 2S1 + Sk-2 


Vk = Sk — 
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k Sk AS = Sk+1 — Sk TA 
0 0 r C 

l r r^c C 

2 PEFP rO C 

3 rO +7rC+4r rg C 

4 PG’ + PE Er CHE pigs C 

5 pl6cl5 p CT C rC Hr [RH 

6 720314 rC 4 C74 HC rC Hr 


TABLE 37.11 The structure of a sequence which is exactly quadratically convergent 


applied to three consecutive members of the exactly linearly convergent sequence s; — 
r eit C" = (rC*-! — 1)/(C — 1), where |C| < 1, yields y; = ise. the exact value of 
the fixed point of the sequence. (See Exercise A2.) Alternatively, if the Aitken formula is 
applied to s,,n = k — 2, k — 1, k, three successive iterates of a sequence that is linearly 
convergent but not exactly linearly convergent, then y; will be closer to the fixed point 3 
than s. Steffensen's implementation of Aitken acceleration, to be studied in Section 38.3 
can make a linearly divergent iteration converge and can make some linearly converging 
sequences converge quadratically. 


Superlinear Convergence of an Iterative Sequence 


Superlinear convergence is the middle ground between linear convergence and quadratic 
convergence. A sequence {x+} converging superlinearly would have its increments Ax; = 
Xk+1 — xy obey | Axp+1|/|Axz|? — Cs, where 1 < p < 2. Superlinear convergence is more 
rapid than linear but not as rapid as quadratic. 


EXAMPLE 373 For an example of a sequence that converges superlinearly, consider the sequence {xz} gen- 


erated by the iteration xy, = 8 (Xk, xy 1), where g(x, y) = EA This iteration function 
requires two starting values, which we take as xo = 5 and x; = 4. Then, the next iterate 
would be x2 = g(x1, xo). The fixed points, x = —3, 1, are the solutions of the equatioz 
x = g(x,x). For this sequence, Table 37.12 lists xy, Axy = x41 — xy, and the ratios 

k Xk Ax, = Yk — XE rea k Xk AX, = Xk+ — Xk rl 

0 5 ji 1.737 y 1.000019452607 0.1943915535387 x 1074 0.5644 

1 4 1.736842105263 0.2877 8 1 4- 0.1345 x 107? 0.1345156307500 x 1077 0.5697 

2 2.263157894737 0.7028466106901 0.7016 9 1 4- 0.1047 x 10-2? 0.1046671870034 x 10-? 0.5655 

3 1.560311284047 0.3966090364565 0.6042 10 1 4- 0.5632 x 10?! 0.5631792892315 x 10?! 0.5676 

4 1.163702247590 0.1352519276245 0.6800 11 1 + 0.2358 x 1074 0.2357855691984 x 10734 

5 1.028450319966 0.0267203357964 0.6006 12 1.0 

6 1.001729984169 0.0017105315622 0.5826 


TABLE 37.12 The superlinear convergence of the sequence in Example 37.3 


EXERCISES 37.2-Part A 


953 
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| Axpal/|Axi|?, where p = 1+v5 = 1.618033989. The computations were actually done 


with 50 digits in Maple. The empirical evidence supports the claim that the convergence to 


x = 1 is superlinear with p = 1v5 


and Cs approximately 0.6. $ 


GENERAL STRUCTURE OF A SEQUENCE CONVERGING SUPERLINEARLY [f the sequence 


k-1 
a —— 
= ) rPICe Ve) k>1 
n=0 
converges, the convergence will be superlinear with order p and positive, finite convergence 
constant C. This structure is derived in the exercises. 


Al. Establish (37.2) by recognizing the sum as a geometric sum. 


A2. Show that the application of Aitken's formula to three successive 


A4. Find all fixed points of x,.; = g (xx) if g(x) = x? + 2x — 20. Will 
the sequence {x,} converge to any of these fixed points? 


iterates of the sequence s, = r(C*! 


— r 
» — Pg 


1)/(C 


1) yields AS. Find all fixed points of x, = g (x+) if g(x) = 229, Will the 


2x+1 
sequence {xz} converge to any of these fixed points? 


A3. Using Table 37.11 with r — T so = 0, and C = 2, find 
Sj, k = 1, 2,3, the next three terms of the corresponding sequence 


that converges exactly quadratically. 


EXERCISES 37.2-Part B 


B1. Find all fixed points of xy,1 = gu, xii) if g(x, y) = 
Generate the first few members of the sequence {xz} if x; = 0 and 


X] = d. 


[n Exercises B2-11: 


(a) Show empirically that the iteration x;,; = g(x,), starting 
from the given xo, converges linearly. 


(b) Empirically determine the convergence constant Cz. 


(c) By solving the equation x = g(x), 


xy+20 


fe Lis 
EDI In Exercises 12-21: 


(a) Show empirically that the iteration x,4; = g(x;), starting 
from the given xo, converges quadratically. 
(b) Empirically determine the convergence constant Cg. 


(c) By solving the equation x = g(x), determine the fixed point 
X to which the iteration in part (a) converges. 


(d) Show that g’(x) = 0. 


determine the fixed point (e) Compare Cg with —3 g"(x). 


X to which the iteration in part (a) converges. 5,3 o. 
2 FE 26 + 3x 5 E" 
(d) Compare C, with g'(x). BIER, gian = mU. Lür- o 
B2. g(x) = 6x? +x? — 7x — 4, xo = —3 6x3 + 3x? +1 l 
B(x) = 6x T" x Xo E B13. g(x) = ea x "- 
B3. g(x) — 3x?--x?— 4x --2, X9 = 5 9x? + 6x +4 2 
, 3 i cid 8x3 4x? —3 
B4. g(x) = 7x? +2x? — 2x — 1, x0 = —§ B14. g(x) = c5 i pee 
B5. g(x) = —4x? — 8x? — 2x + 1, xo = —1.3 ar a 
n 6x? 5x? +1 
B6. g(x) = —3x3 + 5x? — 3x +1, xo = 0.9 B15. g(x) = (9x +10) , Xo = —2 
x(9x 
— 244 543 _ 92 TUNE: 2 
B7. g(x) = 3x 2x 2x* + 2, xo 5 10x3 — 3x2 —4 
B8. g(x) 2x — 2x3 — 5x? — 3x — 1, xo = E B16. g(x) = 15x? — 6x +2 iig em] 
B9. g(x) = 3x* — 4x? — Ax? Ax +2, xo = -5 — 3x* + Ax? + 5x? +1 J j 
B10. g(x) = 4x* +4x° — 2x? — 3x — 1, xo = —1 GET aS + 6x? + 10x lT 
Vea Sat up Sgt BE = De iss x* + 10x3 + 332 +4 
B11. g(x) = 3x^ + 2x° — 2x 2x — 1, xo = —0.9 B18. g(x) 3x" + 10x? + 3x* + ee 
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12x^ — 8x3 — x? 4-2 


B19. g(x) = X9 — —1 
800) = 7 — De AREE 
12x^ + 10:8 + x7 +4 
B20. g(x) = j=l 
g) 16x? + 15x? +2x +2 " 
6x* + 8x? — 5x? - 4 
B21. g(x) — , Xo = —2 
gen = Eg ie le dt 
In Exercises B22-31: 
(a) Use the given xo with x, = 1.02xo to obtain the iterates 


Xk+1 = 8 (Xk, Xy-1). 
(b) Show empirically that the convergence is superlinear with 
parameter p = ++ = 1.618033989. 
(c) Solve the equation x = g(x, x) for the fixed point(s) of the 
iteration. 
5x? y — 3xy + 5xy? +1 


B22. g(x,y) = ,X9 22 
gn T EE ae + 5xy—3—3y45y? 
x?y — Axy + xy? +4 
B23. g(x,y) = - : : Xp 232 
Eh, x? — 4x +xy+4-—4y+4 y? 
3x?y + 5xy +3xy? +5 
B24. g(x, y) = — P > a =z: X0 = —1 
3x? + 5x + 3xy — 5 + 5y + 3y? 
5x?y — xy + 5xy? — 2 
B25. g(x, y) = dm ds =: X0 = —2 


5x? — x + 5xy — 5 — y + 5y 


2xy +1 
B26. g(x, y) = —— PIE 
an FS Eee 
Sxy +4 
B27. g(x, y) = —— X9 = —2 
deca i 
xy txy? +1 
B28. g(x, y) = E 2 us cs. ME s 2 
EP KY Py? 
p2ixy A7 9 
H3 gue t TA oe 
X^ ey iy = 
Chapter Review 


1. What does it mean to say that x is a five decimal place 
approximation to 7? 

2. What does it mean to say that x approximates zr to five significant 
figures? 

3. What is the machine epsilon of a computing device? How can it be 
determined experimentally? 

4. What is a fixed-precision computing device? What is a 10 
significant-figure computing device? How can the precision of a 
computing device be determined experimentally? 


5. Name and describe four different types of roundoff error. 
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yx? T yx + xy? +2 


B30. g(x,y) = — 5 5 =, Xo = —2 
ype se WM dy 
xy+1 
B31. g(x, y) = — , Xo = —2 
x+1+y 


For the sequences x;, k = 0,1,..., given in Exercises B32 and 33: 


(a) Show the convergence is linear. 

(b) Determine the limit of the sequence. 

(c) Determine the convergence constant C; . 

(d) Apply Aitken's formula to xz, k = 5, 6, 7, thereby obtaining 
the limit from part (b). 


| og „a 21 
~ A3 B33. x, = 2 — — — 


B34. If the sequence {sz} converges quadratically, show that 
 — VW EO a O S) 
wS 4C ; 


B35. If the sequence {s,} converges superlinearly with order p, show 
k=1 (p 11) /(p— 
that Sk = Dono pe coio" D/GQ-D. 


B32. x, =3 


In Exercises B36—-40: 


(a) Show that x = a is a fixed point of the iteration 1,4) = g(x; 
(b) Find all values of a for which the convergence of the iteratior 
is linear. 
(c) Find all values of a for which the convergence of the iteratior 
is quadratic. 
B36. g(x) = x? + (8 — a)x? — (19 + 8a)x + 20a 
B37. g(x) = x* — xa — 75x? + (251 + 75a)x 
B38. g(x) = x? — (8 + a)x? + (8a — 19)x + 20a 
B39. g(x) = x? — (5 + a)x? + (5a — 83)x + 84a 
B40. g(x) = x^ — (12 + a)x? + 12x?a + 257x — 256a 


250a 


6. The truncation error of a numeric algorithm would be the inherent 
mathematical error made by the approximations used in the 
algorithm. How would this differ from roundoff error? 

7. What does it mean for an iterative numerical technique to converge 
(a) linearly; (b) quadratically; and (c) superlinearly? 

8. Under what conditions will the fixed-point iteration x;,1 = g(x) 
converge linearly? Under what conditions will it converge 
quadratically? 

9. What is Aitken's acceleration formula? Where might it be used, anc 
what effect might it be expected to have? 


Chapter 38 


Equations in One 
Variable —Methods 


INTRODUCTION Chapter 38 examines five methods for finding roots of 
equations (or zeros of functions). Two methods (fixed-point iteration and bisection) converge 
linearly, which is slow convergence. One method (Newton—Raphson) generally converges 
quadratically, which is rapid convergence. Two methods (secant and Muller) converge 
superlinearly, which is faster than linear but not as fast as quadratic. Other methods appear 
in the exercises. 

We begin by describing fixed-point iteration, a method that converges linearly. This is 
not a production method. It converges far too slowly and is too difficult to arrange so that 
convergence is assured. It is discussed so that the shortcomings of linear convergence will 
be fully understood. 

Next, we describe the bisection algorithm, which, if it starts by bracketing a root, is 
guaranteed to converge. However, it converges at a rate that is, on average, linear, with 
convergence constant +. Unfortunately, the bisection method does not generalize to higher 
dimensions. 7 

The Newton—Raphson method is generally quadratically convergent if started near 
enough to a root. Although the method can be deceived by pathological examples, it is 
generally regarded as a viable and robust solver. The method's need for derivatives can 
sometimes be a difficulty, but in an era of computer algebra systems that can provide 
symbolic expressions for even complicated derivatives, this objection is not as formidable 
as it once was. 

The secant method is a popular alternative to Newton’s method because it replaces the 
derivative with a difference quotient. However, the secant method converges superlinearly 
and not quadratically, so it is slightly slower than Newton's method. 

Newton's method can actually be used in the complex plane, where, however, it must 
usually be started very near to a complex root. Muller's method is an alternative because 
its iterates can move from the real line to the complex plane and back to the real line. It 
will generally converge to some root for almost any starting point. Again, in comparison to 
the quadratic convergence of Newton's method, Muller's method converges superlinearly, 
a slightly slower rate. 


955 


956 


Chapter 38 Equations in One Variable—Methods 


EXAMPLE 38.1 


Fixed-Point Iteration 


Finding Roots by Fixed-Point Iteration 


The method we will call “fixed-point iteration" is called functional iteration in [49], fixed- 
point iteration in [16], [42], [38], and [32], and repeated substitution in [60] and [85]. In 
addition, a case could be made for the terms Picard iteration and linear iteration. 

To find (by fixed-point iteration) a root of the equation f(x) = 0, write the equation in 
the form x = g(x) and apply the iteration xy44 = g(x). The starting value xo will matter. 
and so will the form chosen for g(x). According to Theorem 37.1, if x = X is a fixed point 
of the iteration, g'(x) is continuous in a neighborhood of X, and 0 < |g’(X)| < 1, then the 
sequence {x;} will converge linearly to X provided xo is sufficiently near X. 

The practical difficulties of writing the equation f(x) = 0 in terms of a function g(x 
for which the inequality 0 < |g’(X)| < 1 holds are substantial. Even if that hurdle is cleared, 
the resulting linear convergence is usually slow enough to warrant using a more powerful 
technique. Fixed-point iteration is included here to show how iteration works and to see 
how slow linear convergence actually is. 


Use fixed-point iteration to find the roots of the equation f (x) = 0, where 
f(x) = (x — 1)(x —2)@ — 3) = x? — 6x? + 11x — 6 (38.1) 
Solving for the x? term, we get x? = 6x? — 11x + 6, from which follows the iteration 
xc pm (6x? —llx+ 6) 


The roots of f(x) = 0 are obviously x = 1, 2, 3, so we obtain g’(1) = i gQ2)- B. and 
B= 2. Fixed-point iteration can be expected to converge for xp near x = 1 and x = 3 
but will diverge for xo near x = 2. Table 38.1 summarizes iterations starting from xo = 5, 0. 
and 2.0001. The iteration starting from xo = 5 converges very slowly to x = 3 because 
Cr = g'(3) is so close to 1. The iteration starting from xo = 0 converges linearly to x = 1. 
and the iteration starting from xo — 2.0001 diverges slowly but surely. 


k Xk Xk Xk 
0 5 0 2.0001 
1 4.657009508 1.817120593 2.000108332 
2 4.395093028 1.799098003 2.000117359 
3 4.189904570 1.779020177 2.000127138 
4 4.025726919 1.756601438 2.000137731 
5 3.892025504 1.731508797 2.000149207 
10 3.486190313 1.550110656 2.000222621 
15 3.290498975 1.231037079 2.000332147 
20 3.182355198 1.007146103 2.000495531 
25 3.117832357 1.000031235 2.000739231 


TABLE 38.1  Fixed-point iterates for Example 38.1 


The function g(x) is not the only way f (x) = 0 can be rearranged. For example, we 


could solve for the x? term, obtaining r= tx? + Hy — 1, from which the iteration 


x-—g(x)- ev 6x3 + 66x — 36 
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results. Again checking the derivative at each of the three fixed points, we find gj (1) = 
Z, ACD 2. and g((3) = B, This time, we are assured of convergence for xo near 
x = 2 but divergence for xo near x = 1 or x = 3. But again, the convergence to the 
fixed point at x — 2 will be slow because the derivative is nearly 1 at that point. Indeed, 
starting with xo — 2.2 yields a slowly converging sequence for which x, — 2.192715212 


and x25 = 2.075054707. 


Finally, we can solve the equation f (x) = 0 for the term in just x, obtaining the iteration 


x — g(x) = i(6 + 6x2 — x3) 


Again evaluating the derivative at the fixed points, we find g4(1) = 2, g3(2) = E, and 
g)3) = iD so we would have slow convergence to x — 1 or x — 3 and divergence for xo 
near x — 2. $ 
Graphics 


Geometrically, fixed-point iteration is explained in terms of a graph of the line y — x and 
the curve that is the graph of g (x). Clearly, where these two graphs intersect is a fixed point. 
Figure 38.1, generally called a “web diagram,” shows graphs of y(x) = x, g(x) = 14-2, 


and the iterates (b A a5 a, a} generated by x = g(x). The vertical lines represent the 

- progress of the iteration, starting from xo — b- The stair-step pattern arises from making 

0 I p 3 an output value, which is a y-coordinate, into an input value, which is an x-coordinate, by 
FIGURE 38.1 The progress of reflecting across the line y — x. The accompanying Maple worksheet contains an animation 


fixed-point iteration when g(x) — 1 4- 2 


EXERCISES 38.1 


that represents this dynamically. 


1. If f (x) is as given in (38.1), investigate the fixed-point iteration 


determined by writing x = f(x) +x = g(x). 


2. If f (x) is as given in (38.1), for what values of a will the 


fixed-point iteration determined by x — if) Fax) = g(x) 
converge when xo is near 2? 


For the cubics given in each of Exercises 3-12: 


(a) Determine all real zeros. 


(b) Arrange the equation f(x) = 0 as the fixed-point iteration 


Xev1 = gı (x4) by isolating x in the linear term in f(x). On the 


same set of axes, graph the line y = x and the curve y = gı (x). 


Carry out fixed-point iteration from an appropriate starting 
point xo and show it either converges to a real zero r found in 
part (a) or diverges. In either case, show that the outcome is 
consistent with the value of g! (r). If the iteration converges, 
check Ax; to see how many zeros appear just after the decimal 
point. A hallmark of linear convergence is the appearance of 
one more zeros at each step. 


(c) Repeat part (b) for x44; = g2(x;), a branch determined by 


isolating x in the quadratic term in f (x). 


(d) Repeat part (b) for xy,4 = g3(x;), a real branch determined by 


isolating x in the cubic term in f (x). 


3. f(x) = 60x? + 95x? + 95x — 18 
4. f(x) = 46x? — 20x? + 52x +31 
5. f (x) 2 38 — 23x? — 14x — 58 
6. f(x) = 46 — 12x? — 81x — 63 
7 
8 
9 


. f(x) = 54x? — 71x? + 71x 4-17 

. f(x) = 85x? + 36x? + 35x — 11 

. f(x) = 90x? + 31x? +47x — 50 
10. f(x) = 48x? + 36x? + 73x — 40 
11. f(x) = 6x? — 65x? + 52x + 99 
12. f(x) = 39x? — 49x? + 76x + 15 
In each of Exercises 13-20: 

(a) Determine r, and r2, (ri < r5), the fixed points of the iteration 
Xp = gx). 


(b) Determine all values of p for which the iteration converges 
linearly to rj. 


(c) Determine all values of p for which the iteration converges 
linearly to r2. 


(d) Determine all values of p for which the iteration converges 
quadratically to r1. 
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(e) Determine all values of p for which the iteration converges 15. 2(x) = x*4-px-— E ats 
quadratically to r2. i p+3 
(f) Determine initial values xo for which fixed-point iteration is l&r x? + px — L pA 
likely to converge to 7; when p = 16. ] pt+4 
r PETS n 2 > R " . á 2 - 2 à 
(g) Determine initial values xo for which fixed-point iteration is 17. g(x) = x" + px — - pis Tops x* + px — 33 pad 
likely to converge to r2 when p = —11. p=5 p-8 
2 Tes (2 p= x? + px — 55 x? + px — 54 
13. g(x) = : I o p#L 144.g(x)- : 2 A p#2 19. g(x) = = 6 ,P#6 20. g(x) = s 3 p #3 
The Bisection Method 
Bisection—the Concept 
If a continuous function f (x) changes sign between x = a and x = b, then there is at least 
one point c, a < c < b, for which f (c) = 0. For example, Figure 38.2 shows 
f(x) = arctanx — /2x — 5 (38.2) 
A has a root in the interval [3, 4]. 
» f(a) » 0 To turn this basic idea into an algorithm, evaluate f (x) at the midpoint of the interval 
SeT and determine the half-interval in which the sign-change resides. Keep the interval, now 
0.1 i half the original, in which the root resides. Continue until the root has been bracketed with 
0 m „Sufficient accuracy. ] 
In Figure 38.2, m — E = Z, the midpoint of the interval [3, 4], is marked with an 
«T " arrow. The sign-change resides in the left half-interval, namely, in [3, 1]. Hence, the subin- 
-0.2 + terval [3, 2] is retained and the process repeats. AII that is needed to flesh out an algorithm 
-03d is an efficient method for determining which half-interval contains the sign-change. This is 
f(b)<0 ^ done by examining the sign of the products f (a) f (m). If this is negative, then the function 
sid has opposite signs at these two endpoints, so the sign-change is in the left half-interval [a, m] 
FIGURE 38.2 The bisection method If the product is positive, then the sign-change in [a, 5] has to be in the right half-interval 
applied to f(x) = arctan x — /2x — 5 [m, b]. 


which has a zero in the interval [3, 4] 


Code for a Bisection Algorithm 


The following steps constitute the bisection algorithm. 


1. Test that f(a) f (b) < 0. 

2. Obtain m = —. 

3. If f(a) f(m) < 0, then b = m. Return to step 2. 

4. If f(a) f (m) > 0, then a = m. Return to step 2. 

5. If f(a) f (im) = 0, then stop since m is a root of f (x) = 0. 


EXAMPLE 38.2 Table 38.2 contains the output of the bisection algorithm applied to the function f (x) given 
in (38.2). The first column records the number of interval-halvings; the second gives the 
interval in which the root is located; the third is the midpoint of the interval just halved; the 
fourth is the function value, or residual, at the midpoint; and the fifth is the length of the 
interval in which the root is located. Clearly, the original interval is reduced by a factor of 
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k lo, £] m f (m) IB — «| 
1 [3.000000000, 3.500000000] 3.500000000 —0.121716894 1 
2 [3.250000000, 3.500000000] 3.250000000 0.047552524 i 
3 [3.250000000, 3.375000000] 3.375000000 —0.040134776 i 
4 [3.312500000, 3.375000000] 3.312500000 0.002854552 t 
5 [3.312500000, 3.343750000] 3.343750000 —0.018840941 3 
6 3.312500000, 3.328125000] 3.328125000 —0.008044899 a 
7 [3.312500000, 3.320312500] 3.320312500 —0.002608295 Bi 
8 3.316406250, 3.320312500] 3.316406250 0.000119823 * 
9 3.316406250, 3.318359375] 3.318359375 —0.001245058 3 
10 3.316406250, 3.317382813] 3.317382813 —0.000562824 wa 
11 [3.316406250, 3.316894532] 3.316894532 —0.000221552 xus 
12 [3.316406250, 3.316650391] 3.316650391 —0.000050878 mr 


TABLE 38.2 Results of the bisection method used in Example 38.2 


1/2* after k steps. Thus, the ultimate resolution of the method is the computing device's 
ability to distinguish two endpoints separated by a distance of |b — a|/2". When this distance 
becomes smaller than the machine epsilon, no further refinement of the root can take place. 


EXERCISES 38.2-Part A 


9. 
ksd 


Al. After n iterations of the bisection method, x,, the last midpoint 
computed, becomes the endpoint of the last interval kept and the 
latest approximation to the bracketed root. Hence, the maximum 
error in x, is the length of the last subinterval, or |b — a|/2". If x, 
must be determined with an error no greater than £, how large must 
n be? 


A2. Starting with the interval [a, b] = [0, 3], obtain the first three 
subintervals when the bisection method is applied to the function 


f(x)2x-1. 


EXERCISES 38.2—Part B 


A3. The bisection method samples the function f (x) at the midpoint of 


the current interval [o, 8]. The method of false-position is an 
alternate bracketing method wherein f (x) is sampled at £, the 
x-intercept of the line-segment connecting the points (o, f (o)) 


and (B, f (B)). Show that £ = poc a 


A4. Starting with the interval [a, b] — [0, 3], obtain the first three 
subintervals when the method of false-position is applied to the 
function f(x) =x — 1. 


B1. In the language of your choice, implement the bisection algorithm. 
Test your code by finding the zeros of f (x) = x? — 3x + 2. 


B2. In the language of your choice, implement the method of 
false-position as defined in Exercise A2. Test your code by 
finding the zeros of f(x) = x? — 3x +2. 


For the functions g(x) given in each of Exercises B3-12: 


(a) Use a graph to locate all real zeros. 


(b) Using the bisection method and the results of Exercise A1, 
compute the value of each real zero to a tolerance of 1077. 


(c) Use the method of false-position to compute each real zero, 
correct to 7 significant figures. 


B3. g(x) = 2x? —6x -3 B4. g(x) = 58 +2x? — 3x +3 
B5. g(x) = 3x4 — 3x3 + 5x? 43x — 1 
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3x3 — 7x? — 6x +7 6x? — 9x? — 4x — 9 3x? — 9x? — 8x — 1 
B6. g(x) = B7. g(x) = B10. g(x) = 
dein 974 Oe are ES) = a ox 7 8) = e - ae +1 
x? — 7x? +x47 7x? — 9x? + 4x +6 
B8. g(x) = B11. g(x) = 
80) — 3 E93 233 x 1 88) = "a — X5 9x 5 
4x? — x? - 2x — 9 5x3 — x? —4x 45 
B9. g(x) = B12. g(x) = 
8) 7x3 + 5x2 --2x +1 g(x) 8x4 + 7x? + 9x? + 4x — 8 
Newton-Raphson Iteration 
Newton’s Method—the Concept 
Newton-Raphson iteration finds zeros of a function f(x) by finding, instead, zeros of ap- 
proximating tangent lines. The sequence {x} generated by this method generally converges 
quadratically to a root of the equation f(x) = 0. The closer the initial point, xo, is to the 
root, the greater the likelihood, in general, the sequence will converge to that root. 
: For example, consider the function f(x) = arctan x — /2x — 5 that has a zero in the 
interval [3, 4]. The equation of the tangent line at xy — 2.6 is 
1.54- 


FIGURE 38.3 In Newton's method, a 
root of f(x) = 0 is approximated by the 
x-intercept of a tangent line 


EXAMPLE 38.3 


y = 6.235134095 — 2.107201999x 


found as the first-degree Taylor polynomial at xo. The x-intercept for this tangent line is 
xı = 2.958963639, which is closer to the root than xo, as seen in Figure 38.3. 
The equation of the tangent line constructed at x, is 


y — 3.071906228 — 0.9412418573x 


and its x-intercept is x2 = 3.263673629. The equation of the tangent line constructed at x- 
is y = 2.398324602 — 0.7233284742x, and its x-intercept is x3 = 3.315678406. It turns 
out that x3 is within 0.000899215 of the root, which is actually at x = 3.316577621. 


Toward a Newton Algorithm 


From our discussion, we see that the process of forming Newton iterates consists of the 
following steps. 


l. Let x; be the last Newton iterate found. 

2. At xz, construct the tangent line y = f'(x) (x — xy) + f (xx). 

3. Solve for the x-intercept on this tangent line, obtaining x = x, — f (xi)/ f ' (xx). 

4. Declare this x-intercept to be the next Newton iterate so that xz+1 = xy — f (xi)/ f Gr 
Thus, fixed-point iteration with x = g(x) =x — T5 generates the Newton iterates. 


The second column of Table 38.3 gives the Newton iterates, starting with xo — 2.6, for 
the function f(x) = arctan x — J/2x — 5. The third column gives the increments Ax; = 
X41) — Xg, and the fourth column gives the ratios Ax;+, / (Nx. The entries in the fourth 
column are consistent with the claim that the ratios Ax;,44/(Ax;)? converge to a constant 
Cg approximately 0.3097. Theorem 37.2 indicates this constant should be —39"(X) = 
0.3097038499, where X is the fixed point and g(x) = x — a3 Also, we note the doubling 
of the number of zeros after the decimal point in Ax. This is a hallmark of quadratic 


convergence. 
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AX 
k Xk AXy = Xk+1 — Xk r) 
0 2.6 0.35896 2.364752940 
1 2.9589636391 0.30471 0.5601055206 
2 3.2636736290 0.52005 x 107! 0.3323962178 
3 3.3165773705 0.89896 x 10? 0.3100656806 
4 3.3165773705 0.25058 x 1079 0.3097039502 
5 3.3165776210 0.19446 x 107» 
6 3.3165776210 


TABLE 38.3 Newton iteration applied to f(x) = arctan x — /2x — 5 in 
Example 38.3 


A computation shows that g'(X) = 0 for the Newton iteration function 
arctan x — 2x — 5 
i a 
x*+1 2x—5 
Thus, if g/(X) 4 0 for the fixed-point iteration x = g(x), the convergence to the fixed point 
X is linear; whereas if g'(X) = 0 but g"(X) Æ 0, then the convergence is quadratic. — ** 
F(x) 


For the general Newton iteration function G(x) = x — z^. we find G'(x) = 


so G'(x) = 0 at a zero of F(x) provided F'(x) Æ 0 at that zero. Moreover, 


F" x m x n x 2 
(x) ro( F'O) _ y") ) 
F'(x) Far (EPP 


F(x) F"(x) 
(F'(x))* ? 


G" (x) - 


so G(X) = CO at X, a zero of F(x). Thus, the quadratic convergence constant Cg = 


— i G"(X) must also equal - 


Sufficient Conditions for Convergence 


If f(r) = 0 but f'(r) Æ 0; and if f(x), f'(x), f"(x) are continuous in a neighborhood 
of x — r, then Newton iteration, which is actually fixed-point iteration with the iteration 
function g(x) = x — rm converges to r if xo is sufficiently close to r. 


Multiple Roots 


DEFINITION 38.1 


A function f(x) is said to have a zero of order m at x = r if f, f^, f",..., fOD 
all vanish at r but f™ (r) 4 0. 


Thus, if the function and the first m — 1 derivatives vanish at x = r but the mth derivative 
does not, then the function has a zero of order m at x — r. Equivalently, a function with a 
zero of order m at x = r can be written in the form f (x) = (x —r)" Q(x), where Q(r) Æ 0, 
an obvious representation based on a Taylor expansion at x — r. 
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fœ 


FIGURE 38.4 The function f(x) in 
Example 38.4 


EXAMPLE 38.5 


The function f(x) = In(cos x) + i sin x? has a zero at x — 0, as seen from its graph in 
Figure 38.4. The flatness of the curve in the neighborhood of x = 0 suggests the zero 
is of higher order than m = 1. To determine the order of the zero, obtain the Taylor ex- 


pansion — baxt axe S +--+, which obviously factors to (x — 0) Q(x), where 
Qx)-2-4- mx — hx ^5, and Q(0) £0. Alternatively, compute f(0) = 


f'(0) = f"(0) = f" (0) = 0 and f ?(0) = —2. The first nonzero derivative at x = 0 is 
the fourth, again indicating that the zero at x = 0 is of the fourth order. Hence, m = 4 at 


x. ^ 


LINEAR CONVERGENCE AT MULTIPLE Roots At a zero of order m, Newton's method 
converges linearly, with convergence constant Cz = zl A function of the form F(x) — 
(x — r)” Q(x), with Q(r) Æ 0, has a zero of order m at x = r. For the associated Newton 
iteration function G(x) = x — zo, we find by direct computation that G'(r) = “=! z 0 
whenever m > 1. Consequently, the convergence is linear, not quadratic, and Cz = e, 


The Newton iteration function for f(x) = In(cos x) + i sin x? is 


In(cos x) + 4 sin x? 


g(x) =x 5 
x cos x- —tanx 


Column 2 of Table 38.4 lists the Newton iterates xg, starting with xo = 1. Column 3 lists 


the increments Ax; = x44; — x4, and column 4 lists the ratios Ax; /Ax;. Motivated by 
Theorem 37.2, we compute g’(0) = i. consistent with the claim Cz = mot = Ll! = i and 


with the empirical evidence in the fourth column of Table 38.4. s 


k Xk AXky = Xk41 — Xk Aaa 
Ax; 

0 1 —0.191613 0.8515147856 
1 0.808387 —0.163162 0.8384593354 
2 0.645225 —0.136804 0.8247462283 
3 0.508421 —0.112829 0.8085081933 
4 0.395592 —0.091223 0.7920919548 
5 0.304369 —0.072257 0.7780616363 
6 0.232112 —0.056220 0.7676206188 
7 0.175891 —0.043156 0.7606068775 
8 0.132735 —0.032825 0.7562119694 
9 0.099910 —0.024822 

10 0.075088 


TABLE 38.4 Newton iteration applied to f(x) = In(cos x) + 1 sin x? 
in Example 38.5 


MopnirigD NEWTON ITERATION For a function of the form F(x) = (x — r)” Q(x), with 
Q(r) Æ 0, which has a zero of order m at x = r, the modified Newton iteration function 


m F(x) 
F'(x) 


generates a fixed-point iteration that converges at least quadratically. Direct computation 


Gmax) =x — 


leads to G;, (r) = 0 and G” (r) = 2g. Since the first derivative vanishes at x — r, the 


m 


EXAMPLE 38.6 


FIGURE 38.5 The three solutions of 
x — 2sinx in Example 38.7 


EXAMPLE 38.7 
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modified Newton iteration converges more rapidly than linearly. If Q'(r) 4 0, the conver- 
gence is quadratic, with Cg = —3(2) 28. If Q'(r) = 0, then the convergence is even 


more rapid than quadratic. In fact, if Q'(r) = 0, then G(r) = $9. which means that 
p q m mQ(r) 


for cubic convergence of the modified Newton iteration function, the convergence constant 


would be Co = 4($) £9. 


The modified Newton iteration function for f(x) = In(cos x) + H sin x? is 


In(cos x) + 5 sin x? 
Gm(x)=x— 4 = 


x cos x? — tan x 


Column 2 of Table 38.5 lists the Newton iterates x;, starting with x9 = 1. Column 3 lists 
the increments Ax, = xj441 — Xx, and column 4 lists the ratios Axz41/(Ax,)?. Using 


O(x) = £2, we find Cc = £o — 45 — 0.633, in agreement with the ratios in the fourth 


column. 4 
AXIGA 
k x Ax, = Xpa1 — X 
k k k+1 k (Ax,)3 
0 1 —0.76645341 0.5023607709 
1 0.2335465946 —0.22618979 0.6357048088 
2 0.7356806958 x 10? —0.73565548 x 10? 0.6333377124 
3 0.2521498847 x 1075 —0.25214988 x 1076 
4 0.1015333389 x 107! 


TABLE 38.5 Modified Newton iteration applied to f(x) = In(cos x) + i sin x? in 
Example 38.6 


STEFFENSEN’S METHOD As interesting as the modified Newton iteration might be, the 
reader should be skeptical of its practical value. In order to determine the order of a zero, 
one must know the location of the zero, in which case, why recompute it? 

As a more practical alternative in the face of linear convergence of Newton's method 
at an apparent multiple root, consider applying Aitken's acceleration process to a Newton 
iteration when it appears that convergence is being retarded by an apparent multiple root. 
The following implementation of this acceleration technique is attributed to Steffensen. 

When x; 2, Xx—1, Xi, three successive Newton iterates, appear to be converging linearly, 
use Aitken's formula 


(xk — xia? 
NEN 38.3 
Xk+1 = Xk Xp — 2Xg-1 + Xk-2 ) ? 


to generate xgz+1, the next iterate in the sequence. From xg+1, compute xg+2 and xg+3, two ad- 
ditional Newton iterates, and again apply Aitken acceleration to the triple (Xk+1, Xk+2, X43). 
Continue in this manner until convergence. (The reader is cautioned that Steffensen’s algo- 
rithm is something entirely different in [49].) 


The fixed-point iteration x = g(x) = 2 sin x should converge linearly tor = 1.895494267, 
one of the three solutions of the equation x = 2 sin x. (See Figure 38.5.) The convergence 
is linear since g'(r) = —0.6380450482 z 0. 

Column 2 of Table 38.6 lists xg, the Steffensen iterates computed via (38.3). Column 
3 lists Ax; = Xp41 — Xx, the increments between the Steffensen iterates; and column 4 lists 
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EXAMPLE 38.9 


k Xk AXk = Xk+1 — Xk T 

0 l 1.2324295 —0.2619674388 
1 2.232429 —0.3978977 0.3770358299 
2 1.834532 0.596933 x 107! 0.3560330600 
3 1.894225 0.126865 x 107? 0.3689291231 
4 1.895494 0.593780 x 1075 0.3691627331 
5 1.895494 0.130156 x 107? 0.3691628421 
6 1.895494 0.625398 x 10-76 

T 1.895494 


TABLE 38.6 Fixed-point iteration accelerated by Steffensen's method, 
converges quadratically in Example 38.7 


the ratios Ax;,4;/(Ax;)”, whose relative constancy argues for the quadratic convergence of 
the iteration. > 


Newton Iteration in the Complex Plane 


Newton’s method will converge to complex roots if the iteration can be moved off the real 
line. This can be done by starting the iteration at a complex number or by having the iteration 
itself generate a complex value. Thus, a Newton iteration can leave the real line to converge 
to a point in the complex plane or meander through the complex plane to converge to a point 
on the real line. 

In the days before the availability of electronic computing devices, working with com- 
plex numbers was tedious. In the early days of computing when the only realistic alternative 
was the language FORTRAN, manipulations with complex numbers became feasible but 
not easy. In modern computer algebra systems, complex numbers are routinely handled and 
a Newton iteration that swings into the complex plane does not require a change of data 
type as was required in a FORTRAN program. 

Lest there be premature celebration, we point out that the essential difficulty with using 
Newton’s method in the complex plane is locating the roots accurately enough so that viable 
starting values can be obtained. Because there is "so much extra room" in the complex plane 
iterations that do not start sufficiently near to a root might converge to a different root or tc 
the desired root more slowly than expected. 


An example of a Newton iteration that leaves the real line of its own accord, converging tc 
a fixed point in the complex plane, is afforded by the equation f(x) = x — vx — 5 = 0. Of 
course, this example is just a disguised form of the quadratic equation x? — x +5 = 0, which 
has the complex roots lii/19 = 0.5 + 2.1794494727. Starting from xo = 10, the Newtor 
iterates are then 0, 0.4761904763 + 2.129588551i, 0.4999847542 + 2.179417993i, and 
0.5000000001 + 2.179449472i. As predicted, Newton iteration has left the real line and 
converged to a fixed point in the complex plane. > 


The equation f(x) = ./x —* = Qis a disguised form of the quadratic equation x? —9x = 

whose roots are the real numbers 0 and 9. The Newton iterates, starting from the real number 
Xo = —5, are listed in Table 38.7. The iteration, starting from the real line, has wandered 
into the complex plane, only to converge to the (real) fixed point x = 9. > 


EXAMPLE 38.10 


-3 -2 =] 0 1 2 3 


FIGURE 38.6 The function in Example 
38.10 has no real zeros 
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Xo — —5 X4 = 8.952612441 — 0.087681943i 
xi = 1.551724139 + 2.313173770i Xs = 8.999844224 + 0.00023038420i 
X5 = 4.309230249 — 3.113854023i Xe = 9.000000000 — 0.19938 x 1075; 
x3 = 7.917951296 + 1.367009384i X; = 9.000000000 


TABLE 38.7 In Example 38.9, Newton iteration passes through the complex plane 


Anomalies 


In [24], two functions are given for which Newton's method exhibits pathological behavior. 
For the first, there is no zero, but Newton's method will claim there is. For the second, there 
is a zero that Newton's method will never find. Cycling, where the iterates repeat cyclically, 
is another possibility with Newton's method. We give examples of each of these behaviors. 


> — e px 41) ; AE 
Taken from [24], the function f (x) = ~D | part of whose graph is shown in Figure 
` A/ xt x?41 si 


38.6, has no real zeros. The behavior of the function as |x| — oo is determined by the limits 
Wrs f (X) = 60: ANE litmk-sss fX) = 0. 

Newton’s method applied to this function will falsely claim f(x) = 0 has a root x = 
r > 0. Column 2 of Table 38.8 lists x,, the Newton iterates starting from x9 = 0; and 
column 3 lists the increments Ax; = x,41 — xy. Although the iterates in column 2 do not 
seem to be converging, the increments Ax; appear to be decreasing, and any test based 
on the shrinking of the increments will suggest there is a root at some sufficiently large 
x. In fact, if computed in exact arithmetic, the iterates are x, = vk, so the sequence of 
iterates does not converge but the increments Ax, = /k + 1 — Vk tend to zero. The limit 
limyp-sco Vk + 1 — Vk, an example of the indeterminate form oo — oo, is seen to be zero if 
the two radicals are expanded for large k, giving Ax, = O(x7!/*). 

Thus, if Newton’s method is implemented to stop when successive increments become 
sufficiently small, it is possible for the iteration to declare there is a root where in reality 
there is none. For this example, even the residual f (vk) will be deceptively small for k 


sufficiently large because the right “tail” of f(x) tends to zero. $ 

k Xk Ax, = X41 — Xk 
0 0 1.0 

1 1.0 0.414213562 

2 1.414213562 0.317837245 

3 1.732050807 0.267949192 

4 1.999999999 0.236067978 

5 2.236067977 0.213421766 

6 2.449489743 0.196261568 

7 2.645751311 0.182675815 

8 2.828427126 0.171572875 

9 3.000000001 0.162277660 
10 3.162277661 0.154347130 
1] 3.316624791 


TABLE 38.8 Newton iteration applied to the 
function in Example 38.10 
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EXAMPLE 38.11 


FIGURE 38.7 The function 
f(x) = Jxe-* in Example 38.11 


EXAMPLE 38.12 
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Also taken from [24], the function f(x) = Sxe”, graphed in Figure 38.7, has a single 
zero, x = 0, to which Newton's method cannot converge. As in Example 38.10, f(x) tends 
to zero as |x| gets large. 

The Newton iteration function is 


(3) f(x)  2x8x? +1) 

xy = 

i fie) 63-1 

for which g'(0) = —2. Hence, Newton iteration for this function cannot converge. Worse 


yet, any stopping rule based on the increments Ax; = x;41 — x, will declare there is a root 
at some |x| > 0 because as |x;| gets large, the increments get small. Indeed, if at some point 
in the iteration we have x, = a, then the increment xy, — x, is g(a) — a; that difference 
is plotted as a function of a in Figure 38.8. Since the iteration is known to diverge, a will 
eventually get large; so the corresponding increments will become vanishingly small. Thus, 
since |x,| must eventually get large, the limiting value of the increments will be zero. +$ 


The function f(x) = vx? — 2x — 1 has two real zeros, 1 + /2. The Newton iteration 
function 


g(a)-a g(x) "e f(x) En 3 =P l 
AÀ d “ f(x) x-1 
34 
> has the property that g(g(x)) = x. Thus, no matter where the iteration is started, the second 
T iterate will be the initial one; hence, Newton’s method will simply cycle between xo, x1, and 
IT X? = xo. The sufficient condition for convergence of a fixed-point iteration is |g'(r)| < 1, but 
0 } } —4 L-a wefindg'(1 + A/2j = —]. Atneither zero of f (x) is the sufficient condition for convergence 
m 0.5 l L5 2 satisfied. % 
= gil. 
29i 
FIGURE 38.8 The function g(a) — a 
plotted as a function of a in Example 38.11 
EXERCISES 38.3—Part A 
A1. Obtain the Newton iteration function g(x) = x — € when A4. Obtain the Newton iteration function g(x) = x — 42 when 


f(x) =x? — 6x +8. 


A2. For g(x) in Exercise A1, show that g’(2) = g'(4) = 0. Determine 


Cg for fixed-point iteration with g(x). 


fo) fœ) 
f(x) =x2(x - 1. 
AS. For g(x) in Exercise A4, show that g'(0) = 


is SO. 


. Explain why this 


Nis 


A3. If xy = 2.5, obtain the next three Newton iterates for g(x) in 


Exercise Al. 


EXERCISES 38.3—Part B 


B1. Show that x = 0 is a triple zero of f(x) = tanx — xe-* by 
(a) showing f(0) = f'(0) = f"(0) = 0 but f" (0) z O. 


(b) using a Maclaurin series to write f (x) = x? Q(x), where 


Q(0) £0. 


B2. For f (x) in Exercise Bl, form the modified Newton iteration 
function G3; = x — ` ren Show that G% (0) = 0 and that 


f 
7 — 2Q'(0) y 
G3(0) ~~ 3Q(0) * 


In Exercises B3-14: 


B3. 
BS. 
B7. 
B8. 
B9. 


f(x) 


Fay" 

(b) Use Newton’s method to compute each of the real zeros of 
fo. 

(c) Show empirically that the convergence is quadratic, and 
estimate Co, the quadratic convergence constant. 


(a) Obtain the Newton iteration function g(x) — x — 


(d) For each real zero r, show analytically that g'(r) = 0. 


FO and that 


(e) For each real zero r, verify that g” (r) = 
Co = -E£ 

f(x) = 6x74 8x7 +10x+1 B4. f(x) = 9x3 — 332 — 7x +1 

f(x) =4x?—x?—5x +12 B6. f(x) = 11x? -- 5x? - Ax +6 

f@) =7x4 +x -—Tx? +x41 

fŒ) = 2x4 — 3x3 + 3x? — x —3 

f(x) = 9x* + Ax? + 6x? — 3x — 2 


B10. f(x) = 3x* — 5x3 — 5x? — 5x 4+ 1 
97 + 149x — 24x? 120x? + 67x — 61 
B11. f(x) se paje 
84x? — 94x — 57 25x* + 37x — 46 
246x? + 194x — 39 83x? — 17x — 81 
B13. f(x) = B14. f(x) = 
POT a ae 6 FO) = 69324 9x — 58 
In Exercises B15—24, let g(x) = x — ae be the Newton iteration func- 
tion and g„ (x) =x —m fe. be the modified Newton iteration function. 


(a) Verify that x — r is a zero of f (x), find m, the order of that 
Zero, and determine Q(x), the companion factor of (x — r)". 


(b) Show empirically that Newton's method converges linearly at 
the multiple zero x = r, and estimate C; , the convergence 
constant. 


(c) Show that C; = AD 
(d) Show that g'(r) = Cz, in agreement with part (c). 


m-—l 


(e) Apply Steffensen's method, verifying empirically that the 
convergence to the multiple zero is now quadratic. 

(f) Show that fixed-point iteration with g,, (x) converges 
quadratically to the multiple zero, x — r. 


Slope Methods 


Newton's method, which is fixed-point iteration xy,4 = g(xy), with g(x) =x — 


B15. 
B16. 
B17. 
B18. 
B19. 


B20. 


B21. 


B22. 


B23. 


B24. 


38.4 The Secant Method 
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(g) Empirically estimate Cg, the quadratic convergence constant 
for g,, (x). 
(h) Show that the estimate in part (g) is consistent with 
Go — -i fae provided Q'(r) 4 0. 
f(x) = 4x$ — 163? + 30x* — 40x? + 40x? — 24x +6,r = 1 
f(x) = —4x4 + 24x? + Ax? — 160x + 64,r = 4 
f(x) = 4x? — 91x* + 735x? — 2401x? + 2401x,r =7 
f(x) = —4x* + 16x? — 19x? + 12x — 12, 7 =2 
f (x) 2 —2x4 + 31x? — 147x? + 245x — 343,r =7 
40x? + 624x? + 1512x — 7776 


xy= ,r=—9 
fœ) 87x? + 82x — 79 à 
48x? — 293x? + 40x + 1456 
x= QF I 
fe 483 + 21x — 1 r 
38x^ — 468x? + 1752x? — 1420x — 1950 
f= = FÉ 
46x? + 46x — 71 
T 64x4 — 1066x? + 4696x? — 1536x — 4608 
f(x) = z r=8 
20x? + 75x + 15 
7X3) + 6x* — 111x? — 38x? + 732x — 
fo)- x? + 6x x 38x4 + x E exe 


19x? + 54x + 18 


In Exercises B25—34, use Newton iteration to determine all complex 
zeros in the complex plane. 


B25. 
B26. 
B27. 
B28. 
B29. 
B30. 
B31. 
B32. 
B33. 
B34. 


The Secant Method 


f(x) 24x* — 5x? -- 5x? — 3x41 
f(x) = 7x* — 5x3 — 9x? — 6x +3 
f (x) = 5x4 — x? — 3x? +5x —8 
f(x) = 4x4 +: 2x3 — x? H 12x 43 
f(x) = 8x* — 5x? + 6x? — 12x — 9 
f(x) = 3x* + Ax? — 6x? — 7x — 10 
f (x) = 2x* — 9x? -- 2x? + 9x + 10 
f) = Tx — Tx? 4- Ax? — 10x — 2 
f(x) = 5x4 + 7x3 — x? —5x -7 
f(x) = 2x* +. 2x3 42x — 11 


f(x) 
f'(x) 


as 


the iteration function, is an example of a slope method. Such methods approximate the root 
of f(x) = 0 with the x-intercept of a line of appropriate slope. In Newton's method, the 
slope is that of the tangent line at xz. In the secant method, the approximating x-intercept 
is obtained from a secant line connecting (xz, f (xx)) and (xi 4, f (xx-1)). 
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The Secant Algorithm 

The secant method is the fixed-point iteration defined by 

f Ga) Gi — xxi) 

f Gu) — f Ga-1) 

which is of the form x44; = 8 (xx, xy), and hence computes a new member of the iteration 
sequence {x;} from two previous members. Thus, to start the iteration, fwo initial guesses 
must be made. However, it is not uncommon to take x1— (1 + &)xo, where e = 0.01. This 
represents a 196 perturbation in xo, and the sign rarely matters. 

The convergence rate for the secant method is better than linear but not quite quadratic. 
In fact, it is superlinear, with p = 14v5 = 1.618034, so increments between iterates tend 
to obey |Axx41|/|Ax%|? — Cs, where Cs is a nonzero constant. 

The iteration formula (38.4) can be obtained from Newton's method by approximating 
the derivative f'(x) with the difference quotient (f (xx) — f Gy 1))/(xx — xk-1). Alter- 
natively, let x,_; and x; be two successive approximations to the root r. The secant line 
through the points (xy 1, f (xi 1)) and (xy, f (x4)) has the equation 


— S (xr) — f Ga) 


Xk — Xk-1 


op =e (38.4) 


(x — xy) + fa) (38.5) 


Setting y = 0 and solving for x gives the x-intercept x+1, whose formula is precisely 
(38.4). (See Exercise Al.) 


The equation f(x) = arctan x — /2x — 5 = O has a root in the interval [3, 4], as seen in 
Section 38.3. The secant-iteration function for this equation is 
(arctan xy — J/2xy — 5) (xy — xi 1) 
Xk+ = Xk — 
arctan x, — /2x, — 5 — arctan x-1 + /2xy 1 — 5 
The secant iterates x, starting with xo = 2.6 and x; = (1 + 0.02)xo, are listed in column 
2 of Table 38.9. Column 3 lists the increments Ax, = x;j44 — xy, and column 4 lists the 
ratios |Axz41|/|Ax,|?, with p = Lid, The eventual constancy of these ratios supports 


the claim that the secant method converges superlinearly, with parameter p — iiss (The 


| Axil 
k x AXKy = Xk4+1 — Xk ———— 
k k k+1 k TT 
0 2.6 0.052 41.98 
1 2.652 0.35116101 1.139 
2 3.0031610085 0.20952293 1.154 
3 3.2126839339 0.92046650 x 107! 0.543 
4 3.3047305839 0.11449900 x 107! 0.547 
3 3.3161804843 0.39567358 x 10? 0.469 
6 3.3165761578 0.14630393 x 10? 0.497 
7 3.3165776209 0.17999261 x 107? 0.477 
8 3.3165776210 0.81566365 x 10-16 0.489 
9 3.3165776210 0.45468705 x 1026 0.482 
10 3.3165776210 0.1148604 x 107? 
11 3.3165776210 0.1 x 1074 


TABLE 38.9 Secant method iteration in Example 38.13 
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computations were done in extended precision—at 50 digits—with a computer algebra 
system.) 4 


Multiple Roots 


Like Newton’s method, when the secant method converges to a root of multiplicity m > 1, it 
converges linearly. For example, as we saw in Section 38.3, the equation f (x) = In(cos x) + 
1 sin x? = 0 has a root of multiplicity m = 4 at x = 0. Column 2 of Table 38.10 lists the 
secant iterates Xx, Starting with xo = 1 and x; = (1 + 0.02)xo. Column 3 lists the increments 
Ax = Xk+1 — Xk, and column 4 lists the ratios Axz+1 /Ax;. The eventual constancy of these 


ratios supports the claim that the secant method converges linearly, with Cz approximately 


0.819. (The computations were done in extended precision.) 


k Xk AXy = Xk41 — Xk t 
Ax, 

0 1 0.02 —10.1583921 
1 1.02 —0.203168 0.4750245 
2 0.816832 —0.096510 1.1752695 
3 0.720322 —0.113425 0.797908 1 
4 0.606898 —0.090503 0.9113336 
27 0.712579 x 10? —0.128849 x 10? 0.8191889 
28 0.583730 x 10? —0.105552 x 10? 0.8191835 
29 0.478178 x 10? —0.864663 x 10? 0.8191799 
30 0.391711 x 10? —0.708314 x 10? 
3l 0.320880 x 10? 


TABLE 38.10 


Secant method applied to f (x) = In(cos x) + i sin x? which 


has a zero of order m = 4 atx = 0 


EXERCISES 38.4-Part A 


A1. Obtain the x-intercept for (38.5); show that if it is taken as x... 
the formula for it is precisely (38.4). 


EXERCISES 38.4—Part B 


A2. Let xo = 0, xı = 1, and f(x) = x? — 6x + 8. Obtain xz, 
= 2, 3,4, the next three iterates generated by the secant method. 


B1. It is shown in [49] that at a simple zero x = r, the convergence 
constant in the secant method is Cs — |Z Te | ~! where 
p-l= ETE] |= 45-1 = 0.618033989. Show that the data in 


Table 38.9 are consistent with this claim. 


In Exercises B2-7, use the secant method to find the real zeros of the 
given f (x). Show that the convergence is superlinear, with p — 14/5 = 
1.618033989. Show that Cs is as described in Exercise B1. 


B2. f(x) in Exercise B3, Section 38.3 


B3. f(x) in Exercise B4, Section 38.3 
B4. f(x) in Exercise B7, Section 38.3 
B5. f(x) in Exercise B8, Section 38.3 
B6. f(x) in Exercise B11, Section 38.3 
B7. f(x) in Exercise B12, Section 38.3 


multiple zero. 


accelerated value to x5. 


(a) Write g(x) =x — 42 — £7 . 


(a) Show that the secant method converges linearly at the given 


(b) Apply Steffensen’s algorithm (from Section 38.3) to the 


B8. Exercise B15, Section 38.3 B9. Exercise B16, Section 38.3 
B10. Exercise B17, Section 38.3 B11. Exercise B20, Section 38.3 
B12. Exercise B22, Section 38.3 B13. Exercise B24, Section 38.3 


For the functions f(x) given in Exercises B14—19: 


f(x) 
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For the functions given in each of Exercises B8-13: (c) Show analytically that g'(r) = g"(r) = 0 at x = r, a simple 


zero of f (x). Hence, the rate of convergence for the iteration 
is cubic. 


B14. f(x) in Exercise B5, Section 38.3 


linearly converging sequence in part (a) as follows. Let B15. f(x) in Exercise B6, Section 38.3 
Xo =r + 1, x; =r + 0.9 for the secant method, and apply B16. f(x) in Exercise B9, Section 38.3 
acceleration, just once, to X10, X11, X12. Compare the B17. f(x) in Exercise B10, Section 38.3 


B18. f(x) in Exercise B13, Section 38.3 
B19. f(x) in Exercise B14, Section 38.3 


In Exercises B20—23, apply the iteration 1,4; = g(x), where g(x) = 
9 
x—-f@_ fw. (48) . Each function has a multiple zero. What is the 
f'x) 2 f(x) fŒ) 


rate of convergence of this iteration at a multiple zero? Obtain analytical 


2 and/or empirical evidence to support your answer. 
) as the iteration 


f'(x) 2f'(x) 
function. 


EXAMPLE 38.14 


f'(x) 


(b) Use the iteration x;,,; = g(x;) to find the real zeros of f (x). 


B20. Exercise B18, Section 38.3 B21. Exercise B19, Section 38.3 
B22. Exercise B21, Section 38.3 B23. Exercise B23, Section 38.3 


Muller's Method 


Description 


Newton’s method replaces f(x) with the line tangent to f(x) at x = xy and then takes 
X41 as the x-intercept of this tangent line. The secant method replaces f (x) with a (secant) 
line through the two points (xy 1, f (xx—1)) and (xz, f (xx)) and then takes x;,, as the 
x-intercept on this line. 

In Muller's method, f (x) is replaced by a quadratic polynomial (a parabola) through 
the three points (xy 5, f (xx 2)). Ga, f Ga-1)), and (xz, f£ (x&)) and then x4 is taken 
as the “x-intercept” (there are two) that is closest to x,. We use the phrase “x-intercept” 
carefully because the zeros of a quadratic may be complex numbers, in which case the 
geometric notion of "crossing an axis" might not apply. 


The function f(x) = arctan x — 2x — 5 has a real zero in the interval [3, 4] but evaluates 


to a complex number if x < 3. This will allow us to explore the behavior of Muller’s 


method as its iterates enter the complex plane. Start Muller's iteration with the three points 
(xz, f Giu)), k = 1,...,3, given by (1, f(1)), (2, f(2)), G, f(3)) and interpolated by the 


quadratic 
y = (—0.58993 + 0.13397i)x? + (2.0915 + 0.33013i)x — 0.71621 — 2.1962i 


whose two zeros are 0.14334 + 1.2201; and 3.1073 + 0.077755i, at distances 3.1 and 0.13, 
respectively, from (3, f (3)). Selecting the root corresponding to the smaller of these two 
increments yields the next Muller iterate, x4 = 3.1073 + 0.077755i. 

The three points (xy, f (xy)), k = 2,..., 4, are interpolated by the quadratic 


y = (—0.056216 — 0.87243i)x? + (—0.57703 + 5.3621i)x + 2.4861 — 8.2346i 


whose two zeros are 2.8194 + 1.07947 and 3.2590 — 0.026353i, at distances 1.04 and 0.18, 
respectively, from (x4, f (x4)). Selecting the root corresponding to the smaller of these two 
increments yields the next Muller iterate, xs = 3.2590 — 0.026353i. 
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The three points (xy, f(xy)), k = 3,..., 5, are interpolated by a quadratic, and the 
iteration continues, yielding the additional Muller iterates listed in Table 38.11. 

The ninth Muller iterate gives a reasonable approximation to the known root r — 
3.316577621, but computing xig = 3.316572477 — 0.53 x 10^^i yields a less accurate 
result caused by roundoff error in the application of the quadratic formula. A strategy for 
implementing the quadratic formula, similar to that described in Section 37.1, is used in the 


TABLE 38.11  Muller's method in Muller algorithm developed next. e 
Example 38.14 


Xo = 3.318162834 + 0.147 x 10-4i 
x; = 3.316571952 — 0.159 x 1075i 
xg = 3.316577620 — 0.799 x 107"; 
Xo = 3.316577623 — 0.262 x 10^! i 


Implementation 


Each cycle of the Muller algorithm interpolates three points labeled (xz, fi), k = 1,...,3, 
where f} = f (xy). The interpolating polynomial is written in the form y = AZ? + BZ + C, 
where Z = x — x3, C = f3, and A and B are given in Table 38.12. The zeros of the inter- 
polating quadratic are 


"- —B + sB? —4AC 2C 
al 2A ^ AJBrX4B -4AC 


and the zero closest to x3 is x3 + min(| Z4.|). Hence, the correct choice for Z is —2€. where 
c = max(|B + / B? — 4AC|). The complete algorithm appears in a procedure written in 
the accompanying Maple worksheet. 


Ab _ Afi 
Ax =X% Afi=z h— A= CORE 
=x -— xX he 8 Ax, + Ax» 
Afh 
AX» = X3 — X2 Af» = fs m hr B= AAX; + AE 
X2 


TABLE 38.12 Implementing Muller's method 


EXAMPLE 38.15 If the Muller algorithm in the accompanying Maple worksheet is applied to the function 
f(x) = arctan x — /2x — 5, with starting values x; = k, k =1,...,3, the iterates in Table 
38.13 are obtained. The greater care used in implementing the quadratic formula results in 


improved accuracy. $ 
Ere X6 = 3.318162834 + 0.147429 x 107*i 
Xo 22 x; = 3.316571953 — 0.159366 x 1075; 
X4 —3 Xg = 3.316577621 — 0.561067 x 1070; 
x4 = 3.107324776 + 0.0777546i Xo = 3.316577621 — 0.153784 x 107i 


1 
Xs = 3.258957576 — 0.0263527i 


TABLE 38.13 Muller iterates in Example 38.15 


Comments 


Like Newton's method and the secant method, Muller's method converges linearly at a 
repeated root. In general, though, Muller's method converges superlinearly, with parameter 


972 


Chapter 38 Equations in One Variable—Methods 


p equal to the positive root of x? — x? — x — 1 — 0. (See, e.g., [4].) This value is usually 
listed in the literature as 1.840, but it is actually 1.839286755. 

First published in 1956, Muller's method has found favor because it typically converges 
to some root of a given polynomial, no matter what the starting values. Moreover, it will 
find both real and complex zeros of transcendental functions. 


EXERCISES 33.5 


1. Use Muller’s method to find the positive root of x? — x? — 
x—1=0. 


In Exercises 2—5: 


(a) Use Muller's method to find the real and complex zeros of the 
given functions. 


(b) For each zero computed in part (a), show empirically (where 
possible) that the convergence is superlinear, with 
p = 1.839286755. 


(c) For each zero x — r computed in part (a), show (where 
possible) that the convergence constant C; is consistent with 
, — | fo) o-0/2 
the claim Cy = [m 


part (b). 


, made in [4], where p is given in 


Chapter Review 


1. Given an equation of the form f (x) — 0, describe how fixed-point 
iteration might be used to obtain a root. Discuss the strong and 
weak points of this technique. Discuss the convergence properties. 
Give examples of convergent and divergent fixed-point iterations. 


2. Demonstrate the first few steps of fixed-point iteration used to solve 
the equation x? + x — 1 — 0. 

3. Describe the bisection algorithm. What are its strong and weak 
points? What is its average rate of convergence? 

4. Demonstrate the first few steps of the bisection method applied to 
the equation x? + x — 1 = 0. 


5. State the Newton iteration algorithm. Under what conditions does 
the method converge quadratically? Under what conditions will it 
converge linearly? 


6. Illustrate the first few steps of Newton iteration for obtaining a root 
of the equation x? + x — 1 = 0. 


2. f(x) in Exercise B25, Section 38.3 

3. f(x) in Exercise B28, Section 38.3 

4. f(x) in Exercise B31, Section 38.3 

5. f(x) in Exercise B34, Section 38.3 
In Exercises 6—11, investigate the convergence of Muller’s method for 
the indicated multiple zeros. 

6. Exercise B15, Section 38.3 

8. Exercise B17, Section 38.3 
10. Exercise B22, Section 38.3 


7. Exercise B16, Section 38.3 
9. Exercise B20, Section 38.3 
11. Exercise B24, Section 38.3 


7. What does it mean to say that for the equation f(x) = 0, x =r isa 
root of multiplicity m? 

8. Discuss the convergence of Newton’s method at a root of 
multiplicity m. 

9. Describe Steffensen’s algorithm. When can it be used, and what 
effect can it be expected to have? 

10. Describe three ways in which Newton iteration can fail. 

11. State the algorithm for the secant method. What is the anticipated 
rate of convergence of this method? What are the advantages of the 
method? Discuss the convergence at a root of multiplicity m. 

12. Illustrate the first few steps of the secant method when applied to 
finding a root of the equation x? + x — 1 = 0. 

13. Describe Muller's method. What are its advantages? What are the 
rates of convergence at isolated roots and multiple roots? 


Chapter 39 


Systems of Equations 


INTRODUCTION Numeric solvers for linear systems of algebraic equations 
are at the heart of many computational techniques. The reader should not think of solving 
such systems as merely an end in itself. The principal tool for solving linear equations is 
Gaussian elimination, first seen in Section 12.5. Other tools include the LU decomposition 
of Section 34.1, but that factorization is, in fact, accomplished by the arithmetic of Gaussian 
elimination. These earlier sections did not consider the effects of roundoff error generated 
by computing on a finite-precision device. Mostly, the computations were done in exact 
arithmetic via the symbolic capacity of a computer algebra system. 

Chapter 39 revisits Gaussian elimination and examines it from the perspective of ac- 
curacy in a climate susceptible to roundoff error. We demonstrate how, on a finite-precision 
machine, dramatic roundoff errors can occur. Pivoting strategies for decreasing roundoff 
error are considered in the exercises. The operation counts for Gaussian elimination are 
obtained in the section. For large systems, perhaps on the order of five million equations 
in five million unknowns, the total number of arithmetic operations Gaussian elimination 
consumes becomes a significant component of the solution strategy. The special case of the 
tridiagonal system is examined as a contrast to the general case. However, the extensive 
theory that tailors different strategies for different types of matrices are beyond the scope 
of this text. 

We then discuss condition numbers, a device for quantizing the inherent tendency for 
a linear system to propagate roundoff error during numeric solution. Matrices with large 
condition numbers may generate solutions with almost no accurate significant digits, and 
such matrices can be found in small problems arising from a commonplace task such as least- 
squares fitting of a linear model to data. The condition number is, unfortunately, expensive 
to compute, so in practice, variants (see the exercises) are used to estimate the likelihood 
of catastrophic roundoff error. 

If xy is an approximate solution of the system Ax = y and if r = Axo is the residual 
vector, iterative improvement is a method for obtaining from r a better approximation to the 
actual solution. Packaged system solvers designed for finite-precision machines actually 
use this technique for obtaining the maximum accuracy with the resources available. 

We also describe the method of Jacobi, an iterative technique that is the generalization 
of fixed-point iteration. Hence, the convergence is linear; but for problems so large that the 
full set of equations cannot be fit into memory at the same time, the Jacobi method is a 
realistic alternative. We also examine Gauss—Seidel iteration, a variant of Jacobi's method in 
which newly computed values are used immediately in the on-going calculations. Generally, 
Gauss-Seidel iteration converges more quickly than Jacobi's method, but the convergence 
is still linear. 
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The original relaxation technique, a pencil-and-paper iteration, was devised prior to 
World War II in an era when digital computers weren't yet even a dream. The technique 
is included as a pointer to the more modern successive overrelaxation technique (SOR). 
which can be loosely compared to Gauss-Seidel iteration with a damping factor called the 
relaxation parameter. If the relaxation parameter can be optimally chosen, the convergence 
properties of the iteration are greatly enhanced. 

The chapter concludes with a discussion of iterative techniques for solving nonlinear 
systems of algebraic equations. Fixed-point iteration applied to such a system, converging 
linearly, is nothing more than the Jacobi method for nonlinear equations. The obvious variant 
is a fixed-point method that uses the immediate-update strategy of Gauss-Seidel iteration. 
Newton iteration, the generalization of Newton's method for a single equation in a single 
unknown is treated here, even though it is also an iterative algorithm. However, its quadratic 
convergence makes it a useful strategy, and some of the devices that make the method more 
efficient are discussed. 


Gaussian Arithmetic 
Gauss Elimination 


Review In Section 12.5 we saw how to apply Gaussian elimination to solve the system 
of algebraic equations Ax — y by row-reducing [A, y], the augmented matrix, to an upper 
triangular form and using back substitution to determine x, the vector of unknowns. In the 
exact arithmetic of Section 12.5, we would compute the solution of the system Ax = y, 
where A, y, and [A, y] are 


0 2 —4 4 0 2 —4 .4 
A=l\qu 4 8 y=|6 [Ay] =| mm 4 8 6 
9 7 6 l 9 7 6 313 
by row reduction of the augmented matrix to upper triangular form and back substitution, 
giving 
. 84,000 
9 7 6 ] 71,993 —1.166780104 
0 2 -4 4 x=| Peet} =| 1750102093 
71,993 179.909 Qe 
0 0 4500 90.000 = —À. —0.1249489534 


where the exact solution x has also been expressed in floating-point form. 

The astute reader will have noticed that because A,; = 0, Gaussian elimination cannot 
begin for this matrix until row 1 is interchanged with either row 2 or row 3. Since the upper 
triangular matrix produced by Gaussian elimination will have its first row unchanged and 
that row is the original third row, it is clear that the first and third rows were switched at the 
outset. 


NuMERIC SOLUTION We next examine the process of Gaussian elimination in floating- 
point arithmetic on a fixed-precision device. We simulate work on a five-digit device. Upon 
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interchanging rows 1 and 2, converting the augmented matrix to floating-point form, and 
using row 1 to create a zero in the (3, 1)-position, we get 


000070000 4 8 6 0.00070000 4 8 6 
By — 0 2. -4 4| 0 2 —4 4 = Byl 
9 7 6 1 0.000 —51,421 —102,850 —77,141 


Surprisingly, we do not obtain a zero in the (3, 1)-position because roundoff error is 
greatly exacerbated by our restriction to five significant digits. Indeed, to five digits, the 
multiplier — pa is — 12,857, so that multiplication of row 1 by this factor yields —8.9999, 
and not —9, to be added to the (3, 1)-element. That is why we obtained 0.0001 instead of 
0 for the new (3, 1)-entry. 

In the typical implementation of Gaussian elimination on a fixed-precision device, this 
entry would not be calculated. A zero would simply be understood to exist at this location. 
However, we can see the kind of roundoff error that enters a calculation performed on a 


fixed-precision device. 


Finally, row 2 is used to create a zero at the (3, 2)-location by adding to row 3, — m = 
25,711 times row 2, giving the left-hand matrix in m 
0.00070000 4 8 6 0.00070000 4 8 6 
0 2 —4 4 -— 0 $ o4 4 
0.0001 1 —205,690 25,699 0 0  —205,690 25,699 
(39.1) 


Again, it is disconcerting to see a nonzero entry at the (3, 2)-position in the matrix on the 
left in (39.1); but when 25,711 multiplies the 2 in the (2, 2)-location, we get 51,422, not 
51,421 as expected. Hence, we have another example of roundoff error being introduced 
because of the fixed-precision of the computing device. Remembering, however, that the 
typical Gaussian elimination code would simply write a zero in this location, we simply 
transform the upper triangular matrix to the right-hand matrix in (39.1). This is the matrix 
Gaussian elimination on a five-digit device would produce. If back substitution is now used 
to compute the solution x, we will obtain the right-hand vector in 


— 1.1668 —1.2571 
Xexact = 1.7501 1.7501 = XGaussian 
—0.12495 —0.12494 


Finally, we consider the effect of interchanging not rows 1 and 2 but rows 1 and 3. The 
augmented matrix and its upper-triangularization are then 


9 7 6 I 9 .7 6 1 
0.00070000 4 8 6| — |0 3.9995 7:9995 5:9999 (39.2) 
0 2 —4 4 0 0 —8.0002 0.9997 


Back substitution now yields the right-hand vector in 


—1.1668 —1.2857 —1.1668 
1.7501 1.7501 1.7501 
—0.12495 —0.12494 —0.12496 


with the left-hand vector being the exact solution and the middle vector being the solution 
arising from the interchange of rows 1 and 2. To quantize the difference in the solutions, 
we compute the Euclidean norm of the differences as measured against the exact solution, 
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obtaining 0.11892 for the first solution by Gaussian elimination and 0.0000229 for the 
second. Interchanging the first and third rows produces less error than interchanging the 
first and second rows. This reduction in error is a result of dividing by 9 rather than by the 
much smaller 0.0007. Avoiding divisions by a small number generally leads to a reduction 
of roundoff error. 

Hence, rows are interchanged, or pivoted, not only to avoid division by zero, but also 
to avoid division by small numbers. The strategy of interchanging rows to bring the largest 
remaining column element to the (k, k)-location when creating zeros in column k is called 
partial pivoting and is one of the techniques used in numeric code for Gaussian elimination 
to reduce roundoff error. 

In the next section we will examine in more detail systems for which roundoff-reduction 
techniques are essential. Surprisingly, some linear systems of very modest size can generate 
debilitating roundoff error even on computing devices carrying 16 or more significant digits. 


Counting Operations 


Another important aspect of numeric Gaussian elimination is the total number of arithmetic 
operations that must be performed to solve Ax = y, a linear system of n equations in n 
unknowns. Knowing how many operations are needed and having an idea of how fast each 
operation can be performed on a given computer enable us to determine the feasibility of 
solving large systems that arise in practice. 

Some texts simply total all four kinds of arithmetic operations, and some distinguish 
between them. Table 39.1, essentially a reproduction of Table 3-1 on page 135 of [60]. 
lists the number of operations it takes to row-reduce A to an upper triangular matrix U 
(A — U), the number of operations it takes to row-reduce the column y in the augmented 
matrix [A, y] (y —> w), and the number of operations it takes to complete back substitution. 


N (x) N (s) N(/) Row Totals 
n(n — 1)(2n — 1) n(n — 1)(2n — 1) n(n — 1) n(n — 1)(4n + 1) 
A—U 
6 6 2 6 
n(n — 1) n(n — 1) 
yw Uo = 0 n(n — 1) 
— 1 — 1 
Back substitution nie} n=) n n? 
2 2 
n(n — 1)(2n + 5) n(n — 1)(2n + 5) n(n + 1) n(An? + 9n — 7) 
Column totals SENE SMS 6 ^ 6 


TABLE 39.1 Count of arithmetic operations needed for solving Ax = y by Gaussian elimination and back 
substitution 


In the lower right-hand corner is found the total number of arithmetic operations needed 
to solve an n x n system by Gaussian elimination. This total does not include the effort 
expended making comparisons for the sake of pivoting (interchanging rows to reduce the 
chance of roundoff error). For large n, the number of operations grows as the dominant 


Total Number 

n of Operations 
3 28 
4 62 

10 805 

10? 681,550 

10? 668,165,500 

106 666,668, 166,665,500,000 

TABLE 39.2 Total number of arithmetic 


operations needed to solve various n x n 
systems by Gaussian arithmetic 
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term, that is, as n°. Hence, it is common to say that the number of operations is O(n), 
that is, order of n>. This should be compared to the number of operations performed on the 
vector y and the number of operations needed to execute back substitution. Both of these 
totals are O(n"), so most computational energy goes into reducing the matrix A to upper 
triangular form. 

Table 39.2 lists the total number of arithmetic operations needed to upper-triangularize 
and solve by back substitution n x n systems of various sizes. For a modest system with 
n = 1000, it takes nearly 700 billion arithmetic operations to compute a solution. For n equal 


to one million, a small system when designing an aircraft, the total is so large that a computer 


666,668, 166,665,500,000 __ 
(10°)(3600)(24)(365) 7 


21.140 years to produce a solution. Thus we see one of the reasons for the development of su- 
percomputers and parallel-processing machines in which Gaussian arithmetic is performed 
simultaneously rather than sequentially. 


executing one billion operations per second would take more than 


DERIVING THE OPERATION Counts Deriving the results in Table 39.1 requires 

n—1 1 n—l 1 

oes = So = = 

MI sin —1) and i - gn — Dn - 1) 

k=1 k=1 
formulas for the sum of consecutive integers and their squares, respectively. 

Our approach is to consider the case n = 4, look for patterns, and generalize. To make 

the case n = 4 more concrete, consider the augmented matrix 


x X x x y 
t x x y2 
[A, y] = (39.3) 
t t x x y 
t t f x yÓ4 


in which the numbers at the locations marked with the letter ¢ will be converted to zeros 
during the upper triangularization as A is transformed to U. Divisions take place only 
when the multipliers are formed. Column 1 requires the formation and use of 3 multipliers; 
column 2, 2 multipliers; and column 3, 1 multiplier. The number of divisions required for 
upper-triangularizing A is 

fel 5 (n _ 1) 

@-)+@-2)+--4+1=) k= — 

k=1 
As A is upper-triangularized to U, additions are performed when a row is added to a row 
below it. The tally of such additions is given in Table 39.3, from which we conclude that 
the total number of additions needed to upper-triangularize A is 


2 2 —1)Qn-1 
(n-1* (0-294 P= eH an ) 


k=l 


As A is upper-triangularized to U, multiplications are performed when a multiplier 
multiplies the entries in a row being used to create zeros in a row beneath it. When row 
] makes a zero in rows 2, 3, or 4, there are 3 multiplications. When row 2 makes a zero 
in rows 3 or 4, there are 2 multiplications. When row 3 makes a zero in row 4, there is 1 
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Number of Additions Per Row 


Row | makes 0’s in Column 1 > 3inrow 2 3inrow 3 3inrow 4 
Row 2 makes 0’s in Column 2 > 2 in row 3 2 in row 4 
Row 3 makes 0’s in Column 3 > 1 in row 4 


TABLE 39.3 Number of arithmetic operations needed for upper-triangularizing a 4 x 4 
matrix 


multiplication. Thus, the total number of multiplications needed to upper-triangularize A is 


2 


tot Pse ODETI 


(n — 1 4 (n — 2) 

To help visualize the Gaussian elimination steps applied to the column vector y, look 

at the schematic of the augmented matrix [A, y] in (39.3). No divisions are visited upon an 

element in the fifth column. However, each time a row is used to create a zero, that row is 

multiplied by the multiplier, and the row in which the zero is created has an addition made 

in its fifth column. Thus, when row 1 is used to make zeros in rows 2, 3 and 4, there are 

3 multiplies and 3 adds. When row 2 is used to make zeros in rows 3 and 4, there are 2 

multiplies and 2 adds. When row 3 is used to make zeros in row 4, there is 1 multiply and 
1 add. Hence, there are an additional 


n-—l 


@—-1+@-2)+--+1=) k= 
k=1 


n(n — 1) 
2 


multiplications and an equal number of additional additions required to transform the vector 
y into the vector w. 

To count the operations required for back substitution, consider the schematic of the 
augmented matrix [U, w] appearing in 


u11 Uj2 Uj3 HUj4 Wy 
0 uo) U2 Ux W2 
0 0 U33 U34 W3 
0 0 O  ug4 wa 


[U, w] = (39.4) 


Solving for w4 requires | division, 0 multiplications, and 0 additions. Solving for w3 re- 
quires 1 division, 1 multiplication, and 1 addition. Solving for w» requires 1 division, 2 
multiplications, and 2 additions. Solving for w; requires 1 division, 3 multiplications, and 
3 additions. Consequently, during back substitution there will be an additional n divisions, 


n—] 

1—2 

1+2+---+(@-N=) Tp 
k=1 


multiplications, and an equal number of additions. The total number of operations of all 
types will then be the sum 


n—l n—]l 
7 1 
2X ge +5) ktn= enn" 4- 9n — 7) 
k=1 k=1 
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The Tridiagonal System 


DEFINITION 39.1 


The n x n system of equations Ax = y is called tridiagonal if the only nonzero 
elements in A appear on the main diagonal, the first diagonal above the main diagonal, 
and the first diagonal below the main diagonal. Such a matrix is called banded, and 
the tridiagonal matrix has three contiguous bands, as suggested by the following 
schematic. 


di ui 0 70 0: 0 0 
5 d) u 0 0 0 0 
0 15 d ui 0 0 0 
0 0 I diu 50 0 
077505 Oe 74 i 0 
020: 0 : 0 
Oe ORO 008 tO 08. i : 0 
QissOmisuDt MORES OK RO HESS di OU 
Qon 0 TOn Ora nn. Th dn 
We designate the n elements on the main diagonal by dg, k = 1,...,n; the n — 1 
elements on the diagonal above the main diagonal by ug, k = 1,..., n — 1; and the 
n — | elements on the diagonal below the main diagonal by lg, k = 2,..., n. The 


symbols /, and wu, are not used. 


Such systems are of interest both because they are readily solvable and because they 
frequently occur in such applications as implicit schemes for solving boundary value prob- 
lems by finite-difference techniques. We mention here, and verify momentarily, that such a 
system can be solved (reduced to upper triangular form and solved with back substitution) 
with 8n —7 total arithmetic operations. Hence, there is an O(n) rather than an O(n?) solution 
scheme for the tridiagonal system. For example, if n is a modest 100,000, then 8n — 7 is 
approximately 8 x 10?; whereas an unthinking Gaussian elimination solution would involve 
666,681,666,550,000 (approximately 7 x 10!4) arithmetic operations, a factor of about a 
billion more. 


OPERATION Counts We will next show that Table 39.4 tallies the numbers of operations 
needed to solve ann x n tridiagonal system of linear equations. As before, the table lists the 
number of operations needed to row-reduce A to an upper triangular matrix U (A — U), 
the number of operations needed to row-reduce the column y in the augmented matrix 
[A, y] (y ^ Y). and the number of operations needed to complete the solution by back 
substitution. 

The following schematic of [A, y], the augmented matrix for a 6 x 6 tridiagonal system 
Ax = y, will be useful in generalizing the operations count of a Gaussian elimination process 


For k — 1 to n execute 
If d, = 0 then QUIT else if k < n then 
lia 
l, = = — 
k+l F1 


Nyy = kk+1 + leu 


Yk+1 = Yea + lea yk 


Next k 

y, = Yn 

Su. 
d, 


For k = n — 1 down to 1 in steps of —1, 
execute 


Yk — UkYk+1 
dy 
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N (+) N(x) N(/) Row Totals 
A—U n—l n—l n—l 3(n — 1) 
yo Y n—i n—1 0 2(n — 1) 
Back substitution n—l n—l n 3n — 2 
Column totals 3(n — 1) 3(n — 1) 2n — 1 8n — 7 


TABLE 39.4 Count of operations needed for solving a tridiagonal system by Gaussian 
elimination and back substitution 


that is specifically tailored to the sparse structure of A. 


di ui 0 0 0 (0) yı 
l dz u2 0 0 0 y2 
O lh di uy 0 0 y 
[A, y] = 0 0 h dy ug O y 
0 0 0 ls ds Hus ys 
0 0 0 0 lg dg y6 
To create a zero in the (k, k — 1)-position, k = 2, ..., 6, compute 
m 
=-— dy = dy lug i Ye = Yk + lkYk-ı 
dii 


Notice that /;, d;, and y; are all over-written by new values, thus eliminating the need for 
additional storage. However, this notation should not be allowed to obscure the change in 
values of d», ..., dg and of yo, ..., ye. In the representation of the upper-triangularized 
matrix these calculations have produced, we will use D5, ..., Dg and Y2,..., Ys to denote 
these new values. 

In general, reduction of the tridiagonal A to the upper triangular U will require n — 1 
additions and an equal number of multiplications and divisions. Conversion of the vector y 
to a new vector Y will entail n — 1 additions and an equal number of multiplications. 

For the case n — 6, the augmented matrix [A, y] will now be in the form 


d uj 0 0 0 0 y 


0 D» u? 0 0 0 Y? 
0 0 D3 u3 0 0 Ya 
iU, *i g 0 0 0 D4 u4 0 Y; 
0 0 0 0 D us Ys 
0 0 0 0 0 De Ye 
Back substitution is accomplished via the computations 
Y, Yk — ux Yg — uY 
Go Bae Ro 8459 wu 
Dg Di d 


Again, the updated values of entries in the rightmost column are stored “in place,” elimi- 
nating the need to allocate additional memory. The desired solution x is then the rightmost 
column of the augmented matrix after back substitution has been performed. 

In general, back substitution requires n — 1 additions, an equal number of multiplica- 
tions, and n divisions. Hence, the general tridiagonal system can be solved with just 8 — 7 
arithmetic operations. 
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Pseupocopr A numeric algorithm for solving Ax = y, ann x n tridiagonal system of 
linear equations, could be programmed in a language such as FORTRAN or C according 
to the pseudocode in the margin on page 980. The syntax unique to each programming 
language would be used to implement constructs such as for-loops and if-statements. Also, 
each program would have to be given a mechanism for initializing the variables with the 
data in the matrix A and the vector y. 

There must be a test for dy = 0 since it is possible for one of the elements on the main 
diagonal to become zero during the calculation. If this happens, the algorithm fails. This 
does not mean there is no solution, because the matrix A need not be singular. It simply 
means that the standard intervention of a row-interchange can't be used here since that 


would then destroy the tridiagonal structure of the matrix. 


EXERCISES 39.1 


1. If the lower right entry in Table 39.1 is F (n), the total number of 
arithmetic operations needed to solve a linear system: 


(a) Graph F (n) and =n}, n < 100, on the same set of axes. 


using 27? instead of F (n). 


When upper-triangularizing the n x n matrix A = {a;;} by Gaussian 
elimination, the kth row is used to create zeros in the kth column, below 
the main diagonal. If a, = 0 and the kth row is interchanged with the 
first row below it for which aj, Æ 0, j > k, then the strategy of naive 


| 43 -62 77 E -91 -47 -61 41 
8 54  —57 99 —61 9 —58  —90 53  —17 
* |—50 -12 -—18 3] ` 94 83 —86 23 
—26 —62 13 —47 | —84 19 —50 88 
(b) For n = 10? and n = 10°, obtain the percent error made when [-53 85 49 78] -19 -47 68 -72 
10 17 72. —99 —85 11 —87 79 43  —66 
* | —86 30 80 72 '|—-53 -61 -23 -37 
L 66 =29 -91 -—53| 31 —34 —42 88 
—76  —65 25 28 —36 40 22 53 
—61  —60 19 29 —88 -—43 -73 25 
12. —66  —32 78 39 13. 4] —59 62  —55 
94 68 —17 —98 25 39 40 61 


pivoting has been applied. For the vector y = [1, 2, 3, 4]’ and the matri- 
ces A in Exercises 2-7, apply Gaussian elimination with naive pivoting 
and back substitution to the augmented matrix [A, y], work in four sig- 
nificant figures, and solve Ax — y. Compare the solution to an exact 
solution, and explain any differences that may be observed. 


If y = [3.2, 1, 4, 5, 6]", use the tridiagonal algorithm to solve Ax = y 
for each of the matrices A in Exercises 14 and 15. 


—5 7 0 0 0 0 
=} =1 -—2 0 0 0 


[43 —62 54  —30 15 18 33 25 14 0 1 10 4 0 0 
2 77 66  —5 31 3 60 72 72 —23 . 0 0 —6 6 —9 0 
* [44 —4 40 -—31 š 63 —38 —39 79 0 0 0 8 —5 -2 
| 36 90 48 -71 —95 4 —51 79 29 | 0 0 0 0 —4 4 
[ 96 84 -25 17 [-18 —27 94 -15 [68  —65 0 0 0 0 
4 —48  —42 11 29 5 12 18 41 -—97 8 20 93 0 0 0 
. 82 6 89 10 * | —43 16 14 58 15 0 —80 —5 23 0 0 
—25  —41 88 97 —95 37 -—4 50 . 0 0 —24 -63 —36 0 
-H 66 -64 -si -28 -32 0 89 0 v 9 S 9 2 
P 0 0 0 0 52 31 
6 63 —54 97  —66 7 —77 -88 -77 30 " . f 
84 10 -21 -17 . Of i12 35  —68 16. Apply the tridiagonal algorithm to the augmented matrix 
—57 —82 45 I7 —74 13 —85 69 i L1 & 06 
» 2 2 » 9 7 M : . 
Gaussian elimination is implemented with the strategy of partial pivot- [A, y] = : : 1 : ; = SRE MAT AN AGES AIC T 


ing if the row used to create zeros in the kth column is the one for which 

aj| = max;>¢{|a;x|}. Dividing by the largest coefficient available in a 
column tends to reduce roundoff error. For the matrices A in Exercises 8— 
13 and the vector y = [—2, 3, 1, —5]", apply Gaussian elimination with 
partial pivoting to the augmented matrix [A, y], work in four significant 
figures, and solve Ax — y. Compare the solution to an exact solution, 
and explain any differences that might be observed. 


the algorithm fails because a diagonal entry becomes zero. What is 
the solution of the system? 


=3 IO =] 0 0 0 
10 =3 7 6 0 0 
- T [e$ e9 -2 -0 & m9 
17. fy= [1,2,3,4,5, 6 ada =] 2» 32.1 rb 
0 0 -9 =v 3 4 
0 0 0 —10 -4 7 
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apply Gaussian elimination and back substitution to the augmented 19. Obtain the total number of arithmetic operations needed to execute 
matrix [A, y], noting where adding zero or multiplying by zero the algorithm developed in Exercise 18. If n — 10?, compare the 


Occurs. 


18. Generalize the tridiagonal algorithm for a matrix with five 


contiguous bands. 


| 
"5 


EXAMPLE 39.1 


82 
_ | 1-4 91c 
i c—9 
1 4- 91c 
TABLE 39.5 The system Ax = y, and its 


solution, in Example 39.5 


I|Ax||.. 


+ » C 


—+ } + 
-04 -02 0 02 04 
FIGURE 39.1 A plot of |Ax|, vs. c in 


Example 39.1 


number of operations needed to solve a five-banded system with the 
algorithm of Exercise 18 to the number of operations needed to 
solve the same system with ordinary Gaussian elimination and back 
substitution. 


Condition Numbers 


This example explores the dependence of x, the solution to the linear system Ax — y, on 
a small parameter in the matrix A. We assume c, the small parameter, is roundoff error in 
one entry of A introduced by the act of entering A into a finite-precision computing device. 
This gives the matrix A(c) in Table 39.5, which also gives xo, the solution to A(0)x — y. 
and x,, the solution to the perturbed system A(c)x = y. The determinant of A (c) is 1 4- 91c, 
and the determinant of A(0) is 1. As long as c # —3gp A(c) is not singular. 

The oo-norm of the difference Ax = x, — xo is given by ||AXx||oo = 7462| 1:5; the 
largest of the absolute values of the components of the vector. Figure 39.1 shows a graph 
of this magnitude, from which we can see that large changes in the solution are possible 
with just small changes in the perturbation parameter c. Alternatively, the variability in the 
solution is given by the ratio 


lAxla — — 7482 lS] 


X = 82 
| alles max | Tanta |: greet 


a measure of the relative change in the perturbed solution, graphed in Figure 39.2. Again. 
we see that small changes in c can cause large relative changes in the solution. e 


Our measurement of the changes in the solution were made with exact arithmetic. The 
existence of these changes is not attributable to the computational process but is inherent 
in the matrix A itself. This property of the matrix is measured by its condition number; 
explored next. 


The Condition Number 


The condition number of a matrix A is defined as cond(A) = || A||] A^! ||, where the con- 
dition number depends on the specific norm used on the right. 

Using either the oo-norm or the 1-norm, cond(A(0)) = 10,100, where A(0) refers to 
the matrix defined in Table 39.5. Using the 2-norm, cond(A(0)) — 8462.999883. Note that 
the matrix A(0), whose determinant is 1, has such a large condition number. Matrices with 
large condition numbers are said to be ill-conditioned and have the potential to multiply 
the relative error in the matrix by a large number, establishing a large upper bound for the 
relative error in the solution of the system Ax = y. 

For the system in Example 39.1, we have already examined the relative error in the 
solution Xe. Let us now obtain the relative error in A(0). Thus, we compute AA(0) = 
ve = H as the relative error in 
A (0). Figure 39.3 contains a graph (solid lines) of the relative error in x,, along with a graph 
(dotted lines) of cond(A(0)) times the relative error in A(0). The inequality governing the 
placement of the solid and dotted lines is derived in the next subsection. 

We next look at the singular value decomposition of the matrix A (0). In Section 34.5. 
we saw that A = U X VT, where U and V are orthogonal matrices and X is a diagonal matrix 


A(c) — A(0) — [5 AR and using the co-norm, we find 


llAxll.. 
lix.ll.. 
A 


80 4- 


AXlos 
FIGURE 39.2 A plot of the ratio l Xle 

X. [oo 
vs. c in Example 39.1 j 


t 
—0.1 —0.05 0 0.05 0.1 


FIGURE 39.3 Example 39.1: Relative 
error in x, (solid), and cond(A(0)) times 
the relative error in A(0) (dotted) 
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of singular values ø j, j = 1,...,k, where k is the rank of A. These singular values are the 
square roots of the eigenvalues of the matrix ATA. If A is an r x c matrix, then U is r x r, 
while V is c x c. Denoting the columns of U by u; and the columns of V by v;, we also have, 
from Section 34.5, the outer product expansion of A, namely, A = oiu; v] +- - -+ opu VL. 

The singular values for A(0) in Example 39.1 are exactly 8465/8461 and approx- 
imately 91.99456442, 0.01087020. The small singular value is more indicative of ill- 
conditioning than the value of the determinant. This has a theoretical basis. In the outer prod- 
uct expansion of A, o; is the smallest singular value. If the term that contains it were deleted, 
the remaining sum in the expansion would be the rank k — 1 approximation to A having 
smallest 2-norm. Thus, if A has a small singular value, then it is “close” to a singular matrix. 

In addition, the 2-norm of A is equal to the largest singular value and the 2-norm 
condition number of A is the ratio of the largest and smallest singular values. Thus, a large 
singular value can raise the condition number, but a very small singular value can raise the 
condition number higher. 

The connections between the singular values and both the norm of A and its condition 
number are detailed in the spectral radius theorem, which can be found in texts such as [60] 
or [64]. 


Derivation of the Bound on Relative Error 


We next relate the relative change in the solution x to a relative change in the matrix A, 
establishing the bound 
I Ax|| IAAI 
—— — —— < cond A———— 
lixo + Axl] IAI 
To this end, let the linear system Ax = y have the solution xo, let AA be a small change 
in A, and let B = A+ AA be a perturbation of A. Finally, let the perturbed system Bx = y 
have solution x, = xo + Ax. Then Bx, = y or 
(A + AA) (Xo + AX) = y = AXo 
Removing the parentheses, we get 
AXo + AAX + AA(Xo + AX) = y = Axo 
or AAx + AA(Xo + Ax) = 0. Solve for AAx, obtaining AAx = —AA(xo + AX); then 
multiply both sides by A^, the inverse of A, which gives Ax = —A~'AA(xo + Ax). 
Compute the norm of both sides, obtaining 
Axl] = IA" AAQo + Ax)I 
From Section 33.5 we have, as general properties of matrix norms, ||Mx|| < ||M||||x|| 
and ||MN || < IIMTIIN ||. Applying these estimates, we then get 
Axi] < A HIA ATIIXo + Ax 


Divide both sides by |[xo + Axl] to get 


(39.5) 


lAxl — gt 
r--— Ed AAI 
[Xo + Ax 
On the right, multiply and divide by the norm of A, obtaining, finally, 
|| Ax|| s IAAI 
xz xzy = 4 
Xo + Axl] |All 


The factor || A^! ||||A|| is called the condition number of A and, in the upper bound 
for the relative error in the solution, is the factor by which the relative error in A might be 
multiplied. 
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EXAMPLE 39.2 


EXAMPLE 39.3 


The exact solution x, for the system Ax — y, is given in (39.6), along with A and y. 


9 -2 9 I 234 
A=|-4 3 8 yc x=] 4 (39.6) 
8 8 2 1 " 


The matrix A has the relatively small condition number 1.884725008. To simulate the 
introduction of modest error into the matrix A, convert the augmented matrix [A, y] to the 
floating-point form and row-reduce it to upper triangular form, using partial pivoting and 
just three significant digits. The result, the solution obtained by back substitution, and the 
exact solution to three significant digits are then 


9.00 —2.00 9.00 1.00 0.0212 0.0214 
[A. y] ^ | 0 9.78 —6.00 0.111 x = | 0.0770 Xe = | 0.0769 
0 0 13.3 1.42 0.107 0.107 


Rounding to three significant digits puts error in the third significant digit of the entries 
of A, but using the 2-norm, cond(A) is less than 2. The error gets multiplied at worst by a 
factor of 2, so the first two significant digits in the solution should still be accurate. In fact. 
the computed solution agrees with the exact solution to two significant digits. e 


By writing A as an outer product expansion, we will construct a matrix with the prescribed 
singular values 25, 10, and mae To do this, we need the column vectors u; and v; in the 
orthogonal matrices U and V, respectively, which we get by orthonormalizing the two 


random matrices U; and Vj in (39.7). 


0 -2 3 —1 2 5 
U,;=|3 -1 -3 V = 0 2 1 (39.7) 
1 0 —4 3 —1 -4 
The matrices U and V are then 
o -20 1 nl WEM T 
VAL Ta 10 26 65 
—— 3 l 2 E 242 5 
U 10 410 41 Pe 0 V13 v13 
1 3 6 3 1 2 
10 410 4l 10 26 65 
The matrix A = 25u; v] + 10u;v7 + z usv3 is then 
150,003 79,999 50,001 
soo 7 200 9 soo 7 
_ 15 3747 2001 45 _ 1249 
A= 2 250 7 100° 2 250 
5 , 11.241 6003 15 , 3747 
—3 + 359 100 2 + 35 
whereo — Zum The determinant of A is L, not particularly small. However, the condition 


-— 


ioo; Finally, the 2-norm of A 


number of A is large, since it is 25,000, the ratio of 25 and 
the largest singular value, is 25. 

We have constructed a matrix A with a small singular value. It has modest determinant 
and 2-norm but a large condition number. How long are the vectors r; that make up the 
rows of A? The 2-norms of these row vectors whose components define the equations in 
the system Ax — y are then found to be 24.69, 9.57, and 4.87, respectively. 

In Section 12.4 we interpreted the determinant of a 3 x 3 matrix as the volume of 


the parallelepiped spanned by the row vectors in the matrix. For the matrix A that we have 


FIGURE 39.4 The row vectors in the 
matrix of Example 39.3 


39.2 Condition Numbers 985 


constructed, that volumeis det(A) — i and the row vectors spanning the parallelepiped with 
that volume are not particularly small. However, they are nearly coplanar, an observation 
consistent with A’s small singular value. To show that the rows of A are nearly coplanar, 
we obtain the length of the orthogonal projection of each row, in turn, on the plane spanned 
by the other two rows. 

The length of the projection of r3 onto the span of rı and rz is 1.1 x 107%, and the 
length of the projection of rz onto the span of rı and r3 is 3.2 x 107°, and the length of the 
projection of rı onto the span of rz and r3 is 6.4 x 107°. That the orthogonal projections 
are so small is evidence that the three vectors are nearly coplanar. Figure 39.4 contains a 
graph of these vectors. 

The exact solution of the system Ax = y, where y is the vector given in (39.6), and its 
floating-point equivalent are 


2 23,079 
— 3 — Ger V/2665 —581.21 
Xe = 165 /2665 =} 48422 
6 7693 peak 
E — 2665 193.68 


The augmented matrix [A, y], rounded to five significant figures, and its upper triangular 
form obtained on a simulated five significant-digit device are 


—5.8114  —7.7484 —1.9372 1 —7.7903 —0.38762 — 0.38762 1 
[A, y] = | —7.7903 —0.38762 —0.38762 1| 0 7.4592 —18.649 0.25402 
—1.6290 1.1629 7.1903 1 0 0 — 0.0045 0.83325 


Back substitution then gives, with errors in the second significant digits, the solution 


—555.67 
Xs = 462.90 
—185.17 


To understand the role of the condition number in predicting this loss of accuracy, 
measure the relative error in the computed solution by E — 0.0459. This suggests 
there could be errors in the second significant digit, which is what is actually observed. 


The increment in the matrix A, ascribed to rounding, is 


0.7560 — 10.8408 —6.4147 
AA = | 3.2115 — 0.68681 —22.2628 | x 10? 
0.36549 6.0604 3.2115 
and the condition number times the relative error in A is then 25,000 ales = 0.214. The 
condition number is on the order of 104, so errors in the fifth significant digit can be magnified 


é n . in aie +. 
to become errors in the first. We observed errors in the second significant digit. id 


Another Bound on Relative Error 


We next relate the relative change in the solution x to a relative change in the vector y, 
establishing the bound 


DASI nad (A) A! (39.8) 
lixo Il ly |l 


To this end, let the linear system Ax — y have the solution xo and let Ay be a small 
change in y so that Y = y + Ay is a perturbation of y. Finally, let the perturbed system 
Ax = Y have solution xy = xo + Ax. Then Ax, = Y, or 


A(Xo + AX) = Y =y - Ay 
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Removing the parentheses and replacing y with Axo, we get 
AXo + AAX = Y = Axo + Ay 
or AAx = Ay. Solving for Ax, we obtain Ax = A! Ay. Next, compute the norm of both 
sides, obtaining || Ax|| = ||A~!Ay||. Again from Section 33.5 we invoke the matrix norm 
property ||Mx|| < ||M|l|Ix||, obtaining 
Axl] < IA MMIAYII 
Divide both sides by ||y|| to get 
A A 
Axl] zji l'Ayll (39.9) 
MI M 
From Axo = y, we obtain the estimate 


Ilyll = || Axoll < ATI Xolh 


In the denominator of the fraction on the left in (39.9), replace ||y|| with a larger term, 


namely, with || A||||xo||, thereby strengthening the inequality. This gives 
|| Ax|| 1 | Ay 


cor b 
I|A MH Xo] DAL 
Now, multiply through by ||A||, giving 
I Ay 


AST < (yaya YT 

I|Xo || lly | 
On the left we have the relative error in xo, and on the right we have cond(A) times the 
relative error in y. Again we see the role played by cond(A) is estimating the propagation 
of error when solving a linear system. 


EXERCISES 39.2—Part A 


A1. Let A — A(0) and y be defined as in Example 39.1. Let A3. Evaluate || Ax ||;;/||X.||;o at c = 0.5. 
AA= E d and define B = A + AA. Obtain xo, the solution of A4. Graph cond (A) IA4los NS. 
Ax = y, and x., the solution of Bx = y. do Meg 
. y i ndn A5. At c = 0.5, show (39.5) holds for the quantities computed in 
A2. Obtain Ax = x, — xo and graph || Ax||,o vs. c. Exercises A1—4. 
EXERCISES 39.2—Part B 
B1. Let A — A(0) and y be as defined in Example 39.1. Define (a) obtain x, the solution of Ax — y. 
Ay — à and w = y + Ay, and obtain x,, the solution of (b) obtain x;, the solution of (A + C)x = y. 
Ax = w. Obtain Ax = x, — xo, where Xo is the solution of (c) obtain Ax = x; — x, and compute o = ie cond A, and 
1 
Ax = y. — Ici 
P IAI 
? r s 1 a AXlloo 
B2. If Ax, Xo, Ay, and y are as determined in Exercise 1, graph IIxolloc (d) on the same set of axes, plot œ and the product P cond A for 
and cond (A) js as functions of c. Does the graph support the 0<a<l. 
validity of (39.8)? (e) obtain z, the solution of Bz = y. 


(f) obtain z;, the solution of (B + C)z = y. 
lLAzIl 
lizi ||? 


a 


0 0 
Ify = [L 2,3], C = f 0 s|, and the matrices A, and B are as 


cond B, and 


(g) obtain Az = z; — z, and compute u = 


mE — Ici 
given in each of Exercises B3-6, v= qup 


U 0 g 


(h) on the same set of axes, plot jz and the product v cond B for 


0sdq-l. 


(i) observe that cond A is large but cond B is modest, that det A is 
modest but det B is not modest, and that both graphs are 
consistent with the inequality (39.5). 


(j) use the 2-norm to compute cond A, and show it is the ratio of 
the largest singular value of A to the smallest. Consequently, 

the large condition number of A indicates that A is close to a 

singular matrix even though the determinant of A is not 


“small.” 
1 -1 8 


B3. A= |s —] —4 


|n 10 2 


B4. A= 


B6. A= 


; 
| 10 -7 n 


If y = [-2,3, 5T, Ay = [0,0, a]', and the matrices A and B are as 
given in each of Exercises B7-10, 


(a) obtain x, the solution of Ax = y, and x;, the solution of 


Ax =y + Ay. 


(b) obtain z, the solution of Bz = y, and z,, the solution of 


Bz = y + ^y. 


(c) obtain Ax = X; — x, and Az = Z; — Z. 
(d) obtain a = 12x, g = 


lxil 


(g) on the same set of axes, plot B and à cond B for a > 0. 


(h) observe that cond A is large but cond B is modest, that det A 
is modest but det B is not, and that both graphs are consistent 


with inequality (39.8). 


(i) use the 2-norm to compute cond A, and show it is the ratio of 
the largest singular value of A to the smallest. Consequently, 

the large condition number of A indicates that A is close to a 
singular matrix even though the determinant of A is not 


*small." 


8 9 =5 
B7.A=|9 12 4 B 

|1 -2 -l 

[-4 8 -9 
B8.A-|-9 -3 4 

L2 -7 8 

[| 8 2 1 
B9. A= 4 7 6 B= 

|-10 -11 -9 


lazi and à = vl 
(e) obtain cond A, cond B, det A, and det B. 


(f) on the same set of axes, plot œ and A cond A for a > 0. 
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-7 -12 —9 7 3 -6 
B10. A= | —5 10 11 B= 5 3 —4 
2 —10 -—10 —1 1 10 
If y = [—7,4, 2]T and the matrix A is as given in each of Exercises 
B11-14, 


(a) obtain xo, the exact solution of Ax = y. 


(b) let B be the matrix obtained if A is rounded to four significant 
digits, and obtain a = 1774 

(c) let z be the solution of Bx — y computed by Gaussian 
elimination and back substitution performed in four 


significant-digit arithmetic. 


(d) let Ax = Z — Xo, and compute f = =a and cond A. 


(e) estimate the accuracy in z using (39.5) and the product 
acond A. 


(f) compare the estimated accuracy in part (e) with & computed 
in part (d). How useful is (39.5) in estimating the accuracy of 
a solution computed in fixed precision arithmetic? 


—543 1010 —2480 
B11. A = «d |-417 435 3205 


123,310 
1720 —20 1270 
2247 4590 —4025 
B12. A= = —550 4608 —2482 


158,996 
—2823 814  —887 
1082 —2454 —172 
B13. A = — —1290 2164 483 
l 1344 —2410 —296 


—5130 2603 1093 
B14. A= =- 6576 —2424 -8 
5798 —1725 =819 


In [16] we find the approximation cond A = m 10*, where k is the 
number of significant digits with which the approximate solution z has 
been computed for the system Ax — y, u is the solution of Ax — r, 
with r = Az being the residual vector and the norm is the oo-norm. For 


y = [1, 2, 3, 4]T and each matrix A in Exercises B15-18: 


(a) Let B be the result of rounding A to five significant digits, 
and let z be the solution of Bx — y computed by Gaussian 
elimination and back substitution in five-digit arithmetic. 


(b) Compute the residual r — Bz — y in 10-digit arithmetic. 
(c) In five-digit arithmetic, compute u, the solution of Bx — r. 


(d) Compare cond A with B 10°. 


—9128 1280 —157,020 218,512 

BIS. A= 1 352,822 185,647  —1,343,713 1,059,206 
j 12,057,292 | 114,386 118,693 —383,555 405,526 
448,330 98,283  —1,365,133 1,065,978 

—281,727 214,182 527,493  —241,751 

B16. A = 1 51,252 425,562  —618,612 —243,230 
` 43,666,854 | —581,037 95,778 122,121 —342,973 


—532,194 125,604 217,596 138,356 


988 


—15,420 399,548 

u 1 282,466 | —276,517 

B17. A = gos 221,763 —49,468 
—400,578 559,296 


9 


EXAMPLE 39.4 


Chapter 39 Systems of Equations 


21,607 —41,271 —100,915 | —284,840 94,525 181,335 
169,993  —70,199 B18. A = 1 152,985 154,160 | —133,245 —83,895 
—23,557 —66,458 : 9,661,790 16,908 57,394  —126,132  —193,622 

—245,774 | —314,239 —64,490 211,950 62,800 161,360 


RASEN 


Iterative Improvement | 


The Residual Vector 


If xo is an approximate solution of the linear system Ax = y, then r = y — Axo is called 
the residual vector for xo. Of course, if x; were the exact solution, then r would be 0, the 
zero vector. 


ho 


A symmetric n x n matrix whose entries are aj; = ; T is called a Hilbert matrix. Such 
matrices have large condition numbers and inverses containing only integers. As such, thes 
provide useful examples and counterexamples. The 5 x 5 Hilbert matrix and its inverse are 


[pd bl 
Ad d 25  —300 1050  —1400 630] 
2 3 4 5 6 —300 4800 —18,900 26,880 —12,600 

A-|iilii!i A^ =| 1050 —18,900 79,380 —117,600 ^ 56,700 
LOL Ro X oi —1400 26,880 —117,600 179,200 —88,200 
*& os 5 Y 8 630 —12,600 56,700  —88,200 44,100, 
s 6 7 8 5 


The condition number of A is the large number 943,656. Thus, Hilbert matrices are ex- 
tremely ill-conditioned, allowing us to test for stability and roundoff when solving linear 


systems. 
The vector y and xe, the exact solution to the system Ax = y, are 
1 5 
—120 
y=] 1 y= 630 
I —1120 
1 630 


Clearly, the residual vector for the exact solution is r = 0. Suppose, however, that we are 
working numerically on a five-digit device. Let A5 be A expressed to five significant figures. 
that is 

0.20000 

0.16667 

0.14286 

0.12500 

0.11111 


0.33333 
0.25000 
0.20000 
0.16667 
0.14286 


0.25000 
0.20000 
0.16667 
0.14286 
0.12500 


1.0000 

0.50000 
0.33333 
0.25000 
0.20000 


0.50000 
0.33333 
0.25000 
0.20000 
0.16667 


As 


and let xo be the approximate solution found by back substitution with the upper triangular 
form of the augmented matrix [As, y]. Let the residual for xo be ro, computed in double 
precision, which, here, is 10 digits. As can be seen in (39.10), the residual appears small, but 
Xe — Xo|loo = 108.4, so the co-norm of the difference between the exact and approximate 
solutions is large. For ill-conditioned systems, the residual vector is a poor reflection of the 
accuracy of the solution. The residual vector can be small, while the solution generating it 


EXAMPLE 39.5 


EXAMPLE 39.6 
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is far from accurate. 


4.2800 —0.0040000 

—104.94 —0.00166669 
Xo = 561.00 ro = | —0.00166669 (39.10) 

—1011.6 —0.00146422 

575.47 0.00003 173 
Surprisingly, however, even for ill-conditioned systems, the residual can be used to 
improve the accuracy of an inaccurate solution, as we shall now show. $ 

Iterative Improvement 


The process of refining an inaccurate solution using the residual vector is called iterative 
improvement in [60] and [38]; iterative refinement in [16], [49] and [19]; and residual 
correction in [60]. The steps of one cycle of the iterative improvement algorithm are as 
follows. 


Let x; be a solution of the linear system Ax — y. 
In double precision, compute r} = y — Ax;, the residual vector for x;. 


Solve the system Ae; = rz for ex, the error vector. 


SP PS 


Define x,4; = xy + ei, the improved solution. 


Before discussing the algorithm, we illustrate with a continuation of the example just 
given. 


In (39.10) we list xo, the five-digit solution of Ax = y, and ro, the residual computed 
in double precision. The system Aeo = ro must be solved for eg with the same Gaussian 
arithmetic as was used for obtaining xo. Thus, using As, Gaussian elimination, and back 
substitution we obtain eo and the first improved estimate, x; = xo + eo. Since ||x; — Xe|| = 
7.9 1s approximately E ||Xo — Xe ||; we conclude that an improvement has been made. 


0.67100 4.9510 
=13.993 —118.93 
e) = 64.016 x; = 625.02 
—100.48 —1112.1 
50.514 625.98 


Repeating the cycle of computing the residual ry for x;, the error vector e; as the 
solution of Ae; = rz, and the improved Xz+1 = X; + ej, we obtain the following vectors 
X2, X3, and x4. For these vectors, the norms ||x; — x.|| turn out to be 0.6, 0.03, and 0; so 
iterative improvement, at least for this example, is effective. 


4.9963 4.9997 5.0000 
—119.92 —119.99 —120.00 
X= 629.63 X; = 629.97 x4 = 630.00 $ 
—1119.4 —1120.0 —1120.0 
629.70 629.98 630.00 


We give one more example of the iterative improvement scheme, illustrating a more efficient 
technique for obtaining ez, the solutions of the systems Ae; = rz. In Section 34.1 we saw the 
LU factorization of a matrix A. In fact, if A = LU is the Doolittle decomposition, then the 
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system Ax = y becomes L(Ux = y and setting Ux = c means the system L,c = y can be 
solved for c by forward substitution and Ux = c can be solved for x by back substitution. 
The labor of Gaussian elimination is expended once when factoring A to LU, and any 
number of systems involving A can be solved by simply performing a forward substitution 
and a back substitution pair. Since the labor of factoring A is O(n?) but that of either a 
forward substitution or back substitution is O(n”), the computational savings are worth the 
effort of learning how to use factorization techniques. (See Section 39.1 for a discussion of 
operation counts.) 

Using a strategy from Section 39.2, we construct a 3 x 3 matrix A with prescribed 


singular values and large condition number. Let the unit vectors uy, k = 1,...,3, be 
the columns of the orthogonal matrix Q in (39.11); and obtain A as the outer product 
A =o uu; + omu] + 030304, where oz, k = 1,...,3, are the singular values 25, 10, 
and 1000* 
4 234 55 114,916,813 14,598,168 331,685,757 7 
53 308,089 5813 12,323,560 7,702,225 30,808,900 
Q 1 498 32 A= 14,598,168 328,177,409 154,427,346 
53 308,089 S813 = 7,702,225 38,511,125 38,511,125 
6 EE CS 42 331,685,757 154,427,346 1,321,270,873 
53 308,089 5813 30,808,900 38,511,125 77,022,250 .] 
(39.11) 


Even though the matrix Q contains radicals, A contains just rational numbers because 
the singular value decomposition of the symmetric A is U XUT. The matrix A has the 
modest determinant I but the large (2-norm) condition number 25,000. Thus, A is nearly 
singular and, with a large condition number, is ill-conditioned. Yet, it does not have an 
exceptionally small determinant! 

In five-digit arithmetic, the Doolittle decomposition of A (Section 34.1) is EL,U, 
where E is a permutation matrix (ET = E`!) recording row interchanges caused by partial 
pivoting. Hence, A is approximated by 


0 0 1 1 0 0] [—10.766 4.0099 17.154 
EL,U=|0 1 0| | —0.17604 1 0 0 9.02755 7.098 | 
1 0 0| | —0.86615 0.58179 1 0 0 0.0021265 | 


9.3250 1.8053 —10.766 
= 1.8953 8.5216 4.0100 
—10.766 4.0099 17.154 


where roundoff causes the (2, 3)-entry in EL,U to differ from the (2, 3)-entry. The system 
AX = y becomes EL, Ux = y. To allow forward substitution with the lower triangular Ly. 
multiply this last equation by ET, the inverse of E, to obtain L; Ux = ETy = b. Then, as 
usual, set Ux = c, and solve Lc = b for c by forward substitution and Ux = c for x bs 
back substitution. 

If y is the leftmost vector in (39.12), then Xe, the exact solution to the system Ax = y 
is the second vector in (39.12). To the right of the arrow it is approximated to five significant 
digits. Lastly, the vector b = ETy is given on the right in (39.12). 

8,526,850,633 


ji 7,102,225 1107.1 3 
y=]|2 Xe = ES- m — | —643.83 b-|2 (39.12 
3 13,023,744,981 845.45 1 
15,404,450 


The solution Xo, computed from the L; U decomposition with five-digit arithmetic, and 
the residual ro, computed in double precision, are given in (39.13). For this solution we 


39.3 Iterative Improvement 991 


also find ||xo — Xe || = 203, so xo contains considerable error. The correction vector eo, the 
solution of Aeg = ro, is found from L;Ueọ = Er, and is the rightmost vector in (39.13). 


1310.1 0.99547 —240.29 
1000.6 — 1.62732 —183.60 


The improved solution x; = xo + eo, along with xe, the fifth improvement generated 
by the process of iterative refinement, are given in (39.14). Since ||x; — xe|| = 37.3 and 


|X6 — Xe|| = 0.01, we conclude that iterative improvement was successful once again. 
1069.8 1107.1 
x; = | —622.14 X6 = | —643.83 (39.14) 
817.00 845.46 E 
Justification 


We conclude with a few words on why iterative improvement works. 
Just as Xo is an approximate solution of the system Ax = y, so also is e; an approximate 
solution of Ae, = r. Consequently, we write 


e. A rn-A!(y-Ax)-2A y- AT! Ax, = Xe— X; 


Thus, the correction e; is approximately the difference between the exact solution x, and 
the approximate solution X;, so Xe is then approximately x; + ej. 


EXERCISES 39.3 


1. The n x n Hilbert matrix H, = Inox | <i, j € n, notoriously substitutions.) Compute ||x. — x; || as a measure of the accuracy 

ill-conditioned even though its inverse is nice enough to contain of xj. 

only integers, is a useful czaple against which to test most matrix (c) Apply iterative improvement to x;, being sure to compute each 

algorithms. Let y = [1, 2, 3, 4, 5], and let A = Hs. residual r; in 10-digit arithmetic. Compute ||Xe — x; || for each 

(a) Obtain Xe, the exact solution of Ax = y. iteratively improved solution xz, k = 2,.... How useful is 

: ^ : re iterative 1 r 9 

(b) Let B be the result of rounding A to five significant figures. iterative improvement? 
Using five-digit arithmetic, compute x;, the solution of 2. A in Exercise B11, Section 39.2 
Bx = y. (Use an L1U decomposition of B and forward/back 3. A in Exercise B12: Section 39.2 
substitutions.) Compute ||x. — x; || as a measure of the accuracy . . . 

4. A in Exercise B13, Section 39.2 


of xi. 
(c) On the basis of cond A and the work of Section 39.2, estimate 5. A in Exercise B14, Section 39.2 


the accuracy in x). For the matrices A in Exercises 6—9, and the vector y = [1, 2, 3, 4]*: 
(d) Apply iterative improvement to x;, being sure to compute each 
residual r, in 10-digit arithmetic. Compute ||x. — x; || for each 
iteratively improved solution x;, k = 2,.... How accurately 
can the solution be computed using iterative improvement? 


(a) Obtain x,, the exact solution of Ax = y. 

(b) Let B be the result of rounding A to five significant figures. 
Using five-digit arithmetic, compute x,, the solution of 
Bx = y. (Use an LU decomposition of B and forward/back 


The matrices A in Exercises 2-5 are well-conditioned, thus reducing substitutions.) Compute ||X. — x; || as a measure of the accuracy 
the need for iterative improvement. For each such matrix and the vector of x,. 
= [-7,4,2]T: — 
y=l l (c) Apply iterative improvement to x;, being sure to compute each 
pply p g p 
(a) Obtain x,, the exact solution of Ax — y. residual r; in 10-digit arithmetic. Compute ||x. — x; || for each 
(b) Let B be the result of rounding A to five significant figures. iteratively improved solution x;, k = 2, .... How useful is 
Using five-digit arithmetic, compute x;, the solution of iterative improvement? 


Bx = y. (Use an L,U decomposition of B and forward/back 6. A in Exercise B15, Section 39.2 
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7. A in Exercise B16, Section 39.2 refined solutions converge to X, the solution of A;x = y. For 
wpe T 
8. A in Exercise B17, Section 39.2 example, if y = [1, 2, 3]. and 
> ; : —18€ 62e + 11 88€--e--30 — 81e — 5e — 28 
9. A in Exercise B18, Section 39.2 A(e) -| 


4c? —11e--10 57e? — 82e — 48 11e? 438€ - 7 |: 
10. The process of iterative improvement is often "strong enough" to S8 p468 Me Be -M-3.— 

use in the following way. Suppose the matrix A(¢) depends on the (a) Obtain A; = A(0.1) and X, the exact solution of Aix = y. 
small parameter e so that x, the solution of the system A(¢)x = y, (b) Obtain Ag = A(0) and z, the solution of Aox = y. 

will likewise depend on e. Let Ao = A(0) and A; = A(s1) fora 
fixed e;. Let z be the solution of Aox = y and iteratively refine z 
using A, to compute the residuals r but still using Ao to compute 
the error vectors e, via the equations Ape; = rz. The iteratively 


(c) Perform iterative improvement on z, being sure to compute the 
residual vectors r; with A,, but the error vectors e, with Ao. 
For each improvement x,, compute ||X — x, ||, and show that 
these norms get smaller and that x, converges to X. 


< The Method of Jacobi 
Fixed-Point Iteration for a Linear System 


FORMULATING AN ITERATION FuNcTION If the ith equation in the n x n linear system 
Ax = y is solved for the jth variable in such a way that each variable appears exactly once 
on a left-hand side of the rearranged equations and the equations reordered so the indices 
on the variables on the left-hand sides of the equations are in sequence, the equations can 
be written as 


n 
xj=xj+ = y= aux. J = lyssa n 
aij ms 

Defining the right-hand side of each equation as a function g;(x) and the vector of 
functions [g1(X), ..., g, (X)]T as the vector-valued function g(x), the rearranged equations 
become x = g(x), an equation that suggests a vector version of fixed-point iteration. The 
fixed-point iteration just described is called Jacobi’s method, or the method of simultaneous 
displacements [60], [38]. 

Ateach iteration in the method of Jacobi, xz+1 = g (xx), so anew value for every variable 
is computed, in sequence, from the values generated in the previous iteration. The method 
converges slowly, at a linear rate, as measured by ||x; — x ||, where x = g(x) is a fixed point 
of the iteration. The method is amenable to implementation on a parallel-processor machine 
where variables could be updated simultaneously on dedicated processors. 


EXAMPLE 39.7 To clarify the process of putting the linear system Ax = y into the form x = g(x), consider 
the 4 x 4 system of linear equations defined by the matrix A and vectors x and y in 


-6 11 3 10 xi 7 
10 -3 -2 -8 3» es 

Aeg. -g mm ndr" y=] g (39.15) 
-1 -4 12 -3 X4 -2 


If the ith equation in Ax = y is solved for x;, that is, if the first equation is solved for x;. 
the second, for x2, the third, for x3, and the fourth, for x4, the equations in X = g(x) would 


be 
— rm lt 5. "WEM wm " 12 
X1 = =s + 6 %2 + 5*3 + 344 X3 = 5 5*1 AQ 5 X4 
— 10 2 8... "EG ls 4, r 
m= 3+ 4x1 — 3i — 3X4 x4 = 3 3X1 = 3X2 t 4x3 


EXAMPLE 39.8 
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A more convenient form of these equations is given by 
1 n 
xj—xjdt—lyi— ) jk Xk J= Ll:wsfl 
j aij per 


the advantage being that on the right, the sum `}; a;,xj runs through all n variables in 
each equation. The alternative is the need to program each sum to skip one variable in each 
equation. 4 


Three Definitions 


The variable x; is the strictly dominant variable of the equation 5 ^ . ajjx; = yi if \aix| > 
7i jg lđij|. Thus, the absolute value of the coefficient of x, is strictly greater than the 
sum of the absolute values of all the other coefficients in the equation. 

The matrix A is a strictly dominant matrix if each equation in the linear system Ax — y 
has a strictly dominant variable, each in a different column. Thus, every row of A contains 
a dominant entry, an entry whose absolute value is greater than the sum of all the other 
entries in that row, and no two rows have a dominant entry in the same column. 

The matrix A is strictly diagonally dominant if it is strictly dominant, and the dominant 
entry in each row is a;,;, the diagonal element. In essence, the rows of a strictly dominant 
matrix can be rearranged to form a strictly diagonally dominant matrix. 


The matrix A, is strictly diagonally dominant because of the inequalities to its right. 
15 ] -8 -4 lau = 15 > |I| +|- 8| +|- 4| = 13 
—]1 38 12 11 la22] = 38 > | — 11| + |12| + |11| = 34 
2 —5 -13 4 laal = 13 > |2] +|—5|+ A = 11 
-10 3 12 —30 |a44| = 30 > | — 10] + [3| + |12| = 25 
(39.16) 
The matrix A» is not strictly diagonally dominant because of the inequalities to its right. 
0 0 1 9 laii] =O < 0| [1| + |9| = 10 
PR =6 =} o * =6 la] = 1 «|— 6| |4| - | — 6| = 16 
7 6 -7 -7 0 la33| = 7 < |6| +| —7| + |0| = 13 
—11 6 —8 -1 la44| = 1 < |- 11| 4+ |6| + | — 8| 2 25 


The matrix A3 is not strictly diagonally dominant because of the inequalities to its right. 


—12 -29 11 -3 la] = 12 < |- 29| + |11| + | — 3| = 43 
-12 -9 4 27 la22| 20 < | — 12| + |4| + [27| = 43 
^5—|. 59 -3 7 5| la -7«1-20 4 |—3| + I5] = 28 
—1 6 24 12 |aq4| = 12 < | — 1| + |6| + |24| = 31 
In A3, however, aj? = —29 is a dominant element in row 1, a24 = 27 is a dominant 
element in row 2, a3; = —20 is a dominant element in row 3, and a43 = 24 is a domi- 


nant element in row 4. Thus, A3 is strictly dominant, but not strictly diagonally dominant. 
Moreover, if row 1 becomes row 2, row 2 becomes row 4, row 3 becomes row 1, and row 
4 becomes row 3, A3 will be the strictly diagonally dominant matrix B where the strictly 
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dominant elements in each row are now on the main diagonal. 


-20 -3 7 5 
pa B - na ä 


=] 6 24 12 
—-12 =9 4 27 


Analysis 


If the Jacobi method converges, it does so linearly and slowly. However, if A is a strictly 
diagonally dominant matrix, then Jacobi iteration converges for any starting vector Xo. 
providing each equation is solved for its dominant (diagonal) variable. (See [16] for a 
proof.) 

In the event the linear system Ax — y does not have a strictly dominant matrix A, 
the equations should be rearranged to make the system matrix as close as possible to a 
diagonally dominant matrix. Thus, as many equations as possible should be solved for their 
dominant variables. 


EXAMPLE 39.9 The matrix A, in (39.16) has been shown to be strictly diagonally dominant. The vector y 
and the exact solution x, of the corresponding linear system Ax — y are given in (39.17). 


_ 40,951 
1 "egre —0.2087387796 
2 mers |. | 01751222073 
Y=13] X=] 95 ^ | -0.3928118135 (82.17) 
4 P —0.2033662448 
— 15.091 


Solving for the ith variable in the ith equation, we therefore obtain a convergent fixed-point 
iteration of the form x — g(x), whose equations are 


"PEE EE B 4. wt Da, Še 4. 
X = 15 — 1832 qgX3 + qgX4 — X3 — — TRH GX — 1332 + gY 
aei as Tu 6. 1H a a Gus di à 

X2 = ig + 35X1 — 1933 — 3gX4 — X4 = ZH — gXi t 1932 + $33 


Table 39.6 lists some of the first 20 iterates of the iteration X4, = g(X;), starting with 
the initial vector xy = [10, 10, 10, 10]T. The rightmost column of Table 39.6 lists ||x; — x. ||. 


k xi X2 X3 X4 IX — Xelloo 
0 10.0 10.0 10.0 10.0 10.3928 

1 7.400000000 —3.105263158 0.538461538 1.533333334 7.6087 

2 0.9697525866 1.580836707 2.573819163 —2.695141700 2.9666 

3 0.6152766536 0.3007370314 —1.518865013 0.7310271402 1.1260 

4 —0.5685032383 0.4987664423 —0.0268479453 —0.9158978532 0.7125 

5 —0.2251427612 0.1616714764 —0.7918792385 0.0953052122 0.3991 
16 —0.2088100049 0.1751546057 —0.3926759303 —0.2035262613 0.16 x 10? 
17 —0.2087111395 0.1751049996 —0.3928844679 —0.2032849099 0.81 x 107* 
18 —0.2087546922 0.1751296076 —0.3927759168 —0.2034062407 0.40 x 1074 
19 —0.2087307936 0.1751178430 —0.3928294143 —0.2033458419 0.20 x 10-4 
20 —0.2087424350 0.1751241711 —0.3928026285 —0.2033763835 0.10 x 107* 


TABLE 39.6 Jacobi iterates in Example 39.9 
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the norm of the difference between the kth iterate and the exact solution. It should be clear 
from this data that the iteration converges to the fixed point, but converges slowly. In fact, 
the convergence is linear, as an inspection of the norms in the rightmost column suggests. 
When the number of zeros before the first significant figure does not double at each iteration, 
the convergence is not quadratic. Since it takes several iterations to add another zero before 


the first significant digit, the convergence appears to be linear. 


EXERCISES 39.4 


:*. 
«v 


1. Obtain the exact solution of the linear system 2x + 3y = 9, 
5x +4y = 9. Then, solve each equation for its dominant variable, 
and obtain x, k = 1, 2, 3, by Jacobi iteration starting from xp = 0. 


In Exercises 2-11: 


(a) Rearrange the rows of the given matrix C so that it becomes a 
strictly diagonally dominant matrix A. 


(b) Let y = [liess n|', where n = 4 or 5, as appropriate, and 
obtain x,, the exact solution of Ax = y. 
(c) Using xf? = (y; — p» ajxt- ?)/ai and taking xj = 0 as 


the initial vector, implement Jacobi iteration in terms of the 
individual equations. Monitor convergence by computing 
Ox = ||Xe — X; ||, and note the number of iterations required for 
this measure to be less that 1075. 

(d) If A = {a;;}, let D = diag(ai. .... Gyn) be a diagonal matrix 
whose entries are the (main) diagonal elements in A. Let 
B = D — A, then obtain T = D`! B and v = D^! y. The matrix 
form of Jacobi iteration for Ax = y is then X;,; = Tx, + v. 


(e) Obtain p, the maximum magnitude of the eigenvalues of T. 

(f) Implement the matrix form of Jacobi iteration, and compare ox 
from part (c) with p*||Xe — Xo||. These numbers should be 
approximately the same. 

(g) Using the oo-norm, verify empirically that the bound 
Xe — x«l UT l^ lxi — xoll/C. — ITI) is valid. 


| 1 8 8 25 9 3 19 6 
-20 6 6 =7 T BE sS J 
2. 6 0 tl -2 3. 19 -3 -8 6 
| -9 21 3 -7 ^ NE NET NES 

[ -2 1 10 1 —5 6 2. =% 
E D 4 9 17 T ed 1 

4. 4 7 -l 0 5 7 a8 25 = 
L-9 0 -7 19 -2 =19 8 4 
[9 -4 9 26 9 a^ —91 7 

6 8 —24 5 8 L0 28 9 -6 
oy g 7 * | 18 5 1 3 

L-3 -7 18 3 =j 9 -3 2l 


—31 67 15 —15 4 

9. 39 -25 —83 2 13 
9 46 16 107 20| 

L 67 45 —1 0 16 

[48 46 —93 —14 22 


9 —34 10  —100 44 
10. 9 34 18 16 —82 

41 —90 -—14 2 31 
L149 49 26 33  —35 


[-14 TI 9 21  —31 
—44 33  —25 48 152 
11. 3 34 -79 -25 6 
90 —30 -—24 —9 18 
L-32 —29 21 3113 -22 


For each of the matrices A given in Exercises 12-17: 


(a) Show that p < 1, where p is the maximum magnitude of the 
eigenvalues of T = D^! (D — A), as defined for Exercises 
2-11. 


(b) Obtain x., the exact solution of Ax = y, where y = [2, —5, 3]. 


(c) Show that Jacobi iteration for the system in part (b) converges 
for xy — 0. Actually, it is not necessary for A to be strictly 
diagonally dominant for Jacobi iteration to converge from any 
starting point. More generally, the iteration converges for any 
starting point if the condition in part (a) holds. 

[20 4 -3 ja 5 5 

12. -| -2 -5 6 13. -| 5 —12 9 


5|-3 1 15 0 1 42 
1[%4 8 0 k ax -3 
i —|-7 3e 9| d1d&-|3 w 2 
2| 3 -5 48 à eb o 
,f30 2 9 1/48 7 u 
i6 —| © 40 =| =| 10 30 10 
101.3 9 50 l6| 9 2 32 
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EXAMPLE 39.10 


Gauss-Seidel Iteration 


The Gauss—Seidel Method 


In an attempt to speed up the convergence of the Jacobi fixed-point iteration x = g(x) for 
solving the linear system Ax — y, the Gauss-Seidel method uses newly generated values 
for the x;'s just as soon as they become available. Thus, the Jacobi method computes Xm+1 
from g(x,,) by a recipe of the form 


1 
a i = — | y- ) aps x?” k=1,...,n 
lir 
Akk sxk 


or even of the form 


1 k-1 n 
ap = — |y- ) aks X” — ) Asx” k=1,...,n 
s—l 


kk 
kk sd 


„m 


where the kth component of the vector x,, is denoted by x". 
The Gauss-Seidel method computes the components of Xm+1 by a recipe of the form 


1 k-1 n 
xm — — (x — > ay,x"*l — aust] k=1,...,n (39.18) 
Akk 2. Ži 

The difference in the two methods is subtle. In the first summation on the right-hand side 
in (39.18), newly generated values for xs, s = 1,..., k — 1, denoted by cia are used as 
soon as available. Although this generally speeds up convergence, it makes the method less 
amenable to implementation on multiprocessor computers. 

Because the method immediately uses updated information, it is sometimes called the 
method of successive displacements. 


Analysis 


CONVERGENCE If Gauss-Seidel iteration converges, it converges linearly. However, it 
generally converges whenever Jacobi iteration converges and at a faster rate, but there are 
linear systems for which Jacobi iteration converges and Gauss-Seidel does not and linear 
systems for which Gauss-Seidel iteration converges and Jacobi does not. (See [94] for 
details.) 

Like the Jacobi method, the Gauss-Seidel method converges from any starting vector 
when A is a strictly diagonally dominant matrix. Alternatively [9], if the real matrix A is 
symmetric and positive definite with strictly positive entries in the main diagonal, Gauss— 
Seidel iteration will also converge. (The real symmetric matrix A is positive definite if all 
its eigenvalues are positive, guaranteeing that x Ax >0 for all x 4 0. See Section 33.4.) 


The matrix A in (39.19) is clearly symmetric but not diagonally dominant since, for example, 
|a22| = 16 < |12| + |5| + | — 8| = 25. It is positive definite, however, since its eigenvalues 
are 0.71, 11.8, 34.4, and 41.1. 


32 12 —4 9 


2 16 5 -8 
=) 4 § $4 -l iiim 


9 —8 -1l1 16 D 
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RATE OF CONVERGENCE Write the matrix A in the form A = L + D + U, where L is 
zero on and above the main diagonal, D is zero off the main diagonal, and U is zero on and 
below the main diagonal. Then [38] shows that the rates of convergence for the Jacobi and 
Gauss-Seidel iterations are determined by the largest magnitude of the eigenvectors of the 
respective matrices 


B; 2D (-L-U)-D (D-—4A) and Bos = (-D-L) 'U-(U—A) !U 
In fact, if the largest magnitude of the eigenvalues of B; or Bgs is less than one, the corre- 


sponding method converges, whether or not the matrix A is strictly diagonally dominant. 


For the matrix A in (39.19), the matrices L, D, and U are 


0 0 0 0 32 0 0 0 0 12 —4 9 
12 0 0 0 0 16 O0 0 0 0 5 —8 
im —4 5 0 0 alae 0 024 O dn 0 0 0 -11 
9 —8 -1l 0 0 0 0 16 0 0 0 0 
and the matrices B ; and B, are 
3 1 9 3 1 9 
0 -3 § `z 0 —& & `a 
3 5 1 9 13 91 
~ 4 0 =i 2 0 39 32 128 
a= | 5 1 Bas = 0 31 27 809 
6 4 0 24 256 256 3072 
9 I 1l 1099 823 34,147 
~ 16 2 16 0 0 4096 4096 49,152 
The magnitudes of their eigenvalues are [0.441, 0.507, 0.900, 0.962] and [0, 0.119, 0.274, 
0.926], respectively. 


The magnitudes of the eigenvalues of each matrix are no greater than one, so both 
methods will converge for this matrix, but the Gauss-Seidel method will converge slightly 
faster since 0.926, the maximum magnitude of its eigenvalues, is slightly smaller than 
0.962, the maximum magnitude of the eigenvalues of the matrix B z. e 


Implementation 


Solve the linear system Ax — y by Gauss-Seidel iteration, with A given by the symmetric 
positive definite matrix in (39.19), and y = [1, 2, 3, 4]T. The exact solution, Xe, is given by 


. 3506 
ae —2.078245406 
5434 

x| T | e | 322110549 

e=] 122 | | 0724362774 
nd 3.527563723 


5951 
1687 


Rather than write two sums as in (39.18), it’s easier to assign new values to the same 
symbols, namely, the xy, k = 1,..., 4, so that whenever an x; is called as an input in the 
computation, its value will already have been updated. This strategy is then implemented 
by writing the general equation in the form 


where we solved the kth equation for the kth variable. Table 39.7 lists the components of x, 
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k xi X2 X3 X4 IX — Xelloo 
0 10.0 10.0 10.0 10.0 12.08 
1 —5.2812500 5.9609375 2.5862630 7.9792277 4.45 
2 —4.1249765 6.4001390 1.7612877 6.9812540 3.45 
3 —4.1121189 6.1493138 1.3582813 6.5715421 3.04 
4 —3.9532037 5.9512110 1.2382539 6.3005821 2.17 
5 —3.8177111 5.7516201 1.1782275 6.0833039 2.56 

16 —2.8253574 4.3083080 0.91540601 4.6227592 1.10 

17 —2.7700908 4.2278833 0.90127381 4.5417434 1.01 

18 —2.7189123 4.1534079 0.88818704 4.4667207 0.94 

19 —2.6715198 4.0844418 0.87606834 4.3972477 0.87 

20 —2.6276330 4.0205773 0.86484610 4.3329139 0.81 


TABLE 39.7 Gauss-Seidel iterates in Example 39.11 


and, in its rightmost column, ||x; — Xe ||. The iteration, starting with xo = [10, 10, 10, 10], 
seems to be converging, but slowly, as determined by the magnitudes of the eigenvalues of 
the matrix Bes. 


EXERCISES 39.5 


1. Let A = L + D + U, where L, D, U are described just after (d) to show that the result is the set of equations implemented in 
Example 39.10. matrix notation in part (a). 
(a) Show that Ax = y can be put into the form x = Bgsx + v, 2. the matrix in Exercise 2, Section 39.4 


= mee ERA. : m 
where v = (L + D) y. Hint: Isolate (L + D)x in Ax = y. 3. the matrix in Exercise 3, Section 39.4 


(b) For the case n = 2, use the equations ax, + bx; = y, and 4 
cx; + dx» = y» to show that X = Bgsx + v is actually 5 
Xi41 = BgsX, + v and, therefore, represents Gauss-Seidel = 
iteration. Hint: The first equation in Xy,; = Bosx, + v is just 6 

axı + bx» = yı solved for xı, and the second is cx; + dx. = y» 7. the matrix in Exercise 7, Section 39.4 

8 
9 


. the matrix in Exercise 4, Section 39.4 
. the matrix in Exercise 5, Section 39.4 


. the matrix in Exercise 6, Section 39.4 


solved for x», after which x, is replaced by its equivalent from 


] . the matrix in Exercise 8, Section 39.4 
the first equation. 


. the matrix in Exercise 9, Section 39.4 
In Exercises 2-11, set y = [1, 2, 3, 4]T, and let A be the diagonally 


; s : s . 10. the matrix in Exercise 10, Section 39.4 
dominant form of the given matrix C and write A = L+ D +U. " "ru 


Nit 11. the matrix in Exercise 11, Section 39.4 
(a) Use the matrix formulation x;,,; = Bgsx; + v, where 
v = (D + L)^!y, to implement Gauss-Seidel iteration, starting For the matrices A given in Exercises 12-17 and y = [—3, 7, 5]T: 


at X) = 0. Note the value of k for which ||x, — x;l|4, < 1075. . : 
o Ixe — xe llo (a) Obtain xe, the exact solution of the system Ax = y. 


(b) Obtain the matrix Bgs = (U — A)! U, where A = L+ D +U 
as in Exercise B1. 


(b) Using the oo-norm, test the validity of the inequality 
IXe — x«l < || Bes|I* lxi — xoll/C1 — IBaslD- 


c) Using the oo-norm, test the validity of the inequalit A " cm s 
5 d ined (c) Show that the matrix A is positive definite. 
[Xe — Xll S HBoslllxe — xoll- 


(d) Write the equations for Gauss-Seidel iteration in the form (d) Show that the eigenvalues of Bes all have magnitude less 


(39.18) than one. 


(e) Make successive substitutions in the equations written in part 


(e) Starting from xy = 0, implement the matrix form of 
Gauss-Seidel iteration and determine the number of iterations 
required for ||Xe — Xx [loo < 1075. 


(f) Write the Gauss-Seidel scheme in the form (39.18), and then 
make the appropriate substitutions to bring the equations into 
the matrix form implemented in part (e). 


For the matrices A given in Exercises 18-23 and y = [6, —7, 1, 9]T: 


(a) Obtain xe, the exact solution of the system Ax = y. 
(b) Obtain the matrix Bas = (U — A) !U, where A=L+D+U. 22 
(c) Show that the matrix A is positive definite. 


Nr WN 
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(e) Starting from x, = 0, implement the matrix form of 
Gauss-Seidel iteration, and determine the number of iterations 
required for ||Xe — xl, < 1075. 

(f) Write the Gauss-Seidel scheme in the form (39.18), and then 
make the appropriate substitutions to bring the equations into 
the matrix form implemented in part (e). 


8 6 I 12 7 a 3 10 3 7 6 

14. |6 7 3 T 12 6 F 3 8 2 2 

1 3 1l 18. 7 6 11 1l 7 2 6 4 

7 2 4 2 3 7 1 8 6 2 4 6 
2 17.| 4 5 6 7 2 4 2 10 8 4 5 
9 2 © 10 2 8 $ 3 8.9 5 3 
20. 4 8 10 4 zh 4 5 9 6 
2. 3 4 3 > $ 6 7 

12. 7T & 10 T2 7 4 6 

7 9 6 6 7 10 8 6 

5.6 9 5 n 4 8 9 3 

10 6 5 9 6 6 3 6 


(d) Show that the eigenvalues of Bgs all have magnitude less 


than one. 


Relaxation and SOR 


Relaxation—the Concept 


The idea of relaxation has been attributed to the British engineer, Richard Southwell, [86], 
although some claim that Gauss was familiar with the concept. Conceived in the “by- 
hand” era before computers, the idea underlies the more modern method of successive 
overrelaxation (SOR). Our exposition will be in terms of the linear system Ax = y, for 
which the strictly diagonally dominant matrix A, the vector y, and the exact solution x, are 
given in 


—]12 -1 1 —11 1 
A= i 13 7 y= 48 Xs |2 (39.20) 
3 4 8 35 3 


The residual vector is R(x) = Ax — y, where, of course, R (xe) = 0. The vanishing of 
the kth component of R is equivalent to the satisfaction of the kth equation in the system 
Ax = y. Solving each such equation for its dominant variable gives 


Xj —x1(x2, X3) = 51 — 3 Loi) 


X2 = X2 (X1, X3) = 4 (48 — X1 — 7x3) 
X3 — X3(x1, X2) = £5 — 3x1 = 4x2) 


where the equations are interpreted as functions that determine the value of x, that annihilates 
the kth component of R. 

If we start an iteration process at xp = 0, the residual vector would initially be R = —y, 
in which the largest absolute value is 48, occurring in the second equation. If we could make 
the largest residual zero, that is, if we could relax the largest residual to zero, we should be 
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led to a more accurate solution. Our strategy, then, is to keep x; = x3 = O and adjust x» to 
make the second component of R become zero. 

The value of x2 that drives the second component of R to zero is x2(0, 0) = s. If x2 
is set equal to this value while keeping x; = x3 = 0, then the next member of the sequence 
of iterates is xy = [0, x» (0, 0), OJ? = [0, E, OTT. 

Since the vector x has changed to Xi, the residual vector R will change to R(x). 
whose largest magnitude is in the third component. Relax that third component to zero by 
computing x3(0, 8) = 2 giving x2 = [0, s, aT, 

The largest magnitude in R(x2) is the second, so relax that component to zero by 
computing x»(0, 263) = 2.33, giving x3 = [0, 2.33, 263), The largest magnitude in R(x3) 
is the first, so relax that component to zero by computing x; (2.33, 263) = 0.933, giving 
x4 = [0.933, 2.33, 2e TT. The largest magnitude in R(x4) is the third, so relax that compo- 
nent to zero by computing x5(0.933, 2.33) = 2.86, giving xs = [0.933, 2.33, 2.86]T. The 
largest magnitude in R(xs) is the second, so relax that component to zero by computing 
x2(0.933, 2.86) = 2.08, giving xg = [0.933, 2.08, 2.86]T. The largest magnitude in R (xs) 
is the third, so relax that component to zero by computing x3(0.933, 2.08) — 2.98, giving 
x7 = [0.933, 2.08, 2.86]". The largest magnitude in R(x7) is the second, so relax that com- 
ponent to zero by computing x5(0.933, 2.98) = 2.01, giving xg = [0.933, 2.01, 2.86]. All 
these calculations are summarized in Table 39.8, an unsophisticated summary of Southwell's 
more efficient tableau. 


k R(x&) xi Xk+1 k R(x;x) xi Xk+1 
11 0 0 0.933 

0 E x(0,0) = # i 4 | 0.933 x3(0.933, 2.33) — 2.86 E | 
-35 0 —2.65 2.86 
7.31 n 0.331 0.933 

1 l 0 x; (0, 55) = 28 n 5 [is x2(0.933, 2.86) = 2.08 [s | 
—20.2 263 0 2.86 

104 

9.83 0 0.581 0.933 

2 | x(0, 285) = 2.33 EI 6 | 0 x3 (0.933, 2.08) = 2.98 [s | 
0 BE —1.00 2.98 
11.2 0.933 0.706 0.933 

3 | 0 x1(2.33, 28) = 0.933 E 7 [ns x2 (0.933, 2.98) = 2.01 E | 
—5.45 263 0 2.98 


TABLE 39.8  Southwell's relaxation technique 


Although it can become tedious, selecting the component with the largest magnitude 
in the residual vector is something that can be done “by-hand” for a system of modest size. 
Clearly, having to pick, repeatedly, the largest number from a list of 10,000 would be highly 
susceptible to error. Moreover, having a computer make the many comparisons required to 
select the largest magnitude is not efficient, and this version of the relaxation algorithm is 
not a viable method for solving large problems on a computer. However, the underlying 
concept does motivate the method of successive overrelaxation, the SOR technique, which 
is capable of being implemented on a computer. 
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Successive Overrelaxation 


Southwell discovered that often, when driving a component of the residual to zero, the other 
components would move in the same direction. For example, the third component of the 
residual R(x;) is driven to zero by increasing it from —20 to 0. The first component of 
R(x2) is then driven upward from 7.31 to 9.83, and the second component is driven upward 
from 0 to 17.7. 

This led Southwell to *overcompensate" or overrelax, pushing the residual, not to zero, 
but beyond zero. All that is needed is a more efficient way of implementing the calculations 
on a computer. Formulating the system Ax = y as if for performing Gauss-Seidel iteration 
is the basis for this efficiency. 

Assuming that the kth equation has been solved for x;, we write the linear system in 
the form 


1 n 

_m+1 m " „m 

Xk = Xk + — Jk — ) Aks X, 
dkk =I 


as in the Jacobi method. Then, recognizing that the expression in parentheses is actually the 


kth component of the residual vector R, we write x^! = x!" + R(x,,)/azg. By introducing 


the relaxation factor c > 0, this equation is modified to 
e) 
xp = yh. —R(x,) 
ükk 


Finally, write the general equation in the form 


m k-1 n 
am4l „m " -m+1 m 
XQ =(1= 0); F — iy ) Gist, = J AksX, 
akk E 


s=k+1 
which is now consonant with the Gauss-Seidel method, except for the introduction of c, 
the relaxation factor. Clearly, if œ = 1, the SOR technique is precisely the Gauss-Seidel 
method. If A is asymmetric positive definite matrix and0 < w < 2, then the SOR technique 
converges from any initial vector. (See [67] for a proof.) 


Implementation 


Implementing the SOR method for small systems is more conveniently done in matrix form. 
To accomplish this, write the linear system Ax = y in the form y — Ax = 0 and multiply 
through by c, giving 0 = w(y — Ax). Write A = L + D +U, where L is zero on and above 
the main diagonal, U is zero on and below the main diagonal, and D is zero off the main 
diagonal. In addition, add Dx to each side of the equation, thereby obtaining 


Dx = Dx —w(L + D +U)x + wy 
Bring the term —q@Lx to the left, giving 
(D+ oL)x = [(1 — 9) D — oU ]x + oy 


Let the vector x on the left side be the updated one, namely, Xm+1, while keeping the x 
on the right side as the “old” one, namely, Xm. This gives 


(D t OL)Xm+41 = Ke! — w)D = OU ]x,, + oy 
Solve for x,,4; to obtain 


Xm+1 = (DF oL) ![(u1 — @)D — oU]x, + o(D + oL) !y 


1002 


EXAMPLE 39.12 


s * P Mea 
£t 


fi ` 
T 


í a 
0 0.5 1 1 


E. 
5 2 
FIGURE 39.5 The eigenvalues of 

B = (D-- oL) [(1 — w)D — oU] in 
Example 39.12 


Chapter 39 Systems of Equations 


which has the fixed-point form 
Xm+1 = BXm + C= g(X5) 
where B = (D+ oL) ![(1 — &)D — oU] and € = o(D + oL)^ly. 
Consider the linear system Ax — y for which the symmetric, positive-definite matrix A. 


the vector y, and the exact solution x, are given in (39.21). The matrix A is obviously 
symmetric. Its eigenvalues are 0.36, 10.7, and 19.0, so it is also positive definite. 


8 —5 -7 —23 I 
A=|-5 14 1 y= 26 xs m2 (39.21) 
—] 1 8 19 3 
Decompose A as L + D + U, where L, D, and U are given by 
0 0 0 8 00 0 —-5 -7 
L=|-5 0 0 D=|0 14 0 U=10 0 1 
-7 1 0 0 0 8 0 0 0 
The matrix B = (D + oL) ![(1 — w)D — wU] is 
]1—o Sw m 
B= zo — w) po -wo+! Zw — Lo 
150 5o 98)(w — 1) aw + Ho? m Bg" t Mow? w+ 1 
and the vector C = o(D + oL)^ly is 
-Bo 
C= -o (Hw — B) 
115,2 — 1231, , 19 
O ggg — dg Og) 


The eigenvalues of B determine the rate of convergence of the SOR iteration. Since 
we wish to pick c so that the largest magnitude of the eigenvalues is as small as possible. 
we provide Figure 39.5, a graph of the three eigenvalues as a function of œw. The smallest 
maximum in the absolute values of the eigenvalues will occur at the lowest point for which 
a horizontal line lies above all three curves. From the graph, the optimal value of w appears 
to be approximately 1.55. 

For w = 1.55 the matrix B and the vector C become 


—0.55 0.9687500000 . 1.356250000 —4.456250000 
—0.3044642857  —0.013727679 . 0.6400669643 0.4117187500 
—0.6869475447 1.316526926 . 1.165401088 —2.442309569 


respectively. Starting with the initial vector [10, 10, 10]T, Table 39.9 lists the SOR iterates 


Xp es. re 10, and [xi — Xe llo, the norms of the differences between the iterate and 
the exact solution. 
If xig were computed with c = 1.75, we would find ||xio — Xelloo = 1.03, indicating 


E 
d 


that convergence with this value of œ is slower than with œ = 1.55. 


Equivalence of Forms 


When w = 1, the SOR method reduces precisely to the Gauss-Seidel method, an equiva- 
lence we will now verify for the system in Example 39.12, whose Gauss-Seidel equations 
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k xi X2 X3 Ix% — Xelloo 
0 10.0 10.0 10.0 9.00 
1 13.29375000 3.630468746 15.50749512 12.51 
2 12.78124436 6.240244067 11.27764306 11.78 
3 9.85460544 3.653069007 10.13607283 8.85 
4 7.40967639 3.848960551 7.41004743 6.41 
5 5.24698535 2.845826190 6.17056897 4.25 
6 3.78363634 2.7247709863 4.89108132 2.78 
7 2.73584174 2.352952246 4.24575613 1.74 
8 2.07676629 2.264020314 3.72404447 1.08 
9 1.64553353 2.131975680 3.45171011 0.66 

10 1.38543983 2.090771093 3.25672532 0.39 


TABLE 39.9 Example 39.12: SOR iterates with w = 1.55 


are 


.m+1 _ 5 ,m4l l.m.,.13 
1471 14773 


- uh - Imt 29 1 mol Be 19 


3 mE i 8 2 


When o = 1, the matrix B and the vector C will be 


5 7 _ 23 

0 8 8 8 
= 25 27 = 93 
B= 0 112 112 C = 112 
Q 465 659 219 
896 896 896 


Consequently, the SOR equations in the fixed-point iteration x,,4; = Bx, + C are 


m4 Sym 7m 23 
Xj pote s 
m-4l 25 m 27 m 93 
2 112%2 t9 ti» 
mal 465 m 659 .m _ 219 
X3 80672 T 89673 — 896 


and we want to show these equations are indeed the Gauss-Seidel equations. Clearly, the first 

equation in each formulation is the same. In the second Gauss-Seidel equation, replace x/"*! 

from the first, obtaining x2 *! = 23.x3' + ZLx7 + 23, the second equation in the SOR 

formulation. In the third Gauss-Seidel equation, replace x3’*! from the second equation. 

This introduces another x7’*'. Now replace all x/"*' from the first equation, and the result 
m+1 _ 465 yn JE 659 m 219 


will be x? ^ = a52X5 + gggX3 — ggg. the third equation of the SOR formulation. Thus, 
we have verified that the matrix form of the SOR iteration actually uses the updated values 


Xm+1 in the same way that Gauss-Seidel iteration does. 
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EXERCISES 39.6 


1. Write A — E ?] in the form L + D + U. Then: 


(a) Obtain B = (D + oL) ![(1 — @) D — oU] and its eigenvalues. 


(b) As a function of w, plot the magnitudes of the eigenvalues of 
B, and determine the value of w for which the maximum 
magnitude is minimized. 


For the matrices A given in each of Exercises 2-7 and y = [1, 2, 3]: 


(a) Obtain x, the exact solution of the system Ax = y. 


(b) Implement Southwell’s relaxation technique as summarized in 
Table 39.8. 


4 7 -9 4 0 
2.15 15 -8| 3.|-5 13 
3 5 -9 tl 


6 0 1 12, -T -3 11 =8 2) 
5. 1 —7 1 6. | —7 8 0 7. | 9 -12 1 
—4 2 9 8 5 —14 9 5 15 


For matrices A given in Exercises 8-13: 


(a) Obtain the SOR matrix B(w) = (D+ oL)! [(1 — 9)D — oU], 


where A — L -- D--U. 
(b) Obtain à+ (o), the two eigenvalues of B(w). 


(c) Plot |As.(@)| for 0 < w < 2, and from the graph, estimate ô, 
the value of œw for which max{|A..(@)|} is as small as possible. 
For several of the matrices, at least one of |A.(@)| is greater 
than 1 for 0 < o < 2, implying that there is no value of o for 
which SOR would converge. 


—46  —35 81 —26 —84 51 
8. l 33 A » E =| m. | 93 A 
63 78 —4 -—22 —94  —89 
1. E: iH 12. E “a 13. rE A 
For the system Ax = y determined by y = [—3, 7, 5]" and for the matrix 
A given in each of Exercises 14—19: 


(a) Obtain the SOR matrix B(w) = (D --oL)^![(1 — œ)D — oU]. 
(b) Obtain A;(@), i = 1, 2, 3, the eigenvalues of B(w), and graph 
their magnitudes as functions of w, 0 < œw < 2. 
(c) From the graph in part (b), determine ô, the value of c for 
which max(|A1(o)]. |A2(@)|, |A3(@)|} is as small as possible. 
(d) Starting from xy = 0, implement SOR iteration with œ = ô 
and determine the number of iterations required for 
Xe — Xx loo < 1075. Compare to the number of iterations 


required by Gauss-Seidel iteration, as determined in part (e) of 
Exercises 12-17, Section 39.5. 


14. Exercise 12, Section 39.5 
16. Exercise 14, Section 39.5 
18. Exercise 16, Section 39.5 


15. Exercise 13, Section 39.5 
17. Exercise 15, Section 39.5 
19. Exercise 17, Section 39.5 
For the system Ax = y determined by y = [6, —7, 1, 9]T and for the 
matrix A given in each of Exercises 20—25: 
(a) Obtain the SOR matrix B(w) = (D+ oL) ![(1 — 9) D — oU]. 


(b) For each a = x, k=1,..., 19, obtain A;(@,;), 
i=1,...,4, the eigenvalues of B(w) and determine 
oO, = max{|A;(@,)|,i = 1,..., 4}. 
(c) From a graph of (o;, w), determine ô, the value of c that 
minimizes the maximum values of the eigenvalues of B(w). 
(d) Starting from xo = 0, implement SOR iteration with c = @ as 
found in part (c), determining the number of iterations required 
for |X. — Xx|loo < 107?. Compare to the number of iterations 
required by Gauss-Seidel iteration, as determined in part (e) of 
Exercises 18—23, 
Section 39.5. 
20. Exercise 18, Section 39.5 
22. Exercise 20, Section 39.5 


24. Exercise 22, Section 39.5 


21. Exercise 19, Section 39.5 
23. Exercise 21, Section 39.5 
25. Exercise 23, Section 39.5 


If A is a positive-definite tridiagonal matrix, then the optimal value of the 

B . ^ 9 B + 
relaxation parameter is @ = 7—— , where p is the maximum absolute 
P 1+4/ 1-p? p ; 


value of the eigenvalues of By = D^! (D — A), the iteration matrix for Ja- 
cobi iteration. In each of Exercises 26 29, a positive-definite tridiagonal 
matrix A is determined by the main diagonal d, the (equal) subdiagonal 
l and superdiagonal u. For each such matrix A: 


(a) Obtain B, and its eigenvalues, and from them, determine p 
and à. 

(b) If y = [1, 2, 3, 4, 5, 6]T, obtain x., the exact solution of the 
system AX — y. 

(c) Starting at x; = 0, implement the SOR iteration with w = ô, 
determining an x; for which |x. — Xzllo < 107°. 

d —[16,24,24,21, 3,21] 27. d = [14, 22, 10, 25, 14, 8] 

u= 1 — [15,8, 13, 5, 2] u =l = [8, 8,6, 1, 5] 

d 


—[20,21,22,22,15,2] 29. 
u = 1 = [10, 11, 14,9, 1] 


26. 


28. 


d = [5, 21, 23, 24, 15, 4] 
u =l = [2,11,4, 12, 2] 


EXAMPLE 39.13 


FIGURE 39.6 A graph of the implicit 
functions y(x) determined by f (x, y) and 
g(x, y) in Example 39.13 
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, Iterative Methods for Nonlinear Systems 


Introduction 


Numerically solving nonlinear systems of algebraic equations can be difficult, especially 
if one has no idea where possible solutions might lie. Iterative methods that converge 
when started near a solution often have to be started very near to a solution. Systems of 
two equations in two unknowns can be examined graphically for the location of solutions. 
Systems of three equations in three unknowns have solutions at the intersections of three 
surfaces in space, but the corresponding graph is often difficult to interpret. 

Fixed-point iteration, in essence a nonlinear version of Jacobi's method, will converge 
slowly, if at all. Just as for linear systems, convergence can be accelerated by the Gauss- 
Seidel strategy of using new information immediately. And Newton's method, deferred to 
Section 39.8, converges quadratically when started close enough to a solution. 


The nonlinear system 
f(x, y) 512 + 3x + 8y + 12xy + 9x? — 12? = 0 (39.22a) 
g(x, y) =—5 — 12x — 6y + Oxy - 2x7 + 11y? 20 (39.22b) 


can be analyzed by examining a graph of the implicit functions y(x) determined by each 
equation. Using a solid curve for the function determined by f(x, y) = 0 and a dotted curve 
for the function determined by g(x, y) — 0, we have Figure 39.6, on the basis of which we 
obtain the two solutions (0.2475, —0.6904) and (36.78, —18.36). (See Exercise 1.) 


SOLUTION BY FIXED-POINT ITERATION To set up a fixed-point iteration, the analog of 
Jacobi iteration for linear systems, solve f (x, y) = 0 for x and g(x, y) = 0 for y, obtaining 


x =-—} — $y + i 64y? — 24y — 47 and y= $ — jx + 4; 256 + 420x — 7x? 
(39.23) 


Choosing a branch that contains the solution is a challenge. We resort to “using the so- 
lution to find the solution” by evaluating each branch at the second fixed point, obtaining 
36.78 and — 12.63, respectively, for x and —11.19 and —18.36, respectively, for y. Hence, 
the desired fixed-point iteration x = g(x) is defined by the vector-valued function 


—1 — $y + 4 /64y? — 24y — 47 
Gx yl. , 
i — BX 4256-4 420x — 7x? 


The alternative to using the solution to pick the right branches is to investigate each possible 
combination of branches at the expense of greater complexity and tedium. 

Starting from the point (35, —15), Table 39.10 lists both x, and ||x; — Xe||, where 
Xe corresponds to the point (36.78, —18.36). The convergence is linear and, hence, slow. 
Fixed-point iteration should not ordinarily be the first solution technique tried when solving 
systems of nonlinear algebraic equations. 

Use of new information as it is generated will usually accelerate convergence. Fixed- 
point iteration modified to implement this idea resembles Gauss-Seidel iteration for linear 
systems. 


(39.24) 


SOLUTION BY GAUSS-SEIDEL ITERATION Gauss-Seidel iteration is implemented by writ- 
ing the fixed-point iteration x = g(x) in the form x44) = Gi (Xk, Yk), Vert = G2(Xk+1, Yk), 
where G and G2 are the components of the vector-valued function G(x) defined in (39.24). 
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Table 39.11 records the result of a computation similar to that which led to Table 39.10. 
Comparing the two iterations, we find that the Gauss-Seidel technique speeds up conver- 
gence. For example, the norm of the difference between the fixed point and the fortieth 
Jacobi iterate is approximately 0.018, whereas for the Gauss-Seidel iterate it is 0.0002. 4$ 


k Xk Vk Ix — xell k Xk Yk lx. — xell 
0 35.0 —15.0 3.36397253 0 35.0 —15.0 3.36397253 
1 30.04952597 —17.67641645 6.73408283 1 30.04952597 —15.70067081 6.73408283 
2 35.40743061 —15.70067081 2.66330172 2 31.45236082 —16.27041574 5.33124798 
3 31.45236082 —17.83463779 5.33124798 3 32.59297098 —16.72794150 4.19063782 
4 35.72412590 —16.27041574 2.09355679 + 33.50886737 —17.09158938 3.27474143 
5 32.59297098 —17.95715073 4.19063782 5 34.23680267 —17.37821207 2.54680613 
36 36.76895 194 —18.33275941 0.03121312 36 36.78296389 —18.36372626 0.6449 x 10? 
37 36.72113609 —18.35837669 0.06247271 37 36.78311609 —18.36378436 0.4927 x 10? 
38 36.77240896 —18.34011502 0.02385751 38 36.78323238 —18.36382875 0.3764 x 10? 
39 36.73585832 —18.35969661 0.04775048 3 36.78332123 —18.36386267 0.2876 x 10? 
40 36.77505077 —18.34573871 0.01823382 40 36.78338911 —18.36388859 0.2197 x 10? 
TABLE 39.10  Jacobi-style fixed-point iterates in Example TABLE 39.11 Example 39.13: Fixed-point iterates obtained using 
39.13 the Gauss-Seidel strategy 


EXAMPLE 39.14 A system of three nonlinear equations in three unknowns is generally much more difficult 
to analyze and solve. Consider, for example, the functions 


Fi (x, y, z) = 8z +327 + 2y? + xy — 4x? +9xz — 4 

F(x, y, z) = —z + 4z? — 4y? + 6xy — 6x? — 4yz + 39 

F3(x, y, z) =9y — 2z — 3y? + Axy — 8yz + 20 
for which the equations F(x, y, z) = 0, k = 1,...,3, have the solution P = (—1,2, 1). 
The existence of multiple solutions is more difficult to determine in higher dimensions. 


There are actually three additional real solutions given to three significant figures by 
(—3.05, —4.52, 0.785), (—3.11, —1.84, —1.27), and (1.95, —1.23, 0.675). 


SOLUTION BY FixED-Point ITERATION Inan attempt to find the solution P by fixed- 
point iteration, solve Fi (x, y, z) = 0 for x, Fo(x, y, z) = 0 for y and F3(x, y, z) = 0 for z. 
obtaining 


x= ty + 3z + {33y + 18yz + 1292? + 128z — 64 
y= 4x — 424 4/2022 — 15x? — 12xz — 4z + 156 


1 4xy — 3y? + 9y + 20 
2 4y+1 


& 


Again, we must select correct branches for both x and y. To this end, evaluate the four 


relevant branches at the known solution P, obtaining 2 ,—l and2, — 2 , respectively. Hence, 
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we define the fixed-point iteration x — g(x) by 


Starting at the point (—7, 1, 4), Table 39.12 lists x;, the Jacobi iterates, and ||x, — P 
the norm of the distance from x; to the solution at P. The slow linear convergence can be 
accelerated with the Gauss-Seidel strategy, using new information as soon as it is available. 


Apo 


Ly + 22 — 1/23y? + 18yz + 1292? + 128z — 64 


X= 21(%,y,2) = 
YH HX, y, 2) = 
z-—g93(x,y,z2)— 


4y+1 


x= iz + 1/202 — 15x? — 12xz — 4z + 156 
1 4xy — 3y? + 9y + 20 


k Xk Yk Zk lxx — Xe llo 
0 —0.5 1.0 0.5 1.0 
1 —0.389605496 2.519936408 2.400000000 1.400000000 
2 —1.500007043 2.619849438 0.889 102762 0.619849438 
3 —1.234647038 1.497478462 0.316595061 0.683404939 
4 —0.517220669 1.858542861 1.384462811 0.482779331 
5 —1.062720206 2.396354651 1.334999773 0.396354651 
6 —1.219017372 1.948565677 0.6685 15225 0.331484775 
T —0.891672792 1.810822843 0.946357041 0.189177157 
8 —0.915948167 2.101582428 1.213199967 0.213199967 
9 —1.090452718 2.072952361 0.954917274 0.090452718 
10 —1.016122105 1.916757919 0.899897417 0.100102583 


TABLE 39.12  Jacobi-style fixed-point iterates in Example 39.14 


SOLUTION By Gauss-SEIDEL ITERATION Table 39.13 gives the results of a Gauss-Seidel 


iteration implemented with 


Xk+1 = 81 (Xk, Yk, Zk) 


Yk+1 = 82(Xk+1; Yk» Zk) 


Zk+1 = 83(Xk+1, Ver, Zk) 


k Xk Yk Zk lx% — Xelloo 
0 —0.5 1.0 0.5 1.0 
1 —0.389605496 2.610778061 0.829312078 0.610778061 
2 —1.224306938 1.790993560 1.085565949 0.224306938 
3 —0.952199857 2.041084011 0.987393118 0.047800143 
4 —1.012036733 1.989356559 1.003546239 0.012036733 
5 —0.99702733 1 2.002606825 0.999150406 0.002972669 
6 —1.000737743 1.999351630 1.000212520 0.000737743 
7 —0.999817110 2.000160645 0.999947420 0.000182890 
8 — 1.000045351 1.999960160 1.000013044 0.000045351 
9 —0.999988755 2.000009880 0.999996765 0.000011245 

10 —1.000002789 1.999997551 1.000000801 0.28 x 10? 


TABLE 39.13 Example 39.14: Fixed-point iterates obtained using the Gauss-Seidel 


strategy 
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in a manner that parallels the computation leading to Table 39.12. Comparing the two 
iterations, we find that the Gauss-Seidel technique speeds up convergence. For example, the 
norm of the difference between the fixed point and the tenth Jacobi iterate is approximately 
0.10, whereas for the Gauss-Seidel iterate it is 0.0000028. ES 


EXERCISES 39.7 


1. In Example 39.13, (39.23) defines the four functions x..(y) and 
ya. (x). Were we not to know where to look for solutions to 
equations (39.22a) and (39.22b), we would have to examine four 
cases such as x = x4 (y4 (x)), x = x. (y (x)), x = x (y, ()), and 
x = x. (y. (x)). Each of these equations can be solved with a 
method from Chapter 38. Use this approach to determine the 
solutions of the equations in Example 39.13. 


In Exercises 2-11: 


(a) Verify that f(x, y) = g(x, y) = 0 has a solution at the given X. 

(b) Solve f (x, y) = 0 for the x appearing in its linear term and 
solve g(x, y) = 0 for the y appearing in its linear term, to 
obtain x = G(x) = [f (x, y), (x. y)". 

(c) Show that || V /(&)||; < 1 and that || V& ($)||; < 1. 

(d) Show that J(&) = He f, 09 

8x(X) 8,(X) 

G(x), evaluated at x = £, has no eigenvalue with magnitude 

greater than one. 


| , the Jacobian matrix for 


(e) Implement the fixed-point iteration x,,; = G(x;,), showing it 
converges to X if xo is close enough to &. (Try xp = 0.) 
Determine the number of iterations required for 
IX — X¢lloo < 107. 

(f) Show empirically that || — x|z llo < o*||x; — xollo/(1 — o), 
where o = ||J (X) ||... 

(g) Starting from the same x as in part (d), implement the 
Gauss-Seidel strategy x4) = f Gi, Yk), Vert = S Gua Yi). 
determining the number of iterations required for 
[€ — Xz |loo < 1075. Compare the efficiency of the two iteration 
Schemes. 


(h) On the same set of axes, graph, in a neighborhood of the fixed 
point x, the functions respectively determined by the equations 
f(x, y) = Oand g(x, y) = 0. The curves should intersect at the 
given fixed point. 


2 2 2 ^ 2 
2. f(x, y) = —8xy? + 9y? + 8x? + Axy + 7y? — 50x +4y +56 X= H 
g(x, y) 6x? — 6x?y — 9y? — 9x? — Ay? — 192y + 313 


" 
3. f(x, y) = 2x2 — Oxy? + Oxy — 504x + y — 1527 &- L5 
g(x, y) = 4xy? — 9? — 6x? + 8y? + x — 900y — 5599 
à l 
a= 15 


4. f(x, y) = 3x3 


g(x,y) = x3 


3 
'Ix^y 4 
4 
2xy* + 7: 


6xy — 40x + 56 
4x — lly +19 


" 
do^ 
xy 


5. f(x, y) = xy? + 7y? — 9xy — 494x — 8y — 468 


- 


g(x, y) = 5x? + Axy? + 6y? + 9x? — 5x — 500y — 1494 


6. f(x, y) = — 6x3 y — 8xy? — 9x3 — 3x? — 150x + 320 
g(x,y) = 5x3y + 6x2 y? + xy? + Ax?y + 5x? — 50y — 36 


E 


3 2.3 2 2 á —4 
7. f(x, y) = 9x4 — 7x3 y + 332y? — 8xy? — y? + 9y? — 2000x — 9772 & = ki 
a(x, y) = —73y — 6x? + 3xy? — 9y? + 8xy — 999y — 1574 d 


2 
8. f(x, y) = 5x? — 5x2y — 3y? + 5xy + y? — 448x +406 &— l A 
g(x, y) 2 —2x? + 8xy — 7y? + 8x — 154y — 523 1 


5 2 2 A 3 
9. f(x, y) = -5x^y — 5xy^ -8y? —77x + 193 = |. 1 
g(x, y) = 6x? + 2xy — y? + x — 50y — 100 r 


2 2 X — 
10. f(x, y) = 9y? — 4x? — 7xy 8y^—113x + 9y — 170 x= I] 
g(x, y) = 9x? — 4xy + Ay? — 6x — 44y — 88 


11. f(x, y) = —xy — 5y? — 41x + 5y + 15 
g(x, y) = x? — 9xy — 9y? — 9x — 209y + 934 


In Exercises 12-18, x = [x, y, z]? and F(x) = [f (x), g(x), A(x)]'. In 
each: 
(a) Verify that F(X) — 0. 
(b) By respectively solving f(x), g(x), and h(x) for the x, y, z 
appearing in the linear term, obtain x = G(x). 
(c) Show that || V £(X)||; < 1, |VeGO|l; < 1, |VA(X)] < 1. 


LD LA RÈ) 
(d) Show that J ($) = | g«($)  g,(&) 2:-@Å) | , the Jacobian 
h Rh,(G) hR 


matrix for G(x), evaluated at x = X, has no eigenvalue with 
magnitude greater than one. 


(e) Implement the fixed-point iteration xy,; = G(x,), showing it 
converges to X if x; = 0. Determine the number of iterations 
required for ||X — xil; < 107. 

(f) Show empirically that || — xil; < c*|x; — Xollo;/ (1 — o), 
where o = || J(X)|loo- 

(g) Again starting from xo = 0, implement the Gauss-Seidel 
strategy Xk+1 = f (Xk, Yks Zk), Ver = B+ Yks Zk)» Zk+1 = 
h(Xk+1, Yk+1, Ze), determining the number of iterations required 
for ||X — x,|| < 107%. Compare the efficiency of the two 
iteration schemes. 


—4x7y + 2xyz + y?z + yz?—9yz — 500x + 1920 
12. F(x) = | 8y*—7y3z + y?z?—5y?—1501y — 4z + 9578 
9x3 y — Ax? y? 2x? 72 2x? ; — 6y2—7:2 —3000z + 41833 
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8x?22 Ay? 2 —Tyz? 525 3272 —1504x + 5187 | 6x2y?-7xy 2 -3y* -9y 2 42x y?--6xy — 1200x — 3480 
13. F(x) = | —5x°y — 3x3z — xyz — 8y?z + 2 —9x — 1000y + 4841 16. F(x) = 4z+—7x3—4y*z — 5xy + 6x — 400y + 1437 
Wu —2x2z) 42xy! 2x2? —8xy + 6xz — 2yz — 200z — 714 | 9x3 y + 6xyz?’+yz?—3x”+5xy — 4xz — 1500z + 2615 
& = [-3,4, 1, ]T 
—9x?z — 8xyz? Ax? —4z2 — 1000x + 2508 | -4x^--9x? yz — 3xy?—xyz?--5yz — 1200x — 2756 
14. F(x) = ae yz + 2x222—Txy3+4x — 300y — 5z + 623 17. Fx) = | 4z — 2x? y?—6x2z + 52) +2xy — 700y + 1156 
2x?z72--3xyz? 2x z)--9x — 500z + 1194 |. —5y°z?+3z4—8xz?+3y?z — 9y?—1500z — 6748 
2,2,3 & = [-3, 2, —4]T 
8x445x7 y? —5x? y + 2yz?—8yz — 1500x — 5610 [ 8xy?--4y^ 95? 2 —7x? -Exy? -Ayz — 2500x — 4286 
15. F(x) = mf 7x* Ax? yz — 3xy3—5y*22—xz?49yz — 1000y + 3888 18. F(x) = —xy? yd) +5x27—923-Ty*—500y — 946 
—2x? y? 2x? 22 -8xz? —6x?--x — y — 400z — 1474 L 5x3 y + 3y*z?—4yz34+8x?+6xy — 1500z + 4759 
& = [-3,3, -4]T & = [-1, —3, 4]T 
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EXAMPLE 39.15 


Generalization from the Single- Variable Case 


We have already seen, in Section 38.3, the single-variable Newton iteration x,44 = x, — 
f G)/ f' Ga) for solving the scalar equation f(x) = 0. The natural generalization to the 
vector case f(x) = 0 is the iteration X44; = x,—J  ! (x,)f(x,), where J is the Jacobian 
matrix whose entries are ôf; /óx;, where f; is the ith component of the vector f. The Jaco- 
bian matrix plays the role of the derivative in the single-variable case. Since it is a matrix, 
the reciprocal of f’ in the single-variable case generalizes to the matrix inverse. 


As we saw in Section 39.7, the nonlinear system f(x, y) — 0, g(x, y) = 0, where 

fx, y) =12 + 3x + 8y + 12xy + 9x? — 12y? 

g(x, y) = —5 — 12x — 6y + Oxy + 2x? + 11y? 
has the two real solutions (0.247523687, —0.69040990) and (36.783609, —18.3639725). 
The Jacobian matrix is 


yaf fi] _ [18x12y 43. 12x 24y 8 
[ae 8y| |4x-49y—-12 9x+22y-6 


so the right-hand side of the iteration x,4; = x,—J ^! (x,)f(x,) is then the vector-valued 
function 
—144xy + 32 + 240xy? — 144y + 246x? y — 168x + 57x? — 70x? — 16y? 
78 + 31x — 366y + 492xy + 480y? + 114x? 
42 72 — 43 + 82xy? + 56y + 19x? y + 46x + 80y? + 38x? — 37y? 
78 + 31x — 366y + 492xy + 480y? + 114x? 


g(x) = 


(39.25) 


Newton’s method consists of the fixed-point iteration x = g(x). Starting at the point 
(35, —15), Table 39.14 lists xy, the Newton iterates, and ||x; — x.||, where x, corresponds 
to the second real solution. The rapid (quadratic) convergence of the iteration is apparent 
from the doubling of the number of zeros after the decimal point in the value of the norm 
of the difference between each iterate and the fixed point, Xe. 
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EXAMPLE 39.16 


k Xk Yk lx% — Xelloo 
0 35.0 —15.0 3.364 

1 50.99149362 —26.75906930 14.208 

2 40.35974485 —20.42798275 3.576 

3 37.11933214 —18.55449085 0.3357 

4 36.78701010 —18.36587974 0.003401 

5 36.78360934 —18.36397272 0.5443 x 10-5 


TABLE 39.14 Newton iterates in Example 39.15, computed at 
extended precision 


* 


Just as with the single-variable case, the derivative (Jacobian matrix) of the iteration 
function g(x), evaluated at x = Xe, is the zero matrix, as can be seen by a tedious but 
straightforward calculation. ES 


Derivation 


A derivation of Newton's method for the two-variable case is instructive. Let Xe = (Xe, ye) 
satisfy f (xe, ye) = g(Xe, Ye) = 0. Use Taylor polynomials constructed at x; to approximate 
f (x, y) and g(x, y) at xy.1. Assuming that x; is close enough to Xe for f (xyi1, Vert) 
and g(Xi41, Ye41) both to be essentially zero, we obtain, to a first approximation, 

0 — f Xii. yia) = f (Xk, yi) + f Que Yi) Xr+ — xi) + fy Ge. Yi) esa — Yk) 

0 = 8 (Xk41, Yk+1) = 8 (Xk, Yk) + gx (Xk, Yi) Ke — Xk) + gy (Xk, Yi Oi — Yk) 
which can be written in the form 

fx fy | |Xk+1 — Xk 
—f(x,) = " —J(Xi(Xi1-—X:. 
(Xx) bs | ee (Xk) Xii — Xk) 


and from which xx, = x; — J~!(x;,)f (xj) follows. 


Practical Implementation 


In actual practice, the Jacobian matrix J is not inverted in any realistic implementation 
of Newton’s method. The iteration is based on the equation f(x,) = J (xx) (x, — Xi41) = 
J (x,) ux. The increment ux is computed by solving the linear system J (x;)u, = f(x;,) with 
any of the methods of Sections 39.1—39.6. The next iterate, namely, x;+1, is then obtained 
aS X, — Uk = Xk — (Xk — Xk+) = Xk+1- 


We saw in Section 39.7 that the equations 
Fy(x, y, z) 28z + 32? + 2y? + xy — Ax? + 9xz 420 
Fy(x, y, z) = —z + Az! — Ay! + 6xy — 6x? — Ayz +39 = 0 
F3(x, y, z) =9y — 2z — 3y? + Axy — 8yz + 20 = 0 


have four real solutions, one of which is (—1, 2, 1). Let the vector-valued function F(x) and 
its Jacobian matrix J (x) be given, respectively, by 


F(x,y, z) y — 8x + 9z 4y +x 8 +6z+9x] 
F(x) = | Fo(x, y, z) J(x)=]| 6y — 2x 6x — 8y — 4z 8z— 4y- 1 
F3(x, y, z) 4y 9 —6y + 4x — 8z 2—8y 
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Table 39.15 is obtained when Newton's method is started at xo = [10, 10, 10]T. During 
each cycle, F(x;) and J (x;) are computed. The increment ux is obtained as the solution of 
the linear system J (x;)uy = f(x;), and x;,4 is obtained as x4; = x; — Ux. The iteration 


converges rapidly from a considerable distance from the solution. o 

k Xk Yk Zk IX. — Xe llo 
0 10.0 10.0 10.0 11.0 

1 4.530201245 5.768865724 4.588308158 5.469798755 
2 1.612863602 4.039272089 1.780733948 2.917337643 
3 —0.662756139 3.093654054 0.538427972 2.275619741 
4 —0.931874105 2.101094586 0.897097449 0.992559468 
5 —0.999753527 1.998291828 0.997168715 0.102802758 
6 —0.999999605 2.000000333 1.000002630 0.002833915 


TABLE 39.15 Newton iterates in Example 39.16 


EXERCISES 39.8 


1. 


Use a computer algebra system to obtain J,(x), the Jacobian matrix 
for the iteration function g(x) given in (39.25). Show that Jg (Xe) is 
the zero matrix, where x, is either of the two solutions of the 
system in Example 39.15. 


For the 2 x 2 systems F(x) = 0 in Exercises 2-11: 


aon A N 


(a) Obtain the Newton iteration function G(x) = x — J~!(x)F(x), 
where J (x) is the Jacobian matrix for the vector-valued 
function F(x). 

(b) Show that at the fixed point, the Jacobian matrix for G(x) is the 
zero matrix, thereby verifying that Newton's method for 
systems converges quadratically to a simple zero of F(x). 


(c) Implement Newton iteration as the fixed-point iteration 
Xi41 = G(x,), starting with xp near enough to X to ensure 
convergence to X and noting the number of iterations required 
to obtain |& — xil; < 1075. 

(d) Implement Newton iteration whereby, at each step of the 
iteration, F(x;) = J (x;)u, is solved for u, and x;,; is obtained 
as X4,; = X; — Ux. Do not invert J (X); rather, solve for uz via a 
linear-system solver. 


. Exercise 2, Section 39.7 3. Exercise 3, Section 39.7 
. Exercise 4, Section 39.7 5. Exercise 5, Section 39.7 
. Exercise 6, Section 39.7 7. Exercise 7, Section 39.7 
. Exercise 8, Section 39.7 9. Exercise 9, Section 39.7 
10. 


Exercise 10, Section 39.7 11. Exercise 11, Section 39.7 


For the 3 x 3 systems F(x) — 0 in Exercises 12-18: 


(a) Obtain the Newton iteration function G(x) = x — J^ (x)F(x), 
where J (X) is the Jacobian matrix for the vector-valued 
function F(x). 


(b) Implement Newton iteration as the fixed-point iteration 
Xx+1 = G(x;,), starting with xo near enough to X to ensure 
convergence to X and noting the number of iterations required 
to obtain || — xzllo < 105. 

(c) Show that |& — xz ||; converges to zero quadratically, and that 
the Jacobian matrix G(x) is the zero matrix. 


(d) Implement Newton iteration whereby, at each step of the 
iteration, F(x;,) = J (x;)u, is solved for uz and x;,, is obtained 
as Xj; = Xy — uy. Do not invert J (X); rather, solve for uz via a 
linear-system solver. 
12. Exercise 12, Section 39.7 13. Exercise 13, Section 39.7 
14. Exercise 14, Section 39.7 15. Exercise 15, Section 39.7 
16. Exercise 16, Section 39.7 17. Exercise 17, Section 39.7 
18. Exercise 18, Section 39.7 
For each of the 3 x 3 systems F(x) — 0 in Exercises 19-28 where 
x = [x, y, z]*: 
(a) Verify that F(x) = 0. 
(b) Obtain the Newton iteration function G(x) = x — J^! (x)F(x), 
where J (x) is the Jacobian matrix for the vector-valued 
function F(x). 


(c) Show that the Jacobian matrix for G(x) is the zero matrix, 
thereby verifying that Newton’s method for systems converges 
quadratically to a simple zero of F(x). 


(d) Implement Newton iteration as the fixed-point iteration 
Xii = G(x,), starting with xo near enough to X to ensure 
convergence to X and noting the number of iterations required 
to obtain ||€ — x; |]. < 105. 
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(e) Implement Newton iteration whereby, at each step of the 


iteration, F(x,) = J (x;)u, is solved for u, and x;,, is obtained 
as X;,, = X; — uy. Do not invert J (X); rather, solve for u% via a 


linear-system solver. 
53x — 22x?—9zy34+4y4—523 — 1400 


19. F(x) = | —6z?y — 92x? 32? xy + 3x*-333 y + 92? y — 55353 


Tz? y? —4zy342y4~3z7y +9zx?—7z + 11695 
% = [-12, —5,—5]" 
—8z? y + AzxÓ 6zxy? - Tz? x + 6zx + 6250 
20. F(x) = | —5zx?--5zx? y + 722y + 9x3+4xy + 6y — 5522 
—5zx? -xy)--8zy? —7y?--322 —3164 
% = [5, —3, —5]T 
42? xy F 622y?-6x? y? —4z?y + 9zxy + Ax + 122 


21. F(x) = —822y2—5xy? —5zy + 3x2--8x24-87 


6zx? y + 622 —9z2y? —7x? y + 4y3 —7xy +13 
& = [74, 1, -1]T 
[ 32x + 3zxy — 4x? y — 2xy?—722+82 + 140 
22. F(x) = 32x? x349zy 4- 9z +22 
32 —6x? y + xy?—62 —9y? 4 8y + 276 


8zxy 

& = [-4,2,—2]T 

[ | 2x9-Ax2y + 7y3—Szy — 4y?4322 

23. F(x) = | 722 y + 3zx?3zxy — 5zy? —5x2 4-322 —635 
3zx?—2zx — 9zy + xy + x — 3y — 269 


4xy?—2y? 

24. F(x) = | —5z!y + 8zxy + 7zy^ À-7zx — 5xy — 8y?—370 
Az? x — 3xy? Ay) —2zy — 5x + 2y + 255 

& =[-5, —2, 4] 


—7z?+9zy + 3xy — 2y?+8z + 212 


25. F(x) = 627 +8zy — 9x? +5x + 8y + 268 
| 22x —Ozy — 7x?—9xy — 7x — 3y — 161 
% = [4, —5, 2]" 
Chapter Review 
5 6 9 —58 
1. IfA = | -7 7 2) andy = | -38 | , demonstrate the use of 
6 -9 6 3 


Gaussian elimination to solve the system Ax = y by upper- 
triangularizing the augmented matrix [A, y] and using back 
substitution. 


5z?+5zx — 3x2 —3y? -8y + 44 
26. F(x) 7z5—6zx + 9z — 9y + 99 
—4z?—2zy — 6y2—3y + 33 
& = [4, —1, 3]T 
622+7zy + 3324-7? -8x — 231 
27. F(x) = | —2zxy — 7x? y — 3xy?+3zx + 9y?—432 


28. 


29. 


82x3+4zy3—4x3 y — Ay* -Az? 48x? y 
= [-3, 3, -3,]T 
" 


" 
8z?xy + x* 8x3 y + 5x7 y?—5z7y 


5z?+6xy — 32 


9zy?—597 


F(x) = z2y — 9zx? 8x7y 5y? 


—3z?+x?+7z + 7x + 8y +84 . 
& — [1, —2, -4]T 
Broyden's method, as described in [16], is an example of a 
quasi-Newton algorithm wherein the need to invert the Jacobian 
matrix (or the equivalent, thereof ) is circumvented. The 
convergence of Broyden’s method is only superlinear, but that is an 
acceptable trade-off for the great reduction in computational effort 
effected. To solve F(x) = 0, starting with xo and x;, implement the 
following steps in a computer language of your choice. 
(a) Ao = J (Xo) and Ag! = J^ (x9) — (b) yy = F(x) — F(x) 
=I aif 
(s, — Acai) Sk Ag 
TA-l 
Sk Ay jk 


(0s.—x —x-i (dA; = Ag! + 


(e) X41 = Xk — A; F(x) 


In Exercises 30-38, use Broyden’s method to solve the given system. 
Try starting at the same Xo as before, and using x; = [1, 1]T seeing if 
the method converges to X. Also, monitor the number of steps required 
to achieve the accuracy entailed by |& — x;||;; < 1075, and compare to 
the number of steps taken by Newton's method. 


30. 
32. 
34. 
36. 
38. 


2. 


31. Exercise 3, Section 39.7 

33. Exercise 12, Section 39.7 
35. Exercise 14, Section 39.7 
37. Exercise 20, Section 39.8 


Exercise 2, Section 39.7 
Exercise 4, Section 39.7 
Exercise 13, Section 39.7 
Exercise 19, Section 39.8 


Exercise 21, Section 39.8 


Describe the condition number for a matrix and show how it is used 
to obtain an upper bound to the relative error in a numerically 
computed solution to a system of linear equations. 


39.8 Newton's Iteration for Nonlinear Systems 


. What is partial pivoting in the context of Gaussian arithmetic for 


numerically solving systems of linear equations. What reasoning 
motivates this strategy? 


. What is the asymptotic estimate of the number of arithmetic 


operations Gaussian elimination and back substitution require in 
the solution of an n x n system of linear equations? 


. What is a tridiagonal system, and why is there a specialized 


algorithm for solving such a system? 
What is iterative improvement? Describe how it is implemented. 
Justify why it works. 


. Describe the iterative method of Jacobi. Use the system in Question 


1 to illustrate the first two iterations that start from xo = 0. 


. Is the matrix A in Question 1 strictly diagonally dominant? If the 


method of Jacobi were implemented for the system in Question 1, 
would convergence be likely? 


9. 


10. 


11. 


12. 


13 


14. 


15. 
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Give an example of a strictly diagonally dominant matrix. 


Describe the Gauss-Seidel iterative method. Use the system in 
Question 1 to illustrate the first two iterations that start from 

xo — 0. Is it likely that the iteration will converge? Why? 
Demonstrate at least two steps in Southwell's relaxation solution of 
the system in Question 1. 


Describe the SOR technique. Give its matrix form. Under what 
conditions on the iteration matrix can convergence be expected? 
Demonstrate a Jacobi-style iteration for solving the nonlinear 
system x? + y? = 1,32— y? =}. 

Demonstrate how the system in Question 13 might be solved with 
an iterative technique patterned after the Gauss-Seidel algorithm. 


Demonstrate how the system in Question 13 might be solved by 
Newton iteration. For efficiency, how should Newton iteration for 
systems be implemented? 


Chapter 40) 


Interpolation 


INTRODUCTION Passing a smooth curve through a set of points is called 
interpolation, the curve being said to interpolate the points. Chapter 40 examines severa! 
of the classic techniques for constructing an interpolating polynomial. 

We begin with naive interpolation in which a set of algebraic equations, formed by 
substituting the data points into a polynomial template, is constructed and solved. Unfortu- 
nately, the resulting linear system generally has a large condition number, and the technique 
is not practical for anything but the smallest systems. Hence, the section goes on to con- 
sider Lagrange interpolation in which a set of basis polynomials, the Lagrange interpolating 
polynomials, are first constructed and then combined to form the desired interpolating poly- 
nomial. The section concludes with a look at the polynomial wiggle problem whereby 2 
high-order interpolating polynomial, interpolating between equispaced nodes, can exhibit 
oscillations of a large magnitude between the nodes. Thus, although the polynomial passes 
through the given points, it is probably not a very good representation of the function that 
the data points are approximating. 

We then discuss Newton's method of forming an interpolating polynomial from 2 
divided difference table. The two techniques, that of Lagrange and that of Newton, yield 
the exact same polynomial, but in two different forms. The Newton polynomial is built uz 
degree-by-degree, as new data points are added in from the divided difference table. 

When interpolating a continuous function, if the nodes are spaced according to the 
zeros of the Chebyshev polynomials, a minimax polynomial results. This polynomial min- 
imizes the maximum deviation, or wiggle, exhibited by the interpolating polynomial anc 
the polynomial wiggle problem is greatly alleviated. 

Spline interpolation is a variant of the interpolation problem. Instead of passing a single 
polynomial through all the points in a data set, many lower order polynomials are passed 
through contiguous subsets of the data points. Thus, the interpolation is accomplished b: 
a piecewise polynomial function of consistently low degree. We therefore detail spline 
interpolation with linear, quadratic, and cubic polynomials, the first being the case where a 
collection of straight line segments connects consecutive points in a collection of points 

A Bezier curve is described parametrically by polynomials of equal degree. A cubic 
Bezier curve would be determined by four points, of which just the first and last are actuali 
interpolated by the curve. The two "interior" points, called control points, merely influence 
the shape of the curve. The Bezier spline is a collection of contiguous Bezier curves, the 
advantage being that changing one control point only affects a single component Bezier 
curve. The whole spline does not have to be recalculated, which is quite the contrary to the 
case for the classic polynomial spline. 
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Lagrange Interpolation 


The Need for Interpolation 


Discrete data, typically obtained by experiment or sampling, can be difficult to work with in 
an analytic context. Thus, it is often useful to pass a smooth curve through the data points. 
The problem of interpolation is that of finding an appropriate smooth curve which passes 
through each of the points. 


Naive Interpolation 


Interpolating a set of points with the function y = f (x) amounts to solving a set of equa- 
tions. The simplest examples are afforded by polynomials, but any function with sufficient 
parameters could be used. To pass the parabola y = f(x) = ax? + bx +c through the three 
data points (1, 2), (—4, 7), (6, —13), solve the three equations on the left in (40.1) 


a+b+c=2 1 1 1 
loa —4b+c=7 A-|16 —4 1 (40.1) 
36a + 6b + c = —13 36 6 1 


obtaining y = 1(19 — 8x — x?) as the interpolating parabola. Clearly, the three equations 
determining the parameters a, b, c are f (1) = 2, f (—4) = 7, and f (6) = —13. 


Ill-Conditioning 


Systems of equations arising from interpolation problems are usually highly ill-conditioned. 
For example, the system matrix for the equations of the previous section, given on the right 
in (40.1), has a condition number (using the 1-norm) of 57.24. (See Section 39.2.) Were we 
to increase the size of the problem slightly, the condition number of the coefficient matrix 
would correspondingly increase. 

For example, interpolating the five points 


(—63, 52)  (—57,83)  (—78,—79)  (—12,—25)  (—45,83), 


with the fourth-degree polynomial y = ao + ax + ax? + a3x? + a4x^, generates five 
equations for which the system matrix A is given on the left in (40.2). This is a Vandermonde 
matrix (40.2), whose general form is given on the right in (40.2). The condition number of 
A is the exceptionally large 3.0 x 10°. Working in exact arithmetic causes no problems, 
but should this system be solved by a numeric method from Chapter 39, the large condition 
number signals the possibility of severe roundoff error. 


1 xo FT e XQ 
1 —63 3969 —250,047 15,752,961 i a at o ab 
1 —57 3249 —185,193 10,556,001 l 7 
A=|1 -78 6084 —474,552 37,015,056 | = | x xj s x; (40.2) 
1 —12 144 —1728 20,736 " 
1 —45 2025  —91,125 4,100,625 
l X ds IE. 
Lagrange Interpolating Polynomials 
Naive interpolation through the n + 1 points (xy, yx), k = 0, ..., n, can lead to ill-condi- 


tioned systems of equations. To avoid having to solve such systems, we can resort to 
the Lagrange basis of interpolating polynomials L(x) = IIo iz (x —xi/(xxy — xi), k = 
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0. eis n, Which are explicitly given by 
(x — xo) -*- (x — xk1)(x — Xka1) +++ (x — Xn) 


(Xj — Xo) +++ Gi — Xii) (xk — Xi) +++ (xk — Xn) 


Lx) = 


These polynomials then satisfy 

1 jak 

0 jzk 

so that the nth-degree polynomial interpolating the points (xy, yz), k = 0,...,n, can be 
written as f (x) = 7, 9 YkLr (x). 

Each Lagrange basis polynomial is of degree n since each numerator contains n linear 
factors. Corresponding to each factor x — x; in the numerator, the denominator contains 
the factor x, — x;. In the kth polynomial, the numerator skips the factor x — x, and the 
denominator skips the corresponding factor x, — xx. 


Ly (xj) => 


EXAMPLE 40.1 Ifn = 2, then + 1 = 3 Lagrange interpolating polynomials of degree n = 2 are 


a (x — x1)(x — x2) We (x — xo)(x — x2) ine (x—xo)(x—x) 
(x2 — xo)(x2 — x1) 


(Xo — x1) (Xo — x2) i (x1 — xo) (xı — x2) 7 


EXAMPLE 40.2 The Lagrange interpolating polynomials of degree n = 2 generated by the data points that 
give (40.1) are 


Lo-—45(-4€-6 Li-43G6-0)G9-6 h=Ze@-DY)E+4 * 


EXAMPLE 40.3 If n = 3, then + 1 = 4 Lagrange interpolating polynomials of degree n = 3 are 


Lo = (x — x1)(x — x2)(x — xa) E. = (x — xo)(x — x1)(x — x3) 
È (Xo — x1)(x0 — x2) (Xo — x3) ^5 (X2 — xo) Ga — xi) (xa — x3) 
e (x — xo)(x — x2)(x — xa) L= (x — xo)(x — a = x2) " 
mu" Xo) Er — X2)(%1 — x3) 3 (8 Xo)(x3 — x1) (xs — x2) 


EXAMPLE 40.4 The Lagrange polynomials for the n + 1 = 5 points (—25, —43), (—22, —20), (—24, 37). 
(—69, 13), (88, 88) are 


(x + 22) (x + 24) (x + 69) (x — 88) L (x + 25) (x + 22) (x + 24) (x — 88) 
= 3 = 


Lo = 


14,916 à; 14,610,420 
L (x + 25)(x + 24) (x + 69)(x — 88) L-— (x + 25) (x + 22) (x + 24) (x + 69) 
en 31,020 ii 218,569,120 
«eis (x + 25) (x + 22) (x + 69) (x — 88) 
Jm 10,080 


The fourth-degree polynomial interpolating the given points is then 


4 
TN Av 221,875,439 „4 , 220,127,311 „3 _ 1,423,147,234,529 2 
f(x) = Y Lio)» = 30,818,245,920^  1,100,651,640~ 30,818,245,920 ~ 
k=0 
4,665, 156,224,837 . _ 278,419,407,759 ra 


2,201,303,280 " 11,673,578 
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The Polynomial Wiggle Problem 


FIGURE 40.1 Graph of eighth-degree 
polynomial interpolating G, k), 
ke re) 


In [60], we find the following warning about the “polynomial wiggle problem.” 


“If data points P; lie on a curve that is not polynomial-like, high-degree polynomial 

x curves will oscillate between successive P,s when forced to go... through them; 
and once such oscillations start, increasing the degree further generally increases 
their maximum amplitude." 


We give two examples of this phenomenon. First, consider the function f(x) — 1, 
which is certainly not polynomial-like since it has both a horizontal and vertical asymptote. 
If we select the n + 1 = 9 points G, Ek), le = Ly us 9, whose nodes are equally spaced in 
the interval [0, 1], the eighth-degree interpolating polynomial passing through them is 


F(x) = 362,880x5 — 1,026,576x’ + 1,172,700x9 — 723,680x? + 269,325x^ 
—63,273x? + 9450x? — 870x + 45 


FIGURE 40.2 
polynomial interpolating (k, 42), 


Graph of tenth-degree 


which is graphed in Figure 40.1. The extreme oscillation near the end of the interval should 
be a reminder about the dangers of using interpolating polynomials for nonconforming data. 

A more famous example is due to the German mathematician Carl Runge. For the func- 
tion f(x) = ne the eleven points (k, f (k)), k = —5,...,5, with nodes evenly spaced 
along the x-axis, are interpolated by the tenth-degree polynomial 


83 .6 , 2181.4 1492 
3400% + 11.050" zix tl 


F(x) = -a*l + sux) (40.3) 


Since f (x) is not polynomial-like, having a horizontal asymptote, Figure 40.2, a graph of 


K e 5, yd 


EXERCISES 40.1—Part A 


f (x) and F(x), shows dramatic oscillation in F (x) near the ends of the interval. 


Al. If n = 1, write the n + 1 = 2 Lagrange interpolating polynomials 
of degree n — 1. 


A2. Obtain Lo and L4, the Lagrange interpolating polynomials 
corresponding to the data points (—2, 3) and (4, 7). 


A3. Show that the equation of the line connecting the two points in 
Exercise A2 is y = 3Lo + 7L,. 


EXERCISES 40.1—Part B 


A4. Interpolate the n + 1 = 3 points ((—1, 1), (2, —3), (3, 5)) via 
Lagrange interpolation. 


AS. Write the Vandermonde matrix for the data points in Exercise A4. 


B1. Use appropriate software to verify that the condition number of 
the matrix A in (40.2) is indeed 3.0 x 10?. 


In Exercises B2-11: 


(a) Use naive interpolation (forming n + | equations in n + 1 
unknowns) to obtain p, (x), the nth-degree polynomial that 
interpolates the points (xz, f (xy)). k — 0,..., n. 

(b) Write the equations in part (a) in the form Ax — y, and 
determine the condition number of the matrix A. 


(c) Obtain P, (x) = 375.9 Le (x) f (x), where {L,(x)} are the 
Lagrange interpolating polynomials, and show that 
P, (x) — Pn (x). 

(d) Compare p, (x) to f (x) by plotting both on the given domain. 

(e) Provided f'"*" exists on the closed interval 7 containing c 
and the interpolated nodes xo, ...,- x, the error an 
interpolating polynomial makes at x — c is given by 
fc) — pale) = f "*9(&)/(n + D! T [kole — xx), for some & 
in the open interval 7. If M = max,; | f ^*P (x)|, then 
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Lf) — p. (I < zs Tio le — xd = €(0). Plot 
E = |f(c) — pn(c)| and e(c) on the same set of axes. 

(f) A viable approach to estimating f'(c) from the data points 
(xs Yi. Kom oues n, is to interpolate the data points with 
Pn(x) and approximate f'(c) with p; (c). Test the validity of 
this procedure by graphing f'(x) and p; (x) on the same set 


of axes. 
B2. f(x) -—10xe*,0. & x € 7;xp-k,kv0,...., 7-—n 
BS. Pj esu. ure Seam BER br uos mn 
` ] +x? 
oe E oe a SE E S 
BA, PO) ema a ot =U,..., =n 


B5. fO) = arctan sx, 0 €x < 75x, k-0,2; J=n 
B6. f(x) =e *cosx,0<x <S5;x, =k, k =0,..., 5i 


BY. f(x) - 17x02 x S lix — ck —0,..., 5 on 
BS. f(x) = 5, 0<x<tin=kk= caus 7-—n 
+ x? 
B9. f(x) = — O<x<T;x=k,k=0,...,7=n 
+x 
cosh x T k 
B10. f(x) = ai) SX iS = HHO T d dH 
l +x? 2 2 
_ 7 k 
B11. f(x) =e“ tanx,0<x < zi% = pt — i | PUR =p 
For the nodes xz, k = 0,..., n, given in Exercises B12-14: 


(a) Obtain A, the Vandermonde matrix as given in (40.2). 
(b) Obtain the condition number of A. 
(c) Show that det A = J Jos pen Gc — Xj). 

B12. 2,3,5,6 B13. —2,0,5,9,11 B14. 1,3,4, 7,10 


The inverse interpolation problem consists in estimating, from the data 
points (xy, yk), k = 0,..., n, where the y; are monotone, the value of 
x for which y — y*. There are two obvious approaches. First, interpo- 
late the data points with p,(x) and solve the equation p,(x) = y* for 
x. Second, reverse the roles of x and y, interpolate the points (yz, x) 
with P,(y), and take P, (y*) as the desired x. For the data sets and the 
prescribed value of y* in each of Exercises B15-19: 


(a) Plot the data points. 


(b) Use the first method (involving p, (x)) to determine the value 
of x for which y — y*. 

(c) Use the second method (involving P, ( y)) to determine the 
value of x for which y = y*. Do you expect the two methods 
to give the same value of x? Why do the two methods give the 
same value? 


B15. (0,0). 5. 25, 0, 6, (5 205. 9 9^ = 12 


B16. (0, —3), (0, $), G, BD, Q 322. G, 22. 6, BOE y^ = 1 
5 


B17. ((—3, 21), (-3, £31), (-2, 8), (-8, 25), (à-1, $), (21, - $E: 
greg 
Bis. ((-8, -2), (8. 225. (2, 25, eH. 49) 
E 1 160 CEN TO 1 
( Lat 2? iei (0, 5» =a 
B19. (1, 32), G, -25, (8, - 22), (4, -$ G, 329) 
( 


3 _ 534 (2 _ 584) (5 
» — 730)» (P T 238). (2, 


ÁN. Ay — 
um) j* = -l1 
Interpolation through prescribed values of the function and its derivatives 
is called osculatory interpolation. Some problems of osculatory interpo- 
lation have a unique solution, some have no solution, and some have an 
infinite number of solutions. For the sets of n + 1 conditions in Exercises 
B20-24, use an nth-degree polynomial and naive interpolation to write 
n + 1 equations in n + 1 unknowns. If there is one solution to these 
equations, the associated osculatory interpolation problem has a unique 
solution. If there are an infinite number of solutions to these equations, 
the polynomial p, (x) is not unique. If there is no solution to the equa- 
tions, try a higher degree polynomial. If there is a solution to the new set 
of equations, the interpolating polynomial, p„+ı (x). will not be unique. 
B20. f(1) = 2, f'2) «0, f(3) = —5 
B21. f(0) 22, f( 28, f'0) = +2, £2) =1 
B22. f(1) = -3, fQ) Z 1, f'20) Z4, f 2 —1 
B23. f(—1) =5, f(0) 23, f'(1) 2 1, f"2) 20 
B24. F= 1, fC) =2, f'(D 21, f Q) 23 
B25. Consider the osculatory interpolation problem in which the cubic 
px) = a a,x* is to satisfy the conditions f (0) = bi, 
f (1) = b», f'(c) = bs, f (2) = b4. Write the equations for this 
interpolation in the form Ax = b, where x = [ao, ..., a3]" and 
biz | bs], and determine all values of c for which A is 
singular. If ¢ is such a value, then prescribing f'(C) leads to either 


no solution or an infinite number of solutions, depending on the 
values assigned to bi, ... , ba. 


Osculatory interpolation is called Hermite interpolation if, whenever 

f(&) is prescribed, so also are f(x), f'(3), ..., f^" (£). Hermite 

interpolation always has a unique solution. For the sets of conditions in 

Exercises B26—230, use naive interpolation to obtain the solution of the as- 

sociated Hermite interpolation problem and then graph the interpolating 

polynomial. 

B26. f(0) = 1, f(1) =2, (1) 2-1, f22—55 

B27. f(1) 2 —1,f2) 23, f'@) 20, f"2) = 1 

B28. f(1) = -2, f'(0 2-1, f (3) = 5, f/(3) z0 

B29. f(1) 22, f'(1) = —2, f8) = —1, f*(3) 2 0, f"(3) = 5, 
f"3)2-if00- 

B30. f 
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Divided Differences 


Basic Definitions and Notation 


The nth-degree polynomial interpolating the n + 1 data points (xo, yo), ..., (Xn, Yn) can be 
written in the form 


P (œ) = f Dro] +) flo, ois +++ te] — x0) +++ — x1) 


(40.4) 
k=] 
where f [x;,] = y; and f[xo, xi. .....: xi] is the kth divided difference defined recursively by 
[ee ides IDs: id = JF D: ance 2 Xk—1] 
Xk — X0 
provided xx, k = 0, ..., n, are distinct. This form of the interpolating polynomial is called 


the Newton interpolating polynomial. 
Divided differences can be computed by hand in a divided difference table constructed 
according to the pattern shown in Table 40.1. 


x y First DDs Second DDs Third DDs 
xo fixo] 
fixo, xx A pon ER 
X] — X0 
xi fix] fin. ds fx, x2] — fixo x] 
X2 — Xo 
fbi, a,] = EL f Pad fixo. 31,35, 34] = Zl = Dro a1 22 
Xi — X1 vues 
X2 fix] fbi, x2, x3] = flx2, x3] — f [xi, x2] 
X3 — X1 
Fz xa] = Fi] — fir] fix rS 2j - fl», X3, za] - fln X2, x3] 
i uita X4 — X1 
x3 flx] Pr fix “a = f x] 
X4 — X2 
Fflxs, a] = fixa] — fal fle, Mis eg ee) = fx, 3634 E — Jis. X3, Xa] 
X4 — X3 — 
X4 fixa] fix, xa, xs] = flx, zl = J [x3, x4] 
X5 — X3 
i, ag] o P 8E DAT 
Xs — X4 
xs — f [xs] 
TABLE 40.1 Divided differences f[x;,... , xj.i] 
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Table 40.2 is a more compact, but perhaps less informative, representation of the in- 
formation in Table 40.1. Table 40.2 more aptly reveals some of the latent patterns anc 
introduces a simpler notation for divided differences. 


x y First DDs Second DDs Third DDs Fourth DDs Fifth DDs 
Xo fo 
foa 
Xi fi Joa. 
fia fo.1,2,3 
X2 h fia; fo,1,2,3,4 
f fi334 f0,1,2,34,5 
X3 fis f234 fi2345 à 
f3,4 f2,34,5 
X4 fa Jas 
fas 
Xs fs 


TABLE 40.2 Divided differences expressed as fj... j+i 


The entries in the jth column of Table 40.2 are formed according to the prescriptions 


in Table 40.3. 
J Entries in Column j 
; fk — fe 
3 har = jm ls n 
Xk — Xk-1 
fiia — fik 
4 fakes = aH 1,1 tl 
Xk+1 — Xk-1 
fi tie2 — fiie 
5 fia = —M— ; E E n—2 
Xk+2 — Xk-1 
: Fe ket 2,3 — fk-i kt kt? 
6 fei = EE ml, esas n—3 
Xk+3 — Xk-1 
: The k+1,k+2,k+3,k+4 — fk-1,k,k+1,k+2,k+3 
7 fia, ka = t — 5 i ti k=l1,..., n—4 


Xk+4 — Xk-1 
TABLE 40.3 The jth column of a divided-difference table 


EXAMPLE 40.5 From the divided difference table in Table 40.4, we obtain the fifth-degree interpolating 
polynomial 


T 1993 — 5 671 .4 12,127 3 5,156,159 .2 4076 . _ 22.811 
Ps(x) = — 1266.000% + 26894 3,402,000 ^ 10,206,000 ^ 14.175% — 17.820 


formed according to (40.4). Thus, Ps(x) is the simplification of 
16 — 10(x + 13) + 35x 4-13) (x + 10) — 23 (x + 13)(x + 10) (x + 6) 
+ aes + 13)(x + 10)(x + 6)(x — 5) 


— mA (c + 13)(x + 10)(x + 6)(x — 5)(x — 14) 
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Xk Yk First DDs Second DDs Third DDs Fourth DDs Fifth DDs 
—13 16 
fo. = —10 
—10 —14 foi2 = 5 
fi2=4 fo,1,2,3 e 
—6 —13 fi23= -4 f0,1,23,.4 = ws 
f3 = -u fi234 = YER f0,1,2,3.4,5 = —iÓBE 
5 —14 fosa = 35 fiz34s = pees 
fa= s f23,4,5 = ES 
14 —10 faas = H 
fayss 
15 5 


EXAMPLE 40.6 


TABLE 40.4 The divided differences for Example 40.5 


the terms of which are obtained by traversing the "diagonal" from yo to fo,1,2,3,4,5 in 
Table 40.4. ^ 


Utility of the Newton Form 


The Newton form of the interpolating polynomial is useful because it allows one more point 
to be interpolated by simply adding a term to the existing interpolating polynomial. To see 
why this is so, we make several observations. 

First, from (40.4) we see that f[xo, ..., Xn] is the coefficient of x" in the interpolating 
polynomial P, (x). (This is explored empirically in the exercises.) Hence, the order of the 
nodes xo, ...,: x, is irrelevant; that is, f[xo. .. .,: Xn] = f Dei: Xo. X2,---, Xn], etc. Finally, 
as is shown in [60], if P(x) interpolates the nodes x, ..., Xk+m—1, then 


PH) + fF es «+ «Xml E —3)5:7QC — Kem) 


interpolates the nodes xx, ..., Xk+m- If P(x) interpolates the nodes x;41,..., Xk+m, then 


P(X) + fx, Keep] E — Keg) ** € — Aen) 


interpolates the nodes xx, ..., Xk4m- In other words, to add a node to the nodes already 
interpolated, add the node to the divided difference symbol and multiply by the factors 
corresponding to all the nodes previously interpolated. It is this flexibility of the Newton 
form of the interpolating polynomial, which makes it useful in the applications. 


The polynomial of degree zero that interpolates the single node x3 is y3. The polynomial of 
degree one that interpolates the nodes x3 and x4 is 


P, = ys + f[x3, xal(x — x3) (40.5) 
The polynomial of degree two that interpolates the nodes x5, x4, and x» is 
Py = Pi f[x2, x3, xa](x — xa3)(x — x4) (40.6) 
The polynomial of degree three that interpolates the nodes x2, x3, x4, and x, is 
P3 = Py + fba X2, x3, xa](x — x2)(x — x3)(x — xa) dn 


v 
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EXERCISES 40.2—Part A 


A1. Obtain a divided difference table for the three points 
(3, 2), (7, 9), (5, 4), in that order. What is fo.1.2? 


A2. Obtain a divided difference table for the three points 
(7, 9), (3, 2), (5, 4), in that order. What is fo.1.2? 

A3. Use the data in Table 40.4 to obtain the polynomial given by 
(40.5). Confirm this polynomial actually interpolates the 
appropriate points. 


EXERCISES 40.2-Part B 


A4. Use the data in Table 40.4 to obtain the polynomial given by 
(40.6). Confirm this polynomial actually interpolates the 
appropriate points. 

AS. Use the data in Table 40.4 to obtain the polynomial given by 
(40.7). Confirm this polynomial actually interpolates the 
appropriate points. 


B1. If the data points in Table 40.4 are Py, k = 0,..., 5, obtain a 


divided difference table for the points P», P4, Po, Ps, P, P4. The 


rightmost entry in the new table is f? 40.5 ;.3. Show this is the 
same as fo,1,2,3,4,5 in Table 40.4. 


For the sets of data points in Exercises B2-11: 


(a) Obtain a divided difference table. 


(b) From the divided difference table, construct the Newton 
interpolating polynomial (40.4) for the data. 


(c) Interpolate the given data with » 7 9 L;(x)y;. where L,(x) is 


the kth Lagrange interpolating polynomial. 


(d) Show that both forms of the interpolating polynomial agree. 


(e) Graph the interpolating polynomial. 


B2. ((—16, 14), (—13, 15), (—6, 4), (—3, —10), (—1, 10), (10, —7)) 


B3. ((—19, 16), (9, 18), (10, 2), (14, 10), (16, —7)} 


B4. {(—19, —10), (—15, —20), (—12, 20), (—11, 20), (2, —17), 
(3, 4), (5. —18)} 


B5. ((—19, 9), (—7, —18), (9, — 17), (13, —17)] 
B6. ((—13, —7), (—1, 7), (3, —2), (6, 14), (8, 8), (10, —6)] 
B7. 1(—13, —8), (0, —15), (1, —12), (7, 175, (12, 12] 


B8. ((—14, —7), (—13, 6), (—5, 4), (—4, —16), (—2, —14), (0, 0), 


(10, —14), (18, 13)] 
B9. ((—17,3), (2, —2), (11, —18), (18, "e 
B10. ((—18, —9), (—9, —16), (—1, 13), (4, —20), (16, 1)} 
B11. unm MA LI 17, —13)) 


For the polynomials p, (x) in Exercises B12-17: 


(a) Obtain the divided difference table for the points (k, p,(k)), 


k2É0,..., n 4-3. 


(b) Which column of the divided difference table first becomes 


constant? 


(c) Verify that p, (x) 


= Yop Iu 50s smi xx] Ii Sie 


B12. p(x) = 2x7 +6x+5 B13. p3(x) = 8x3 — 8x? — 7x —9 
B14. p4(x) = 9x4 + 3x? — 4x? + 6x — 5 

B15. ps(x) = 5x? — 5x* + 4x? +2x?4+2x+7 

B16. po(x) = 9x° + 7x5 + xf — x? — 2x? + 1 

B17. p;(x) = 6x8 + 8x5 + 8x3 — 5x? — 5x + 3 


In Exercises B18—22, use the given function and data points to 


(a) verify that if p, (x) interpolates f(x) at (xy, f (xi)), 
k 0, s n, then f (t) — p.(t) = f[xo. xi, ..., Xn, t] 
[io(t — x), provided : is distinct from the nodes xe 


(b) verify that in each case, there is a point £ in [xo, x,] for which 


f [X65:315 55.2 xx] = lf (£). (In general, the statement is 


true provided f (x) has n continuous derivatives in [a, b] and 


the nodes x; are distinct points in [a, b].) Here, verify the 
claim by finding £. 


5x* — 11x? + 9x? — 12x —8 k—1 
ET —7x3 — 3x? — 3x — 3 w= g 
EE ag 5—nt-i 
B19. f(x) = 11+ 8x? — 2x? —4x pek] 
i 3x4 — 6x? — 7x? =- x —1' , 
Kl ess 6-—mf-T 
B20. f(x) = 7x? — 6x? — 12x —4 pum 
: 5x4 — 9x3 — 3x2 — 3x — 1 ' 
kc. uu 4=n;t=c 
—11x? + 6x +2 
B21. f(x) = 9x4 9 = 5x2 — Ox 5X, =k, 
k=)) 009 = t= 
B22. f(x) = L e. m exp k,k20,..52nmtz-c 
` —4x? — 2x? — 2x — 3 
B23. Demonstrate that f [xo, xi, ..., x4] = (—1)" [Tro 1/xe for 
fe)-t 


N 


SA 0 1234 5 


FIGURE 40.3 The magnitude of the error 
when F(x) = x is interpolated by 
F(x), a polynomial through (k, f (k)), 

k = —5,...,5, the nodes of which are 
equally spaced 
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| Chebyshev Interpolation 


Polynomial Wiggle Problem—Review 


In Section 40.1 we observed the polynomial wiggle problem wherein polynomial interpola- 
tion of data points from a curve that is not polynomial-like yields an interpolating function 
exhibiting dramatic oscillation between the interpolated points. We saw that for the function 
T= nz and the 11 points (k, f (k)), k = —5,...,5, with equally spaced nodes, the 
interpolating polynomial F(x) was given by (40.3). The magnitude of the error between 
f(x) and F(x), E(x) = |F(x) — f(x)|, is graphed in Figure 40.3. The maximum value 
of the error, Emax = 1.91566, located at Xmax = +4.701093180, is found by elementary 
calculus. The aim of this section is to show that with unequally spaced nodes, the maximum 
error of polynomial interpolation can be minimized. The agent of this reduced error is the 
set of Chebyshev polynomials, discussed next. 


Chebyshev Polynomials 


Table 40.5 lists 7, (x), n = 0,..., 7, the first eight Chebyshev polynomials. In addition, 
the Chebyshev polynomials obey the recursive relationship 


Tri (x) = 2x Tn (x) — Ty aA (x) (40.8) 


and are orthogonal, with weight w(x) = = on the interval [—1, 1]. Orthogonality of 


EX 
x^ 


the Chebyshev polynomials is expressed by the integrals 


l T(x) Tm (x) b 
—————dx-in m=n=0 (40.9) 
-1 vi-a? 2 m=nZ#0 
To = 1 T, 28x — 8x? + 1 
Ti =x T; = 16x5 — 20x? + 5x 
T) = 2x* — 1 Ts = 32x5 — 48x^ + 18x? — 1 
T, = 4x? — 3x T; = 64x? — 112x? + 56x? — 7x 


TABLE 40.5 The first eight Chebyshev polynomials 


Surprisingly, an alternate form of the Chebyshev polynomial is T, (x) = cos(n arccos x). 
To demonstrate this for a specific polynomial, set arccos x = f and expand the resulting 
cos nt, obtaining, in the case n = 7, 


64 cos! t — 112 cos? t + 56cos? t — 7 cost 


Replacing each t with arccos x gives 64x’ — 11232 + 56:2 — 7x = Tz (x). 


Chebyshev Interpolation 


The following theorem from [60] describes Chebyshev interpolation. 
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FIGURE 40.4 The Chebyshev 
interpolating polynomial p(x) (solid), the 
equispaced interpolating polynomial F (x) 
(dotted), and the function f(x) (dashed) 


EXAMPLE 40.7 


Error = Ip) -fœ 


5-4-8-2- & 1 


FIGURE 40.5 Graph of |p(x) — f (x)], 
the absolute value of the error in the 
Chebyshev interpolating polynomial 


2 3 4 5 


Chapter 40 Interpolation 


THEOREM 40.1 


1. f(x), the nth derivative of f (x), is continuous on the interval [a, b]. 

2. |f" (x)| x M, on the interval [a, b]. 

3. &,...,&, are the n zeros of T, (x), the nth-degree Chebyshev polynomial. 

4. In[a, b], xx 2 a - (b — a)(& - D, k =1,...,n, are the images of &,..., En 
under the transformation x = a + ;(b — a)(& + 1), which takes [—1, 1] onto 
[a, b]. 

5. pn—(x) is the polynomial of degree n — 1 that interpolates the points (x1, f (x1)). 
Seu Gros eee . 


6. cisinthe interval [a, b]. 


M, n 
=> |f (c) — pa-i(o) < Tram =a) 


Loosely speaking, this theorem says that to interpolate n points whose nodes lie in 
[a, b], take the nodes as the images of the zeros of the Chebyshev polynomial 7; (x) and 
the maximum error in the interpolating polynomial will as small as possible. 
For the function f(x) — im we will obtain the Chebyshev interpolating polynomial 
that interpolates 11 points in the interval [—5, 5]. Table 40.6 lists £y, the 11 zeros of the 
Chebyshev polynomial T1; (x), along with the points (xy, f (xx)), k = 1,..., 11, where x; 
is the image of & under the mapping x = 5£, which takes the interval —1 < & < 1 to 


—5 = xc Y. $ 
& Xk S (xx) 
+0.9898214419 +4.949107210 0.0392254354 
+0.9096319954 +4.548159977 0.0461132115 


+0.7557495744 
+0.5406408175 
+0.2817325568 


+3.778747872 
+2.703204088 
+1.408662784 


0.0654495859 
0.1203758760 
0.3350834924 


0 0 1.0 


TABLE 40.6 The zeros of Tj, (x) and their images under the 
mapping x = 5é 


The tenth-degree polynomial interpolating (xy, f (xx)), k = 1,..., 11, is then 
p = —0.478 x 107?x19 + 0.333 x 10-3x8 — 0.854 x 107?x$ 
-- 0.983 x 107! x^ — 0.499x? + 1 


Figure 40.4 contains graphs of p(x), the Chebyshev interpolating polynomial (solid). 
the equispaced interpolating polynomial (dotted), and the function f(x) (dashed). Figure 
40.5 shows a graph of |p(x) — f(x)|, the absolute value of the error made by the Cheby- 
shev interpolating polynomial, revealing that for x > O the largest error is made some- 
where in the interval (0, 1). Elementary calculus gives the corresponding extreme point 
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as (0.7757975, 0.1091535). The maximum error is considerably smaller than the error of 
nearly 2 in the equispaced interpolating polynomial. 


EXERCISES 40.3 


1. If To(x) = 1 and Tj (x) = x, use the recursion (40.8) to generate 
the Chebyshev polynomials 7; (x), k =2,...,5. 


[n Exercises 2-6: 


(a) Obtain P, (x), the polynomial of degree n — 1 that 
interpolates the n uniformly spaced nodes x, = a + (k — 1), 
k=1,...,n, where h = 7-4, and [a, b] is the given interval. 


n-1l? 


(b) Obtain p, 1 (x), the Chebyshev interpolating polynomial of 
degree n — 1. 

(c) Determine M,,, a constant for which | f ? (x)| < M, holds for x 
in [a, 5]. 

(d) Obtain e, = max, | f(x) — P,.1(x)], € = max, | f (x) — 
Pn—1(x)|, and e3 = M,(b — a)'/(2?"-!nt). 

(e) Verify that e; < &3 and that £2 < £1, thereby showing the error 
bound for the Chebyshev interpolating polynomial is valid. 


-5x* qx? 9x? = 12% — 8 


2. f(x) = a ^ [-3,2],n 2 6 
11 + 8x3 — 2x? — 4x 
3. f(x) = [215], n27 
fe 3x4 — 6x3 — 7x? -x — 1. [ ba 
7x? — 6x? — 12x 
4. f(x) = ;[0,4], n 2 5 
J= Ta SP Pe h^ 
—11x? + 6x +2 
5. f(x) = ;[2-L 2], n = 4 
sI e ape n 
7x? — Ax — 6 
S ra= 4x3 —2331-2x-3 Perth d= 


In Exercises 7-16: 


(a) Obtain P,_; (x), the polynomial of degree n — 1 that 
interpolates the n uniformly spaced nodes x, = a + (k — 1), 
k — 1,...,n, where h = 2a, (Except for a renaming of the 


parameter n, these are the polynomials obtained in the 
exercises of Section 40.1.) 


(b) Obtain p„—ı(x), the Chebyshev interpolating polynomial of 


degree n — 1. 
(c) Determine M,,, a constant for which | f (x)| < M, holds for x 
in [a, b]. 


(d) Obtain e, = max, | f(x) — P,.1(x)], € = max, | f(x) — 
Pn-1 (x)|, and e = M, (b — anl). 

(e) Verify that £2 < £3 and that £2 < £1, thereby showing the error 
bound for the Chebyshev interpolating polynomial is valid. 


7. f(x) = 10xe *, Ox x Tng 
2 


8. fo) = 


i po 3sxsz3nz! 
x 


18. 


19. 


. f(x) =xt+ 


9 1 
x 2 


2 
. f(x) 2 arctanx, 0 x x 75;n- 8 


= f(x) = e™ cosx, 0 <x x 55n-6 
. f(x) =VJV14+x7,0<x < lin =7 
] xX 
Zi imbres aes hess 
JO = Osx <Tn=8 
f) cosh x Bas al 8 
. x)= 3 X — — 
FU iioi da 


u f(x) =e*tanx,0<x< 5n =$ 


. The following construction sheds light on the meaning of 


“minimax.” The error in polynomial interpolation is given by 

f(x) — p,G) = f *»(£)/( + D! [Tox — xà. In Chebyshev 
interpolation, the nodes are “moved” until the absolute value of the 
factor y. = [To (x — x) is as small as possible. Consider the case 
n = 1 in which y = (x — @)(x — f) and the interval of 
interpolation is taken as [—1, 1]. Assume that |v'| is minimized 
when as much of the parabola y is above the x-axis as below. Thus, 
require w(—1) = w(1) but w(x) = —w(1), where X locates the 
vertex of the parabola. These conditions determine o and f as t2 
and give y = x? — i = iT, (x), the Chebyshev polynomial of 
second degree. 

(a) Verify the construction of y. 


(b) Extend the construction just described to the case n = 2 in 
which Y = (x — a)(x — B)(x — y) is a cubic and the 
construction yields 2 T3 (x), the Chebyshev polynomial of third 
degree. Hint: Require w(—1) = —w(1), W(x’) = —v (x^), and 
V (x^) = v (1), where x’ and x" are the locations of the two 
horizontal tangents (extrema) for v. 


From the representation 7; (x) = cos(k arccos x), obtain the 
formula x, — cos( 7H aa n —0,...,k — 1, for the zeros of T, (x). 
For k = 2,..., 8, verify that this formula gives the correct zeros. 
Let xo, ..., xx. .1 be the k zeros of T; (x). For k = 7 and several 
values of i and j, verify 

k-1 
(a) 9 /T,G,)T; Gu) = 0 fori # j 

n-Ü 


k-1 

(b) 2, Tit; æn) = ; fori = j £0 
k-1 

(©) 9 Ton) To) =k 


n=0 
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Spline Interpolation 


What Is a Spline? 
Loosely speaking, a spline is a piecewise-smooth polynomial that interpolates the n — 
points (xy, Yk), k =0,..., n. More precisely, a spline of degree d interpolating n + 1 poini 


is a piecewise defined function consisting of n polynomial segments, one between each pax 

of consecutive points, each polynomial being of degree no more than d and joined at the 
y interpolated points so as to form a function whose first d — 1 derivatives are all continuow 
QUADRATIC SPLINE A quadratic spline (degree d = 2) connecting the n + 1 = 5 point 
(—8, —20), (—3, 10), (4, 2), (13, —17), (17, 3) is 


1284 + 96x + 6x?) —8<x<-3 
35 (1426 + 36x — 923?) —3<x<4 
F(x) = 
a; (45,806 — 14,236x + 767x°) 4<x<13 
555 (10,830x — 319x? — 91,163) 13<x<17 
(a) This spline is a piecewise function whose segments are quadratic polynomials. In Figure 
" 40.6(a) we see a graph of the spline and the interpolated points, and in Figure 40.6(4 
n graph of F5(x), the first derivative. From the graph, we conclude that the first derivative 


304- continuous. 


Cusic SPLINE A cubic spline (degree d = 3) joining the same n + 1 = 5 points is 


9,094,052 _ 9.106.354. — 1.194.496 .2 149,312. .3 "ER 
dis 879.375 — 2.638.125" ^ 879,375 ^ 2,638,125” EITI a 
15.718.618 — 757.612... 676.646 2 122.846 3 _ ] 
and. FG) = ] MBLES ^ 738.675 1,231,125% + 3,693,375% di Ecl, (40.16 
oe) 59,221,586 _ 1,271,612 , _ 957.934 2 4. SH y3 A4 Ey 213 a 
-30 + 4.748,625 1,582,875“ 1,582,875" 135.675 -Lp L 
25.675.649 _ 120.049.619. , 2.608.973 .2 153.469 3 . 
b) 100,500 2.110,500 ^ + 703,300 ^ 2.110.500 * ae Bo 
FIGURE 40.6 The quadratic spline F» (x) In Figure 40.7(a) we see a graph of the cubic spline F3(x), which seems to oscillate 
and its first derivative less than the quadratic spline F2(x) in Figure 40.6(a). In Figure 40.7(b) we see a graph 


F;(x), the first derivative of the cubic spline, and in Figure 40.7(c) we see a graph of F; 
the second derivative. From the graphs, we conclude that the first and second derivative 
of F3(x) are continuous. Since F7(—8) = 0 = F1(17), we have what is called a naturs 
spline. Before the end of the section, this will be discussed further. 
We next construct the cubic spline from first principles. To this end, start with the n = 4 

cubic polynomials 

g(x) = aix? + bx? +cix +d g3(x) = a3x? + byx? + c3x + d3 

g(x) = ax? + bax? + eax + do g4(x) = a4x? + bax? + xac + da 
We now have n(d + 1) = 4 x 4 = 16 constants to determine. Prescribing the endpois 
values for these four cubics gives the 2n = 8 equations 


—512a, + 64b, = 8c, +d, = —20 64a; + 16b3 + 4c3 + d; =2 


—27a, + 9b, — 3c, +d; = 10 2197a3 + 169b3 + 13c3 + d3 = —17 (40.11 


—27a»5 + 9b» m 3c2 + d» = 10 2197a4 + 169b, + 13c4 + d4 = —17 
64a» + 16b2 + 4c +d2 = 2 4913a4 + 289b4 + 17c4 + d4 = 3 


(a) 


(b) 


(c) 


FIGURE 40.7 (a) the cubic spline F3(x); 
(b) its first derivative F(x); (c) the second 
derivative Fy (x) 
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Continuity of the first derivative at each of the (n + 1) — 2 = 3 interior points generates 
the three additional equations on the left in (40.12). Continuity of the second derivative at 
these same three points gives the three equations on the right in 


27a; — 6b, + c1 = 27a — 6b; + c3 —18a, + 2b, = — 18a + 2b; 
48a5 + 8b2 + c; = 48a3 + 8b3 + c3 24a + 2b = 24a3 + 2b3 
507a3 + 26b3 + c3 = 507a4 + 26b4 + c4 78a3 + 2b3 = 78a4 + 2b4 


We have a total of 8 + 3 + 3 = 14 equations in 16 unknowns. Using a computer algebra 
system, we can solve the equations (40.11) and (40.12) in terms of any two of the unknowns 
and write the cubic spline in terms of these two parameters. If we choose d3 and d; as the 
arbitrary parameters, we are still at liberty to impose two additional conditions on the cubic 
spline. 

There are four common endpoint conditions used to provide the additional two equa- 
tions needed to specify the cubic spline completely. Prescribing the first derivatives at the 
endpoints yields the clamped spline. For example, if the derivatives at the endpoints are 
taken as zero, we have, in terms of the arbitrary parameters d3 and d4, the two additional 


(40.12) 


equations 
5.081.581 11.328 1,125,171 18.847 5152 iP o3 _. 
194.922 3.398, 759 04 799,708 d; —0 1989 485,537 l4 78,561 3 =0 
Solving for d3 and d4, the resulting cubic spline is then 
2,443,933 .3 — 1.842.913 ,2. 6,500,744 11,880,364 = » 
9.516.150% 500,850 ` 679,25 * + 1,586,025 Bsix 3 
8171 3 2,248,345,2 1,407,530. , 7,104,478 , 
Gi) 140,238 2.664.522% 1332261% T 444.087 -2a 
AX.) -— 
l 532,999 3 — 2,627,455 , 2.336230 . , 12,045,022 A<x<13 
10,277,442 3.425.814% 1.712,907 * 734,103 Sd S 
635.837 .3 į 27.346.699 378.517.087 1,661,551,985 
772.030.1127 2350412 7. 2.080.112. ^ + 2,080,112 I3<x<17 


which is graphed as the solid black curve in Figure 40.8. (In the accompanying Maple 
worksheet, the derivative at the left endpoint is assigned the value s and the resulting family 
of splines is animated to visualize how the endpoint condition influences the shape of the 
spline.) 


FIGURE 40.8 The four cubic splines G, (solid, in 
black), G2 (dotted), G4 (dashed), and G4 (solid, in 
color) 


At the endpoints, setting the second derivatives equal to zero gives the free, or natural, 
spline. This would correspond to prescribing the endpoint curvature to be zero. Doing that 
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here gives the two additional equations 


671.974 73.089 2848 101 _ 1701 248 
—' siiás + 7689503 + 130721544 = O 39 — 57.0205 — 3&se1d4 = O 
and the cubic spline 
9,094,052 _ 9,106,354 1,194,496 .2 _ _149,312 3 
3024 ; 496 x2 : —-8<x<- 
879,375 2,688.05^ ^ 879,375 ^ 2,638,125% IE 
15,718,618 _ 757,612 _ 676,646 „2 , 122,846 ..3 E 
Go(x) 1,231,125 — 7386757 — 1,231,125% + 3,693,375% Isaga (40.13 
20) = 1 50,221,586 1,271,612». _ 951934 „2 4 _5141_ 43 Aay <= 13 ' 
4.748.625 ^ 1.582.875% — 1.582.875“ 135,675 zxmi 
25,675,649 _ 120,049,619 2,608,973 2 _ 153,469 
LM "od < < 
100,500 2.110.800 ^ + 703,800 ^ — 2110.500 13 <x <17 


Comparing (40.10) with (40.13), we see G2(x) = F3(x), so the cubic spline first examined 
is the natural spline with zero curvature at the endpoints. The spline G? (x) appears in Figure 
40.8 as the dotted curve. 

Equating the second derivatives at the first and second points will make the first cubic 
collapse to a quadratic. Similarly, equating the second derivatives at the next-to-last and last 
points will cause the last cubic to collapse to a quadratic. Thus, imposing the conditions 


G” (xo) = G” (xı) ad G”(xn) = G” (Xn41) 


gives the equations 


ie + esd + ors = e ib 33907554 
a~ 715 + 955574 = A — 545 zi ser 44 
| and the cubic spline 
uo mb que — 
cy .| o T 
| — UM NI MEL 
"TM CNET: pexei7 


As predicted, the first and last ama in the spline have collapsed to quadratic functions. 
The spline G3(x) appears in Figure 40.8 as the dashed curve. 
Finally, consider making the first and second cubics identical and the next-to-last and 
last cubics identical. These two conditions will generate the equations 
810) = 82(x) and g,—1(x) = gn (x) 
In this example, these conditions become the equations 


A(x? +9x? 27x +27) 20 and B(x? — 39x? + 507x — 2197) = 0 


where A = 6,163,516,528 — 562,406,733d3 — 1,064,448d, and B = d4 — d3. Hence. 
A = B = 0 determine d3 and d4, giving the cubic spline 


156,757 .3 1,435,963 .2.— 6,786,827 12,733,712 
Bi 22 2 6 ; 733, — 
6,668,298 ^ 3,334,149% 6.668.208 + 1.111.383 8<x<-3 
156,757 .3 1,435,963 .2 6,786,827 12,733,712 
IST. s 2 6,786, ida 
Galx) 6,668,298 ^ 3,334,149 * 6.668.208 + LIIL383 35x54 
x)= 
4 210.839 „3 _ 1.760455 „2 _ 4.190.891 „ 2,805,424 Aapan 
6,668,298" 3,334,149 6,668,298 256,473 Sa 
210,839 .3  1,760,455..2 4,190,891 2,805,424 
: p ns y^ MI <x< 
6,668,298 ~ 3,334,149 * 6.668.298 + 356.473 3<x<17 


The first two cubics are identical, and the last two cubics are identical. The spline G4(x 
appears in Figure 40.8 as the solid curve in color. 


40.4 Spline Interpolation 1029 


Summary 


A degree d polynomial spline that interpolates the n + 1 points (xy, yy), k = 0,...,n, 
will be a piecewise function consisting of n polynomials of degree d, joined in such a 
way as to make a function whose first d — 1 derivatives are continuous. A polynomial of 
degree d contains d + 1 coefficients, so there are a total of n(d + 1) parameters that must 
be determined to specify the spline. There are 27 interpolating conditions since each of 
the n polynomials must pass through two appropriate endpoints. Since each of the first 
d — 1 derivatives must be continuous at the n — 1 interior points, there are a total of 
(d — 1)(n — 1) continuity conditions available. Thus, there are d — 1 conditions missing. 
Indeed, (d + 1)n — (2n + (d — 1)(n — 1)) 2d — 1. 


Numeric Algorithm for a Cubic Spline 


Completely derived in [60], a formalism for numerically computing G (x), a cubic spline that 


interpolates the n + 1 points (xy, yk), k = 0,..., n, is stated next. The spline is described, 
not in terms of the (d + 1)n = 4n coefficients of the individual cubics making up the spline, 
but rather, in terms of 0, = G” (xp), k =0,..., n. Thus, the unknowns in the spline are the 


values of the second derivative of the spline at the nodes. 


Cubic Spline Algorithm 


Input xg, k = 0, ..., n and yy, k =0,..., n. 

2. Define hy = Xk+1 — Xk; B=) cay n-l. 

3. Define Firn zeal] = (ja — ve)/ ep — xi), k = 0,..., n — 1, the first divided 
differences as defined in Section 40.2. 

4. Toimpose a condition on the left endpoint, select one equation from the following four 
types of endpoint conditions. 
(a) 2(ho + hi)oi + hion = 6Cf[xi, x2] — f [xoi xi — hoG” (xo) 


(b) (ho + 2h1)oi + hion = 6Cf[xi, x2] — fIxo, xi 
6} 
(c) (ho + 2h1)o1 + (hy — ho)oz = 1 CfDxi, x2] — flo. xi D 
ho T hi 


(d) ($ho + 2hi)a; + hio» = 3Q f [xi x2] — 3f x0, x1] + G'(x9)) 


If (a) is chosen, input the value of G" (xo). If (d) is chosen, input the value of G'(xo). 


5. Ateach of the n — 3 interior nodes x, k = 2,...,n — 2, write the equation 
hy 4044 + 2014 + hon + hyoyaua = 6CPIx xia] — fbi xl) 
6. To impose a condition on the right endpoint, select one equation from the following 
four types of right endpoint conditions. 
(a) ha -205—2 +2(hn-2 FAri )94—1 = 6( f [xn -1 , Xn] pa F EXn-25 5-11) m hy 4G" (Xn) 
(b) hran- = (2hn-2 + 3h, )9n-1 = 6Cf [xs i. 3] ol fIxs-2. Xn-11) 
6h, 5 Cf [Xn-1 , Xn] e f a-a Xn-1]) 
hy 2 haa 
(d) h,—204—2 T (2h, 2 E 3h, 3)051 = IOT Dri > nn] = 2 f [xaos Haal = G'(Xn)) 


(c) (An—2 — hi -1)08-2 + Q2 T h—)95—i = 


If (a) is chosen, input the value of G” (x„). If (d) is chosen, input the value of G’ (xn). 
This is now a tridiagonal system of dimension (n — 1) x (n — 1) for og, k = l,..., 
n — 1, a system that can be solved quickly with an O(n) algorithm. 
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p^ 


10. 


After computing oz, k = 1,...,n—1,compute oo ando; from the following equations. 
(a) For type (a) endpoint conditions, use 

oo = G” (xo) On = G” (Xn) 
(b) For type (b) endpoint conditions, use 

00 = 0| On = 05. 
(c) For type (c) endpoint conditions, use 
_ (ho +h1)01 — hoo? (An—2 + An—1)On—-1 — An-10n-2 

hy T 


(d) For type (d) endpoint conditions, use 


90 
hn-2 


3 . ^ 01 
oo = Pat [xo 31] — G (x9) — > 
10 p 


3 / On-1 
On = ——(G (Xn) = J Eii; Xn]) = 
ha 2 
Fork =0,..., n — 1, compute the numbers Az, Bg, C, via the equations 
hy OK Ok+1 — OK 
Ay = f [Xi, Xii] ^ — (0x41 + 20% B; = — C, = — — 
k= f Ersta] 6 (O%41 + 204) l= k 6h; 


Define zg = x — x, so that the individual cubics g(x) making up the cubic spline are 
given by 

Seri(X) = Yk + Zk(Ak + zk(Bk + ZkCk)) | xy Ex SM | ko0,...,n—-1 
Comments: 
(a) Type (a) endpoint conditions are used when G"(xo) or G"(x,), the value of the 


second derivative at an endpoint, is specified. When the prescribed values are zero. 
these are the natural, or free, boundary conditions. 


(b) Type (b) endpoint conditions will cause gi (x) or g; (x) to collapse to quadratics. 
(c) Type (c) endpoint conditions will cause g; (x) = g2(x) or 8—1 (x) = 8n (x). 


(d) Type (d) endpoint conditions are used when G’ (xo) or G’(x,), the value of the first 
derivative at an endpoint, is specified. These are the clamped boundary conditions 


EXAMPLE 40.8 Table 40.7 contains a list of n + 1 = 9 points (xz, yg), the eight differences hy = xy41 — xi. 
and the first divided differences fk x41 = f[xi, xiii] = (Yk+1 — Yid / Gea — Xk). 


Table 40.8 contains the seven equations defining oj, k = 1,..., 7. The first equation 


arises from the natural boundary condition G"(xo) = 0 at the left endpoint. The next five 
equations arise from the interior-point equation 


Ay Ox—1 + 204 + hy og + hkk = OCF Dx xil — Fl %e-1, xb 


The final equation arises from the natural boundary condition G"(x,) = O at the right 
endpoint. Also included in Table 40.8 are the values of og, k = 1,...,7, determined by 
these equations. The values of oo and og were determined to be zero when we imposed the 
natural endpoint conditions. 


Table 40.9 lists the values of the constants Aj, Bj, Cj, k —0,...,n—1- 7. 
The component cubics g(x), k = 1,...,n = 8, are obtained from zg = x — xz, and 


Er) = yk + (AR + zk(Bp-Fzy&Ck)) | Xy EX € Xii. k—0,...,n—1 
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k (Xk, Ye) hy = xia — Xk Sickel = E 
0 (—20, 3) hy =3 ne 

] (717,3) hy =9 fack 

2 (8, —3) hy =5 fe —2 

3 (-3, -16) hy =5 faa 

4 (2, -5) h4 = PLE 

5 (4, 2) hs = fs6 = -2 

6 (10, —17) hg =3 fe7 = 2 

7 (13, 5) hı = fis =} 

8 (17, —4) 


TABLE 40.7 Data points, hų, and first divided-differences in Example 40.8 


k Ax By C; 
0 E scm 0 E 
240, + 902 = —4 O1 = aeai l 26 187460 32290520 [att 963,840 
901+ 2802+ 50;=-$ =E mE gam E 
S02 +200 +5o= 4 oy = RUE | -RuE — gue — xum. 
50; + I4oy+205= 2 oy = 188 (0 *Bm o imm ee 
20, + 1605+605 =—40 os = Hoou 3E ME QM — 
60s + 1806+307 =63 o = DU E — E 
305 + 140; = — 7 On = — a0 7 26.147 460 BTSO 208,179,680 
TABLE 40.8 Example 40.8: The equations defining TABLE 40.9 The values of Az, By, Ck, k =0,..., hs 
Gy, k =1,... , 7, and their solution computed in Example 40.8 
which appear in G(x), given by 
DUE er E ee 
IUEN TE E a7 oy x 8 
2662 + BME) 4 MIE, IR sga 
5 9 2.742 
ad we owa | uu A n MEL 
-20 -15 -1 19,478,113 „3 4 110,270,189 „2 _ 63,832,763 , _ 19,707,648 TIC 
41,835,936 34,863,280 26,147,460 2,178,955 =" 
308.175.680* — 863.980 + Side * — du Assai 
S221020% + 47-30 * — 839m Xt szoa «= 10S x < 13 
XU — “eo-ra6.s00* + x9D946 1 — emnes D Sx S17 


|GURE 40.9 Graph of the cubic spline 
G(x) computed in Example 40.8 A graph of the cubic spline and the data points is given in Figure 40.9 e 
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EXERCISES 40.4 


1. Given the data points ((1, 5), (2, —3), (3, 7), (4, 2)): 


(a) Graph the points (xp, y), k =0,..., n — 3, and sketch a linear 
spline that interpolates them. 


(b) Obtain Fo(x), the piecewise function that is an analytic 
representation of the linear spline sketched in part (a). 


(c) Obtain and graph F; (x), the natural quadratic spline for which 


Fi (xo) =0, 
(d) Obtain and graph F>(x), the natural quadratic spline for which 
F3(Xn) = 0. 


(e) Obtain and graph F3(x), the clamped quadratic spline for 
which F; (xo) = 1. 

(f) Obtain and graph F4(x), the clamped quadratic spline for 
which Fj(x,) = 1. 

(g) Obtain and graph F5(x), the quadratic spline for which 
Fz(xo) = Fz(xi), noting that this condition causes g; (x), the 
first polynomial segment in the spline, to be linear. 

(h) Obtain and graph F¢(x), the quadratic spline for which 
Fi(Xn-1) = Fé(x,), noting that this condition causes g, (x), the 
last polynomial segment in the spline, to be linear. 

(i) Obtain and graph F;(x), the quadratic spline for which the first 
and second segments are the same quadratic, that is, for which 
gi(x) = g(x). 

(j) Obtain and graph Fs(x). the quadratic spline for which the 
next-to-last and last segments are the same quadratic, that is, 
for which g,- (x) = g, (x). 

(k) Obtain and graph P, (x), the nth-degree Newton (or Lagrange) 
polynomial that interpolates the given data. 


In Exercises 2 and 3: 
(a) Graph the points (xz, yz), k = 0,..., n — 5, and sketch a linear 
spline that interpolates them. 


(b) Obtain Fo(x), the piecewise function that is an analytic 
representation of the linear spline sketched in part (a). 


(c) Obtain and graph F| (x), the natural quadratic spline for which 


Fi (xo) =). 
(d) Obtain and graph F>(x), the natural quadratic spline for which 
F3(%n) = 0. 


(e) Obtain and graph F3(x), the clamped quadratic spline for 
which F; (xo) — 

(f) Obtain and graph F(x), the clamped quadratic spline for 
which Fj(x,) = 1. 

(g) Obtain and graph F5(x), the quadratic spline for which 
Fi(xo)— F:(xi), noting that this condition causes g, (x), the 
first polynomial segment in the spline, to be linear. 


(h) Obtain and graph F(x), the quadratic spline for which 
Fi(xn-1) = Fix). noting that this condition causes g, (x). the 
last polynomial segment in the spline, to be linear. 

(i) Obtain and graph F} (x), the quadratic spline for which the first 
and second segments are the same quadratic, that is, for which 
gix) = ga(x). 

(j) Obtain and graph F(x), the quadratic spline for which the 
next-to-last and last segments are the same quadratic, that is, 
for which g,. (x) = g, (x). 

(k) Obtain and graph P, (x), the nth-degree Newton (or Lagrange 
polynomial that interpolates the given data. 


9, 1), (—6, —17), (3, 18), (7, 17), (15, 8)} 
9), (—2, —5), (2, —3), (11, —16), (18, —14)] 


2. ((—15, —5), ( 
3. ((—20, 8), (—16, 


In Exercises 4-6: 


(a) Obtain and graph G; (x), the natural cubic spline for which 
Gj(xo) = Gi (x,) = 0. 

(b) Obtain and graph G2(x), the cubic spline for which G3 (xo) = ! 
and G5(x,) = —1. 

(c) Obtain and graph G3(x), the cubic spline for which 
G5 (xo) = G$Gx1) and G2(x, 1) = G3 (xn), noting that these 
conditions cause gi (x), the first segment polynomial in the 
spline, and 2, (x), the last segment polynomial in the spline, to 
be quadratic. 

(d) Obtain and graph G4(x), the cubic spline for which 
g1(X) = go(x) and g, 1 (x) = gj, (x), that is, for which the first 
and second cubics and next-to-last and last cubics are the same 

(e) Obtain and graph G5(x), the clamped cubic spline for which 
G% (xo) = 0 and G;(x,) = I. 

(f) Obtain and graph G¢(x), the cubic spline for which 
Gg (xo) = Gi (xo) = 0. 

(g) Obtain and graph G;(x), the cubic spline for which 
G7(xo) = G} (x1) and gr-1 (x) = g,(x). 


4. ((—19, 2), (—8, 15), (76, 5), (—5, 5), (—4, 7), (18, —9)] 
5. ((—20, 4), (—18, —14), (—9, —16), (8, 15), (18, —4), 20, 15)] 
6. ((—10, —2), (1, 16), (5, —10), (16, 17), (17, 9), (17, 19)] 


For each function f (x) and set of nodes xg, k = 0,..., n, prescribed in 
Exercises 7-10: 


(a) Obtain G(x), the natural cubic spline (G"(xo) = G"(x,) = 0 
interpolating the points (x, f (x4)), k = 0,..., n. 


(b) Show that [7 [G"G)F dx < f Lf" GOT dx. 
7. Exercise B2, Section 40.1 8. Exercise B4, Section 40.1 
9. Exercise B7, Section 40.1 


10. Exercise B9, Section 40.1 


[n Exercises 11 and 12, use the following prescription to obtain the cubic 
tension spline G,(x), in which the parameter t simulates “tension” in 
the spline. In each case, graph G- (x) for several values of t in the range 
$ <rt x 10. (Try t = 0.1, 1, 10.) In fact, as t > 0, G, (x) becomes a 


cubic spline, and as T — oo, G,(x) becomes a linear spline. 
(a) Fork =0,..., n — 1, obtain hy = xy41 — Xk, oy = 1/ hg — 
t/ sinh thy, B, = T coth thy — 1/ hy, yy = T? (Yer — Yedhe. 
(b) Set zo = z, = 0, and solve the equations o; .1zi1 + 
(Br-1 + Biz + AkZk+i = Ve — Ve-1K=1,..., n — 1, for 
Zo yrr n — 1. 


(c) On [xy xy. 1], Gr (X) is given by 
zy sinh t (xy44 — Xx) + zi441 sinh T(x — xg) 


G(x) = 
ae t? sinh thy 


1 Zk . 
"a L(». =) (X41 — x) 
+ EN = a ) G= xo] 


11. ((—16, —8), (—6, —20), (—2, 10), (5, —5), (8, 1), Q0, —5)} 
12. ((—18, 1), (—13, —14), (—6, 6), (—5, 12), (9, —18), (13, —4)] 


Bezier Curves 


DEFINITION 40.1 
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40.5 Bezier Curves 


In Exercises 13-15, obtain and graph G(x), the cubic spline for which 
G” (x) is continuous at x, and x,. ;. This pair of continuity conditions is 
to hold in lieu of any of the options given in step (6) of the cubic spline 
numerical algorithm. 

13. ((—19, 12), (—9, 10), (—8, 9), (—6, 
14. ((—20, 6), (—17, 9), (—12, 11), (—11, 
15. ((—15, 7), (8; —19), (8, 


15), (1, 9), (17, 10)} 
3), (-7, —1), (-2, 1)) 
15), (14, 12), (15, —4), (19, 16)] 


In Exercises 16—20, the curve interpolating the given points (xz, yg), k = 
15:255 n, loops back on itself and, hence, must be represented paramet- 
rically. Let ^, = k; form the two sets of points (tk, Xk), (tk, Yk), k = 
j m n; and obtain two natural splines G, (t) and G, (t) interpolating 
the respective sets of points. Graph the resulting parametrically given 
curve x = x(t) and y = y(f). 


16. 1(—97, 20), (9, —7), (—18, —8), (30, —15), (8, 19), (12, 81 
17. {(15, —4), (14, 16), (7, 5), (—19, 0), (—15, —20), (12, 20)) 
i8: (4. 1), 6-6, 15). 0-2; — 15), 0-18, 5 015,85, 0-8, 200 


19. ((—20, —13), (1, —20), (2, 15), (8, —7), (—11, 3), (—20, 6] 
20. ((9, —3), (—16, 11), (—4, —1), (—9, —3), (1, —10), 
(16, 9), (12, 7)] 


Given the n + 1 points p; = (xy. Yk), k = 0,.... n, and the corresponding vectors 
P; = xii + y;j, the associated nth-degree Bezier curve is given by 


k 


- y RS n! 
where ( ) = kin! 


EXAMPLE 40.9 


3 P2 o ; : 
Py 5 the cubic Bezier curve 
@2 
^ Po p 
——*—+ +++ x 
-1 0 1 2 3 4 5 6 7 


FIGURE 40.10 Example 40.9: The solid 
curve is the cubic Bezier curve, while the 
dotted lines are tangent at the endpoints 


(40.14) 


R(u) = >. (ja uy "uP, 


k=0 


is the binomial coefficient “n choose k” and 0 < u < 1. 


The cubic Bezier curve associated with n + 1 = 4 points has the general form 
R(u) = 10 — u)>u°Po +31 — uy ulP, +301 — u)! u’ P» +1(1— u)ľu’ P3 
where ©) = (3) = 1, () = G) = 3. The four points (0, 0), (—1, 2), (7, 3), (5, 0) determine 


—3u + 274? — | 


Ru) = | 6u — 3u? — 3u? 


which is graphed as the solid curve in Figure 40.10. The two intermediate points pı and p» 
are called control points and influence the shape of the Bezier curve. (The accompanying 
Maple worksheet contains an animation showing how the Bezier curve responds as these 
two control points move horizontally along two parallel lines.) 
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m. * p» 


10 + 


ep 


Po P3 


0 123456789 


FIGURE 40.11 The Bezier curve 
determined by (1, 5), (4, 7), (5, 12), and 
(9, 4) 
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The dotted line segments connecting po with p; and p» with ps appear to be tangent 
to the Bezier curve at the endpoints of the curve. Indeed, a computation shows R'(0) — 
3(P; — Po) and R'(1) = 3(P3 — P5), so lines connecting the first and second points and 
the third and fourth points must necessarily be tangent to the Bezier curve. In effect, the 
curve appears to be a flexible rod with “handles” attached at the ends. As the “handles” are 
manipulated, the rod flexes and assumes the shape of the Bezier curve. e 


Constructing a Cubic Bezier Curve 
The four points (1, 5), (4, 7), (5, 12), (9, 4) determine the cubic Bezier curve 


1 + 9u — 6u? + 5u? 
5+ 6u + 9u? — | pu 
which, along with the four points, is graphed in Figure 40.11. To understand how the points 
pı and p» influence the shape of the Bezier curve, draw line segments connecting consecutive 
pairs of points py, pk+1, k = 0, 1, 2. Then, using vector notation and for k = 0, 1, 2, let 
Q,..1 (u) describe the segment connecting p; with p;+). In addition, for each fixed value of 
u in the interval [0, 1], Q,(u), k = 1, 2, 3, is a single point on the respective line segment. 
We can therefore connect the points Q; (u) and Q»(u) with the line segment Q4(u) and 
the points Q>(u) and Qs(u) with the line segment Qs(u). Finally, for each fixed value u in 
the interval [0, 1], Q4 (u) and Qs(u) are points that can be connected with the line segment 
Qs(u). 

As u varies from 0 to 1, the corresponding point on the line segment Q¢(u) traces 
the Bezier cubic, show in cyan, in Figure 40.12. The line segments Q4 (u) and Qs(u) are 
dashed, and the line segment Q¢(u) is dotted. Analytic representations of the line segments 
Q; (u) = Py_; + u(Py — Py_1), k = 1, 2, 3, are 


1+3u 4+u _ | 54+4u 
Qi = E + d Q = | + A Q = E - | 
where, in each case, 0 < u < 1. Analytic representations of the line segments Q;(u) = 
Qr-3 + u(Qi o — Qu) k = 4, 5, are 


Q= 1+ 6u — 2u? Q; = 4 + 2u + 3u? 
4 15 + 4u + 3u? ? 17+ 10u — 13u? 


R(u) =| 


AT P3 


FIGURE 40.12 The cubic Bezier curve (in 
color) is the locus of point Q6 


o> 4 6 8 m 
FIGURE 40.13 The natural cubic spline 

Y (x) interpolating (0, 0), (4, 7), (7, 2), and 
(10, 5) 


P7 
e Po 
H 1 
p t 
t P6 E 
I 4 9] x 
: 2 
6 * p. 10 :12 
* ps 


FIGURE 40.14 Cubic Bezier spline 
fitting the points interpolated in Figure 
40.13 
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Finally, the analytic representation of the line segment Qe(u) = Q4 + u(Qs — Q4) is 


es 1 4-9u — 6u? + 5u? 
$7 15+ 6u 4-9? — 16u3 


For each fixed value of u in the interval [0, 1] there is a single point on the line segment 
Q¢(u). That point is a point on the Bezier cubic, as we can see by comparing Q¢(u) to the 
vector R (in (40.15)), which gave the Bezier curve by its definition. 

Consequently, we can now imagine how the Bezier curve might have been discovered. 
Idly drawing four points on a scrap of paper, a doodler could have connected with solid lines, 
the consecutive pairs of points, then connected with dashed lines, the midpoints of the solid 
line segments, and connected with dotted lines, the midpoints of the dashed lines. If, say, 
the quarter points were similarly connected, and the one-third points likewise connected, 
etc., it is not hard to believe that the inspired doodler would have seen that the Bezier 
curve is the envelop of all the dotted lines. This speculation is animated and verified in the 
accompanying Maple worksheet. 


The Cubic Bezier Spline 


From Section 40.4, the natural cubic spline interpolating the n + 1 = 4 points (0, 0), (4, 7), 
(7, 2), (10, 5) is 


1897. 49 3 . 
Bek — vici O0<x<4 
m 25.600 , 31291. 1600.2 , 1159.3 . 
Y= i431 + 198 * — 475 * T sp4* ASESI 
245.495 — 53,479 , 2855,2 _ 571 ,3 > 
2862 1908 * + 954% 5724 ?3* 10 


with the graph shown in Figure 40.13. Both from this graph and the theory developed in 
Section 40.4, we know this spline has a continuous second derivative. However, if we wish 
to change the shape near one of the four interpolated points, we would have to recompute 
the complete spline. A small local change in the shape of the curve requires the recalculation 
of all the coefficients of all the component polynomials making up the spline. 
Alternatively, we can interpolate the given points with three Bezier cubics by introduc- 
ing control points such as p, = (2, 2), p» = (1, 6) between po and ps; introducing control 
points such as p4 = (5, 1), ps = (8, —1) between p3 and ps; and introducing control points 
such as p; = (8, 5), pg = (12, —3) between pe and po. Then, three separate cubic Bezier 
curves can be constructed between po and ps; p3 and pg; and pe and po. In fact, these three 
Bezier curves are given by 
R = P n mel R = Mie Ju] i | 7 -- 3u + 9i? sand | 
6u + 6u? — 5u? 7 — 18u + 12u? +u? s 2 + 9u — 33u? + 27u? 


Each Bezier segment is independent from the others. This is clear even from an attempt 
to graph them. The parameter u ranges between 0 and 1 for each of the curves. The location of 
the graphs of these three segments is “built-into” the representation of each segment. Figure 
40.14 shows these three Bezier curves, along with the control points, and the "handles" at 
the ends of the Bezier segments. The middle segment is dotted. 

We have lost continuity of the derivative. The three Bezier curves form a continuous 
spline, but not necessarily a differentiable one. We have lost some degree of smoothness 
but have gained “local control." Thus, if control point p» is changed, only the first segment 
would be affected. The remaining portion of the interpolating spline would not have to be 
recalculated. We can see this analytically if we change p» to (1, ¢) in an attempt to vary 
p» through a range of values. The influence of pz is felt only by Rj, which, in terms of t, 
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becomes 


R (u, t) = | 


6u — 9u? + 7u? 
6u — 12u? + 13u? + 3u7t — 3i?1t 


Clearly, the Bezier spline allows local control of the shape of the interpolating function. 
Differentiability can be regained by choosing control points for which the slopes of con- 
tiguous “handles” are equal. (The accompanying Maple worksheet contains an animation 
showing the Bezier spline as t varies. It shows, as it should, that only R; changes, and not 


R» or R5.) 


EXERCISES 40.5 


1. Use (40.14) to obtain the quadratic Bezier curve determined by the 
points po = (1, 3), p, = (5, 4), p; = (7, —2). Sketch the curve. 
Show that the line segments connecting po with p; and p» with p; 
are tangent to the Bezier curve at its endpoints. 

2. Use (40.14) to obtain the cubic Bezier curve determined by the 
points po = (1,3), p, = (5, 4), p; = (7, —2), p3 = (8, 8). Sketch 
the curve. Show that the line segments connecting po with p; and 
p» with p3 are tangent to the Bezier curve at its endpoints. 


For the points p, and the associated vectors P; k = 0,...,3, in each of 
Exercises 3-7: 

(a) Use (40.14) with n = 3 to obtain R(u) = [x(u), y (u)]T, 

0 <u < 1, the cubic Bezier curve determined by the points. 

(b) Show that the tangent vector R'(0) is proportional to the vector 
from Po to Pi P 

(c) Show that the tangent vector R'(1) is proportional to the vector 
from P; to P}. 

(d) Carry out the construction corresponding to Figure 40.12 by 
obtaining the line segments Q; (u) = P; , + u(P, — Pj 4), 
k= 1,2, 33 Q; (u) = Q5 zi u(Qi » == Qi 3). k — 4,5, and 
Q«(u) = Q4 + u(Qs — Q4). Show that Q6(u) = R(u). 

(e) Graph the Bezier curve. 


3. (—16, 2), (8, —9), (11, —2), (18, —20) 
4. (—5, —3), (—16, —14), (—2, —16), (20, 20) 
5. (—6, 20), (—8, —20), (10, —5), (1, —5) 

6. (8, 3), (—5, —6), (—19, —4), (2, 15) 


7. (17, 1), (16, 5), (—10, 17), (—2, 16) 
For the points p, and the associated vectors P; k = 0,...,2, in each of 
Exercises 8-12: 


(a) Use 40.14 with n = 2 to obtain R(u) = [x(u), y(u)]", 
0 < u < 1, the quadratic Bezier curve determined by the points. 


(b) Show that the tangent vector R'(0) is proportional to the vector 
from Po to P}. 


(c) Show that the tangent vector R'(1) is proportional to the vector 
from P; to P}. 

(d) Carry out the construction corresponding to Figure 40.12 by 
obtaining the line segments Q, (u) = Pj. + u(Pj — Pj 1), 
k = 1,2, and Q3(u) = Qi + u(Q» — Qi). Show that 
Qi(u) = R(u). 


(e) Graph the Bezier curve. 


8. (-2, 218), (1, 214), (6,12) 9. (—18, —4), (—9, —6), (—19, 17) 
10. (—8, —6), (12, 10), (9, —15) : 
11. (9, 10), (—11, —7), (-12, —20) 
12. (—2, —17), (6, 9), (11, —3) 
For the points p; and the associated vectors Py k = 0, ..., 4, in each of 


Exercises 13-17: 


13. 
14. 
15. 
16. 
17. 


(a) Use (40.14) with n = 4 to obtain R(u) = [x(u), y(u)]!, 
0 < u < 1, the quartic Bezier curve determined by the points. 


(b) Show that the tangent vector R'(0) is proportional to the vector 
from P, to P}. 


(c) Show that the tangent vector R'(1) is proportional to the vector 
from P, to P3. 


(d) Carry out the construction corresponding to Figure 40.12 by 
obtaining the line segments Q; (u) = P,_; + u(P, — P4), 
Km ese 4; Qu) = Qi + u(Qk-3 — Qu), 

k = 5,6, 7; Q (u) = Qr-3 + u(Qk-2 — Qu 3), k = 8,9; and 
Qio(u) = Qs + u(Qo — Qs). Show that Qio(w) = R(u). 


(e) Graph the Bezier curve. 

(—18, 20), (—8, —15), (—7, 9), (8, 12), (20, —7) 
(19, 8), (15, 14), (7, —19), (—15, 12), (—4, 16) 
(5, 0), (—20, 20), (4, —6), (—2, —18), (—15, —2) 
(1, —15), (—16, —5), (8, 2), (—20, 1), (2, 8) 
(—8, —8), (3, 4), (8, —9), (9, —4), (14, —13) 


18. To determine if the control points pı = (a, b) and p; = (c, d) can 
be extracted from data, perform the following experiment. 


(a) Obtain R(u), the cubic Bezier curve through po — (0, 0) and 
p3 = (5,0), controlled by p; and p2. 

(b) Impose the conditions R(+) = [2, 3]" and R(2) = [3, 7]", and 
use the equations these conditions imply to calculate a, b, c, d, 
thereby determining p; and p» and the Bezier curve Rj (u). 

(c) Now, impose conditions R(+) = [2, 3]* and R(2) = [3, 7]", 
and again use the equations these conditions imply to calculate 


Chapter Review 


1. Naive interpolation consists of passing a polynomial of degree n 
through n + 1 points by forming and solving a system of n + 1 
equations in n + 1 unknowns. Demonstrate the process by 
interpolating a quadratic polynomial through the three points 
(—1, 5), (1, 2), (3, 7). Why, in general, is this a numerically 
perilous technique? 


2. Obtain the Lagrange polynomials for the three nodes in Question 1. 


Use them to construct the quadratic interpolating polynomial for 
the data. 


3. Describe the “polynomial wiggle problem.” 


4. Form a divided difference table for the data in Question |. Use the 
table to construct the quadratic polynomial that interpolates the 
data. 

5. Illustrate how to approximate the function f(x) = HP. 

—2 € x € 3, with an interpolating quadratic based on three 


equispaced nodes. 


6. Illustrate how to approximate the function in Question 5 with a 
quadratic Chebyshev interpolating polynomial. What is the 
advantage of Chebyshev interpolation? 

7. Why isn't the data of Question 1 subjected to Chebyshev 
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a, b, c, d, thereby determining f, and p» as the control points 
and the Bezier curve R, (u). 

(d) Finally, impose the more proportional conditions 
R(2) = [2, 3]" and RÈ) = [3, 7]", and again use the 
equations these conditions imply to calculate a, b, c, d, thereby 
determining p, and p» as the control points and the Bezier 
curve R3(u). 

(e) Graph R,(u), k = 1, 2, 3, on the same set of axes. 


(f) What does this experiment say about determining control 
points that make a Bezier curve assume a desired shape? 


interpolation? (Does Chebyshev interpolation make sense for a set 
of data points?) 


8. What is a linear spline? 


9. Construct a linear spline that interpolates the points (0, 1), (2, —1), 


10. 


11. 


12. 


13. 


14. 


(3, 2), (4, 0). 

What is a quadratic spline? How smooth is it? (How many 
derivatives will it have?) To what extent is a quadratic spline 
determined by the points through which it must pass? 


Obtain the natural quadratic spline interpolating the data in 
Question 9. How many distinct quadratic polynomials will it take to 
interpolate these four data points? 


What is a cubic spline? How smooth is it? (How many derivatives 
will it have?) To what extent is a cubic spline determined by the 
points through which it must pass? 


Obtain the natural cubic spline interpolating the data in Question 9. 
How many distinct cubic polynomials will it take to interpolate 
these four data points? 


Construct the cubic Bezier curve determined by the points in 
Question 9. Show that the tangent line at the first point passes 
through the second point, and show that the tangent line at the 
fourth point passes through the third point. 
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Chapter 4] 


Approximation of Continuous 
Functions 


INTRODUCTION The interpolation problem of Chapter 40 is not unrelated 
to the problem of approximating continuous functions, the subject of Chapter 41. In the 
context of solving differential equations, the question of providing a solution often amounts 
to finding a useful representation of the solution. Sometimes an exact analytic formula can 
be given. Often, a numeric solution must be computed, and this can be given as a graph, as a 
table of discrete values, as a procedure that will yield the solution value at any given point, 
as a spline, as an interpolating polynomial, or as an approximating function or polynomial. 

Chapter 41 discusses techniques for approximating a function. For purposes of de- 
velopment and exposition, the function being approximated is known. The approximating 
functions are generally polynomials but can be rational functions, the ratios of polynomials. 
The utility of an approximation is established only if there is a measure of how well the 
approximation succeeds. 

Hence, the notion of norms again appears. The different ways to quantize how well 
an approximating function represents a given function are called norms, and the goal is to 
find approximations that have the smallest value for the norm of the difference between 
the function and its approximation. When the norm is the integral of the square of the 
difference between the function and its approximation and when the norm is minimized, 
the approximation is called the least-squares approximation. This is precisely the idea 
behind least-squares fits of linear models to data, but only here, the fit is between a function 
and its approximation. 

We then discuss the Padé approximation, a rational function approximation to a given 
continuous function. The error made by the Padé is generally smaller than that made by a 
Taylor polynomial using the same number of coefficients, but like the Taylor approximation, 
the error is not uniform. In both cases, the error tends to increase at the ends of the interval 
over which the approximation is made. 

The Chebyshev approximation is a partial sum of a Fourier- Chebyshev series, where 
the Chebyshev polynomials, orthogonal with weight function w — A on [—1, 1], are 
the analog of sines and cosines in the trigonometric Fourier series. The error made by this 
approximation is more uniform than for either the Taylor or the Padé approximations and 
generally smaller. 

The Chebyshev—Padé approximation is an approximation by a rational function in 
which powers of the variable have been replaced by Chebyshev polynomials of correspond- 
ing degree. The error made by this approximation is uniform and significantly smaller than 
that of any of the preceding approximations. Surprisingly, this is still not the best uniform 
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approximation. That is given by the minimax rational approximation, computed by an itera- 
tive process that starts from a Chebyshev—Padé approximation. The minimax approximation 
minimizes the maximum deviation between the function and its approximation. 


Least-Squares Approximation 


Why Approximate? 


Obtaining a floating-point value for 4/2, sin(1), e! 7, In 5.38, or Jo(2.94) seems to be a 
routine task in the presence of a modern scientific calculator or computer algebra system. But 
how are these computations done efficiently and accurately? How are functions evaluated 
on a computing device that knows only the four operations of arithmetic? And how can these 
evaluations be made with a minimum of the "expensive" (time-consuming) operations of 
multiplication and division? 

In this chapter we will investigate some standard tools for approximating continuous 
functions. 


Norms—the Yardsticks of Approximation 


The number 178,563 is an approximation of z. It's not a very good approximation, but it's an 
approximation. If we had no measure of the “size” of each number, or of the “closeness” of 
the approximation, we would not have been able to say “it’s not a very good approximation.” 
So, there is no utility in making approximations if there is no corresponding measure of the 
validity of the approximation. 

The “size” of a real or complex number x is simply |x|, its absolute value, which is an 
example of a norm. In particular, a norm is a function that yields a nonnegative real number 
[x ||, is zero only when applied to the zero object, satisfies ||æx || = |o |]|x || for every scalar 
a, and satisfies ||x + y|| < ||xl| + ||yl|, the triangle inequality. In effect, a norm is a function 
that has the essential properties of the absolute-value function on real or complex numbers. 

The reader is reminded that Table 31.1 in Section 31.1 lists a variety of vector norms 
and that Section 33.5 describes related matrix norms. The notion of a norm is grounded in 
comparisons between real numbers and is extended to objects, like vectors and matrices, 
and, shortly, to functions. 

A metric measures the length of the “gap” between two objects. For real or complex 
numbers we simply look at |x — y|, the absolute value (or norm) of the difference between 
the two numbers. Thus, a metric is induced by a norm. If there is a way of assigning a 
"size" to objects, then it is possible to assign a "size" to the difference between two objects 
by defining the induced metric ||x — y||. For much of Chapter 39 we used the norm of the 
difference between vectors as a metric to monitor the convergence of iterative schemes for 
solving a linear system. 

In this section we will consider two different ways of assigning a "size" to a function 
f (x). Each way is a norm, and for each norm defined we have an associated metric or 
measure of the “distance” between two functions. The two norms we will consider in this 
section are the square-norm (Euclidean or 2-norm) and the infinity-norm (or the absolute- 
value norm). 


THE SquarE-Norm The square-norm, already used in Section 10.6, measures the “size” 
of a function as the square root of the integral of its absolute value, squared. Thus, we have 
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EXAMPLE 41.1 


fey = Me*- xll; 


FIGURE 41.1 Example 41.1: The 
difference e* — x (solid) and the line 
y = |le* — x ||2 (dotted) 


EXAMPLE 41.2 


y 

A 
ui 
6+ f(x) =e* 
s+ 
4+ 
3+ 
3-L 

g(x) =x 
Ar 
x 

oe 1 2 

FIGURE 41.2 Example 41.1: Graphs of 


f(x) = e* and g(x) = x showing how the 
distance between these functions increases 
from 1 as x varies from 0 to 2 
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the definition || f (x)]l = JD | f (x)|? dx. Consequently, the induced metric, the measure 


of the “distance” between the two functions f(x) and g(x), is the norm of the difference or 


b 
If) — gwl = If lf) — g(x)? dx 


Of course, we have assumed that both functions share the common domain [a, b], and 
that domain is the interval over which the measurement of separation is to be made. 


On the interval [0,2], the square-norm measure of the distance between the functions 
f(x) = e* and g(x) = x is 


m 


| (e* xy dx = 
0 


Figure 41.1, a graph of the difference f (x) — g(x) (solid) and the line y = || f (x) — g(x)||2 
(dotted), shows that f(x) and g(x) are separated by the distance || f (x) — g(x)||2 only once 
in the interval [0, 2]. The value of the square-norm is an average of the separation between 
the functions. 

Figure 41.2, containing graphs of f(x) and g(x), shows the distance between the 
functions is 1 at x = 0 and increases as x increases. The square-norm, like any norm for 
functions, uses a single number to express a property distributed over an interval. e 


e* — 2e? + 1 = 3.561960889 


l 
2 


Inriniry-Norm The infinity-norm measures the “size” of the function f (x) by the max- 
imum of its absolute value, that is, by 


I. f œ) llo = max {|f 601) 
x€[a,b] 


Consequently, the “distance” between the functions f(x) and g(x) is the maximum of 
the absolute value of the difference between the functions. In particular, the infinity-norm 
measures the closeness of functions by 


If) — g@)llo = Anas U o) — g(x)|} 


The infinity-norm measures the distance between the functions x and e* as the maximum 
of |e* — x|. One way to determine this maximum value is from the graph of |e* — x| in 
Figure 41.3, which shows that the maximum occurs at the endpoint x = 2, and so must be 


lx — e" las = le? — 2| = 5.389056099 
Measured this way, the distance between f(x) and g(x) seems larger than the distance 
measured by the square-norm. e 
Approximation by Taylor Polynomial 


Throughout the earlier chapters of this text we used Taylor polynomials to approximate 
functions. For example, a third-degree Taylor polynomial constructed at x — 1, and which 
approximates the function f(x) = e* on the interval [0, 2], is 


p3 =e+te(x—1)+ ie(x =s fA sex = 1p 


Figure 41.4, a graph of f(x) — p3, the error made by approximating f(x) with ps, reveals 
that the error is zero at x = 1, Lthe point at which the Taylor polynomial was constructed. 
but tends to be greater at the endpoints. As useful as Taylor polynomials are, the need for 


FIGURE 41.3 Graph of |e* — x| in 
Example 41.2 


0 


FIGURE 41.4 Graph of e* — ps, showin 
the error made when approximating e* by 
its third-degree Taylor polynomial 


P3. 
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more uniform approximations motivates the other approximation techniques of the next 
three sections. 

The infinity-norm ||e* — p3|ləo = 0.1403045564 is just the maximum of |e* — p], 
the absolute value of the error. Figure 41.4 indicates the maximum error is located at the 
endpoint x — 2. 


Best Square-Norm Approximations 


If f (x) is approximated by a function of the form g(x) = Y azp (x), then the square-norm 
applied to the difference f(x) — g(x) will generate integrals containing terms like $;$;. If 
the functions $, are orthogonal, then these integrals will vanish, making the computation 
of the square-norm simpler. Hence, we distinguish between the cases of approximation by 
orthogonal and nonorthogonal functions. 


NONORTHOGONAL Casr On the interval [0, 2], the best square-norm approximation to 
f(x) = e* by a quadratic polynomial from the family g(x) = a + bx + cx? is the one that 
minimizes the square-norm or, equivalently, its square. Thus, choose the parameters a, b, c 
so as to minimize 


F(a,b,c) 2 IC —a-— bx — cx?) dx 
= let + ip? — 2e?a + 8bc — 2e?b + 2e — 4e?c 
--2a? + 4ab + Bac — 1 + 2a — 2b + 4c 


via the ordinary techniques of the calculus. Thus, differentiating, setting the partial deriva- 
tives to zero, and dividing each equation by 2, we get the three normal equations 


2a +2b + ic—- 84120 

2a + $b+4c—e?-1=0 

$a +4b+ 2c—2e7+2=0 
111 15 2 105 , 152 


whose solution is a = 3e? — 21, b = Br ue e = 4€. The optimal approxi- 
mating quadratic is then 


giving, as the minimum value of the square-norm, 


le* — Yl» = 1144e? — 518 — 10e? = 0.1031721862 


This example illustrates the nonorthogonal case. If the normal equations are written as 
the linear system Ax — y, with the matrix A given by 


8 
22 8 
8 
A=|2 8 4 
8 32 
3 4 F 


we see that A is not a diagonal matrix. This happens because the basis functions 1, x, x”, 

from which g(x) = a + bx + cx? was constructed, are not orthogonal on [0, 2] under the 
2 ~ 

inner product (u, v) = du u(x)v(x) dx. Indeed, we find 


> 


2 2 
(1,23) fi xdx=2 (l, x?) = f x’ dx = E (x,x?) = [^ x dx =4 
0 0 
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EXERCISES 41.1 


Approximation of Continuous Functions 


Were these functions mutually orthogonal, each of these three integrals would have evaluated 
to zero. 

Although the matrix A has the modest determinant n = 0.237, it has the large 
condition number 578.2, suggesting that the normal equations are typically ill-conditioned 
and become more so as the dimension of the system increases. 


ORTHOGONAL Case To approximate, in the square-norm sense, f(x) = e*,0 < x x 2, 


with a member of the family 
. UX , . 37x 
g(x) =asin = + bsinzx + csin ES 
minimize the square-norm or, equivalently, its square. Thus, choose the parameters a, b, c 
so as to minimize 


2 
B .OUX i _ 3x \~ 
F(a,b,c) = € — asin — — bsinzx — csin 5 dx 
0 


The normal equations, 1 + =1} T =1} LZ = 0, whose coefficient matrix is the diagonal 
= Hu » 2 2 2 : 
matrix A = 1, have the solution a = 23035 ) b= E c= 62, so the optimal 


approximating function is then 


z(l--e).nxx (e-lDmx. a(l +e) . 3x 
Y 3 sin sinz x +6 - sin 
44 z? 2 147? 4 + 9x? 2 


and the minimum value of the square-norm |je* — Y || is 2.458498213. 
The coefficient matrix for the normal equations is a diagonal matrix because the basis 


functions g = sin mw k = 1, 2,3, are orthogonal on [0, 2]. Thus, we find 


nx MITX 


($n, Om) = [ sin sin dx=0 nzm (41.1) 
0 


2 2 


The matrix A has the modest determinant 1 and the equally modest condition number 
1. Thus, the basis functions are orthogonal; the normal equations uncouple since only a 
single unknown appears in each; and, in this example, the system matrix A is no longer 
ill-conditioned. 


1. Verify (41.1). 


For the functions f(x) in each of Exercises 2-11: 


f (x) = 4x3 — 7x? +5x+2,-2< «<2 
»f)y=xe*,0<x<5 6 f(x) =VI1—-x7,-l<x<l 


7. f(x) =e, 2x x <2 


n e 


(a) Obtain || f (x)||;. the square-norm. 


(b) On the given domain of the function, graph f (x) and the 
horizontal line y = || f(x)|l2. 


(c) Find all values of x, if any, for which | f (x)| = || f(x) lla. 
(d) Obtain || f (x) ||s;. the infinity-norm. 


(e) On the given domain, graph f (x) and the horizontal lines 


y = IFO lo- 
(f) On the given domain, find all values of x for which 
Fœ = |] fF) loo. 
2. fx) i ,-3€xx3 3. f(x) =e" cosx,0 <x < 27 


1+ x? 


8 ,U x «2 
f(x) rmi <x< 
100x 
9. fülie——— — daa db 
j Tx? + 5x +13 


10. f(x) 2e?Inx,1xx <5 11. f(x) 2x(1—x),0zxxxl 
For each pair of functions f (x) and g(x) given in Exercises 12-21: 


(a) Obtain || f(x) — g(x)|l2 and || f(x) — g(x)llos. 


(b) On the same set of axes, graph f (x), g(x), f(x) — g(x), and 
the horizontal line y = || f(x) — g(x)llz. 


(c) Find all values of x, if any, for which | f(x) — g(x)| = 
Il f (x) — g@)lle- 
(d) On the same set of axes, graph f(x) — g(x) and the horizontal 
lines y = || f(x) — g(%)Iloo- 
(e) Find all values of x for which | f(x) — g(x)| = 
Ilf (x) — 8) loo. 
12. f(x) = sin x, g(x) = cosx, 0 € x < 2z 
13. f(x) slnx,g(x)-—e*^,lzxez3 
14. f(x) = cosh x, g(x) = sinhx,0 € x <2 
15. f(x) =x?, g(x) 2x? 6,» 06;-1xxx1 
16. f(x) = 


i 7? (x) = 
x x, 
1+x E 


2« y2 


8 d s 
17. f(x) = cosx, 2(X) = z, Gin 2x + $ sin 4x), 0 <x <x 
3r S 


18. f(x) = arctan x, g(x) = ix + x 2 ix? + x3, O<% <2 


8 
19. f(x) = x(t — x), g(x) = — (sinx + + sin3x),0x x € zx 
E 2 


20. fx) = V1 =x, g(x) 21— Ix? - ixt — Ex, -1 €x <1 
21. f(x) 2 xInx, g(x) — -i — ix paf = ax, 
The functions f (x) in Exercises 22-31 all have domain [—1, 1]. For each: 
(a) Obtain the function y; — emt a,x* that minimizes 
If G) — yilli. 


(b) Obtain the function y2 = ao + a, cos zt x + a» sin x that 
minimizes || f (x) — y2ll2. 


(c) If P(x), k =0,..., 2, are the first three Legendre polynomials 
(see Section 10.7), obtain the function ys = 37; 4 Ax P (x) that 
minimizes || f (x) — ysll2. 


(d) If T, (x), k =0,..., 2, are the first three Chebyshev 
polynomials (see Section 40.3), obtain the function 
ya = Y o €i Tk (x) that minimizes || f (x) — yall3. 

(e) For which yg, k =1,...,4, is || f(x) — xxl; smallest? 


(f) On the same set of axes, graph f(x) and yg, k =1,..., 4. 
22. f(x) — cos Zy 23. f(x) = sin Sx 24. f(x) 2 x(1— x) 
25. f(x) =e 
28. f(x) 2 x?^(1 — x) 


30. f(x) = e? coszx 


26. f(x) = xe 27. f) =e 

29. f(x) 2x(1 — xy 

31. f(x) = e'sinzx 

For each function f (x) and interval a < x < b in Exercises 32—36: 


(a) Obtain || f (x) loc. 


(b) For k = 2,3,..., obtain || f GO], = (Lf GO dx) ^^, the 
k-norms of f (x). 
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(c) Obtain limz>o || f(x) ||,, and compare to || f (x) ||... 


32. f(x) =x, 0<x<1 33. f(x) 229,0 x «10 
34 f)e$0csz10 35 7/(00232,0x» £10 
36. f@)={) 9212? 


0 9<x<@w 


The functions f (x) in Exercises 37—46 all have domain [— 1, 1]. For each: 
(a) At x = 0, obtain p3(x), the third-degree Taylor (or Maclaurin) 
polynomial. 
(b) Compare a = |f (x) — p3(x)|l2 with B = || f(x) — pœ) llo: 
(c) On the same set of axes, graph | f(x) — p3(x)| and the 
horizontal lines y = o, y = £. 


37. f(x) 2 J1— x? 


38. f(x) = x arctan x 


4 


39. fa) = TAT 40. f(x) = e' cosh x 
41. f(x) = eh 42, f(x) = 2 
cosh x 


43. f(x) = cos(x) cosh(x) 44. f(x) = cos(x cosh x) 
45. f(x) 2 Incoshx 46. f(x) = 41 + 2cos? x 
When the weight w(x) is a well-behaved positive function, an in- 


ner product between the real functions f(x) and g(x) is defined by 
(Ug) = [^ w(x) f(x) g(x) dx. Then the norm || f (x)||,, is defined by 


Us FY =a) i: w(x) f? (x) dx, and the metric || f — g||,, is defined by 


JKf-gf-8)- JT w(x)(f (x) — g(x))? dx. If w(x) = e^* and 
[a, b] = [0, 1], obtain || f) llw ll GO los If Œ) — g(%)||w, and a graph 
of f(x) — g(x) for the functions f (x) and g(x) in Exercises 47—56. 


47. f(x) = cosmx, g(x) = sin mx 
48. f(x) = 3x? — 5x +7, g(x) = arctan x 
49. f(x) =— 


- .g(x) = tanx 
1+ 2x? gtx) 


50. f(x) = cosh x, g(x) = sinh x 

51. f(x) =x(1 — x), g(x) = In(1- x) 
x -—x-43 

go 4 Ox 45" g(x) = tanh x 
53. f(x) = sech x, g(x) = sec x 


4x 
54. f(x) = y 1 + 3x?, g(x) = cosh = 


55. f(x) = Jı (Tx), g(x) = sin 27x 
p 

56. f(x) — erf 3x, g(x) — — arctan 10x 
x 


52. fœ) = 


-15x1074- 


Y 
Error 


FIGURE 41.5 The error e* — R(x) when 
e* is approximated by the rational function 
R(x) 
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Rational-Function Approximations 


A rational function is the ratio of two polynomials. As we saw in Section 41.1, approximating 
a function such as f (x) = e” with a Taylor polynomial yields an error that tends to increase 
at the endpoints of the approximating interval. In an attempt to approximate f(x) with 2 
more uniform error, we will therefore consider approximating with rational functions such as 


ao + ax + ax? + a3x? 

1 + bix + box? + bax? + bax* + bsx? 

Without loss of generality, we illustrate the approximation based at x = 0. Were this not 
the case, the simple change of variables z = x — xo (accomplished by setting x = z + 4 
would restore the base z = 0 in place of the base x = xo. Moreover, for r (0) to be defined 
the denominator must not vanish at x = 0. Hence, bọ 4 0, and we can divide by bp and 
take the lead coefficient in the denominator to be 1. 

If n = 3 is the degree of the numerator and m = 5 is the degree of the denominator 
the total number of parameters to determine is N = n +m + 1 = 9. The nine parameters 
y. ossa a3, bi, ..., bs are determined by the nine equations 


f? (0) = r ? 0) k = 0, Seay 8 


r(x)- 


where f'?,Kk > 1, denotes the kth derivative and f is the function itself. The first four 
equations are 


l = ao 1 = a, — dob, = 2a» — 2a4b, + 2aob? — 2aob» 
] = 6a3 — 6a»b, + 6a, b? — 6a, b» — 6aobi + 12aobib» — 6aob3 


but the full set of nine fill more than a page. Surprisingly, these highly nonlinear equations 
have the simple and exact solution 


ERE EUN: 
1+ gx + agx + ogg 


R(x) = 
EE CNN. 3 y | xå age. 
] — gx + gx Toa + 336% 6720% 


The error made with this approximating rational function is then e* — R(x); and oa 
the symmetric interval [—1, 1], the infinity-norm of this error is 0.1721 x 1076, with the 
maximum error located at the endpoint, x = 1. Figure 41.5, a graph of the error, shows that 
again, the error increases at the endpoints of the approximating interval. 

The approximating rational function r (x) contained nine parameters. A Taylor polyno- 
mial approximating f(x) = e* and containing nine coefficients would be the eighth-degree 
polynomial pg = m x*/k!. The infinity-norm of the error made when approximating 
f(x) with this Taylor polynomial is 0.3058617775 x 1075, with this larger error agais 
being located at an endpoint, x — 1. 

Thus, the rational-function approximation seems to yield a smaller error with the same 
number of coefficients. Moreover, the rational function can be evaluated with fewer arith- 
metic operations, even if the Taylor polynomial is written in the nested (Horner) form 


l 1 l 1 1 | QE oh URS ER 
1+ (1+ (5 + (6 + (3 + Goo + Cro + (x0 + mmx) x) X) x) x) x) x) 
Starting inside the innermost parentheses, we count eight multiplications and eight additions 


Alternatively, the rational function R(x) can be more efficiently evaluated if it is written ia 
continued-fraction form. 
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Continued-Fraction Form of a Rational Function 


By repeated long-division, a rational function such as that on the left in (41.2) can be 
expressed in the continued-fraction form achieved on the right. 
x42 ] 1 I 1 
ipae] fema rho » 1 ET — (41.2) 
xe-t+xt+ (: x4 ) x + — x+[ + 5] X Taa 


L2 
x42 x+2 


Continued-Fraction Form of R(x) 


If the rational function R(x) is expressed in the continued-fraction form 
20 


R= 10392 
x? — 38x + 758 


21.92538896 
11.06363643 
x + 3.344416863 

it can be evaluated with four divisions and seven additions (or subtractions). Assuming 
a division is as expensive as a multiplication, the continued-fraction form of the rational 
function is therefore more efficient than the nested form of the polynomial. 

Thus, the rational approximation makes a smaller error, and with less arithmetic, than 
an equivalent polynomial. 


x + 10.44226328 4 


x + 4.213319857 4 


Padé Approximation 


Texts such as [60] say that an approximating rational function with a numerator of degree 
n, denominator of degree m, and total number of parameters N = n +m + 1, having n = m 
when n + m is even and n = m + 1 when n + m is odd, is a Padé approximation. (The 
name Padé is pronounced with two syllables and sounds like pad-DAY.) 

By way of contrast, [5], whom we will follow, defines the n, m Padé approximation 
to f(x) by [n/m] = P,(x)/Qs (x), where P,(x) = p» ayx*, a polynomial of degree 
at most n, and Q,,(x) = - byx*, a polynomial of degree at most m, have no common 
factors, and typically the normalization bọ = 1 is applied. (Also, [5] warns that some authors 
use the notation [m/n] for P, (x)/ Q,, (x).) Interestingly enough, [5] points out that Jacobi 
(1846) made the original discovery of Padé approximations, Frobenius (1881) studied the 
case where n and m differ by 1, and Padé (1892), in his thesis, studied the structure of the 
Padé table of approximations, depicted in Table 41.1. 


[0/0] [0/1] [0/2] [0/3] [0/4] 
[1/0] [1/1] [1/2] [1/3] [1/4] 
[2/0] [2/1] [2/2] [2/3] [2/4] 
[3/0] [3/1] [3/2] [3/3] [3/4] 
[4/0] [4/1] [4/2] [4/3] [4/4] 


TABLE 41.1 Structure of the Padé table of approximations 
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Table 41.2 shows part of the Padé table for f(x) = e*. 


j 1 1 1 
1— 1—-x4i2 ]1-x-c ix? — ax? 
es 
i 1 4 ix I+ ix 1+ ix 
dx 2 —__ 
lx = 2y 41,2 HN UNNP MER M. 
1 — 5x l2 Fah oe ] — ix c ix 21 
2 2 2 
1.3 1+ 3x4 ix? 1+ ixt hx? 1+ 2x4 d 
Lp + 5% L 1. i— ig Lage jt i 22 1A 
-7 eT E 5* T 39 607 
3 2 
i» EEA lx? las 1 3x 4 2a? 4 be ER ETS T 
i By 1.8 4 4 24 5 20 60 2 10 120 
Lf Rb 5x" b ex | = | = oe 1.2 ] = ass sn T o 
— 4% ui kd — &*Fig* — pg* 


TABLE 41.2 Table of Padé approximations for f(x) = e 


The leftmost column contains the Taylor polynomials of increasing degree. Corre- 
sponding to Table 41.2, Table 41.3 shows the maximum deviations from f (x) on the inter- 
val [—0.9, 0.9]. The cubic Taylor polynomial containing four coefficients has a maximum 
error of 0.033, but the [2/1] Padé approximation, also with four coefficients, has the smaller 
maximum error of 0.019. 


1.459603111 7.540396889 0.4794050914 0.1479588184 
0.559603111 0.176760525 0.0296965691 0.0045658604 
0.154603111 0.018968317 0.0021132326 0.0002194936 
0.033103111 0.002171082 0.0001615241 0.0000120426 


TABLE 41.3 For the interval [—0.9, 0.9], the maximum deviation between 
f (x) = e* and its Padé approximations in Table 41.2 


Numeric Algorithm 


With a computer algebra system such as Maple, the Padé approximation can be obtained with 
the built-in pade function. Alternatively, the n, m Padé approximation can be constructed 
by solving the nonlinear equations 


f 9 (0) = r (0) k=0,...,.n+m 


for its coefficients. While there is an interesting structure to these equations, the following al- 

gorithm, based on coefficient matching, leads to a set of linear equations that can more easily 

be used for computing, perhaps numerically, the coefficients of [n/m] = P,(x)/Qm(x), the 
m 


n, m Padé approximation of f (x), where P,(x) = piel ayx* and Qm (x) = 1+% ay OKX"- 


1. Expand f(x) in a Taylor series of degree n + m so that f(x) = Bi ex. 


2. Require baee cyx* = P,(x)/ Q, (x) to be an identity in x. Therefore: 
(a) Bring all terms to the left and add fractions, resulting in 


Qu (x) d cg == P, (x) 0 


On (x) 


(b) Combine like-powers of x in the numerator, and equate to zero the coefficient of 
each such power. 


EXAMPLE 41.3 
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(c) In the resulting set of equations, the first n + m + 1 are then solved for aj, k = 
O,...,n,andb,k=1,..., m. 


As an example of this algorithm, let n = 3 and m = 5, so that we have 
P = ag + ax + ax? + ax? Q = L4 bix + bax? + bax? + bax? + bsx" 
F = co + eix + cox? + ex? + cax* + esx? + cgxS + 7x7 + cxt 
Then F Qm — Pa, the numerator of (F Qm — P,)/ Q,, = 0, becomes Da Ax% = 0, giv- 
ing the equations A; = 0, k =0,..., n +m = 8, which are 
—dg + co — 0 
—a, +c, 4 cob — 0 
—a + C2 + cibi + cob; — 0 
—a3 + €3 + cobi + cqb3 + cob3 = 0 
C4 + Cab + cob» + cq b3 + c9b4 = 0 
c5 + c4by + cab» + c2b3 + c1b4 + cobs = 0 
C6 + csb1 + c4b2 + €3b3 + c2b4 + ci bs =0 
C7 + c6b, + e5b2 + c4b3 + c3b4 + cobs =0 
Cg + c7b1 + c6b2 + c5b3 + c4b4 + c3bs =0 


Of these equations, the last m = 5 are independent of ag, k = 0,..., n = 3, so they 
can be solved for bj, k = 1,...,m = 5, and these values used in the first m + 1 = 4, 
thereby determining az, k =0,..., n = 3. In fact, the augmented matrix for the last m = 5 
equations is 

€3 & €y Co 0 —C4 

C4 C3 C2 Cy Cg —Cs 

C5 C4 C3 C2 Cj —C6 (41.3) 

C C5 C4 C3 C2 —C7 

C7 Cg. s Cy Caz —€g 


a matrix with sufficient structure to allow easy coding in a numeric programming language. 
(See Exercise B23.) Then, solving the first n + 1 = 4 equations for aj, k =0,...,n = 3, 
we have 


ao = Co a; = c4 + cobi a = cibi + c» + cob3 d3 = c3 + Cib + cob3 + cobi 


from which we can generalize the pattern ay = c, + NT d Da CE. $ 

EXERCISES 41.2-Part A 
Al. If evaluating x? = x x x requires one multiplication, determine the A3. Determine the total number of arithmetic operations needed to 

total number of arithmetic operations (multiplications and evaluate the rational function R(x) — pim. 

additions) required o sraute the polynomial A4. Write the denominator of R(x) (from Exercise A3) in nested form, 

p(x) = 1 +2x + 3x7 + 4x”. and again determine the number of arithmetic operations needed to 
A2. Write the polynomial p(x) (from Exercise A1) in nested (Horner) evaluate R(x). 

form, and count the number of arithmetic operations needed to AS. Verify that the continued-fraction form of R(x) (from Exercise A3) 


evaluate it in that form. 


is R(x) = oero saro: Count the number of arithmetic 


operations needed to evaluate R(x) in this form. 
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1+2x 


e 10 continued-fraction form. 


B1. Convert R(x) = 


The domain of the functions f(x) in Exercises B2-11 is [—1, 1]. For 
each: 

(a) Obtain [3/2], the 3, 2 Padé approximation, by writing 
r(x) = s P, = Y 5 9 ax", and Q; = 1 + edm b,x* and 
solving the equations f® (0) = r® (0), k =0,...,3+2=5, 
for the coefficients ag, ..., a, and b}, bo. 

(b) Let F — ps(x) be the fifth-degree Taylor polynomial 
constructed at x — 0, and obtain [3/2] by equating to zero the 
coefficients of x^, k = 0,..., 3 +2 = 5, in the numerator of 
FQ2—P3 

Qo ^7 

(c) Obtain || f(x) — [3/2]l|os, and determine where in [—1,.1] the 
maximum of | f (x) — [3/2]| occurs. 

(d) Count the number of operations needed for evaluation of 
[3/2]. 

(e) Write the numerator and denominator of [3/2] in Horner 
(nested) form, and count the number of operations needed for 
evaluation. 


(f) Put [3/2] in continued-fraction form, and count the number of 
arithmetic operations needed for evaluation. 


(g) Obtain || f (x) — ps(x)||.o, and determine where in [—1, 1] the 
maximum of | f (x) — ps(x)| occurs. 


(h) Write ps(x) in Horner (nested) form, and count the number of 
arithmetic operations needed for evaluation. 


(i) Graph f (x) and [3/2] on the same set of axes. 
B3. f(x) 2x(1—-x) B4. f(x) 2 x?(1— x) 


B6. fx) =xe™ B7. f(x) = 1 — x? 


B2. f(x) — cos 7” 


B5. f(x) 2 x(1 — x)? 


B8. f(x) 2 xarctanx B9. f(x) = ln cosh x 
B10. f(x) = <> 
oS 


h B11. f(x) = /1--2cosx 
sh x 


For each function f(x) in Exercises B12-17, let F(z) = f(z + xo). 
where xo = x is the midpoint of the interval [a, b] over which f (x) is 
defined. This centers z = 0 in the interval [—h, A], where h = x 


b—a 


c 


(a) Obtain, for F(z), the Padé table containing [n/m], 0 < n, 
m <3. 


(b) Obtain a table of the norms || F(z) — [n/m]||.. corresponding 
to the table in part (a). 

(c) Which Padé approximations in the table from part (a) have a 
smaller error than [3/0], the third-degree Taylor (or 
Maclaurin) polynomial for F(z)? 

B12. 
B13. 
B14. 
B15. 
B16. 
B17. 


f(x) in Exercise 3, Section 41.1 
f(x) in Exercise 5, Section 41.1 
f(x) in Exercise 10, Section 41.1 
f (x) in Exercise 13, Section 41.1 
f (x) in Exercise 18, Section 41.1 
f (x) in Exercise 21, Section 41.1 


The text [38] claims a crude estimate of the error in [n/m], the Padé 


approximation of f(z), is given by E. where pz“ is the first nonzero 


term past b,z" in the Maclaurin expansion of f(z) Qn(z) — P, (z). In the 


Maehly algorithm, r — ax F = P444, (z) is a Maclaurin expansion of 
f(z), and SETER = 0 leads to [n/m]. If Ê, a Maclaurin polynomial for 


f (x) of higher degree than F, is used in place of F, then [n/m] is obtained 
from equating to zero the first n +m + 1 coefficients in F Qm — Pn = 0, 
and z“ is the next nonvanishing term. In Exercises B18—22, test this 
claim for [4/4] with the given function g(x). Since each of these func- 
tions is defined on an interval [a, b], use the shift f(z) = g(z + xo), as 
in Exercises B12-17. Compute | = I. and | f(z) — [4/4] | .... then plot 
the magnitudes of the actual and estimated errors. 


B18. 
B20. 
B22. 
B23. 


oo 


g(x) =e*,1l<x <3 B19. g(x) =sinhx,0<x <2 
g(x) =Ind+x),1l<x <5 
g(x) =arctanx,0 <x <3 


Generalize the pattern in (41.3) to ck + 7", bci, = 0, 
k=n+1,..., n +m, where b, = 0 fork > m and c, = 0 for 


B21. g(x) = sinx,0Ox x x2 


m 


Chebyshev Approximation 


Chebyshev Polynomials 


In Section 40.3 we saw the Chebyshev polynomials 7; (x) that satisfy (40.8) and the three- 
term recurrence relation 7,4; (x) = 2x T, (x) — T, .1(x) and that are orthogonal, with weight 


1 


function w(x) — Ti 


-1 V1l—x?2 


on [—1, 1]. Hence, they satisfy (40.9), the orthogonality conditions 


m -*n 


L SOS m=m=(0 


dx = 
m=n>0O0 


0 
T 
T 
2 


âo = 5.429975096 

ay = 3.236988642 

â = 1.113990242 

a; = 0.266347996 

â, = 0.04859825643 

as = 0.007157295457 
âs = 0.0008829533638 
à; = 0.00009366852746 


TABLE 41.4 Fourier-Chebyshev 
coefficients for f(z) = e* in Example 41.4 


EXAMPLE 41.4 


Error 
A 


seit JORO 


—9 x 107 


jiya 41.6 Example 41.4: The error 
(z) — F(z) made when approximating e* 
wW bs a Fourier-Chebyshev polynomial 
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The Fourier- Chebyshev Series 


In Units Two, Three, Five, and Seven we have seen rr used the Fourier series repre- 
sentation of the function f (x) |, defined on the interval [—L, L]. Thus, we wrote f(x) — 
Donat On Sin F=, where b, = 7 f f (x) sin "75 dx. 

In Units Two and Five we generalized the Panties series to the Fourier-Legendre series 
for f(x) defined on the interval [—1, 1]. Thus, we wrote f(x) = 377 9 an P,(x), where 
P, (x) is the nth Legendre polynomial and a, = a JE f (x) P4 (X) dx. 

Finally, we saw in Units Three and Five the Fourier-Bessel series for f (x) defined on 
the interval [0, o]. Thus, we wrote f(x) = pus AnJo(Anx), where Jo(x) is the Bessel 
function of order zero, A,, is the nth zero of Jo(o x), and 


fo xf G0JoQx) dx _ 2 fo xf (x) Jo(Anx) dx 
I x 2x) dx o? J? (Ano) 


A, = 


It should be no surprise, then, that the function g(x), defined on the interval [—1, 1], 
can be 2 eased in the Fourier- Chebyshev series g(x) = E + ae | Ax Tn (x), where 
2 f [g(x)T(x)/V 1 — x?] dx. 
p the function f (z) defined for z in the interval [o, 8], the Fourier- Chebyshev series 
generalizes to 


B f(z mn ( (2522 2 2 1) (41.4) 
dz 


A 


ay = i 
E J- E 


Gx 


Of course, this generalization is based on the linear transformation z = œ + i-e, 


which maps —1 < x < 1 too < z < P. (Equivalently, x = 20m 1 maps a < z < p in 


—L x 1.) 

To obtain the i-is aga ow series for f(z) — c on the interval —1 < z < 2, 2 
x(z) = 2€ ‘= — 1 = åz — 3. The coefficients a; = Ep ET GG) dz/V1 2 Ass 
seo Te ‘computed m pits integration, are listed i in Table 41.4. 


The partial sum of the Fourier- Chebyshev series, âo 2 y | âk Ti Gc (z)). simplifies to 
F7 = 1 + 0.99998z + 0.499872" + 0.166772? + 4.1945 x 10*z* 
+ 8.0994 x 10225 + 1.2525 x 10 ?z5 + 3.5086 x 10-427 


Figure 41.6 shows that the error f(z) — F7(z) is both smaller and more uniform than the 
error in the comparable Taylor polynomial approximation. In fact, the maximum value of 
this error, the infinity-norm of f(z) — F;(z), is 0.9496533650 x 1075, with the maximum 
value occurring at z — 2. $ 


A Comparison 


The partial sum F;(z) contains the eight coefficients aps b = Orosa 7. A Taylor dure 
with as many coefficients is v/e Y; 9 (z — iy '/k!, where we have picked z = 1, the 
midpoint of the interval [—1, 2], as the point of expansion. The maximum error mes by 
this polynomial is 0.001252930683, and it occurs at the endpoint z = 2. 
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[n/ m] Maximum Error 
[0/7] 0.0180476732 
[1/6 0.0018070821 
[2/5 0.0004202679 
[3/4 0.0001744064 
[4/3 0.000119524870 
[5/2] 0.000135075581 
[6/1 0.000271417184 
[7/0] 0.001252930683 


TABLE 41.5  Seven-coefficient Padé 
approximations of f(z) = e*, and their 
maximum errors 


-5x1024- 


f(z) - [473] 


Error 


FIGURE 41.7 The error in the [4/3] Padé 
approximation of f(z) = e* 


All Padé approximations with seven coefficients and their maximum errors are listed 
in Table 41.5. 

The smallest error is made by [4/3], the Padé approximation whose numerator is of 
degree n = 4 and whose denominator is of degree m = 3. Figure 41.7 contains a graph of 
the error in this approximation, showing the error is not uniform since it again increases 
greatly in the vicinity of the endpoint z = 2. 

The maximum error of 0.9496533650 x 1075 in the eight-term Chebyshev approxima- 
tion is considerably smaller than the errors in the Taylor or Padé approximations. In addition, 
the error in the Chebyshev approximation, shown in Figure 41.6, is far more uniform than 
the error in either the Taylor polynomial or the Padé approximation. - 


Chebyshev Economization 


If f(z) is approximated by a polynomial of degree n, we seek a new polynomial of lower 
degree that approximates f (z) with about the same error. Since it has fewer coefficients, this 
new polynomial would then require less storage space on a computing device and fewer 
arithmetic operations for evaluation—hence, the name economization. The two equiva- 
lent algorithms we will present use Chebyshev polynomials—hence, the name Chebyshev 
economization. 

On the interval —1 < z < 2, the fifth-degree Taylor polynomial P5(z) = duet zk / k! 
approximates f(z) — e* with a maximum error of 0.1223894323. 

To find a polynomial of lower degree that approximates f(z) with about the same error 
requires us to use Chebyshev polynomials that are defined on the interval —1 < x < 1. The 
change of variables 


— 1 2(z = 
z—z(xX)-a-c pw y <> x=x(z)= a a NND (41.5) 

2 B—a 
linearly maps æ < z < £ to—1 <x < 1. With œ = —1 and B = 2 we have z = $ + 3x 


and x = $z — 1. Define gs(x) by 


ENDS _ 6331 , 633, , 237.2 , 117,3 , 81.4, 81 5 
85(x) = Ps(z(x)) = 3375 + 356% + Psx + mX tas% + T0% 


The Chebyshev economization algorithm in texts such as [16] and [38] is 


n 


A 
Becon(X) = n(x) — nai In (X) 


where gecon (x) is the economized polynomial and A, is the coefficient of the highest power 
81 


of x in g,(x). Here, n = 5, A, = 1280^ and 
A 6931, 10,047.. , 237,2 , 1017,3 , 81,4 
Secon(X) = 349 + “goog ^ + 128* + 10044 + 2564 (41.6) 


Already a polynomial of lower degree, gecon (x) is now transformed to Pecon(Z) = Secon (x (Z)) 
by the change of variables (41.5), giving 


Y — 61,681 , 6155, , 365.2 | 65,3 | 1,4 
Pecon(2) = giao + 61442 + 7687 + 3844 + 76% 


The maximum error made on —1 < z < 2 when approximating f(z) by Pecon(z) is then 
0.1263445104, which is nearly the same error as that made when approximating f(z) with 
Ps(z). 

The alternative algorithm, found in texts such as [60] and [41], again starts with g5(x) — 
Ps(z(x)), but then expresses gs5(x) in terms of Chebyshev polynomials by the substitutions 


in the rightmost column of Table 41.6. 
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Polynomial Form of T, (x) Chebyshev Expansion of x* 
To(x) — 1 l= To 
T(x) =x x=T, 
T(x) = 2x? -1 r= iT 4. I 
T(x) = 4? — 3x x= in 4 in 
T,(x) = 8x4 — 8? + 1 i -ineinej 
Ts(x) = 16x? — 20x? + 5x P= nat 4j aT; $ aT; 


TABLE 41.6 Chebyshev polynomials and the Chebyshev expansions of x* 


When each power of x in g5(x) is replaced by its equivalent in terms of the Chebyshev 
polynomials, the result is 


.. 82,733 6549 555 1017 81 81 
Gc — 30.720 To + 2048 Ti + 512 ID 4096 13 + 5048 T4 + 20.480 15 


which is economized by dropping the term in 75, since this Chebyshev polynomial will 
contain the highest power of x. Deleting that term and replacing each symbol 7; by the 
corresponding Chebyshev polynomial from the leftmost column of Table 41.6 gives the 
economized polynomial gecon(x) as stated in (41.6). As in the first algorithm, Pecon(Z) is 
obtained as g«con (x (z)). 

The theory of Chebyshev economization is best detailed in [16] and [41]. 


EXERCISES 41.3 


1. If f(x) = e7, —1 € x < 1, obtain the Fourier series coefficients 
a, and b, up through index n = 2. 


N 


. For the function in Exercise 1, obtain the Fourier-Legendre 
coefficients up through index n = 2. 
3. For the function in Exercise 1, obtain the Fourier- Chebyshev 
coefficients up through index n = 2. Use numerical integration. 
4. If f(x) 2e *,0 € x < 1, obtain the Fourier-Bessel coefficients 
up through index n = 2. Use numerical integration. 
The functions f(x) in Exercises 5-14 have domain —1 < x < 1. For 
each: 
(a) Obtain S$5(x) = AN + Sa A, T, (x), a partial sum of the 
Fourier- Chebyshev expansion of f (x). 
(b) By replacing the symbols 7; with the Chebyshev polynomials 
TK = 0,..., 5, obtain Ss(x), a polynomial in x. 
(c) Graph f (x) — Ss(x), looking for uniformity in the error made 
by S$5(x). 
(d) Obtain || f(x) — Ss(x)l|;;. and determine where in [—1, 1] the 
error is this large. 
(e) Compare || f (x) — Ss(x)|las to || f(x) — psGo|lse. where ps(x) 
is the fifth-degree Taylor (or Maclaurin) polynomial at x — 0. 


5. f(x) = cos € 6. f(x)ex(ül-—x) T7.f(x)2x?0 —x) 
8. f(x) 2x(1—x 99 f(x)=xe* 10. f(x) = V1 — x? 
11. f(x) 2 xarctanx 12. f(x) =Incoshx 


13. f(x) = endi 14. f(x) = V1 +2cos? x 


cosh x 


In Exercises 15 and 16: 


(a) Use (41.4) and (41.5) to obtain ss(z) = © + J}, à Ti (x(z)). 
a partial sum of the Fourier- Chebyshev expansion of g(z). 

(b) Graph g(z) — ss(z), looking for uniformity in the error made by 
Ss(z). 

(c) Obtain ||g(z) — s5(z) loo, and determine where in [o, £] the 
error is this large. 

(d) Compare ||g(z) — ss(z)|las to ||g(z) — ps(z)llos. where ps(z) is 
the fifth-degree Taylor polynomial constructed at z — HE, the 
midpoint of [o, £]. 


A 


“ 


15. g(z) = ,-3<z<3 16. g(z) =e *cosz,0<z< 2x 


2 & = 


1+ 2 
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In Exercises 17-20, implement Chebyshev economization by executing 
the following steps. 
(a) Apply (41.5) to ps(z), the fifth-degree Taylor polynomial 
constructed at z — ae the midpoint of [a, B], to obtain gs(x). 
(b) Obtain gecon(x) = gs(x) — (A,/2" 1 T, (x), 
degree of gs(x). 


where n is the 


(c) Use (41.5) to obtain Pecon(Z) = eon (x (z)). the desired 


economized polynomial. 


\lloo with ||g(z) — Pecon(Z)|loo, and graph 


(z) on the same set 4 axes. 


(d) Compare ||g(z) — ps(z 
g(z), ps(z), and Pecon 

(e) Use Table 41.6 to replace each power of x in gs(x) with its 
equivalent in terms of the symbols 7;, and write the resulting 
expression in the form X`} , c; Ty. 

(f) Drop the term containing 75; then replace each remaining 
symbol 7; with the Chebyshev polynomial 7; (x), thereby 
obtaining gecon(x), which should agree with the result in 
part (b). 


17. g(z) = 423 —7 
18. g(z) =ze*,0<z<5 
20. g(z) = e 


21. Obtain expressions comparable to (41.4) for a Fourier-Legendre 
series of a function g(z) defined on the interval [a, f]. 


—tanhz,-3«z < 2 


In Exercises 22 and 23, apply the results of Exercise 21 to each given 
function g(z). In particular: 


(a) Obtain o5(z), a partial sum of the expansion developed in 
Exercise 21. 
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(b) Obtain ss(z) = @ + ie. | Ak Ty x (z)), a partial sum of the 
Fourier- Chebyshev expansion of g (z). 

(c) Obtain || g(z) — os(z)||.s, and compare it to both 
lg (z) — $5(Z)]loo and ||g(z) — PsC) los. where ps(z) is the 
fifth-degree Taylor polynomial constructed at z — ath the 
midpoint of [@, £]. 


22. g > 0xzz2 
ze zx 
100z 
23. g(z) = ——z——.0zzz10 
PUT RELÉ-1: 4 
In Exercises 24 and 25, apply the formalism of Theorem 10.1, Section 


10.1, and thereby 


(a) obtain = partial sum y = 9 + Y, (a, cos E. 
b, sin = 7), Where B — œ = 2L. 


(b) obtain ss(z) = B + ee à, T, (x (z)), a partial sum of the 
Fourier- Chebyshev expansion of g(z). 


(c) obtain ||g(z) — v/|;;, and compare it to ||g(z) — ss(z)]|o;, and 
llg(z) — ps(z)|loo, where ps(z) is the fifth-degree Taylor 
polynomial constructed at z — EXP. the midpoint of [o, 8]. Of 
course, y contains seven parameters, whereas the other 
approximations contain six. 


24. g(z) —e*lnz1xz-x5 25. g(z)=zd—z),0<z<1 


Chebyshev—Padé and Minimax Approximations 


The Chebyshev—Padé Approximation 


This section examines the Chebyshev—Padé approximation 


2 2 ak Tk (z) 
1+ p b T, (z) 


(41.7) 


a rational function with small, uniform error, and which, in continued-fraction form, is 
economical to evaluate. Motivation for this approximation comes from the ideas seen in 


Sections 41.1—41.3. 


On —1 < z < 2, the function f(z) = e* can be approximated via 


1. the fifth-degree Taylor polynomial Ps(z) = /e ys (z 


k . 
— 4) /k!, with a nonuniform 


error whose maximum magnitude is less than 0.032925. 


2. the Chebyshev series $5(z) = 


h 5 ^ ; i 
Qua âkTk(x(z)), with a uniform error whose 


maximum magnitude is less than 0.98611 x 107°. 


3. the3 


, 2 Padé approximation [3/2] = 


se 60+36(z—1/2)+9(z—1/2)?+(z-1/2? 


24- Sz (G1) , based at z = = 


and having a nonuniform error whose maimam magnitude i is less than 0.0100230. 


Error 


0.00015 t 


—0.00015 7+ 


FIGURE 41.8 The error made when 
f(z) = e* is approximated by the 3, 2 
Chebyshev-Padé rational function (41.8a) 
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Like Ps and Ss, the 3, 2 Padé approximation has six coefficients but, its continued- 
fraction form, 
83.53521107 


6565 
T ee 
z — 2.342105263 


can be economically evaluated with just two divisions, one multiplication, and five additions. 

Consequently, we seek a rational-function approximation to f(z) that, like the Padé 
approximation, is economical to evaluate and, like the Chebyshev approximation, is very 
accurate. The desired approximation is the Chebyshev-Padé approximation (41.7). The 
3, 2 Chebyshev-Padé approximation, obtained with an algorithm attributed to Clenshaw 
and Lord [36], is 


1.147328304 + 0.7309945667z + 0.2019501560z? + 0.02672316719z? 
1.147393547 — 0.4165562786z + 0.04427970359z? 


97.18510371 
= 10.23821925 + 0.6035082672z + (41.8b) 


.807502 
z — 6.944190547 + Eo € 
z — 2.463195790 


and has an error with maximum magnitude no greater than 0.15734 x 107°, a bound that is 
roughly ES of that for the equivalent Padé approximation. In its continued-fraction form, it 
can be economically evaluated with just two divisions, one multiplication, and five additions. 
Finally, Figure 41.8 shows the uniformity of the error. Consequently, the Chebyshev—Padé 
approximation has a more uniform error that is significantly smaller than the error in other 
approximations and preserves the efficiency of the continued-fraction form. 


9.06796699] + 0.5495737569z + 


C P39 = (41.8a) 


A Chebyshev-Padé Algorithm 


Texts such as [16], [60], [38], and [48] find the Chebyshev—Padé approximation of f(z), o < 
z < P, by imitating the technique for finding the Padé approximation. The difference 
f(z) — Pn(z)/Qm(z) is made to match its error term md o T,(z) by matching the 
numerator, Q(z) f (z) — Pa (z), with the error term. This is not the same as matching the 
complete difference with the error term, but it is simpler. Unfortunately, it results in an 
approximation that is not as good as the one obtained by the Clenshaw-Lord algorithm. 

The algorithm that matches the numerator, Qm (z) f(z) — P,(z). with the error term is 
attributed to Maehly by [36] and consists of the following steps. 


1. Linearly map the interval œ € z < B to —1 < x < 1 by the transformation x(z) = 
Pa — | and its inverse z(x) = o + Boxe 
Obtain g(x) = f (z(x)). 
Let R = a where P = Y 9a,T, and Q = 1 + 9 7. , by Ty, treating T; as a symbol. 
This step determines the parameters n and m. 

4. Obtain the Chebyshev expansion g(x) = & + 5*7 Ay Ti(x), writing the result with 
the symbols 7; not the Chebyshev polynomials T; (x). The coefficients A; are deter- 
mined by the integrals A, = E f [e(x) Tk GO /A/ 1 — x?] dx. 


gQ-P 
Q 
The left side of gQ — P — 0 contains products of Chebyshev polynomials that are 


simplified with the identities 7; 7,, = "emm + Tj, 4j), derived as part of Example 
41.5. An equation of the form }°,_, $T, = 0 results, where the $; are functions of 
the Ai, di, and bi. 


5. Manipulate R = g(x) to the form = 0 or, equivalently, gQ — P = 0. 
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EXAMPLE 41.5 


Ao = 5.429975098 
A; = 3.236988642 
A = 1.1139902420 
A3 = 0.2663479964 
A4 = 0.04859825644 
As = 0.00715729546 


TABLE 41.7  Fourier-Chebyshev 
coefficients for g(x) = eO**9/2, 
—] < x < 1, in Example 41.5 


7. Solvethen + m + 1equations gd, = 0, k = 0, ..., n + m, forthen + m + 1unknowns 
(ys s s 5 By and bi, ..., Dm. 


This, the Maehly algorithm, is now illustrated for f(z) = e*, —1 < z x 2. The interval 
—1 < z x2ismappedto —1 < x < 1 by the function x(z) = #7 and mapped back by 
the function z(x) — A. Then, obtain g(x) = f(z(x)) = e@t)/?, Let n = 3 and m = 2 
so that P = v aT, and Q = 1 + ET. b, T,. Expand g(x) in the Chebyshev series 
g(x) = 4 Y, ALT). The coefficients A, = 2 f1 [669 * T, (x) / VI = x?] dx are 
listed in Table 41.7. Equate R — a with g(x) = E T Y. A, T;,, and set the numerator 
to zero, obtaining 


5 3 
A 
gQ-P- (5 Dx D aT- (To +biT +b) = 0 


k=1 k=0 
Expanding the left side leads to the surprisingly complex 
0 = Ao + Aob Tı + Aob? T) + 2A1T + 2A1T? bi + 2Aqb3 TT, + 242 + 2A3b1 Ti T 
+2A2T?b + 2A3T3 + 2AsbiT T3 + 2A3b5 TT; + 2A4T4 + 2A4b4 T, T4 — 20373 
+ 2Agb2ToTy + 2A5sT; + 2A5bıTı Ts; + 2Asbo T2 Ts — 2ag — 2a4 T; — 2a3T» 
(41.9) 
The products of Chebyshev polynomials are simplified via the identity 
TaTm = 3054s Tic mp. 


which follows from writing 7; (x) as cos(k arccos x) = cos k0 and applying to the product 
T, T, = cos nO cos m, the trig identity cos n0 cos m0 = £ (cos(m +n)@ + cos(n — m)0). 
The absolute value on the difference n — m can be accounted for by the evenness of cos 6 
whereby cos(—0) = cos(0). 

Removing the products from (41.9) leads to nr oT, = 0, where then+m+1=6 
equations $; = 0 are linear and can be expressed in the form Ax = y, where the matrix A 
and the vectors x and y are defined by 


—2 0 0 0 A1 A2 ag —Apo 
0 -2 0 0 A+A: Ai +A3] } a —2A| 
0 0 —2 0 Aic A35 Ag+Aq4] | a _ —2A2 (41.10) 
Ü 0 0 - Geb dude] lw ET 
0 0 0 0 AscAs A» bi —2A4 
0 0 0 0 A, Ay by =JAs 


Although interesting, a symbolic solution of (41.10) is complicated. Hence, the floating- 
point form of the equations in (41.10), namely, 


—do + 1.618494321b,; + 0.5569951210b2 + 2.714987549 = 0 
3.236988642 + 3.271982670b, + 1.751668319b2 — a, =0 
2.739286677b2 + 1.113990242 — a» + 1.751668319b; = 0 

—43 + 0.5812942492b, + 1.622072969b; + 0.2663479964 = 0 
0.5569951210b2 + 0.04859825644 + 0.1367526459b, = 0 
0.1331739982b + 0.02429912822b, + 0.007157295460 = 0 


-8x10- [| 


FIGURE 41.9 The error made by the 
minimax approximation of f(z) = e* 
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is instead solved, yielding the rational function 


R= 1.87903 14597 + 1.5740364187; + 0.30156852787 + 0.02755554881T3 
i 1 — 0.5313732123T| + 0.043211215687» 


1.577462931 + 1.491369772x + 0.6031370556x? + 0.1102221952x? 
i 0.9567887843 — 0.5313732123x + 0.08642243136x? 


Finally, obtain p(z) = R(x(z)), where p(z) is given by 


)= 1.143272598 + 0.7506794224z + 0.2190732713z? + 0.03265842821z2? 
e 1.143515680 — 0.3926587777z + 0.038409969497? 


The maximum magnitude of the error made when using p(z) to approximate f(z) = e* on 
—1 < z < 2 is 0.3755860225 x 107°. 

The algorithm of Clenshaw and Lord yields the approximation (41.8a) for which the 
maximum magnitude of the error is 0.1573484994 x 107°, about half that of (41.11), 
because it uses a slightly different matching scheme than [16]. In fact, [48] suggests several 
alternatives, one of which is the collocation strategy g(xx) = R(x), k = 1,...,n+m+ 1, 
for xz, k = 1,...,n +m + lin —1 < x < 1. Taking xx = —1 + 2k, k =0,...,5, we 
obtain 


p (41.11) 


.. 1.148207901 + 0.7262159545z + 0.1980125881 z? + 0.02548951481z? 
Pg 1.148238067 — 0.4221292593z + 0.04569204506z? 


for which the maximum magnitude of the error is 0.5527915183 x 107°. Other techniques 
are explored in the exercises. 

Surprisingly, the rational approximation provided by the Clenshaw-Lord algorithm is 
not the best rational-function approximation. A better one is the minimax approximation, 
discussed next. e 


The Minimax Approximation 


The minimax rational function minimizes the maximum error in the approximation of f(z). 
Typically computed by an iterative process attributed to Remes, the [3/2] minimax approx- 
imation for f(z) = e* on [—1, 2] is given by Maple’s minimax command as 
1.146452 + (0.7350169 + (0.2055243 + 0.02805070z)z)z 

1.146549 + (—0.4115607 + 0.04307749z)z 


Pmm = 


where the calculations were performed at extended precision. 

The maximum magnitude of the error made by this rational function is 0.841 x 107^ and 
occurs at x = 1.862. Figure 41.9 shows the error to be uniform and small. Evaluation of the 
nested (Horner) form of the minimax approximation requires a total of five multiplications 
or divisions and five additions. On the other hand, in the continued-fraction form (41.12), 
evaluation requires just two divisions, a multiplication, and five additions. 


104.7510 


Nm 8.805248 
dii z — 2.538938 


10.9928 + 0.6511684z + (41.12) 


Additional information on the minimax approximation and the (second) algorithm of 
Remes can be found in [41], [75], and [72]. 
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EXERCISES 41.4 


1. Verify that the matching process in Maehly's algorithm for 
generating (41.7), the Chebyshev—Padé rational approximation of 
the function f(x) = “2 + 35,7 AT; x), results in the system of 
equations 2a = 7), Agby, 2a; = Y a (Aja + Apa) De, k = 


LI n 4- m, where A, = 0 ifo > n-- manda, = Q ifo >n. 
Exercises 2—7, apply to any of the functions f(x), k =1,..., 10, from 
the following list. Each function has the domain —1 < x < 1. 

; T x 
fi(x) = cos 5% fo(x) = V1 — x? 
f(x) =x = x) f; (x) = x arctan x 


fx)-x(1—x) — fe(x) = Incoshx 
cos x 


f(x) =xQl—x)? pa) = 
fs(x) =xe™ fio(x) = V1 + 2 cos? x 
2. For a function f; (x) from the list provided: 

(a) Use Maehly's algorithm to obtain R;(x) as a 
(3, 2)-Chebyshev-Padé rational approximation to f; (x). 

(b) Graph cı (x) = f;(x) — Rı (x), the error of the approximation 
on the interval [—1, 1]. 

(c) If N =n +m =3 +2 = 5, verify that e, (x) has N +2 =7 
local extrema at x)» = —1, xy,; = 1, and xg, k =1,..., N, 
where £j (xx) = 0 for each xz. 

(d) Ifk 20,..., N +1, obtain |e; (x;)], m, = min; {]£; (x4)|}, and 
Mı = max, {£1 (xx)|}. 

(e) Obtain |[ei (x) los. 

3. For the function f; (x) selected earlier: 

(a) Determine R»(x), the (3, 2)-Chebyshev-Padé rational 
approximation to f; (x) obtained via collocation at 
& EE I. N + 1, the N + 1 zeros of Ty,4(x), where 
N=n+m>=342=5. 

(b) Graph £;(x) = fi(x) — Ro(x), the error of the approximation 
on the interval [—1, 1]. 


(c) Verify that e£; (x) has N +2 = 7 extrema at xy = —1, xy, = 1, 
and xy, k = 1,..., N, where £4 (xz) = 0 for each xz. 

(d) If & = 0,..., N + 1, obtain |£2(xx)], m2 = min;f|e5 (x;)|], and 
M» = max; {|€2(x;)]}. 

(e) Obtain |]é2(x)||o0- 

4. For the function f; (x) selected earlier: 

(a) Determine R3(x), the (3, 2)-Chebyshev—Padé rational 

approximation to f; (x) obtained via collocation at the N + 1 


uniformly spaced nodes z, = —1 + k=, k — 0,.... N, 
where N =n +m 234-225. 


(b) Graph ¢3(x) = fi (x) — R3(x), the error of the approximation 
on the interval [—1, 1]. 


(c) Verify that e3(x) has N +2 = 7 extrema at x9 = —1, xy, = l. 
and xg Km lisma N, where e5(x,) = 0 for each xz. 
(d) If Kk =0,..., N +1, obtain |£3(x;)|, m3 = min; {/e3(x,)|}, and 


M, = max, {|e3(x,)]}. 
(e) Obtain ||e3 (x) || s. 


. For the function f;(x) selected earlier: 


(a) Determine R4(x), the (3, 2)-Chebyshev—Padé rational 
approximation to f; (x) obtained via a least-squares technique 
implemented by solving the N 4- 1 equations 
flee — P)|T,(x)/V1 — x?]dx =0,k =0,..., N, 


where N=n+m=3+2=5. 


(b) Graph e4(x) = f;(x) — R4(x), the error of the approximation 
on the interval [—1, 1]. 

(c) Verify that £4(x) has N + 2 = 7 extrema at xo = —1, xy4) = 1. 
and xz Es us N, where e; (x;) = 0 for each xz. 

(d) I.E m0... N + 1, obtain |£4(x4)], m4 = min; {]e4(x;)|}, and 
M; = max, (lea Gu)l]. 

(e) Obtain ||£4 (x) || ss. 


. For the function f; (x) selected earlier: 


(a) If possible, obtain R5(x), the (3, 2)-Chebyshev-Padé rational 
approximation to f; (x) given by Maple's chebpade command 
or the equivalent. 

(b) Graph es(x) = f;(x) — Rs(x), the error of the approximation 
on the interval [—1, 1]. 


(c) Verify that £&(x) has N 4-2 = 7 extrema at xo = —1, xy4) = 1. 
and ik = L; sass N, where £% (xx) = 0 for each x;. 
(d) If k =0,..., N +1, obtain |e5(x,)|, ms = min; {les (x;,)|}, and 


Ms = max,{|é5(x;)|}. 
(e) Obtain |[e5(x) loo. 


. For the function f; (x) selected earlier: 


(a) If possible, obtain Rg (x), the (3, 2)-minimax rational 
approximation to f; (x) given by Maple's minimax command 
or the equivalent. 

(b) Graph é6(x) = f;(x) — Re(x), the error of the approximation 
on the interval [—1, 1]. 


(c) Verify that e&(x) has N +2 = 7 extrema at xo = —1, xy4) = l. 
and xy, k 2 1,..., N, where &;(x,) = 0 for each xx. 
(d) If Kk = 0,..., N + 1, obtain [e5(x;)]|, noting the relative 


constancy of these values. 


(e) Obtain ||e5(x) |... 


. To the extent possible, for the results obtained in Exercises 2-7, 
show that m, < ||es(x)llo < My, k = 1,...,5. Thus, the minimax 
approximation R(x), if found, has a smaller error than any other 
rational approximation, but because it has a uniform error, its error 


41.4 Chebyshev-Padé and Minimax Approximations 


is larger than the smallest extrema of another rational 
approximation. 
For the functions g(z) defined on the indicated intervals [a, 8] in Exer- 
cises 9-18: 
(a) Obtain R(z), a (3, 2)-Chebyshev—Padé rational approximation. 
(b) Graph e(z) = g(z) — R(z), the error of the approximation, and 
determine ||g(z) — R(z) las. 
(c) If possible, compare R(z) to the minimax approximation 
provided by Maple's minimax command. 


Chapter Review 


1. Obtain the least-squares approximation of f(x) =x,0 <x <1, 
using the functions sin kztx, k — 1, 2, 3. How small is the 
square-norm of the difference between f(x) and the approximation? 


N 


. What is the infinity-norm of the difference between f(x) and the 
least-squares approximation in Question 1? 

3. Obtain the least-squares approximation of f(x) = sin x, 0 < x < 

using the functions 1, x, x?. How small is the square-norm of the 

difference between f (x) and the approximation? 


IN 


4. What is the infinity-norm of the difference between f(x) and the 
least-squares approximation in Question 3? 


a ol —3<z<3 10. g(z) =e*cosz,0<z<2n 
11. g(z) = 42 — 7z? +524+2,-2 <z <2 
12. g(z) 2ze?,0xzx5 13. g(z) = tanhz,—3 <z < 2 
14. 9(z) 2e, -2«z <2 

z — 2z —5z +7 
15. g(z) = : + 0<z<2 

24241 

it. dide des ii 
easily I" T" Min 
17.g(2-—e?lnz1xz-x5 18. g(z) =z(1—z),0<z<1 


. Obtain the Chebyshev expansion of f(x) = 


. What is the advantage of performing a least-squares approximation 


with a set of orthogonal functions? 


. Obtain, at x = 0, the [1/2] Padé approximation of sin x. 


xl 
aa Lex <2. 


Sketch the calculations by which this series is determined. 


. Describe the difference between the Maehly algorithm for finding 


the Chebyshev-Padé approximation to f (x) and the Clenshaw—Lord 
algorithm. 


. Describe the minimax rational approximation to f (x). 
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Chapter 42 


Numeric Differentiation 


INTRODUCTION Chapter 42 is a short chapter, containing two essential ideas, 
namely, techniques for numeric differentiation and Richardson extrapolation. Because of 
the potential for subtractive cancellation in the difference quotient, numeric differentiation 
is inherently unstable on a finite precision computing device. A variety of finite-difference 


formulas for derivatives are obtained, and the notion of polynomial exactness appears. The 


degree of polynomial exactness refers to the degree of a polynomial for which a differ- 
entiation formula gives an exact answer. That and a method's order are the two ways of 
quantizing the accuracy of numeric differentiation. 

Richardson extrapolation is a technique for generating more accurate numeric values 
from two values of lesser accuracy. This device is applied to numeric differentiation and is 
useful in that context because with it, the perils of subtractive cancellation are more likely 
to be avoided. Richardson extrapolation appears again in Chapter 43, where, in conjunc- 
tion with the Trapezoid rule for numeric integration, it forms the method called Romberg 
integration. The theory that makes Richardson extrapolation viable also justifies error as- 
sessment in adaptive implementations of numeric integration and numeric methods for 
solving differential equations. 


Basic Formulas 


Naive Numeric Differentiating 


In Section 25.4 we actually used the O(h) forward-difference formula 


fü a fie +h) = fle) (42.1) 
h 

to replace u; (Xn, tm) With (Vp_.m+1 — Un.m)/dt in the numeric solution of the heat equation on 
a finite rod. In Section 37.1 we used this formula to give an example of dramatic roundoff er- 
ror so severe that subtractive cancellation could be made to invalidate numeric differentiation 
on an n-digit computing device, no matter how large n might be. In particular, our example 
was the computation of f’(1) = e for the function f(x) = e*. We wrote the difference quo- 
tient as (e! * — e)/h and found for h = 107^, k = 0, 1, ..., 10, the results in Table 42.1. 
As h decreases, the difference quotient begins to converge to e, but then, with further 

decrease in h, the difference quotient becomes wildly erroneous. 
In this section we will study and derive more stable formulas for numeric differentiation. 
Formulas that obtain approximations of derivatives at x = c using function values at and 


^ eth) —e 
h 

l 4.670774271 
107! 2.85884196 
107? 2.7319187 
107? 2.719642 
10+ 2.71842 
10? 2.7183 
1079 2.719 
1077 2.12 
1075 2.8 
107? 3.0 
j0-19 0 


TABLE 42.1 Atx = 1, and for 
f(x) = e*, values of the difference 


quotient with h = 107*, k = 0 
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to the right of x — c are called forward-difference formulas. Formulas that obtain such 
approximations using function values at and to the left of x — c are called backward- 
difference formulas. Finally, formulas that obtain such approximations using function values 
at and symmetrically to the left and right of x — c are called central-difference formulas. 


Forward- and Backward-Difference Formulas 


The naive formula (42.1) is an O(A) forward-difference expression for f'(c) because the 
error it makes is proportional to h. Table 42.2 shows this for the calculation of f’(1) = 3e**, 
where f(x) = e**, by listing hg = 2-*,k = 0,..., 10, the value of f£, = (fA + Ahi) — 
f (1)/ hi, and the ratios ( f; — f'(1))/ hi. That these ratios tend to a constant is empirical 
evidence that the approximation is O(A). 


fach) - f fe- F'O 
hk fk = 
hy hy 

l 383.34 323.09 
3 139.86 159.21 
ppt 89.74 117.94 
9-3 73.11 102.83 
P 66.28 96.31 
ars 63.17 93.28 
2-9 61.69 91.81 
gc 60.97 91.10 
2-8 60.61 90.74 
d 60.43 90.56 
2-10 60.34 90.48 


TABLE 42.2 For f(x) = e**, a demonstration that the 
truncation error for f’(1) = han is O(h) 


The formula approximating f’(x) in Table 42.2 is an example of a 2-point formula. The 
following equispaced (n + 1)-point formulas for derivatives are O(h?) forward-difference 
formulas when h > 0 and O(h?) backward-difference formulas when h < 0. 


1 
f" (c) 3: =a! 3f(c)+4flc +h) — f(c 4- 2h)] (42.2a) 
4n 
1 
FAs peo Sf (c +h) +4f(c+2h) — f(c+3h)] (42.2b) 
p 
1 
f"(c)-— as SLO -F 18f (c 4- h) — 24f (c + 2h) + M4 f (c + 3h) — 3f (c + Ah)] (42.2c) 
an~ 
3f (c) — 14 f (c +h) + 26f (c + 2h) — 24 f (c +3h)+11f(c+4h)—2f(c+ 5h) 


(4) p 2 
f F (c) i 


(42.24) 


Not only are these formulas of order O(h7), they each have truncation errors of the form 
Ch? + DI? +--+, as we will see. In addition, these formulas are exact for polynomials 
of degree 2, 3, 4, 5, respectively. Table 42.3 summarizes the results of using these formu- 
las to compute f" (c) for the polynomials p,(x) = 37; 9 axx, n =2,..., 5, thereby 
verifying the polynomial exactness of each. 


1060 Chapter 42 Numeric Differentiation 


n 
n Pn(x) = Y ax" pf Yo) = f°) Exactness Degree 
k=0 
2 > a,x* a, + 2a5c 2 
k=0 
3 
3 * a,x* 2a + 6asc 3 
k=0 
4 
4 >: a,x* 6a3 + 24a4c 4 
k=0 
5 
5 b» a,x* 24a4 + 120asc > 
k=0 


TABLE 42.3 Polynomial exactness of degree n for the O(A?) forward-difference formulas 
for f e? (c) 


We conclude this discussion with derivations of these forward- and backward-difference 
differentiation formulas. We base the derivations on Taylor series expansions, thereby 
demonstrating the origin and nature of the error estimates. 


DERIVATION OF FORMULA (423) To obtain the O(h) formula (42.1), solve the Taylor 
expansion f(c +h) = 37; 9 f 9 (c)h*/ k! + O(h"*!), n > 3, for f' (c), obtaining 


: } = (^ n (Kk) . 
fo- f (c 4- h) — fo f (ONE OQ) 
h E k! 
The first term is the formula under consideration, whereas the remaining terms give the 
truncation error in the form Ch + Dh? + --- . Thus, the formula is of order O(A). 


DERIVATION OF FORMULA (42.24) To derive formula (42.2a), write the Taylor expansions 


H cH] (4) (5 
PO ga, POs | FOO, 


h? 3. EUM 
dier: 24 


f (c - 2h) — f (c)  2f'(c)h - 2f" (c)? + $ f" (c)? + f n^ +--- 


and subtract the second equation from 4 times the first to eliminate the term in f" (c). This 
gives 


Af (c th) — f(c 2h) - 3f(c) -2f'(c)h — F f" (c)? —-if(cn -... 


to be solved for 


f(c 4 h) = f(c) + foh + 


| TET 
FO = giS O 4f eh) — feH 2] + 5 f" (OI! SOO H 


The first term on the right gives (42.2a), whereas the remaining terms indicate the truncation 
error is of the form Ch? + Dh? + --- . Thus, the formula is of order O(h?). 
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DERIVATION OF FORMULA (42.20) To derive formula (42.2b), write the Taylor expansions 


FO a+ Fon, £702 
f(c 2h) =f) - 2f (c)h - 2f" (co)? + Ff (OM + $ fon* + SFO (e) +++ 
f(c --3h) 2 f (c) -- 3f'(c)h + TMOL + 2 f" (c)? 

Ji 2 £9 (chi ES sf (ch exa 


f(c 4 h) — fà) + foh + li? ax 


To the first equation add -i times the second and 1 times the third, yielding 
f(c th) — $f(c 2h) + if(c 3h) = $ f(o) — if" (o)? 
+ H £9 (cht 4 ifO (cs JD aso 
which, when solved for f"(c), gives 
res zs. f — 5f (c - h) -- 4f (c - 2h) — f (c 4-3h)] 
4 pfo (c)h? je f (c)? sg 
The first term on the right gives (42.2b), whereas the remaining terms indicate that the 
truncation error is of the form Ch? + Dh? + --- . Thus, the formula is of order O(/2). 
DERIVATION OF FORMULA (42.2c) To derive formula (42.2c), write the Taylor expansions 
f(c - nh) = Yos FOO NEk! n 2 1,..., 4, and form the linear combination 
f(c- h) — $f(c +2h) - Lf (c - 3h) — 1 f (c - Ah) 
= Bho) + gf" OW — 3 f (i6 — 3 f (e) +--- 


(c) gives 


"t 


Solving for f 


l 
f" c) = z,3L-5 C) + 18f (c + h) — 24 f (c + 2h) + Mf (c + 3h) - 3f (c + 4h)] 


PIJO OOP + 5 fO OR +++ 
The first term on the right gives (42.2c), whereas the remaining terms indicate that the 
truncation error is of the form Ch? + Dh? + --- . Thus, the formula is of order O(/?). 
DERIVATION OF FORMULA (42.24) To derive formula (42.2d), write the Taylor expansions 
fle+nk) = XV s FP OCR B, nm 1, 5, and form the linear combination 
f(c - h) 2 9 f (c - 2h) + 2 f (c - 3h) — H f (c - Ah) + 1f (c - 5h) 
= df) — aJ Ooh + gf?) + BFR +> 
Solving for f ? (c) gives 


1 
fPO= ABSO — 14 f(c +h) + 26f(c + 2h) — 24 f (c + 3h) 


+11 f(e+4h) 2 2f (c - 580)] - ZfO Oh +5f/P OR +++: 


The first term on the right gives (42.2d), whereas the remaining terms indicate that the 
truncation error is of the form CA? + Dh? + --- . Thus, the formula is of order O(h7). 


1062 Chapter 42 Numeric Differentiation 


Central-Difference Formulas 


The following are O(h?) central-difference formulas with truncation errors of the form 
Ch? + Dht + Eh® + - - -. We have, in fact, used the first formula in Section 15.2 and the 
second in Sections 15.2, 24.6, 25.4, and 26.4. These are (n + 1)-point formulas: the first 
is a three-point formula even though f(c) has a coefficient of zero! Finally, the formula 
for f "—U(c) is exact for polynomials of degree n. If, for n = 2,...,5, the formula for 
f "V (c) is applied to the polynomial p, (x) = Y 7; 9 axx*, the results listed in Table 42.3 


are again obtained. 
gXd-hi) _ 2e? + edith) 


"c 1 
i hi FOL z-[- f (e — hb) + feth] (42.3a) 
=f" "PED: 
hy fi hm f (o) == y Ceh — 2A OFF EFR] (42.3b) 
k 
M gs a BA. 9 2 p J My ui fos 2 $ 
j 364258 183.488 FPO = Fal-F 2h) - 2f (c — h) -—2f(et+h) + f(c + 2h)] (42.3c) 
27i 217.311 146.165 |] 
2-2 189404 138.145 f° O= pal fle 2h) —4f(c—h) + 6f(c) - 4f(c - h) 4- f(ce+2h)] (42.3d) 
2 182.898 136215 ; 
27 181.300 135.737 Table 42.4 contains empirical evidence that (42.3b), applied to f(x) = e** atc = 1, 
25 180.902 135.626 is of order O(h7). Table 42.4 lists hy = 1/2*, f, = (e*1-^9 — 2e? + g^) / h2. and the 
p 180.803 135.937 ratios (f. — f"(1)/hz, k = 0,..., 7. The constancy of the ratios supports the claim that 
27 180.778 135.458 (42.3b) is O(h?). 
TABLE 42.4 For f(x) =e, a DERIVATION OF FORMULA (42.3a) To derive formula (42.3a), write the Taylor expansions 


demonstration that the truncation error for — f(c +h) = Y 9 f(c)(£h)*/k! and subtract the second from the first, obtaining 
"(1) 2 4[fU—h) -2f(0 + fü +h 
ei Tac SPD HUNE f(c - h) — f(c — h) 2 2f'(c)h ++ $ f"(c)I? + à; fO (c) ++: 


is O(h?) 
Solving for f’(c) then gives 


" 1 n c "t 2 
FO — g3-E- fic - ID + fic 1— af t)? — aa JO OH +--- 


The first term on the right-hand side gives (42.3a), whereas the remaining terms indicate 
the truncation error is of the form Ch? + Dh* + - - - . Thus, this formula is indeed of order 
O(h’). 


DERIVATION OF FORMULA (42.3b) To derive formula (42.3b), add the two Taylor expan- 
sions f(c +h) = Y, f (c) h)* / k! to obtain 
f(c — h)  f(c - h) 2 2f (o) + f" (o)? + 45 f 9 (e)h* + HOON ++: 


Solving for f"(c) then gives 


1 5 , ; 
f'O= Doi — h) - 2f (c) + f(c +h] - 5 f 9o)? — x f 9 (e)n* +--+ 


The first term on the right-hand side establishes (42.3b), whereas the remaining terms 
indicate the truncation error is of the form Ch? + Dh* + ---. Thus, this formula is indeed 
of order O(/2). 


DERIVATION OF FORMULA (42.3c) To derive (42.3c), write the four Taylor expansions 
f(c x nh) = $, f 9 (c) nh) / k!, n = 1, 2, and isolate f" (c) from the linear combi- 


42.1 Basic Formulas 


nation f (c — 2h) — 2f (c — h) + 2f (c + h) — f (c 4- 2h), thereby obtaining 


l 
fF” = —À[-f(c-— 2h) 4-2f(c — h) — 2f(c +h) + f(c +2h)] 


2n? 
f (c) " f (c) á 
: h^ —: hc 
4 40 
The first term on the right-hand side establishes (42.3c), whereas the remaining terms 
indicate the truncation error is of the form Ch? + Dh* + ---. Thus, this formula is indeed 


of order O(/?). 


DERIVATION OF FORMULA (42.34) To derive (42.3d), write the four Taylor expansions 
f(c x nh) = Y y f 9 (Cc) nh) / Kl, n = 1,2, and isolate f® (c) from the linear com- 
bination f(c — 2h) — 4f (c — h) — Af(c +h) + f (c + 2h), thereby obtaining 


1 
FO] = 3 Lf (e 2h) — Af (c — h) + 6f (c) - Af Cc +h) + f(c 4-2h)] 


f (c) 5 f (c) 4 
= h = h TAn 
B 80 ^ * 
The first term on the right-hand side establishes (42.3d), whereas the remaining terms 
indicate the truncation error is of the form Ch? + Dh* + ---. Thus, this formula is indeed 


of order O(h?). 


Nonuniform Spacing 


The forward-difference and central-difference formulas just studied, and derived from Tay- 
lor expansions, implement numerical differentiation for data with equally spaced nodes. 
Formulas for numerical differentiation of data with nonuniformly spaced nodes are derived 
from interpolating polynomials. Of course, equispaced nodes are a special case of this new 
theory, so we will be able to obtain all the previous formulas by this approach. 

For example, to approximate f'"(c) from the n + 1 = 5 points (—5, yo), (—2, yı), 
(3, y2), (6, y3), (9, y4) with nonuniformly spaced nodes, interpolate the points with the 
polynomial 


oa a — — eT I d 1 „4 
P = (97394 — 39333 + 792 — GIA 7696.90) 3 
5. 13 D: L., Ü 23.3 
+ (sas 13391 — zii — 9922 7356 4) X 
S as S a. 3. 47. \.2 
+ (770 — 30694 — 32932 — ag + 7933) x 


Hl. i. 53... y. 19: d 
+ (7X1 + 374 — 3643 + $02 t 303 o) x 


PEE CRECEN 27 ., 
Tai + Z¥2 — q4Ys + 774 — 30g Yo 


and differentiate the polynomial. Thus, we would have 


P"(c) = (—# + 13e) Yo + (25 — 35e) 1 + (5 — 15) 2 


+ (-3c- i)» + (c — ga)» 


^n 


as an approximation to the value of f” (c). 
This result is of the form f? (c) = $7 , wi(c)y;, whereby the kth derivative at x = c 
is approximated by a weighted sum of the n + 1 function values f (xi) = yi, i = 0,..., 
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51 
w=- 
9 
w = P 
12 
nd h? 
| "TA 
BEN 
31 
7728 


TABLE 42.5 The weights 
wz, k = O0, act in 
f" (c) = Yeo wi(e)yi 


The weights w;(c) are actually given by w;(c) — LP (c), where 


Lx) * [| €-x9/60 - x) 
j=0,j#i 
is the ith Lagrange interpolating polynomial. 
To illustrate these relationships, use the five nodes x;,i = 0,...,n = 4, from the 
preceding discussion. The Lagrange interpolating polynomials for these nodes are 


Lo = 3596 (x + 2)(@ — 3) — (x — 9) L; = —45(x + 5)(x + 2)(x — 3)(x — 9) 
L,— —dg(x456-3)—-6G0-9) La = 4G 4 5)(x 42) —3)( — 6) 


Lz = a(x - 5)(x -2)(x — 6(x — 9) 
In terms of the Lagrange polynomials, the polynomial, interpolating the data points (x;, y;). 
130, 4,is F(x) — Fem yi Li (x), which has to be the polynomial P (x) obtained ear- 
lier. However, to find the weights w; (c), the representation in terms of Lagrange polynomials 
is preferable. 
Next, compute F” (c) as an approximation to f 
form P s w; (c) y;, obtaining 


ES , (B=4e +(e i Eg NIS 
154 J^» «wo j"'Us JY me Jaen J^ 


Clearly, the coefficient of y; is w;(c) = LO () by linearity in the derivative of F(x) = 
p» yi Li(x). 

We therefore have a procedure for numerically differentiating data with n -- 1 nonuni- 
formly spaced nodes. Simply interpolate the data with a polynomial of degree n and differ- 
entiate the polynomial. Formulas incorporating this idea are then f (c) = $7. o wi(c)y;. 
with w;(c) — LP (c) and L;(x) = I-oji (x — xj)/ x; — x;). Details, proofs, and error- 
estimates can be found in texts such as [60] or [16]. (See Exercise 45.) We close, instead, 
with a demonstration that for equispaced nodes, the interpolating polynomial approach 
generates the same formulas as the Taylor expansion approach. 

The Lagrange interpolating polynomials for the equispaced nodes x, = c + kh, k = 
0; nois 4, are 


n m 


(c) and then express the result in the 


1 (x — c — h)(x — c — 2h) (x — c — 3h) (x — c — 4h) 


L= z h^ 
1 (x — c)(x — c — 2h) (x —^c—3h)(x — c — 4h) 
ME h^ 
L= 1 (x — c)(x — c — h) (x — c — 3h)(x — c — 4h) 
274 h^ 
1 (x —c)(x — c —h)(x — c — 2h)(x — c — 4h) 
am 6 ht 
1 (x —c)(x — c — h)(x — c — 2h) (x — c — 3h) 
4" 24 h^ 


From the weights w;(c) = LP. listed in Table 42.5, we have 


—5yo + 18y1 — 24y2 + 14y3 — 34 
25? 


4 
f"(c) € $  wi(o)y = 
i=0 


which, except for the notation y; = f (c + ih), is identical to (42.2c), obtained earlier via 
Taylor expansions. 


EXERCISES 42.1 


42.1 Basic Formulas 
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1. Verify that (42.2a) is polynomial-exact of degree 2. See Table 42.3. 
2. Verify that (42.2b) is polynomial-exact of degree 3. See Table 42.3. 
3. Verify that (42.2c) is polynomial-exact of degree 4. See Table 42.3. 
4. Verify that (42.2d) is polynomial-exact of degree 5. See Table 42.3. 
5. Verify that (42.3a) is polynomial-exact of degree 2. See Table 42.3. 
6. Verify that (42.3b) is polynomial-exact of degree 3. See Table 42.3. 
7. Verify that (42.3c) is polynomial-exact of degree 4. See Table 42.3. 
8. Verify that (42.3d) is polynomial-exact of degree 5. See Table 42.3. 
The object of Exercises 9-18 is the recognition that the forward- 


difference formulas (42.2a)-(42.2d) are equivalent to the differentiation 
of an interpolating polynomial. For the nodes x, = —2+k,k = 0,1,..., 


as appropriate, and for the given function f(x): 
(a) Apply each of (42.2a)-(42.2d) to approximate the relevant 
derivative at c — —2. 
(b) Obtain g;(x), ..., 4 24 (x), the polynomial interpolating the 
points (xy, f (x,)) used for each differentiation formula in 
part (a). 
(c) For each of g,(x), ..., ga (x), evaluate the appropriate 


derivative at x — c, and compare to the result in part (a). 


(d) To demonstrate empirically that each of (42.2a)-(42.2d) is 
O(/2), note that in these formulas the order of the derivatives 
varies from n = 1 ton = 4. Leth; = 27,i —0,1,..., and let 
gi (x) be the polynomial interpolating the points 
(c + khi, f (c + kh;)), k =0,..., n + 1. Evaluate 
Cf 9 (c) — gi" (c))/ h2 and show, for each n = 1, ..., 4, that 
these ratios become constant as i increases. 


9. f(x) = (x -2e7? 10. f(x) = V2+2x +x? 


Ox? = e= 3x3 + 5x? — 9x +4 
1L fo = ————— 12. f= 
du Ax? +4x +2 dian S+x 
9x? + 5x — 6 
13. f(x) = i 14. f(x) = xsinx 
d 


16. f(x) = ln(x? + 5x + 2) 
18. f(x) = sinh(sin x) 


15. f(x) = sin(cos x) 
17. f(x) = In(cosx + cosh x) 


The object of Exercises 19-28 is the recognition that the central- 
difference formulas (42.3a)-(42.3d) are equivalent to the differentiation 
of an interpolating polynomial. For the nodes x, = —2, —2 +k, k= 
12; 223 as appropriate, and for each of the following functions: 


(a) Apply each of (42.3a)-(42.3d) to approximate the relevant 
derivative at c — —2. 

(b) Obtain g,(x),..., ga(x), the polynomial interpolating the 
points (xy, f (x;)) used for each differentiation formula in 
part (a). 

(c) For each of g,(x). ..., ga(x), evaluate the appropriate 
derivative at x — c, and compare to the result in part (a). 

(d) To demonstrate empirically that each of (42.3a)-(42.3d) is 
O(h?), note that in these formulas the order of the derivatives 


19. 


21. 


23. 


25. 
27. 
29. 


30. 


varies from n = 1 ton = 4. Leth; =27',i —0,1,..., and let 
2; (x) be the polynomial interpolating the points (c, f(c)), 

(c Ekhi f (CEkh; Jk = lyes [5], where [ -] is the 
greatest-integer function. Evaluate ( f ? (c) — gf (c))/ h2 and 


show, for each n = l,..., 4, that these ratios become constant 
as i increases. 
f(x)=xe* 20. f(x) 23sinx —4cosx 
11x? — 12x — 10 x? +3x? — 4x +6 
x)= 22. f(x) = ——————— 
feu 3844-1 fO) = "gia X ilx 4-12 
2x? —9x — 8 
f(x) = ae 24. f(x) = 2e* — sin(sin x) 
f(x) =sinxtanhx 26. f(x) = ln(x? + 2e*) 


28. f(x) = /1+In(x + cosh x) 


This exercise shows symbolically that the forward-difference 
formulas can be derived by differentiating an appropriate 
interpolating polynomial. 


f= e-*” — sech x 


(a) Let g, (x) interpolate the points (c + kh, f(c + kh)), 
k=0,..., n + 1, and show that g(c),n =1,..., 4, are the 
right-hand sides in (42.2a)-(42.2d), respectively. 


(b) Let L, (x) be the Lagrange interpolating polynomials for the 
nodes x, = c + kh, k =0,...,n+1, wheren = l,..., 4 refer 
to the formulas for the derivatives f" (c). For each fixed 


opus 4, obtain the weights w, , = LU (c) and show that 
e , n,k 


wm Wy x f (xk) are again the right-hand sides of 
(42.2a)-(42.2d). 

This exercise shows symbolically that the central-difference 
formulas can be derived by differentiating an appropriate 
interpolating polynomial. 
(a) Let 2, (x) interpolate the points (c, f(c)), (c + kh, f (c + kh)), 
neris [5], and show that g™ (c), n = 1,...,4, are the 
right-hand sides in (42.3a)-(42.3d), respectively. 


(b) Let L, (x) be the Lagrange interpolating polynomials for the 
nodes x, = c + kh, k = —[5]. ...., [2], where n = 1,..., 4 
refer to the formulas for the derivatives f" (c). For each fixed 
n=1,...,4, obtain the weights w, « = Lf; (c) and show that 

E eti W, 4 f (Xx) are again the right-hand sides of 


(42.3a)-(42.3d). 


For the function f (x), set of unequally spaced nodes xy, k = 0,..., 4, 
and value x — c given in each of Exercises 31—40: 


(a) Obtain the error e; = f"(c) — gj (c), where gi (x) is the 
polynomial that interpolates the points P; = (xi, f (xx)), 


(b) Obtain the error &; = f"(c) — g5(c), where g»(x) is a natural 
quadratic spline interpolating {Px}. 

(c) Obtain the error £3 = f"(c) — g3(c), where g3(x) is a natural 
cubic spline interpolating ( P;) (Section 40.4). 
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(d) Obtain the error £4 = f"(c) — g} (c), where g4(x) is a natural 
quartic spline interpolating ( P,} (Section 40.4). 

(e) Obtain the error £s = f"(c) — gf(c), where gs(x) is the 
least-squares quadratic best fitting ( P;) (Section 41.1). 

(f) Obtain the error eg = f"(c) — g¥ (c), where ge(x) is the 
least-squares cubic best fitting { P,) (Section 41.1). 


(g) Obtain the weights wą = L;(c), where L(x), k =0,..., n, 


are the Lagrange interpolating polynomials for the given nodes. 


Compute 57; , wx f (xx) and show it is the same as g? (c). 


. f(x) = e cosx; (1, 1.7, 3.2, 3.3, 7.4), c = 4.6 
. f(x) = 5sin? x — 3cos2x; (3.7, 4.8, 6.0, 7.2, 8.7}, c = 5.7 
. fœ) = Wtr- (0.58, 2.5, 3.6, 5.2, 9.8}, c = 6.7 
` 7x35 +10 + 11x 
Jie e ex 12. o 68 0.72, 1.4, 7.3, 7.8) 
ieee a ene 
c=54 
. 4x? -2x +1 
. f(x) = 10x2 + 10x +2 (2.6, 3.1; 0:3, 7.4, 8.2}, c=43 
. 1+ sinx 
. Fi) = —— — 3552,74, 1S, 8:2, 891,0 — 6/8 
l4 e^ 
x? — sinh x 
. fœ) = : {3.8, 6.1, 8.7,9.1,9.9},c — 5.9 


cos x + cosh x 


. f(x) 2 1n (1 + 2sin? =) : (3.9, 6.0, 6.7, 8.0, 8.2},c = 5.2 


3 


Jx+1-—- JX +2, 


fox) — 211.1,.2.7, 2.8, 8.7, 9.6), ¢ —:6.3 


cosh i — sin x 


. f(x) = e VOT), (0.68, 2.2, 2.4, 5.1, 5.5}, c = 3.7 


. Rework Exercise 31 with the points (x+, yg), where y, = 


(1 +0.01(—1)*) f(xy), k 2 0,..., 4. Obtain the percent change in 
the errors £,,n = 1,..., 6, because of the 146 distortion in 
function values. 

Rework Exercise 31 with the points (xz, yg), where y; = 
(1+0.1(-1)*) fx), k =0,..., 4. Obtain the percent change in 
the errors €,,n =1,..., 6, because of the 10% distortion in 
function values. 


43. 


44. 


46. 


47. 


48. 


49. 


50. 


. Develop the O(h*) central-difference formula f (c) 


Develop the O(h*) central-difference formula f"(c) = 

as (f-s —8f2 + 13f-1 — 13fi + 8f2 — fa). where 

fi = f(c+kh),k = -3,...,3, 

(a) using the Taylor series, thereby showing the truncation error is 
of the form Ch* + Dh? +--+. 

(b) by differentiating the polynomial that interpolates the nodes 
x, = cc kh, k = —3,...,3. 

(c) by finding the weights w; in the approximation 
f" (e) ES 2 Wk fk- 

Verify the polynomial exactness of the formula developed in 

Exercise 43. 


(—f_3+12f_. —39f_) +56 fy — 39 f. + 12f4 — fs), where 


6n* 


fk = f(c +kh),k = —3,...,3, 
(a) using the Taylor series, thereby showing the truncation error is 
of the form Cht + Dhf +--+. 
(b) by differentiating the polynomial that interpolates the nodes 
xp = Ot kh; b= -—3,:3 
(c) by finding the weights wx in the approximation 
^ o 3 ~ 
FOO = 3. We fe- 
Verify the polynomial exactness of the formula developed in 
Exercise 45. 


Let Lra) R=, ....., n, be the Lagrange interpolating 
polynomials for the nodes xz, k = 0, ..., n. A theorem in [60] 


states that if c is a node x;, then the truncation error in 
approximating f'(c) with p'(c) = 37;  L;(c) fx. the derivative of 
the polynomial interpolating (xz, fz), k =0...., n, is 

((n + De" 235 E text" ) F9 (&)/ (n + 1)!, for some £ in the 
smallest closed interval containing all the nodes x+. Verify this 
theorem for f(x) = e*, with x; = k, k —0,..., 3, and c = 1. 
Show that the sum of the coefficients in formulas (42.2a)-(42.2d) 
sum to zero. 


Show that the sum of the coefficients in formulas (42.3a)-(42.3d) 
sum to zero. 

Show that, in general, if f 9 (c) = 7. o w; f; is polynomial-exact 
of any positive degree, then 5 7  w; = 0. 


Richardson Extrapolation 


Review 


In Section 4.1, under the guise of estimating the per-step error when solving a differential 
equation, we established (4.2), a result that is essentially Richardson's extrapolation formula. 
Let us recast our earlier work by letting E = yexact be the exact value of a quantity being 
computed numerically with stepsize / in a function f (h). We assume the truncation error in 
the approximation of E by f (A) is of the form Ch*, that is, the error is O(h^). We compute 


two estimates for E: P = Yapprox(/) at stepsize h and Q = Vapp E) at stepsize E giving 
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E-Q= (42.4) 


By dividing the difference between the more and less accurate approximations Q and 
P, respectively, by 2^ — 1, we obtain an estimate of the error in Q, the more accurate 
approximation. 

However, the Richardson extrapolation technique is based on the resulting expression 
E = (2* Q — P)/(2* — 1) and its generalization. For the moment, we simply observe that 
the expression for £ is just a weighted average of two approximations, with greater weight 
being given to the more accurate approximation. Because we started with two statements 
purporting to be exact representations of the exact value E, we ended up with a correspond- 
ing equation for E. However, the actual error estimate for the truncation error of f (h) is 
more complex than simply Ch*, so the value computed for E by E = (2^ Q — P)/(2* — 1) 
is not the exact value but merely a more accurate value. We have used two approximations 
to extrapolate to a more accurate value, but we typically don't obtain the exact value. How- 
ever, we will be able to repeat the extrapolation process and thereby continue to obtain more 
accurate values from less accurate ones. 


Richardson Extrapolation 


Let E, the exact value of a quantity, be computed with stepsize h by the function f (A) for 
which the truncation error is 


m 


pth) = Y a^ + o(h) 


k=0 
where s and A are nonnegative integers and $ (A) goes to zero as h goes to zero. Two 
approximations to E using stepsizes h and A where r > | and E = f (Ah) + p(h), are 


E = f (h) + cg + cq *^ + c4 85?^ 4... 


h h $ h STA h s+2A 
E=f T + Co 7 ta 9 +e = T 
» a ; r 


Assuming the equality of these two values for E and subtracting the first equation from r° 

times the second, we solve for E, obtaining 

rs f (4) — f(h) hstA(p-A = te h3*2^ (472^ — De 
r5 —] ri — 1 rs—] 

The truncation error's leading term, coh*, has been removed. The weighted average F(A) = 

(r? fÈ) — f (h))/(r* — 1) approximates E with a truncation error of the form C,/**^ + 


Cohs+24 4...., where Ck = cA (r), k = 1,..., for appropriate functions A. (7). 

The extrapolation process can be repeated with F (A) now playing the role of f (h) and 
R(h) = E C, h3**^ representing the truncation error. By the same strategy of computing 
E via F(h) with the two stepsizes 4 and LR we have 


h PTA j ATA pya 

r? r? e p 

h h stA h S+2A h s+3A 
B= P {= |}+€i( 4 tC) JO quss 

r? r3 r? r? 
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Subtracting the first equation from r?*^ times the second and solving for E, we have 


4-2 Dec a Digi 
h3*?^ (y 2s—SA —y AY C 


E — A4 t 
rstA — ] 


"TES " 2 
h5*35 (y 2s—8A — 7s GAN Cs 


rstA — 1 


where A = (r**^ F(À) = F(4))/(rs*4 — 1). Again, the truncation error’s leading term, 
this time C,/5*^, has been eliminated, so the weighted average A approximates E with a 


and the o; (r) are appropriate functions of r. 
The extrapolation scheme these calculations support is summarized by the following 
Richardson extrapolation algorithm. 


1. E= f(h) + cof? + c h5*^ + c4h3?^ + cah tA E... 
2. Pick the factor r > 1 and an initial stepsize A. 


3. Compute the nonzero entries A; ; of the lower triangular array A, where both i and j 
start at 1, and 


(a) the first column of A is given by A; ; = f (hj ri-). 

(b) the remaining nonzero entries of A are given by A;; = (r33072^ Aij 1. — 
Ai-1,j-1 )/(r$* 82^ - 1). 

(c) compute A by its rows, each row ending at its diagonal element. If two adjacent 
entries in a row differ by less than a prescribed tolerance, terminate the calculation. 
Alternatively, if successive diagonal elements differ by less than a prescribed 
tolerance, terminate the calculation and take the last diagonal element as the best 


approximation. 


Table 42.6 contains a schematic illustrating the Richardson extrapolation table formed 
by this algorithm. 


r'À4—4A 
Ay, An - m 
r5 —] 
r° A3) — An r**^ As; — An 
A3; = ———_ Ay = ——————— 
U r'-—] 3 rst — | 
r5 Ag = A31 rst4 Ag ii Az yit Age == Ax 
Ag = ————— Ag = —À——À— Ay = —— 
42 rs —] 43 rstA —] 44 p5*2^ =a] 


TABLE 42.6 Structure of the Richardson extrapolation table 


EXAMPLE 42.1 


There is a delicate balance between the benefits of rapid extrapolation (large r) and 
roundoff error (small A). See Tables 42.7—42.10 for a case study. A common value of r is 
r = 2, with A neither very small nor very large. 


Table 42.7 contains the result of Richardson extrapolation applied to the forward-difference 


i o (c--h)—g(c i z ; : 
formula g'(c) — LH where g(x) — e* and c — 1. The truncation error, obtained in 


Section 42.1, is ofthe form cj 4- co? +c3h? +--+ so thats = 1 and A = 1. Thus, we have 
f(h) = (e!*" — e)/h, along with s = 1, A = 1, r = 2, and h = 2, so the entries in the first 
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i Ait Aj,2 Ai,3 Ai,4 Aj,s 
8.68362755 
2 4.67077427 0.65792100 
3 3.52681448 2.38285470 2.957832597 
4 3.08824452 2.64967456 2.738614507 2.707297638 
5 2.89548017 2.70271582 2.720396241 2.717793632 2.718493365 
TABLE 42.7 Richardson extrapolation applied to g'(c) = zov where g(x) = e*,c = 1, 
h=r=2 
column of Table 42.7 are A;; = f (2/271), and, for j > 1, the entries in the jth column 
in Table 42.7 are computed with A; ; = (22* 07? A; j , — Aj; ,)/Q?* 07? — 1). 
Table 42.8 lists |e — Aj;;|, the absolute value of the error in each entry of Table 42.7. 
Indeed, accuracy increases across rows, with the most accurate value at the end of the last 
row. 
i le — Ail le — Aj,2| le — Ail le — Ail le — Aj,s| 
l 5.9653457 
2 1.9524924 2.0603608 
3 0.8085327 0.3354271 0.239550769 
4 0.3699627 0.0686073 0.020332679 0.010984190 
5 0.1771983 0.0155660 0.002114413 0.000488196 0.000211537 


TABLE 42.8 Absolute errors in the entries of Table 42.7 


Table 42.9 is the Richardson table for h = To and r = 10. For this contrasting exper- 
iment, we have taken h small and compensated with a large r. 


i Aint Ai,2 Ai3 Ai,4 Ais 

l 2.7319187 

2 2.719642 2.7182779 

3 2.71842 2.7182842 2.7182843 

4 2.7183 2.7182867 2.7182867 2.7182867 

5 2.719 2.7190778 2.7190858 2.7190866 2.7190866 


TABLE 42.9 Richardson extrapolation applied to g'(c) = act)" 8© where g(x) = e*, 
l 
andr — 10 


100° 


Ee lyk 


Table 42.10 lists |e — A;;|, the absolute values of the errors in the entries of Table 42.9. 
Now, because of roundoff error, the entries in the first column, values that are not 
extrapolated, decrease and then increase, as A/r/ ^! decreases. Consequently, the error in 
the last entry in the last row now is greater than before. Hence, there is a delicate balance 
between the benefits of extrapolation and the perils of roundoff. * 
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le — Ai ıl 


i le — Aj,2| le — Ai,sl le — Aja] le — Ais] 
1 0.136 x 107! 

2 0.136 x 107? 0.391 x 10? 

3 0.138 x 10? 0.239 x 107? 0.246 x 10 

4 0.182 x 107* 0.484 x 10? 0.486 x 10? 0.487 x 10^? 

5 0.718 x 10? 0.796 x 10? 0.804 x 1073 0.805 x 103 0.805 x 10? 


TABLE 42.10 Absolute errors in the entries of Table 42.9 


EXERCISES 42.2 


1. Eliminate C and h from E = P+ Chk and E = Q + cay to 
obtain E = (2* Q — P)/(2* — 1) and then (42.4). 


In Exercises 2-11: 


(a) Apply Richardson extrapolation to (42.2a) to obtain, with error 
less than 1077, the value of f’(—2), where f (x) is the given 
function. Use h = r = 2 but be alert for the possibility of 
overwhelming roundoff errors. Compensate by computing with 
extended precision. Use the diagonal stopping rule whereby 
f'(c) = Age when |Az g — Ajaa-i| < 1077, where (A; j} are 
the entries of the Richardson table. Determine the actual error 
in Akk. 

(b) Repeat part (a) for (42.2b) and f”(—2). Take h = 1 andr — 2. 

(c) Repeat part (a) for (42.2c) and f” (—2). Take h = 1 andr = 2. 

(d) Repeat part (a) for (42.2d) and f? (—2). Take h = H andr = 2. 


2. f@)=@4+2e%? 3.f()-24242x 4 p x? 


9x? —7x —5 3x? +5x7 — 9x +4 
4. f(x) = ——— — S. F(x) = 
TaS We or C49 54x 
9x? + 5x — 6 
6. fy — Ts f(x) =x six 
b ars 


8. f(x) = sin(cos x) 9. f(x) = ln(x? + 2x + 2) 
10. f(x) = In(cos x + cosh x) 11. f(x) = sinh(sin x) 


In Exercises 12-21: 


(a) Apply Richardson extrapolation to (42.3a) to obtain, with error 
less than 1077, the value of f’(0), where f(x) is the given 
function. Use h = 1, r = 2 but be alert for the possibility of 
overwhelming roundoff errors. Compensate by computing with 
extended precision. Use the diagonal stopping rule whereby 
Fo = Ak.k when lAkk X Arari] < 107, where (Aij) are 
the entries of the Richardson table. Determine the actual error 
in Akk: 

(b) Repeat part (a) for (42.3b) and f”(0). Take h = 1,r = 2. 

(c) Repeat part (a) for (42.3c) and f” (0). Take h = i, pod. 

(d) Repeat part (a) for (42.3d) and f (0). Take h = 1.r = 2. 


12. f(x) 2 xe* 13. f(x) = 3sinx —4cosx 


]1x? = 12x — 10 x? + 3x* — 4x +6 


ie e 

FO) = 3 133 4-1 FO) = "a lin + 12 
rog- 4 fig) ea" — aiiifain a) 

li o) ze ———— " p = ze —S sin X 

FG 10x? —7x 2 f(x e sin(sin x 


18. f(x) = sin x tanh x 
20. f(x) = e^" — sechx 


19. f(x) = In(x? 4- 2e?) 
21. f(x) = /1 + In(x + cosh x) 


In the following table, the numbers in the top row are nodes, x,. The 
numbers in the first column are the values, at x — 1, of the deriva- 
tives of the functions f,(x),k = 1,...,5, whose values at the nodes 
Ag, E ESO uos 8, are displayed in rows 2, ..., 6, respectively. For the 
function f; specified in each of Exercises 22-26, determine which of the 
following two alternatives yields the more accurate result. 

(a) Richardson extrapolation applied to the differentiation formula 


fU+h)—f() 
h i 


(b) Richardson extrapolation applied to (42.2a). 


fA) x 1 11 12 13 14 1.5 1.6 17 18 


B f(x) 1 m $9 w 200 303 1109 10,297 39 
9 JIV 3 1356 193 36 63 92 327 02994 TI 
S5 f(y) 4 499 I4 B 26 49 316 Mn — 4M 
169 J247 313 1380 365 1540 405 68 445 1860 485 
2 f(x) 2 W 43 1372 216 4 311 2892 138 
7 43V 7 1865 100 308 48] 9 715 6839 337 
34 gx) à 5752, 97. 10204 808 128 347 23236 1714 
g1 J4V*/ 9 22,129 3369 32,523 2431 369 969 63,367 4593 
—23 gx) 4 40 Us w 130 22 145 610 160 
pi 45V qp PRB 38 21 43 75 512 2227 603 
22. fix) 23. hx) 24 hœ) 25. fax) 26. fs(x) 


27. In Section 42.1, the forward-difference formula f'(c) — 
Lu T Ch + DI? +--+ was obtained. 


(a) Use Richardson extrapolation to obtain an O(h?) 
forward-difference formula for f’(c). 


(b) Using f(x) = e* with c = 1, compute ratios of error over h° to 
verify empirically that your formula is actually O(h?). 


28. In Section 42.1, the central-difference formula f'(c) — 
Lc + Ch? + Dht 4- --- was obtained. 


Chapter Review 


1. What does it mean to say that the forward-difference formula 
3, [3f (c) - 4f (c +h) — f (c 4- 2h)] is an O(h?) approximation 
of f'(c)? What does it mean to say that this formula has 
polynomial exactness of degree 2? 

2. At x = 1, apply the formula in Question 1 to f(x) = e^* and 
describe a calculation that would show empirically that the formula 
is indeed second order in A. 

3. Use Taylor expansions to derive the formula in Question 1. Carry 


through enough terms so that the structure of the truncation error is 
evident. 


oo -1 0 Un 
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(a) Use Richardson extrapolation to obtain an O(A*) 
central-difference formula for f'(c). 

(b) Using f(x) = e* with c = 1, compute ratios of error over h* to 
verify empirically that your formula is actually O(h*). 


. Demonstrate how to use Lagrange interpolating polynomials for 


obtaining the formula in Question 1. 


. Describe the Richardson extrapolation algorithm. 
. Give a justification for the Richardson extrapolation algorithm. 
. What is the diagonal stopping rule for Richardson extrapolation? 


. For the function f(x) = e^*, apply the Richardson extrapolation 


algorithm to the computation of f'(1) with the forward-difference 
formula in Question 1. Start with h = 1, and let r = 2. Show at 
least one extrapolation step. In general, is it better to start with a 
small A or a large ^? Why? 
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Numeric Integration 


INTRODUCTION Chapter 43 is devoted to the ideas and methods of numeric 
integration. The student of elementary calculus has most likely seen such techniques as 
the rectangular rule, the Trapezoid rule, and Simpson's rule. It is even likely that the 
error estimates for these methods were seen as well. However, we begin with these three 
methods and the midpoint rule, with the rectangular rule being restricted to the Left-end rule, 
where heights of approximating rectangles are evaluated at the left end of the supporting 
subintervals. 

The recursive form of the Trapezoid rule reuses previously computed function values 
when the stepsize is halved. This provides a considerable savings in computational effort 
when applying Richardson extrapolation to numeric integration based on the Trapezoid 
rule. The resulting method is called Romberg integration. 

Gauss—Legendre quadratures evaluate the integrand at nodes that are not uniformly 
spaced. The evaluation nodes are the zeros of Legendre polynomials, and the methods so 
developed are polynomial exact to a degree that is more than double the number of function 
evaluations. These methods are often used in finite-element methods for the numeric solution 
of partial differential equations. 

An adaptive quadrature based on Simpson's rule illustrates the concept of adaptivity. 
The basic adaptive idea is first seen in Section 4.8 where rkf45, the Runge—Kutta—Fehlberg 
algorithm for numerically solving differential equations, is described. The same process 
holds for numeric integration. From two approximate values for the integral, an estimate 
of the error in the more accurate value can be determined. If the estimated error is small 
enough, the more accurate value of the integral is accepted and the computation ends. If the 
estimated error is too large, the interval of integration is cut in half and the process repeated 
for each half. This continues until all of the original interval passes the error criterion. 

A naive application of the adaptive strategy would not necessarily lessen the com- 
putation burden in numeric integration. In fact, it would probably increase it. Hence, a 
scheme that reuses enough of the previously computed function values is essential if adap- 
tive quadrature is to be efficient. 

Finally, we discuss the challenge of evaluating iterated integrals numerically. The 
techniques available are the one-dimensional ones from the earlier parts of the chapter. For 
example, when the outer integral in an iterated double integral requires the value of the inner 
integral, the inner integral must be evaluated numerically with one of the techniques from 
Sections 43.1—43.4. Thus, a numeric integration of the inner integral is performed for each 
function value required during the numeric integration of the outer integral. Coordinating 
the two integration processes with respect to data structures and computer code and with 
respect to error estimates is the challenge for the programmer. 
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Methods from Elementary Calculus 


Newton—Cotes Integration Formulas 


Some numeric integration methods that often appear in elementary calculus are listed in 
Tables 43.1 and 43.2. Table 43.1 shows the “one section” version for intervals [a, 8] con- 
taining the minimum number of nodes to which each method applies. For the Midpoint rule, 
the notation f,+1/2 designates the function value midway between the two nodes a = x; 
and B = Xx41. 


Method Integral Value Local Truncation Error 
. kH . h? " 
Left-end Í f(x) dx hf ail (&) 
Xk = 
: L2 NA h P 
Trapezoid / f(x) dx 5 (fe fia) E (&) 
Xk+1 h? 
Midpoint Í f(x) dx hfs A 9 
Xk Z 
: 1 bis h E he Ae) 
Simpson-i f (x) dx x (fe-1 + 4 fe fie 7994 (8) 
Xk—1 


TABLE 43.1 Common Newton-Cotes quadratures for a single “section” 


b 
Rule Approximation of f f(x)dx Global Truncation Error 
a 
n—1 h 
Left-end h 5 f zí (e — à) 
k=0 
h m. h? 
Trapezoid 5 (^ + fr +2 ^ 4) -p mo — a) 
k=l 
n—-i h2 
Midpoint | 1411/2 — f"(y)(b — 
idpoin PL nat ())(b — a) 
h n/2 n/2-1 h? 
i S a = ( k 4 D 2 2k -— fo b— 
Simpson-; 3 (+s +$ » ic 3 fa) 180 / (n) (b — a) 


TABLE 43.2 Composite Newton-Cotes quadratures for the methods of Table 43.1 


Table 43.2 lists the composite rules that apply in [a, 5], an interval consisting of at least 
two contiguous "sections." Obtained from Table 43.1, the rules in Table 43.2 appear in the 
form in which they are typically used. 


Unifying Principles 


The methods in Table 43.1 are obtained by integrating a polynomial that interpolates the 
m + 1 equispaced nodes xg, k = 0,..., m, in [o, B]. The values of m for the methods in 


1074 Chapter 43 Numeric Integration 


Table 43.1 are m = O for the Left-end and Midpoint rules, m = 1 for the Trapezoid rule, 
and m — 2 for the Simpson-4 rule (henceforth called Simpson’s rule). In each case, we 
| obtain results of the form 


m 


B 
| 1002s = Dns (43.1) 


where the weights wg are computed by integrating P, (x), an mth-degree polynomial that 
interpolates the m + 1 points (xy, f (xy)) = (Xk, fi). k = 0,..., m. Indeed, if the inter- 
polating polynomial is written in terms of the Lagrange polynomials L(x) = [ [j oiy 
(x — x;)/ (xy — xj), the weights w+ are given by 


B 
Wy = f L(x)dx (43.2) 
and the truncation error is given by 
pe? qint2 m T f "*»(£) 
— XT. — — 43.3 
— m+2 2, wert (m+ 1)! ( ) 


with £ in [a, £], provided [ [; 9 (x — xx) does not change sign in (a, B). The formulas in the 
“Value” column of Table 43.1 can all be obtained from (43.1) if the weights are given by 
(43.2). Except for Simpson’s rule, the truncation errors can be determined by (43.3). The 
truncation error for Simpson’s rule must be obtained by an alternate technique, as we will 
show. All such formulas are exact for polynomials whose degree is at least m. (See [60] for 
a proof of these claims.) 

Quadrature formulas are called closed if they sample f(x) at the endpoints a and £ 
and open otherwise. The methods listed in Tables 43.1 and 43.2 are closed, except for the 
Midpoint rule, which is open since it does not sample the endpoints of the interval [a, £]. 

For integration on the interval [a, b], three of the composite methods of Table 43.2 use 
the n + 1 equispaced nodes x, = a + kh, k = 0,..., n, where h = p-a, For the Midpoint 
rule, although the nodes are defined by x, = a + kh, where h = Us —. the po vp 
tions are midway between the nodes—hence the notation fk+1/2 = I a+ (k+ Ł)h), k = 


(); ions n — 1. For Simpson’s rule, n must be even because the interval [a, b] is a uta 
of “double-panels,” pairs of contiguous subintervals [x2,, x2k+1] and [X2k+1; X2k+2], K = 
Osii “In Simpson's (composite) rule, the first sum is over function values at nodes with 


odd indices, while the second sum is over nodes with even indices. 

Comparing the truncation errors as listed in Tables 43.1 and 43.2 shows the order of 
the error in the composite case is always one less. This loss of order is explained in detail 
for the Left-end rule as part of its treatment in the paragraph on Derivations on page 1076. 

In each case in Table 43.2, a < n < b and fo = a, fa = b. Since y is not known, the 
error estimates are used in a “worst case" sense wherein the absolute value of the actual error 
is bounded by the maximum of the absolute value of the estimate, obtained by estimating 
the maximum absolute value of the relevant derivative. 

There may be a tendency in elementary calculus to prefer Simpson's rule over the 
Trapezoid rule because, as compared to the O(h?) error of the latter, the error of the former 
is O(h*), one order higher than expected. However, in Section 43.2 we will see Romberg 
integration, the effective integration technique generated by Richardson extrapolation of 
the Trapezoid rule. 


EXAMPLE 43.1 
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With F(x) = e”, we will use each of the methods in Table 43.2 to approximate, with an 
error no worse than 107°, the value of 


1 
À =i F(x)dx = e — 1 = 1.718281828 
0 


LErr-END Rute On the interval [0, 1] the maximum value of |F'(x)| = e* is e. An n 
for which P 5(b — a) < 10^? holds, where we have replaced A with baa is a solution 
of 4 = 10, or n — 1359.140914. Therefore, we take n — 1360 for a guarantee that 
the composite Left-end rule will compute A with an error no worse than 107° and obtain 
1.717650184 as an approximation to A. The actual error made with this n is 0.000631644, 
somewhat smaller than the required tolerance. By trial and error, we can determine n = 859 
is the smallest n for which the error bound is satisfied. 


TRAPEZzOID Rute On the interval [0, 1] the maximum value of |F"(x)| = e* is e. Ann 
for which (= NA — a) < 107? holds, where we have again replaced h with 2-a, isa 
solution of pz = 102, or n = 15.05069719. Therefore, we take n = 16 for a guarantee 
that the composite Trapezoid rule will compute A with an error no worse than 10^? and obtain 
1.718841128 as an approximation to A. The actual error made with this n is 0.000559300, 
somewhat smaller than the required tolerance. By trial and error, we can determine n — 12 


is the smallest n for which the error bound is satisfied. 


Mippornt RurE On the interval [0, 1] the maximum value of |F"(x)| = e* is e. Ann 
for which (=£) £ (b — a) < 107? holds, where we have again replaced h with 2, is a 


solution of i = 10, or n = 10.64245004. Therefore, we take n = 11 for a guarantee 
that the composite Midpoint rule will compute 4 with an error no worse than 10^? and obtain 
1.717690276 as an approximation to A. The actual error made with this n is 0.000591552, 
somewhat smaller than the required tolerance. By trial and error, we can determine n — 9 


is the smallest n for which the error bound is satisfied. 


Stmpson’s Rute Because the (n + 1)-point composite Simpson's rule will obtain 4 with 
an error no worse than 107? for n = 2, too few points to experience the composite rule, we 
instead illustrate approximating A. with an error no worse than 1075. 

On the interval [0, 1] the maximum value of |F® (x)| = e* is e. An n for which 
(=) s nh — a) < 10^? holds, where we have again replaced h with baa, is a solution 
of o = 1075, or n = 6.233837751. Therefore, we take n = 8 for a guarantee that the 
composite Simpson's rule will compute à with an error no worse than 1075 and obtain 
1.718284155 as an approximation to A. The actual error made with this n is 0.2327 x 1075, 
somewhat smaller than the required tolerance. By trial and error, we can determine n = 6 


is the smallest n for which the error bound is satisfied. * 


Polynomial Exactness 


We next demonstrate polynomial-exactness for each of the four methods of Table 43.1. We 
therefore show exactness for the (m + 1)-point Newton-Cotes formulas, not the (n + 1)- 
point composite formulas because if the former are polynomial exact, the latter must also 
be exact. 
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LEFT-END Rute If the zero-degree polynomial po(x) = c is integrated on the interval 
[a, a +h], the value of the integral I po(x) dx = ch is given exactly by the Left-end 
rule hpo(a) = hc. 


TRAPEZOID Rute [f the first-degree polynomial pi(x) = Ax + B is integrated over the 
interval [a, a + A], the value of the integral 


at+h 
J Ax + Bdx = h(Ah + 2Aa + 2B) (43.4) 


a 


is precisely the value of A [(Aa + B) + A(a + h) + B], as given by the Trapezoid rule. 


Mippornt Rute Ifthe first-degree polynomial p(x) = Ax + B is integrated over the 
interval [a, a +h], the value of the integral is again given by (43.4). The Midpoint rule gives 


T 
h |^ (as) as B = <h(Ah + 24a + 2B) 


a 


Thus, the Midpoint rule is polynomial-exact of degree one. à 


Stmpson’s Rute If the third-degree polynomial p3(x) = co + cix + Cox? + €3x is 
integrated over the interval [a, a + 2h], we obtain 


a+2h 
1 p3(x) dx = 4c3h* + (8c + 8c3a)h> 
a 


+ (4c3a + 2c) + 6c3a7)h? + 2(cg + cia + casa? + coa?) 


whereas the value given by Simpson’s rule is t (p3(a) + p3(a + 2h) +4p3(a+h)). A 


3 
E ; “a+ r 
computation shows this is precisely I» 


/ . s : 
" p3(x) dx, so Simpson's rule is exact for third- 
degree polynomials, not just second-degree polynomials as would be expected from the 
value m — 2. 


Derivations 


Some Newton-Cotes integration formulas and their truncation errors are easily obtained 
from the general theory on integrating interpolating polynomials. Some are more easily 
obtained directly from Taylor series expansions. We illustrate both techniques in the ensuing 
derivations. In the exercises, we explore a different version of the theorem on integration 
of interpolating polynomials and again derive both the Newton-Cotes formulas and their 
truncation errors. 

The single-section (m + 1)-point formulas are used to form the companion (n + 1)-point 
composite formulas. The way the error terms then combine to form a truncation-error term 
of order one less is detailed for the Left-end rule. The truncation errors for the other rules 
are obtained with similar reasoning. 


LEFT-END Rute Using Taylor's theorem to write f(x) as f(x) = f Gi) + f'(&)(x — xx) 
for some £ in [x, x1], we have 

EE" ise d pi = zr i h? : 

fG)dx = fG)Gu — xx) + f E) z =hfi + f) 


Xk = 


establishing both the integration rule and the truncation error. (Since x — x; does not change 
sign in [xk, X41], the second mean value theorem for integrals [91] justifies the integration. 
See Exercise B22.) 


43.1 Methods from Elementary Calculus 1077 


The composite Left-end rule would join n contiguous panels to form, the interval 
[a, b] containing the n + 1 nodes xg, k = 0,..., n. Clearly, A will have f f(x)dx = 
h aa fk + Rn, where R, is the truncation error. That R, is 5 ^ £'(n)(b — a) follows from 


the sum iE ee f (&) intuitively by assuming that all the derivative values in the sum are 
nearly equal, so there is some one point 7 at which the derivative can be evaluated but once, 
and this value multiplied by n. If one h in h? is replaced by h = Bu £ then the truncation 
error is 5 A ne = f'(n)n = Ab — a) f'n). 

A more rigorous argument for the equality n f’ (n) = eue f" (&) rests on the Interme- 
diate Value theorem, which says that a continuous function takes on every value between its 
maximum and minimum on a er DEM In particular, write Y = Lizo "(&y) so that 
nfn, < Wtznfy,and fj, € € Sax are immediate. Consequently, 5 = is a value that 
f’ must assume in the interval [a, b], provided f’ is continuous on [a, b], so there exists an 
n in [a, b] for which z = f’(n), and hence, v = y f'(&) =nf'(n). 

This same proof will suffice for each of the remaining derivations of truncation errors, 
provided the appropriate derivative is used in place of the first. 


TRAPEZOID Rute Ifthe two points (xz, fk) and (xk+1, fk+1) are interpolated by a first- 
degree polynomial and the polynomial integrated, we will have the Trapezoid rule. In 
fact, the interpolating polynomial is P(x) = L(x) fk + Lr+ı (x) fez, where Lg = (x — 
Xk+1)/(Xk — xg) and Ley) = (x — XK) /(Xe+1 — xx). The weights are wy = 5 (xe — Xx) 
and wy.) = 3 Ga — Xi), so the quadrature formula fa“ " fadi = ET. wz fy becomes 


X h 
Í f(x)dx = ome =H) Sk + fia) = 5 Se fea) 


Xk 
The truncation error of the single-section formula is given by 


m 


— 5 Wi aida f abled) (43 5) 
rr (m+ 1)! i 


p"? - RE 


m --2 


where m = 1, œ = xx, and f = X44, so -E Gea — xy)? is the multiplier of the second 
derivative. Since h = x44 — xy, (43.5) is therefore =E f" (£). 

If there are n nodes in the interval [a, b], then we must sum EUR. + fk+1) across the 
resulting n panels. In the leftmost panel, k = 0; but in the rightmost panel, k = n — 1. 
Hence, we must evaluate the sum 

n—l n-1 n—l 

So (fe + fet) = >> fe + SE. 

k=0 k=0 k=0 
The two sums on the right have most terms in common. The first sum on the right only has 
fo not in common with the second sum on the right, and the second sum on the right only 
has f, not in common with the first sum on the right. Hence, all the common terms are 
doubled, and the result is fo+ f, +2 ky fk, from which follows the composite Trapezoid 
rule. 

The truncation error for the composite Trapezoid rule follows from — il ^" (E) 
by an argument identical to that made for the truncation error of the ens Left-end 
rule. 


MipPomNTRurE If x = cis the midpoint of the interval J = [xy, xi41] = [c — Ë, c + 1], 
the single-section Midpoint rule can be derived by integrating the Taylor expandon 
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f(x) = flc) + f(x —c) + TMO — cy? over I, yielding 


c+h/2 c+h/2 " 
/ f(x)dx = i (f(c) + f(x — e) - 5f" (E) (x — cy) dx 
c—h/2 c—h/2 (43.6) 


= hf ( h? " ) 
=hf etf G 


Since f(c) = f (xy + 5), (43.6) establishes both the Midpoint rule and its truncation error. 
(Again, since (x — c)? does not change sign in the interval of integration, the second mean 
value theorem for integrals justifies the integration.) 

The composite Midpoint rule and expression for the corresponding truncation both 
follow from summing the single-section results over n sections. 


Stmpson’s Rute Although Simpson's rule itself can be obtained by integrating an inter- 
polating polynomial, the truncation error cannot be obtained this way because p m (x— x) 
changes sign in the interval [x,, xz+2]. Instead, we obtain both Simpson's rule and its trun- 
cation error directly, from Taylor series expansions. 

Let xy = c, SO xy 4i = c — h and xj44 = c +h, letting us take the interval [o, 8] as 
Xk-1, Xk+1] = [c — A, c + h]. Replacing f(x) with its Taylor expansion constructed at 
x — c and integrating termwise, we have E 


pe f(x)dx = eam c PT x cY dx = 2hf (c) + E f (c) de sf Oc) ecce 
(43.7) 


Replacing f"(c) with the central-difference expression 


4 


1 h4 
a= 5f - 1) -2f() fic h) + t, O 
the right side in (43.7) becomes 


h > n? (4) 
3 (Fle —h)+4f(c)+ f(e+h)) — o0 (c) + 


giving both the one-section integration formula and its truncation error. 


EXERCISES 43.1—Part A 


Al. Evaluate à = f, sin x dx. A4. Approximate A by the Midpoint rule with n = 5. Determine the 
actual error made. Use the truncation error formula from Table 
43.2 to obtain an upper bound on the error. 


A2. Approximate A by the Left-end rule with n = 5. Determine the 
actual error made. Use the truncation error formula from Table 
43.2 to obtain an upper bound on the error. AS. Approximate X by Simpson's rule with n = 6. Determine the 

actual error made. Use the truncation error formula from Table 


A3. Approximate A by the Trapezoid rule with n = 5. Determine the 
43.2 to obtain an upper bound on the error. 


actual error made. Use the truncation error formula from Table 
43.2 to obtain an upper bound on the error. 


EXERCISES 43.1—Part B 


B1. Obtain Simpson's rule by evaluating hir Yo Li(x) fe dx, where A@=@+QBer* fee) =xsinx 
L,(x) is the kth Lagrange interpolating polynomial for the nodes fox) = J2+2x +422 f(x) = sin(cosx) 
xy, k =0, 1,2. ] 
In Exercises B2—6, select one function f; (x) from the given list and use f(x) = woi fg(x) = In(x? + 2x + 2) 
ub 4x- x42 ` 


it for all five exercises. 


3x? 5x? — 9% +4 
5+x 


fo(x) = In(cos x + cosh x) 


fa) = 


9x? + 5x —6 


fs(x) = —3 


fio(x) = sinh(sin x) 


B2. For the function f; (x) selected from the given list: 


(a) Use the error estimate in Table 43.2 to determine an n for 
which the Left-end rule is guaranteed to approximate 
^3 s 
à = J`, f(x)dx with an error smaller than 1072, 


(b) Evaluate 4 either analytically or numerically (using 
appropriate technology). 


(c) If n « 5000, implement the Left-end rule and determine the 
actual error made. 


(d) Find the smallest value of n for which the Left-end rule 
actually approximates A with less than the prescribed error. 


. Repeat Exercise B2 for the Trapezoid rule. 

. Repeat Exercise B2 for the Midpoint rule. 

. Repeat Exercise B2 for Simpson's rule. 

. For the function f; (x) selected from the given list and stepsizes 


h, = 2^*, show empirically that the error made when evaluating 
3 o. : 
A= f°, f(x) dx with 


(a) the Left-end rule is O(A). 
(c) the Midpoint rule is O(h7). 


(b) the Trapezoid rule is O(h7). 
(d) Simpson’s rule is O(h*). 
In Exercises B7-11, function values are given at h-spaced nodes for 
a function f(x). The values of A, = Id Ye Guy», B= unas 5; 
are 2.478140004, 0.4550629667, 0.3361125107, 0.256845281, 
0.246162838, respectively. Approximate the relevant A, by each 
of the following methods, and determine which method gives the most 

accurate results. 


(a) The Left-énd rule. 
(c) The Midpoint rule. 


(b) The Trapezoid rule. 
(d) Simpson's rule. 


(e) Integrating a linear spline that interpolates the given data 
points; compare the result with part (b). 


(f) Integrating a natural quadratic spline that interpolates the 
given data points. 


(g) Integrating a natural cubic spline that interpolates the given 
data points. 


(h) Integrating a polynomial that interpolates the given data 
points. 

B7. 

B8. 

B9. 

B10. 

B11. 


fi (x) from Exercise 22 in Section 42.2 
fa(x) from Exercise 23 in Section 42.2 
a(x) from Exercise 24 in Section 42.2 
f4(x) from Exercise 25 in Section 42.2 


fs(x) from Exercise 26 in Section 42.2 
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In Exercises B12-21, functions fi(x), k — 1,..., 10, and nodes 
RETE x4 are given, thus determining the points P, = (Xn, fi(x,)), n = 
Messy 4. For each: 


B12. 
B13. 
B14. 
B15. 
B16. 
B17. 
B18. 
B19. 
B20. 
B21. 
B22. 


(a) Evaluate A, = ie f(x) dx. 


(b) Approximate A; by applying the Left-end rule to successive 
pairs of points. 

(c) Approximate A; by applying the Trapezoid rule to successive 
pairs of points. 


(d) Approximate A; by integrating a polynomial that interpolates 
Po "ESI P4. 


(e) Approximate A; by integrating a linear spline that 
interpolates Po, ..., P4. Compare to part (c). 


(f) Approximate A; by integrating a natural quadratic spline that 
interpolates Po, ..., P4. 


(g) Approximate A; by integrating a natural cubic spline that 
interpolates Po, ..., P; 


(h) Approximate A; by integrating a natural quartic spline that 
interpolates Po, ..., P4. 


(i) Approximate A; by applying the Left-end rule with 
uniformly spaced nodes and n — 4. 


(j) Approximate 4, by applying the Trapezoid rule with 
uniformly spaced nodes and n = 4. 


(k) Approximate A; by applying the Midpoint rule with 
uniformly spaced nodes and n — 4. 


(D Approximate A, by applying Simpson's rule with uniformly 
spaced nodes and n — 4. 


(m) Which method gives the most accurate answer? 


the data from Exercise 31, Section 42. 


— 


the data from Exercise 32, Section 42. 


the data from Exercise 33, Section 42. 


— 


the data from Exercise 34, Section 42. 


the data from Exercise 35, Section 42. 


— 


the data from Exercise 36, Section 42. 


pà 


the data from Exercise 37, Section 42. 


the data from Exercise 38, Section 42. 


the data from Exercise 39, Section 42. 


the data from Exercise 40, Section 42. 


The second mean value theorem for integrals says that if f (x) and 
g(x) are continuous functions defined on [a, b], an interval over 
which g(x) does not change sign, then Ef f(x)g(x) dx = 

fE) p g(x) dx for some & satisfying a < & < b. (A proof can 
be found in [91].) In each of the following examples, show that 
the equation a F(x)g(x) dx = fE) E g(x) dx has no solution 
for £ in [a, b], a consequence of g(x) changing sign in [a, b]. The 


1080 


ENS reader will notice that f (£) 


E g(x) dx has no solution if f , g(x) dx is close to zero, the 


fraction is large, and | f (x)| is small. 
(a) f(x) 21-4 x3, g(x) 2 x*, [-1, 
(b) f(x) =xe™, g(x) = x? 


Xo Xi "d I Xs X6 
H i iia j } h-spaced 
ne | |. |. | 
= i TT H s n : h spaced 
b à Z4 £6 $28 uo S12 ^ 


FIGURE 43.1 Schematic relating T [A] to 
T[5], where TU i is the result of 

approximating hi f (x) dx with the 

Trapezoid rule when the stepsize is h 
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n? 


ES f f G0g(x) dx/ (c) f(x) = sinh x, g(x) = 2sinx + 4cos x, [0, 4] 
(d) f(x) =x? +2x +2, g(x) = e — he ?x [0, 3] 
(e) f(x) = V1 + 2cos? x, g(x) = 7x3 — 8x? + 3x 4 5, [-1, 1] 


=e, [0,8] 


Recursive Trapezoid Rule and Romberg Integration 


Recursive Trapezoid Rule 


Let T [A] be the value the Trapezoid rule gives for the integral n f (x) dx when ni: with 
stepsize h, so T[4 5] is the value the Trapezoid rule gives when used with stepsize ^. The 
schematic in Figure 43.1 helps visualize how some of the nodes used when computing T[À ] 
are nodes that were used when computing T [A]. 

In particular, we observe thatfork — 1,..., n — 1, the nodes z2; coincide with the nodes 
xz, and hence, we have f(zo4) = f(x), k = 1,...,n — 1. (In words, we might say that 
the interior nodes for 7 [A] are the even interior nodes for T[5].) Therefore, with stepsize 
h= ba we have T[h] = Aila + f5)/2-- Ya f (xx)], where fa = f (a) and f, = f (b). 
Then, with stepsize 5, we have 


h] hÍftfh,xs. h 
PECENE 
k= 


Since f (Zax) = f(x), k= 1,..., n — 1, we have == F Gx) = 
fore, can write 


n—1 
(E25 «Y ra 1 re) 
k=1 
n—1 


ia f (xg) and, there- 


n—i 
J (E34 Erat rea ») 


cc 


1 n 
; (rm +h Ysea) 


k=1 


n—1l 


ti Fes] D f Ea- ») 


fa T fb 


This is the recursive form of the Trapezoid rule. The value of T [2] can be obtained 
from the value of T [A] by evaluating f(x) at an additional n — 1 nodes rather than at an 
additional 2n + 1 nodes. Hence, this recursive form saves about 50% of the computational 
energy needed to halve the stepsize in the application of the Trapezoid rule. 


Romberg Integration 


Romberg integration consists of applying Richardson extrapolation of Section 42.2 to the 
Trapezoid rule, with the recursive Trapezoid rule being used to economize function eval- 
uations in the first column of a Richardson table. Since the first column of the resulting 


0.9610577565 
0.8491941620 
0.8200025601 
0.8126600517 
0.8108218586 
0.8103621518 


1 
TABLE 43.3 Romberg table for A = f 


0.151 

0.390 x 107! 
0.980 x 10 
0.245 x 10? 
0.613 x 10? 
0.153 x 10? 
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Richardson table would contain T[ho/r'~'],i = 1,..., we take r — 2 so that we can com- 
pute this first column via the recursive form of the Trapezoid rule. 

For an example, take the function f(x) = xe*/4/1 + x? so that the definite integral 
A [^ f (x) dx has the approximate value à = 0.810208902342828. With s = 2, A = 2, 
h = 1, and r = 2, Table 43.3 gives the result of Richardson extrapolation applied to the 
values computed for A by means of the Trapezoid rule. The values of s and A are verified 
at the conclusion of this section. 


0.8119062973 
0.8102720259 
0.8102125489 
0.8102091273 
0.8102089159 


0.8101630740 
0.8102085834 
0.8102088994 
0.8102089014 


0.8102093057 
0.8102089043 
0.8102089013 


0.8102089027 


0.8102089011 0.8102089010 


xe* dx 


o VIF x? 


with r = 5 =2,4 = 1 


The ith row of column 1 in Table 43.3 contains the Trapezoidal approximations 
T[1/2/7!], i = 1,.... Thus, the first invocation of the Trapezoid rule has h = 1 so that 
Xo = a and x, = b, with n = 1. The second and successive columns contain the Richardson 
extrapolates built from the Trapezoidal values in column 1. 

Table 43.4 contains |À — A;j|, the absolute value of the error in the i, j-entry in Table 
43.3. The first column contains the errors in Trapezoidal approximations to A, approxima- 
tions in which A is repeatedly halved for each iteration. Across each row we have the errors 
in successive Richardson extrapolates. Typically, the diagonal value at the end of the last 
row is accepted as the best approximation to the definite integral. Hence, a purely numeric 
implementation of Romberg integration would have as a stopping rule, the comparison of 
successive diagonal elements. 


0.170 x 10 

0.631 x 1074 0.458 x 107^ 

0.365 x 10? 0.319 x 1079 0.403 x 107° 

0.225 x 1076 0.294 x 1075 0.196 x 1075 0.357 x 107? 

0.136 x 1077 0.943 x 107? 0.104 x 1075 0.124 x 1075 0.134 x 1075 


TABLE 43.4 Absolute errors in the entries of Table 43.3 


This table of errors shows the effect of roundoff in the extrapolation process. As we 


saw in Section 42.2, there is a balance between the stepsize h and the ratio r. Romberg 
integration based on the iterative Trapezoid rule must have r — 2, so we cannot manipulate 
the interplay between h and r to our advantage. 
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Numeric Implementation of Romberg Integration 


The following steps sketch an implementation of Romberg integration that uses the iterated 
Trapezoid rule for generating the first column of the Richardson extrapolation table. Like 
Richardson extrapolation, the calculation proceeds by rows, with the diagonal element at 
the end of each row compared to the diagonal element of the preceding row. Computation 
is stopped by the diagonal stopping rule, which terminates the method when two successive 
diagonal elements are within a prescribed tolerance of each other. The complete Richardson 
table is printed upon termination of the calculations. In practice, just the diagonal element 
in the last row would be returned. 

The initial stepsize is taken as b — a and is halved for each succeeding Trapezoidal 
calculation, as required by the iterative Trapezoid rule. Hence r = 2, and since s = A = 2, 
Richardson extrapolation proceeds with r5*^^ = 27+% — 4k-!, 

The output is formatted in an array, or matrix. Hence, there are no zero indices. Since 
the Romberg table is computed by rows, at the end of row i the row index remains i, but 
the column index becomes j + 1 outside the second loop. Thus, when comparing diagonal 
elements, the column index must be shifted back by one to compensate for the increment to /. 


1. Input the parameters 


(a) f(x), the function to be integrated; 
(b) a,b, the bounds on the interval of integration; 
(c) £, the error tolerance in the stopping rule; 
(d) N, the maximum number of rows in the Richardson table. 
2. Declare A to be a matrix so that the Richardson table is stored as a matrix. The upper 
left corner of the table corresponds to A11. 
3. Compute 
(a) L=b-a 


L 
(b Aii = z (GF (a) + f) 
4. Fori from 2 to N, perform the following calculations. 


L 


(b Aj = jAiii + PD) f(a + Qk - P) 
k=1 


(c) For j from 2 to i, perform the following calculations. 
47 Ana Aag 
4j-1—] 
(ii) If |Aj—1,;-2 — Ai,j-1| < £, return the matrix A, otherwise, continue. 


If implemented with e = 1078, these steps yield, except for several minute roundoff 
differences, the contents of Table 43.3. Note the second column of Table 43.3. The entries are 
exactly those that would be computed by the composite Simpson's rule because Richardson 
extrapolation of the Trapezoid rule yields Simpson's rule. Below, we will indeed verify the 
identity 


HL 2r[j-TwWi) 4T [$] -T [h] 
| |- 2-1 7 3 


where S[h] is the value computed by the composite Simpson’s rule using stepsize h. 
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Simpson's Rule as Richardson Extrapolation of the Trapezoid Rule 


We next verify the claim that Richardson extrapolation applied to the Trapezoid rule yields 
Simpson's rule. As a consequence, we then have a proof that s = A = 2 for Romberg 
integration. (The Trapezoidal rule is O(/1?). One extrapolation of the Trapezoid rule yields 
Simpson's rule, for which we already know A — 2. Hence, we are justified in carrying out 
Richardson extrapolation with s = A = 2 when building the Romberg table.) 

To prove that ‘(47[4] — T[A]) = S| 4], write T[4] in terms of the iterated Trapezoid 


rule, so that we have 


1 ( E 
4T 
3 2 


where Xx, Z2k, Z2k-1, k = 1,. 


EXERCISES 43.2—Part A 


2T [h] 4- 2h 5 f (zox-i) — T [h] 


k=1 


T[A] ea reso] 


k=1 


fa Ta b V : J 
h (452 +5 ro) emY reno] 
k=1 


k=1 


` k=1 k=1 


h n—1l n 
d l + fot+2>> fox) F4 feal 


n—li n 
fa fo +2 DD Tea) + 3 feao] 
k=l k=l 


seg 


A1. This exercise examines the computational savings that the 
recursive Trapezoid rule contributes to Romberg integration. 
(a) In closed form, obtain N (i), the cumulative total for the 
number of function evaluations performed through i rows of a 
Romberg integration using the ordinary Trapezoid rule. 


(b) In closed form, obtain AG), the cumulative total for the 
number of function evaluations performed through 7 rows of a 
Romberg integration using the recursive Trapezoid rule. 

(c) Compare, by graph or table of values, N (i) with N (i), for 

10. 

. Where Simpson's rule is first considered in elementary calculus, 

some texts suggest successively doubling the number of points 
used in Simpson's rule and stopping when the digits no longer 


A3. 
A4. 


AS. 


change on the computing device being used. Show that this is an 
inefficient process by obtaining N (i), the cumulative total for the 
number of function evaluations performed through i steps of this 
process if the process started with n — 2. Compare to the results in 


Exercise Al. 


Use the Trapezoid rule with h = 1 to approximate A = h sin x dx. 


Use the Trapezoid rule with h = 1 to approximate A in Exercise 
A3, and then perform a Richardson extrapolation based on the 
values computed in Exercises A3 and 4. 

Use Simpson’s rule with h = 1 to approximate À in Exercise A3. 
Compare to the extrapolated value in Exercise A4. The results 
should agree. 
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EXERCISES 43.2- Part B 


B1. Starting with h = 1, obtain the first three rows of the Romberg 


Simpson’s rule to obtain the same accuracy as required in 
table that evaluates À in Exercise A3. 


part (a). 

For each function f (x) in Exercises B2-11: (e) Determine the actual number of function evaluations it would 
Us l take Simpson’s rule to approximate A to within the 

(a) Use Romberg integration with the diagonal element stopping- prescribed tolerance. 

rule to approximate A = ie f (x) dx with an error less than 


10-5 B2. f(x) 2(x -2)e7? B3. f(x) = /2-2x +x? 
x: - 9x? — 7x — 5 3x3 + 5x? — 9x +4 
(b) Verify that the answer in part (a) indeed satisfies the B4. f(x) = ——————____ B5. f(x) = = 
: : 4x? + Ax +2 54x 
prescribed tolerance requirement. 9x245 6 
5 Xx" gp ; 

(c) Determine the actual number of function evaluations needed B6. f(x) = i B7. f(x) 2 xsinx 

by the Romberg algorithm to obtain the answer in part (a). i 


: B8. f(x) = sin(cos x) B9. f(x) = In(x? + 2x + 2) 
(d) Use the error estimate for Simpson's rule (Table 43.2, Section 


43.1) to estimate how many function evaluations it would take B10. f(x) =In(cosx +coshx) B11. f(x) = sinh(sin x) 


Gauss—Legendre Quadrature 


Gauss—Legendre Quadrature by Polynomial Exactness 


Gauss quadrature rules are (n + 1)-point open formulas of the form 


B n 
[ vea 2 Daren 
= k=0 
where w(&) is a positive but fixed weight function; £j, k = 0,..., n, aren + 1 unevenly 
spaced nodes in the interval [o, 8]; and the nodal weights cx, k = 0,..., n, are appropriate 
constants. Such formulas are typically exact for polynomials of at least degree 2n + 1. 
When the weight function is w(€) = 1 and the interval [o, 8] is [—1, 1], the resulting 


formulas are called Gauss-Legendre quadratures. In fact, Table 43.5 lists several of the 
more common Gauss quadrature families. 


B 
w(é) o p Name f w(&) f (8) d£ 
1 
l -1 l Gauss-Legendre / f(&) dé 
-1 
1 ' fE) 
———— -1 1 Gauss-Chebyshev ——— dE 
/1-g FEET 
e * 0 oo Gauss-Laguerre [ e 5 f (E) dé 
0 


TABLE 43.5 Gauss quadrature formulas 


In this section we will explore Gauss—Legendre quadrature rules and leave the other 
methods for the exercises. We begin with the following examples. 


EXAMPLE 43.2 
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CasEn=1 Ifn = 1, the associated Gauss—Legendre quadrature rule 


l 
/ f(E) dE = cof (&) + cif (&)) 
=i 


contains four unknowns, namely, the two constants co and c, and the two nodes & and &. 
Requiring polynomial exactness of degree 2n + 1 = 2(1) + 1 = 3 provides four conditions 
for determining the four unknowns since a polynomial of degree three contains the four 
basis elements (1, £, £?, £?]. 

Imposing polynomial exactness for each of the polynomials £*, k = 0, . . . , 3, gives the 
equations and solution listed in Table 43.6, where the solution for which £y < & holds has 
been selected. The resulting n = 1 Gauss-Legendre quadrature rule is then I f§)dé = 


FOK + fC. 


1 
f 16722275 c9 —1 
=j 
1 
f £ dE = 0 = coo + cii cq =1 
=i 
1 
[ Euz} =o =- 
1 " 
| fap=o=atas — 8-3 


TABLE 43.6 Nodes and weights for 
Gauss-Legendre quadrature when n — 1 


For a test function, take F (£) = /3 — £ so that A; = HC — 4/2), the value of the definite 
integral 


1 
Ay =} J3=€de (43.8) 
-1 


is approximately 3.447715251. The n = 1 Gauss-Legendre quadrature formula gives 


1 ] 9 / A 
3 +++ /3 — E 2 3447874791 


with an error of 0.000159540. 

By way of comparison, the Left-end rule, with n = 2 to force function evaluation at 
two nodes, yields the approximation 2 4- V/3 = 3.732051, with an error of 0.284335557; 
the Trapezoid rule with n = 1 and two function evaluations gives 2 + /2 = 3.414213562, 
with an error of 0.033501689; and the Midpoint rule, with n = 2 to force function eval- 
uation at two nodes, yields the approximation avs + J/7) = 3.451967523, with error 
0.004252272. 

With the same number of function evaluations, Gauss-Legendre quadrature is signif- 


icantly more accurate than any of the closed formulas familiar from elementary calculus. 
4$ 


CasEn=2 Ifn = 2, the associated Gauss—Legendre quadrature rule 


1 
Í fE) dE = cof (&o) + c1 f (E1) + e» f (&2) 
-1 
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EXAMPLE 43.3 


contains six unknowns, namely, the three constants co, c;, and c» and the three nodes &p, £1, 
and £». Requiring polynomial exactness of degree 2n + 1 = 2(2) + 1 = 5 provides six 
conditions for determining the six unknowns since a polynomial of degree five contains 
the six basis elements (1, £, £?, £?, £^, £5}. Table 43.7 contains the six equations and their 
solution arising from imposing polynomial exactness for each of polynomials &*,k = 
0, ..., 5. The resulting n = 2 Gauss-Legendre quadrature rule is then 


[ fG)dé — 5f (-/3) -$/0) 3f (/2) (43.9) 


l 
[ l dE =2 = co +c te co = 3 
J-1 
l 
/ E dE = 0 = cof + 181 + 28 G=} 
1 
| c 
J E dE = $ = cof} + cié? + o5] €;—3 
= 
1 
3 3 3 3 3 
/ & dE = 0 = cof + ci; + c8; f= -/2 
-1 


1 
/ df= tcati tatan &=0 
1 


l = 
/ Bdé=0=a8+aetoe b= 
-1 


TABLE 43.7 Nodes and weights for Gauss-Legendre 
quadrature when n — 2 


Evaluating (43.8) with (43.9) gives 


NE H+ $43 + 3,/3- R = 3.447717777 


with an error of 0.25258 x 10~>. By way of comparison, the Left-end rule with n = 3 has four 
nodes but makes three function evaluations, yielding 5 (6 + 4/30 + 24/6) = 3.639156680, 
with an error of 0.191441429. The Trapezoid rule with n = 2 makes three function evalu- 
ations and yields 1 + /3 + + = 3.439157589, with an error of 0.008557662. The Mid- 
point rule with n = 3 has four nodes and three function evaluations, each midway be- 
tween consecutive nodes, yielding $(/33 + 34/3 + V21) = 3.449620171, with an error 
of 0.001904920. Finally, since n = 2 is an even integer, we can also apply Simpson’s rule, 
obtaining iQ + V2 +43) = 3.447472264, with an error of 0.000242986. 

Once again, with the same number of function evaluations, Gauss-Legendre quadrature 
is significantly more accurate than any of the closed methods familiar from elementary 


calculus. 4 


Case n=3 Ifn —3,the associated Gauss—Legendre quadrature rule 


l 
i f(&) d& = co f (&o) + cif (1) + e» f (&2) + c3 f (&3) (43.10) 
-] 


EXAMPLE 43.4 
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contains eight unknowns, namely, the four constants cy, k = 0,..., 3, and the four nodes 
&y, k =0,...,3. Requiring polynomial exactness of degree 2n + 1 = 2(3) + 1 = 7 pro- 
vides eight conditions for determining the eight unknowns since a polynomial of degree 
seven contains the eight basis elements £^, k = 0,..., 7. Table 43.8 contains the eight 
equations and their solution arising from imposing polynomial exactness for each of poly- 
nomials £^, k = 0,..., 7. Unfortunately, without the symmetry conditions £j,— —&3, £j = 
—&, co = €3, C1 = C2 and the ordering conditions 0 < & < £j the equations resist solution 
in exact arithmetic. 


1 
/ 1 dé = 2 = co + c1 + c2 + 65 co = 3 — x V30 
=i : 
1 
J & dE = 0 = co&o + ci&i + C282 + C383 ey z T 3% 30 
1 
l 
Et dE = 3 = cobi + ci? J-o£ +0387 c2 = 3 + 3 30 
=l 
l P 
&£ d£ =0 = cobs +a + ok + 038} a= i» 30 
aj : 
1 
ét dé = 2 = cg + akt o8] + o6 & = — 35 V 525 + 70/30 


& d£ = 0 = cofi + cit + oé + 038} & = — 4V 525 — 70/30 
6 dé = 2 = cotf + cif + of +o ^ &oi/525- 70/30 
1 
/ E d£ — 0 = cod + cié] +o +08 & = 1525 + 70430 
=1 


TABLE 43.8 Nodes and weights for Gauss—Legendre quadrature when n = 3 


This example calls attention to the difficulty of determining the nodes and nodal weights 
in exact form. Typically, these parameters are determined numerically in floating-point form 
and by more efficient techniques which we will illustrate for the case n = 4. 


Evaluating (43.8) with (43.10) and the contents of Table 43.8 gives 3.447715300, with an 
error of 0.484 x 1077. By way of comparison, the Left-end rule with n = 4, so that there 
are four function evaluations, gives 1 + t(/14 + 24/3 + /10) = 3.592009166, with an 
error of 0.144293914. The Trapezoid rule with n = 3 implements four function evaluations, 
yielding 1(6 + 24/30 + 4/6 + 3V2) = 3.443894535, with an error of 0.003820716. The 
Midpoint rule with n = 4 implements four function evaluations and approximates A, as 
1(/15 + /13 + VTI + 3) = 3.448789853, with an error of 0.001074602. 

Once again, with the same number of function evaluations, Gauss—Legendre quadrature 
is significantly more accurate than comparable closed methods familiar from elementary 
calculus. $ 
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Gauss—Legendre Quadrature by Legendre Polynomials 


The following theorem summarizes the creation of Gauss—Legendre quadrature formulas 
via the Legendre polynomials. (See [49], [16], or [60] for a proof.) 


THEOREM 43.1 


eek =] 0 n, are the n + 1 zeros of P,,+)(x), the Legendre polynomial of 
degree n + 1. 


2. L(x) = [Tio 49 E/E), k =0,...,n,are the Lagrange interpolating 
polynomials for éz, k = 0, ... n. 

3. = T Exo dx k-0 57 n 

=> 

1. The quadrature formula T. f(&) d£ = Yo ce f (&) is polynomial-exact of at 
least degree 2n + 1. 

2. The error of the approximation is given by 

22135 ((n + DN Qn + 3)? 


(2n4-2) 
(n + 2)4((2n + 3)? f WB Shay el 


We will now illustrate the construction of Gauss—Legendre quadrature formulas via this 
theorem. In the next part of the section, we will extend these Gauss—Legendre quadrature 
formulas to integrals of the form f : g(x) dx. In the final part of the section, we will examine 
the applicability of the error estimate given by this theorem and give an alternate form of 
the error estimate for integrals over the interval [a, b]. 


Case n=1 Earlier we used polynomial exactness to construct the n = 1 Gauss—Legendre 
quadrature formula whose nodes and weights are given in Table 43.6. The zeros of the 
Legendre polynomial P»(x) = 3x? — 1 are easily found to be £5, in agreement with £o 
and é; of Table 43.6. The Lagrange interpolating polynomials are then Lo = 1 — i 3x and 
Lı = 4 + 13x, so the nodal weights are cy = i, Lo(x)dx =1= i Li(x)dx 2 c, 
again in agreement with Table 43.6. 


CasEn-2 Earlier we used polynomial exactness to construct the n = 2 Gauss—Legendre 
quadrature formula for which the nodes and weights are given in Table 43.7. The zeros of 
the Legendre polynomial P3(x) — 3x? — 3x are easily found to be 0, Li , in agreement 
with Table 43.7. For these nodes, the Lagrange interpolating polynomials L;(x) and the 


weights c= 15 L(x) dx are 


-1 
1 

asf (1—3x32)ax 2 $ 
T 

a= | = (5x + V15)dx = § 
E 


in agreement with Table 43.7. 
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CasEn-3 Earlier we used polynomial exactness to construct the n = 3 Gauss—Legendre 
quadrature formula for which the nodes and weights are given in Table "a 8. In agreement 


with Table 43.8, the zeros of the Legendre polynomial P4(x) — 


35, 
354 _ Dy? 743 are found 


to be +4 35V 925 d 704/30 by noting that the equation to be slo] is anirai i in x? 
The Lagrange interpolating polynomials for these nodes are 


n -&[x SS — 80) + {ae EP. [as - 959-12] 
L- sla (4+ /30) — 4 GR +n] +2 &|-02 - 5/304 12] 
n= 564+ v5) - ERE 0 | e [0 - 30 2] 
1-8 [7 50) + CR - 0] e [e - V+] 


and tedious calculation (or appropriate software) will show that c, = f Ly(x)dx,k = 


3, in agreement with Table 43.8. 


Case n=4 Finally, we will obtain the nodes for the n = 4 Gauss-Legendre quadrature 


formula by computing ék, k = 0,..., 
Bx, as 0, +0.5384693101, +0.9061798459. The Lagrange interpolating 


63.5 _. 22943 
gy 4% + 


polynomials for these nodes are 


Lo = 1.146232575x* 


Lı = —3.246232572x* 
Ly = 3x4 — Bx? +1 
L3 = —3.246232572x* 
L4 = 1.14623 


and the nodal weights are 


— 1.038692852x° 
+ 1.747996613x° 


4, the zeros of the Legendre polynomial Ps(x) 


— 0.332349219x + 0.301168159x 
+ 2.665682549x? — 1.435388244x 


— 1.747996614x? + 2.665682548x? + 1.435388242x 
2570x* + 1.038692854x? 


— 0.3323492143x? — 0.3011681598x 


l 1 
co =} Lo(x) dx = 0.2369268858 = / Lax) dx = c4 
-1 


1 

C] =} L\(x) dx 
-1 
1 

a= f L3(x) dx 
= 


1 
0.4786286687 — J L3(x)dx = 63 
=i 


] = 

For the Gauss—Legendre quadrature formula Fa f(&)d& = ym ck f (Ex), Table 43.9 
contains the data that confirms the polynomial exactness of degree 2n +1 — 2x 4-- 1 = 9. 
After accounting for a modest amount of roundoff error from the numeric calculations, the 
table confirms the claim about polynomial exactness. 


Integration on |a, b] 


To extend the Gauss-Legendre quadrature rules to integrals of the form 


(43.11) 


b 
/ g(x) dx 
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4 


1 k " 1 " 4 : 
[sas Tat fe Las 


i=0 

1 
[ sae = 

-1 

1 1 
f $470 0 [ sae = 
E 1 

1 
f| ?«- 

-1 


l 
1 l 
J EdE =0 —0.3 x 107? EdE =? 
=| 1 


] 
J ¿td = 
-1 


TABLE 43.9 Confirmation of polynomial exactness of degree 2n + 1=2x4+1=9 
for Gauss-Legendre quadrature when n — 4 


N 


l 
1.999999999 i &£ d£ =0 —0.4 x 107? 
-1 


0.2857142861 


SIN 


ZI 


l 
0.6666666665 Í & d£ =0 —0.3 x 107? 


ir 


l 
0.4 Í EdE =0 —0.27 x 107? 
-i 


we reason as follows. The formula 


1 n 
/ f(é)dé = ». wy f (Ex) 
=l k=0 
is already available, but we want to evaluate (43.11), so linearly map the intervala < x < b 
to the interval —1 < € < 1 by means of the transformation £(x) = eer — 1, for which the 
inverse transformation is 


B — 
LE 4T) (43.12) 


x(€é)=at 
Define the transformed nodes 
b—a 
Xk = x(E&) — a + — ék t ]) B0... n 


and the function f(€) = g(x(&)) so that f(&) = g(x(&)) = gGu). k = 0,..., n. If we 
now start with the integral (43.11) and change of variables from x to £ by means of (43.12). 


we obtain 
b—a [! b—a 
5 alat — (E+1)] dé 


But g(x(&)) is f (E), so we have 


9 b-— | b-a f . 
Í g(x) dx = — / g(x(5$)) d$ = — - / f(&) dé 
a 2 = 2 = 


n n 


b—a b—a 
E > ce f (&) = 5 So ceg (an) 


k=0 k=0 


a result illustrated in the following example. 


The value of the definite integral A» = L^ g(x) dx, where g(x) = cosh v1 + x 4-2x2, is 
approximately à> = 45.21287573. The transformation (43.12) becomes x = 3E + L. For 
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the casen = 4, the nodes &,k =0,..., 4, the transformed nodes x;, and the nodal weights 
c, are listed in Table 43.10. 


k & xk = m Ck 

2 
0 —0.9061798459 —1.765449615 0.2369268858 
1 —0.5384693101 —0.8461732750 0.4786286687 
2 0 1 0.5688888891 
3 0.5384693101 1.846173275 0.4786286699 
4 0.9061798459 2.765449615 0.2369268851 


TABLE 43.10 Example 43.5: Nodes and weights for Gauss-Legendre 
quadrature applied to A? when n = 4 


The n — 4 Gauss-Legendre quadrature formula 


d bea 
J g(x) dx = — 5 Ck g (Xk) 
a ^^ k-0 
will give 45.21154144, for which the absolute value of the error is 0.00133429. The n — 4 
Gauss—Legendre quadrature formula evaluates g(x) at n + 1 = 5 points, as does Simpson's 
rule with n = 4. The error made by Simpson's rule with this many function evaluations is 
1.62638469, an error that is more than 1200 times as large. $ 


ksd 


Error Analysis 


In this final part of the section, we will examine how the actual errors made in our examples 
of Gauss-Legendre quadrature compare with theoretical estimates. Table 43.11 summarizes 
the two forms of Gauss-Legendre quadrature we have just seen and error estimates for each. 


Gauss-Legendre Quadrature Error-Estimate Coefficient Error Estimate 


i fE)dE = 
-l 


2743 ((n + 2))* 2n + 3) 


p — (2n4-2) u 
an) = —n 4 2 (2n 4-3)» Baa fe) aes 
n ab n 2 
co — Xe) | dx . -— 
Yo ceg (an) on) = Ja | m 7 5T ] E; = o3g "+? (n) a<n<b 
2n +2)! 


Error-estimate formulas for Gauss—Legendre quadrature 


In its third column, Table 43.12 lists the actual error found when approximating A, 
with the Gauss—Legendre quadrature of order n. The fourth column of Table 43.12 shows 
the common values for o; (n) and o» (n), the coefficients of the derivatives F "^? (5) in the 
error estimates E; and E». For Aj, either of the estimates in Table 43.11 can be applied 
since here, [a, b] — [—1, 1] and F and g can be identified with each other. The fifth column 
of Table 43.12 lists the maximum of the absolute value of FO"*? (€). In each case, the 
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n 2n+2 Actual Error o1(n) = 02(n) max|F@"+?)| Error Bound 
1 4 0.160 x 10-3 d EN 0.614 x 10? 
2 6 0.253 x 105 aa 2v 0.208 x 107^ 
3 8 0.484 x 1077 — 135,135/2 0.840 x 10-5 


TABLE 43.12 Errors, and error bounds, for approximating A, by Gauss—Legendre quadratures of order 
n=1,2,3 


maximum occurs at the endpoint € = 1. The sixth column lists the estimate of error given 
by the theoretical error bounds E; or E» listed in Table 43.11. For each n, the actual error 
is smaller than the upper bound predicted by theory. However, the theoretical upper bounds 
are within an order of magnitude of the actual error, so theory proves useful in gauging 
errors in Gauss-Legendre quadratures. 

In Example 43.5, a fourth-order Gauss-Legendre quadrature approximated the defi- 
nite integral A» as 45.21154144, with an error of 0.00133429. The nodes & and xg, k = 
0, ..., 4, are given in Table 43.10. Using the nodes éz, o5 (4) = 0.808 x 107°, in agreement 
with the value of o; (4). However, the error estimate E> must be used, so 02(4) is evaluated 
with the nodes xz, giving the value 0.1926 x 107^. The maximum of |g | occurs at x = 3 
and has the value 1631.77, so, as an upper bound for the error, theory predicts 0.0314321, 
which is slightly larger than the actual error. 


EXERCISES 43.3 


1. Use the 2-point (n = 1) Gauss-Legendre quadrature formula to 


3. Repeat Exercise 2 for 3-point (n — 2) Gauss-Legendre quadrature. 
approximate A = fj cos x dx and determine the actual error made. 4. Repeat Exercise 2 for 4-point (n = 3) Gauss—Legendre quadrature. 
5 
6 


Compare to the error made when A is approximated with the 
Left-end, Trapezoid, and Midpoint rules, each using exactly two 
function evaluations. 


. Repeat Exercise 2 for 5-point (n = 4) Gauss—Legendre quadrature. 


. Obtain the nodes & and weights c, for Gauss—Legendre quadrature 


for the case n — 5. 
For Exercises 2-5, select a function f; (x) from the following list. 


7. Repeat Exercise 6 for the case n — 6. 
fix) = (x + 2)e2 fo(x) = xsinx 8. Repeat Exercise 6 for the case n = 7. 
bi) e «f at fx (x) = sin(cos x) 9. Repeat Exercise 6 for the case n — 8. 
9 —Tx —5 10. Repeat Exercise 6 for the case n = 9. 
Ae) = ae ae fs(x) = InG? + 2x + 2) 11. Repeat Exercise 6 for the case n = 10. 
3x? + 5x? — Ox +4 In Exercises 12-16: 
fax) = ha = fo(x) = In(cos x + cosh x) "m 
54x (a) Approximate A — hi ~ g(x) dx using (n + 1)-point 
9x? + 5x — 6 Gauss-Legendre quadrature, with n — 2, 3, 4; in each case, 
A(x) = — z fio(x) = sinh(sin x) determine the actual error made. 
"E T" . - (b) Approximate A using Simpson's rule with n = 4, and compare 
. For the function selected from the given list: the actual error with part (a). 
(a) Ó€— o = (ar E quadrature to -— S8 4. Ge? + ds — d er 9x? — Ox +4 
a = s .g(x)- . g(x) = ———— 
Rp Fa ees Os 3 8x2 — 9x +7 g 8x +5 
(b) Apply the appropriate error estimate from Table 43.11. Ag? 4-22 —9 233 4-932 — Si + 1 
14. g(x) = 15. g(x) 


(c) Compare the predicted error to the actual error. 


5x3 + 7x2 — 8x +3 7550 9x3 + 5x2 +x 43 


N 
bak 


m 3x 4-1 

. g(x) = L———— 

d 2x? + 8x 

. For the case n = 1, obtain the nodes & and the weights c, for 


(n + 1)-point Gauss—Chebyshev quadrature I5 m di 
2 i-o Ck f (Éx) using 
(a) polynomial exactness. 


(b) Chebyshev polynomials 7; (&) for the nodes and Lagrange 
interpolating polynomials for the weights. 


. Repeat Exercise 17 for the case n = 2. 
. Repeat Exercise 17 for the case n = 3. 
. Approximate A — a eë d£&/A/1 — &* with (n + 1)-point 


Gauss-Chebyshev quadrature, with n = 1, 2, 3. In each case, 
obtain the actual error made. How many function evaluations would 
it take to achieve the accuracy of the n = 3 Gauss-Chebyshev 
quadrature if Romberg integration were used? 


. To find a 2-point (n = 1) Gauss quadrature of the form 


F w(x)f(x)dx = Ed Ck f (Xx), where w(x) = x, 
[a, b] = [0, 4]: 


(a) Using the inner product (u, v) — n w(x)u(x)v(x) dx, apply 
the Gram-Schmidt process to (1, x, x?) to obtain po = 1, 
pi (x). and p(x), polynomials orthogonal with respect to the 
given inner product. 
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(b) Obtain the zeros of p»(x) as the nodes x;. 


(c) Obtain L(x), k = 0, 1, the Lagrange interpolating 
polynomials for the nodes xo, x. 


(d) Obtain the weights c} = [n w(x)Li (x) dx. 
22. Repeat Exercise 21 for w(x) = e", [a, b] = [0, 2]. 
In Exercises 23-26: 
(a) Apply the Gauss quadrature of Exercise 21 to approximate the 
, " : 
integral fj /x f (x) dx. 
(b) Determine the actual error made by this approximation. 
23. f(x) 2 xe'* 24. f(x) = 3 sinx —4cosx 
x? +3x? — 4x +6 
8x? + 11x +12 


In Exercises 27-30: 


25. f(x) = 26. f(x) = 2e* — sin(sin x) 


(a) Apply the Gauss quadrature of Exercise 22 to approximate the 


integral f» e* f (x) dx. 
(b) Determine the actual error made by this approximation. 
27. f(x) 2 sinxtanhx 28. f(x) = ln(x? + 2e?) 
29. f(x) = e^ — sech x 30. f(x) = /1 + In(x + cosh x) 


Adaptive Quadrature 


Motivation 


Suppose Simpson's rule requires n + 1 points to evaluate the integral A = E f(x)dx 

to an accuracy of e. It may well be that in one portion of the interval [a, b] the function 

f (x) varies more rapidly than in another, so that the number of function evaluations is 

actually being determined by only a small part of [a, b]. If so, it might be more efficient to 

integrate over each subsection of [a, b], each time using just enough points appropriate for 

that subsection. Perhaps the total number of function evaluations can thereby be reduced. 
By way of illustration, consider the function f(x) = cosh V1 + x + 2x? so that 


3 
A= J f (x) dx = 45.21287573 


Using Simpson's rule to approximate A with an error no greater than 10~* takes 51 function 
evaluations because with n — 48, Simpson's rule gives an error of 1.08 x 1074 and, with 
n = 50, it gives A to within 0.9 x 1077. There are 51 function evaluations because the 
nodes are indexed xz, k =0,..., 50. 

Suppose we split the interval [—2, 3] exactly in half, forming the two subintervals 
[—2, 1] and [4, 3], and then integrate separately over the two subintervals, permitting an 
error of at most £ = 0.5 x 107* on each subinterval. On each subinterval we have the 
integrals ' 

1/2 3 
A, = f(x)dx = 6.594312496 and A> = f (x) dx = 38.61856323 


=) 1/2 
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It takes 19 (n = 18) function evaluations to approximate A, to within 5 = 0.5 x 10~* 
and 31 (n = 15) function evaluations for A2. Hence, a total of 19 + 31 — 1 = 49 function 
evaluations are needed with the interval-splitting technique. (Since the two subintervals are 
contiguous, the function need be computed at the midpoint of [—2, 3] just once, not twice.) 
This is a slight savings over the original tally of 51, but the intent here is merely to provide 
a motivation for the interval splitting that constitutes the adaptive quadrature strategy. 


Error- Test Mechanism 


A key ingredient of an adaptive scheme is the error-test mechanism. In Section 4.1, in the 
context of numeric solutions of differential equations, we derived the error-test mechanism 


h ; 
h Yapprox (3) e Yapprox (A) 
Yexact — Yapprox 2 = 2 —]1 


valid if the error in Yapprox 18 O(A^). Thus, the error in the more accurate approximation (i.e. 
the one made with stepsize 2) is measured by the difference between the more accurate ^- 
approximation and the less-accurate h-approximation, all divided by 2^ — 1. This very cal- 
culation was reviewed in Section 42.2 in the context of Richardson extrapolation. 

Since Simpson's composite rule is O(h*), the factor in the denominator of the error-test 
estimate would be 2* — 1 — 15. 

We will show how the interval-splitting strategy is coupled with this error-test expres- 
sion to produce an adaptive, or self-directed, numeric integration scheme. 


Naive Implementation of Adaptive Quadrature 


We next sketch a naive implementation of an adaptive quadrature scheme based on Simp- 
son's rule. Since its purpose is merely to illustrate the strategy, no attempt is made to min- 
imize the number of function evaluations. For the moment, we ignore the efficiencies that 
would accrue if we saved all function evaluations that get recomputed during the execution 
of our algorithm. 

Toevaluate the definite integral A — I f (x) dx, weapply Simpson's rule with stepsize 
h = b — a and again with stepsize ^. The first computation is done by invoking Simpson’s 
rule with n — 2, the second, with n — 4. As a consequence, we have two estimates of A, 
from which the error in the more accurate approximation can be determined by dividing the 
difference by 15. If the error is small enough, we accept the more accurate ^-approximation 
and the computation is finished. | 

If the error is too large, the process is repeated on the interval [a, ath), with the interval 
, b] set aside in a last-in, first-out stack, for processing later. If the numeric approxima- 
tion for the left-hand subinterval is acceptable, its value is stored and the process repeated 
on the right-hand subinterval. The accuracy demanded of any subinterval is proportional to 
the ratio of the length of the subinterval to the length of the original interval. If the overall 
tolerance for A is £, then the permitted error in any subinterval [@, £] is £ times the ratio of 
the length of [o, £] to the length of [a, b]. 

Table 43.13 summarizes for 


1 
A= Í V3 — x dx = 3.447715250169 
-1 


L 
m 


an adaptive quadrature based on Simpson's rule, in whiche = 10 5. The adaptive integration 
yielded the answer 3.447715248, whose error is 0.2 x 107? < e. 
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k Present Interval Present Stack P/F k Present Interval Present Stack P/F 
l (=, 1] [] F 10 [0, +] [5.1] F 
2 [-1, 0] [0, 1] F 11 [0, 1] [5.1], [7 4] P 
3 [-1, -i] [0, 1], [-2. 0] F 12 [5.43] 3.0 P 
4 [-1, -£] [0, 1], [25, 01, [-2. -3] P 13 [3.1] [] F 
5 [-2, -i] [0, 1], [—1. 0] P 14 [5,3] [3, 1] P 
6 [-1.0] [0, 1] F 15 [3,1] [] F 
7 [-4,-4] [0, 1], [—1. 0] p 16 I$. g] Ls. !] P 
8 [-i.0] [0, 1] P 17 [5 1] [] P 
9 [0, 1] [] s 


TABLE 43.13 The dynamic stack of an adaptive Simpson's rule quadrature applied to A = f 1v 3—xdx 


The left-hand column indexes the "cycles" executed by the code. The second column 
lists the “active interval,” the interval over which integration is presently taking place. The 
third column lists the contents of the stack, the pile of subintervals over which integration 
has yet to take place. The fourth column lists the outcome of the error test applied to the 
integration on the "active interval." Where it lists P (Pass), the integration was accurate 
enough, and no further splitting of that interval need take place. Where it lists F (Fail), the 
integration was not accurate enough, and the "active integral" must be split in half, with 
the left-hand portion becoming the next "active interval" and the right-hand portion being 
added to the stack. 

Taking the computation from the start, we begin with [—1, 1] as the active, or present, 
interval. Simpson's rule is applied to this interval with h = 2 and ^ = 1. As seen from 
Table 43.13, this first integration is not accurate enough, so the interval is split into the 
subintervals [—1, 0] and [0, 1]. 

In cycle 2, the active interval is [—1, 0] and the interval [0, 1] is placed on the stack. 
Again, integration over the active interval is done twice, with n = 2, 4, respectively, in Simp- 
son's rule. The outcome of the integrations is error-tested, and again, the integration over 
the active interval is not accurate enough. Hence, the active interval is split again, this time 
into the new active interval [— 1, -i] and the interval [-3, 0], which is placed on the stack. 

In cycle 3, the active integral is [—1, —+] and integration over it is performed twice, 
with n = 2, 4, respectively, in Simpson’s rule. The outcome of the two integrations is error- 
tested, and again, the error is too large. Once again, the active interval is split, this time into 
the new active interval [—1, -i] and the interval [-3, -jl which is placed on the stack. 

In cycle 4, the active integral is [—1, -il and integration over it is performed twice, 
with n — 2,4, respectively, in Simpson's rule. The outcome of the two integrations is 
passed to the error-test, and finally, the error is deemed small enough. The n = 4 value 
produced by Simpson's rule is accepted as the value of the integral over the active interval, 
and this number is added to an accumulator X that was initialized to O at the very start of the 
computation. No new subinterval is added to the stack. In fact, the last subinterval added to 
the stack at the end of cycle 3 is now removed from the stack and becomes the new active 
interval for cycle 5. 
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We leave it to the reader to continue this exposition, cycle-by-cycle. Instead, we turn 
our attention to some final aspects of the logic leading to Table 43.13. 


1. Each time integration over a subinterval is deemed accurate enough for that value to 
be “kept,” it is added to the accumulator X. 


2. Thecomputation ends when integration over the present interval is accepted as accurate 
and the stack is empty. Table 43.13 shows the stack is empty after cycles 8, 12, 14, and 
16. However, the integrations in cycles 9, 13, and 15 do not pass the error test, so the 
integration does not terminate. Only after cycle 16 does the next integration pass the 
error test, and that is when the integration terminates. 


3. When the integration process ends, the value accumulated in X is the desired approxi- 
mation of A. 


4. To program a “split” of the active interval [o, 8], compute its midpoint C = at? and 
form the right-hand subinterval [C, £] before forming the left-hand subinterval la. C]. 
If 8 were overwritten by C first, the subinterval [C, 8] would be unavailable. 


Minimizing Function Evaluations 


It is highly inefficient to invoke a Simpson procedure twice for each cycle and to invoke 
Simpson's rule "fresh" for each subinterval. A little thought shows that repeated calls to 
Simpson's rule requires recalculating function values. If we can determine where these 
function values are being used, and can determine a way to store them, the number of 
function evaluations can be dramatically reduced. 

In the example used to generate Table 43.13, for the two initial integrations, the active 
interval was [—1, 1], so when Simpson's rule was applied with n = 2, f (x) was evaluated 
at the three nodes x = —1, 0, I. For that same interval, whet ponpsan S rule was applied 
with n = 4, f (x) was eval aie at the five nodes x = —1, -i. 0, 4 z» |. However, only two 


of these nodes, namely, x = + bi, are new nodes. Hence, if we had stored the values of f (x) 
at the first three nodes initially we would have needed to evaluate f(x) at just two more 
nodes to complete the first cycle. The first cycle requires just five function evaluations. 

The integrations in the first cycle were not accurate enough, so the initial interval 
was split into the two subintervals, [—1, 0] and [0, 1]. Two new integrations were then 
performed in the new active interval, [—1,0]. The n = 2 application of Simpson’s rule 
required evaluating f(x) at the three nodes x = —1, —1, 0. Had we stored all function 
values computed in cycle 1, we could have obtained this new Simpson’s rule approximation 
without computing new function values. 

The n = 4 application of Simpson’s rule required evaluating f(x) at the five nodes 

x ee, 3-1, — z, 0. However, only two of these five nodes—namely, x = =- 4 
are new. It [es Ti tw new function evaluations to complete the integrations in cycle 2. 

A similar analysis shows that after cycle 1 (which requires five function evaluations), 
all subsequent cycles can be completed with just two more function evaluations each. Thus, 
the 17 cycles we executed should have taken just 5+2 x 16 = 37 function evaluations. Had 
we used Simpson's rule with n = 36, we would have expended the equivalent computational 
energy and approximated A with an error of —0.3 x 10-75, 50% more than the adaptive 
version’s 0.2 x 1078. 


However, for the function f(x) = -+ + +; 


z E , the integral 


A= / . f(x) dx = 7.538290891 
1/10 
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would require 27 cycles, hence 5+2 x 26 = 57 points, to obtain A to within an error of only 
107^. Direct invocation of Simpson's rule with n = 56 (and hence 57 function evaluations) 
yields an answer with an error of 0.008631295, considerably worse than the value obtained 
by the adaptive version of Simpson's rule. In fact, to obtain a comparable accuracy with 
a uniform Simpson's rule, we would need 205 function evaluations since the error with 
Simpson's rule and n = 202 is 0.00102 while the error made with n = 204 is 0.0000985. 


1. In the computing language of your choice, develop a procedure (or 
subroutine) that implements adaptive quadrature based on 
Simpson's rule. Have your procedure return the value of a definite 
integral and enough information from which to determine the 
number of function evaluations executed. 


In Exercises 2-11: 
(a) Use an adaptive quadrature program to approximate 
13 > 

A = f`, f (x) dx with an error no worse than 1075. 

(b) Determine the number of function evaluations it took to obtain 
this approximation. 

(c) Determine the accuracy that would be achieved using 
Simpson's rule with the same number of equispaced function 


. 9x? -7x —5 . 3x3 + 5x? —9x +4 
4. f [f E PECWON ECKE 5. f x) = 
4x? -- Ax +2 5+x 
9x? + 5x — 6 
6. f(x) = ULL 7. f(x) =xsinx 
p= 


8. f(x) =sin(cosx) 9. f(x) = ln(x? + 2x + 2) 
10. f(x) =In(cosx+coshx) 11. f(x) = sinh(sin x) 


In Exercises 12-15: 


(a) Use the Trapezoid rule in an adaptive fashion to approximate, 
with an error no worse than 1077, each of the following 
integrals. Ignore concerns of efficiency; instead, concentrate on 
mastering the flow of the adaptive algorithm and the role of the 
error test. (If T [A] is the output of the Trapezoid rule with 


evaluations. 


(d) Determine the actual number of function evaluations that 


stepsize h, then the error in T [A] is approximately 
&T[A] — T[2A].) 


Simpson's rule would need to approximate A with an error no (b) Repeat the calculations with the Left-end rule where, if L[A] is 


worse than 10-6. 


(e) Use the results of Exercise Al(b), Section 43.2, to determine 


the output of the Left-end rule with stepsize h, then the error in 
L{h] is approximately L[h] — L[2h]. 


the number of function evaluations Romberg integration, 12. i xe*dx 13. " xd 


implemented with the recursive Trapezoid rule, needs for 
approximating A with an error no worse than 10 5. 


3. f(x) = /2-2x +x? 


2. f(x) = (x + Del- 


^5 zd ue 
14. f e^ cosxdx 15. fj xe* sinx dx 


Iterated Integrals 


The Double Integral 


As an example of a multiple integral, the double integral is typically introduced in the 
multivariable calculus course by a discussion of volume under a surface. In particular, if 
z = f(x, y) is a surface defined over a region R in the xy-plane, the volume of the region 
bounded by the surface and the region R is said to be given by 


M-1N-1 
yt. 2, 2 f On, Yn) AXn Aym (43.13) 
m=0 n= 


a double limit of a double sum, provided appropriate care is taken with the definitions of 
the grid points (xn, Ym) and the internodal distances Ax, and Aym. The number determined 
by this expression is written as ffe f(x, y) dA and is called the double integral. 
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EXAMPLE 43.6 
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FIGURE 43.2 The surface determined 
by f(x, y) = x?y? in Example 43.6 


We next demonstrate how we might implement the definition in (43.13). In Figure 43.2, the 
surface determined by f(x, y) = x?y? is graphed over the region R, the square defined 
by —1 < x, y x 1. Figure 43.3 contains a schematic of a rectangular grid constructed on 
R. Let there be N spaces in the x-direction and M spaces in the y-direction. This gives an 


x-spacing of dx — ae = nou = z and a y-spacing of dy Ay DL Z. Thus, 
the nodes in the grid have coordinates (x,, Ym) with 
2 2 
dc EPA An -—O,1,....N ym = —1 rmi m=0,1,...,M 
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FIGURE 43.3 Example 43.6: A FIGURE 43.4 Example 43.6: A representation 
schematic of the grid over which of the discretized volume bounded by the 
f(x, y) = x? y? is to be evaluated surface f(x, y) = x2y? and the plane z = 0 


Figure 43.4 shows a collection of rectangular parallelepipeds (blocks) approximating 
the volume under the surface. At each node we evaluate the height of the surface and 
then construct a block of that height. For example, if (1, 1) is a node, the height of the 
corresponding block would be f(1, 1) = 1? x 1? = 1. We compute the volume of each 
such block and sum to get an approximation to the volume under the surface. 

An approximation of the volume under the surface is 


M-1N-1 5 2 " ly : 
1+n— l+m— 2 
ELI ") ( nr) NM 


and in the limit, as the number of blocks increases without bound and the area of their bases 
decreases, this double sum tends to the limiting value 3. We therefore define the volume 


under this function and above the region R to be the number s. $ 


The Iterated Double Integral 


For continuous functions f(x, y), the double integral can be evaluated by either of the 
iterated integrals 


b yix) d x2(y) 
/ / f(x, y)dydx or Í / f(x, y) dx dy 
a yix) c Jx) 


where each integral sign represents an integration with respect to one variable. For the 
function of Example 43.6, the two possible iterated double integrals and their evaluations 


FIGURE 43.5 The region R bounded by 
; = x? (solid) and y; = x? (dashed) 
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are 


1 1 1 1 1 2) 4 

J / x?y? dy dx =f x J y?’ dy | dx = / x? (5 dx —-— 
fw o =] E = 3 9 

1 pl | i 1 1 5 4 
i J x?y? dx dy =f y^ Í x*dx|dy = / y? (5) dy =- 
da a zn : "ud M 


Curvep BouNpanmrzes The region R, bounded by the curves y; = x? and y; = x?, and 
shown in Figure 43.5 with y; as the solid curve and yz as the dashed, has curved boundaries. 
The iterated integrals representing the volume bounded by this region and the function 
f (x, y) are 


1 px? pi 1 : x^ 1 : x8 _ xl! 1 
NI xy dydx= Í x* / y! dy ax= [ x? | ——— dee (43.14a) 
o Je h " 5 3 108 


1/3 


js 2.2 l 2 a 2 i 3 df y — yi? 1 
i} x^y* dx dy =f y* f x*dx|dy- / y* (— dy = —— (43.14b) 
0 J Jy 0 Jy 0 3 108 


In evaluating the iterated double integral, the inner integral is computed first. For example, in 
evaluating (43.14a), the inner integral f^ y? dy determines a function g(x) = į (x8 — x!!), 
which is then integrated in the remaining outer integral. 


Numeric Evaluation of Iterated Integrals 


Numeric evaluation of the iterated double integral takes its cue from the analytical evaluation 
just described. For example, in (43.14a), the inner integral determines g(x). For each fixed 
value x = X , the inner integral can be evaluated numerically, returning the value g(t). In 
a numeric scheme for evaluating the outer integral, the integrand must be a function that 
returns the numeric value of g. A naive integration scheme would use a simple integrator 
such as Simpson's rule or the Trapezoid rule to evaluate g(X) — i e y? dy. 

For example, evaluating the outer integral with Simpson's rule and n — 10 requires 
that g(x) be evaluated at 11 points. At each of these 11 points, a numeric integration 
must be performed. Suppose each of these integrations is again done with Simpson's rule 
and n — 10, so that each requires 11 function evaluations. The total number of function 
evaluations will then be (n + 1? = (10+ 1)? = 121. 

Were this scheme to be implemented for (43.142), the integral would be approximated 
by 0.0091485179, with an error of 0.00011. Unfortunately, this naive strategy relinquishes 
all error control and is not viable for more demanding applications. 


Error Control 


The Romberg integration scheme in Section 43.2 can be modified to accept a function of two 
variables as integrand and returns, from the diagonal of the Romberg table, the single value 
that passes a prescribed tolerance test. Suppose this scheme is captured in a subroutine 
whose call is of the form Inner-Romberg( f (£, y), y1(X), y2(X), £) and that returns the 
value of g (£), computed to within a tolerance of e. 

Suppose another subroutine implements the Romberg integration scheme for a func- 
tion of a single variable, again returning a single value satisfying a prescribed tolerance. 
Suppose, then, this integration is implemented with a subroutine whose call is of the form 
Romberg(A(x), a, b, €) and that returns the value of J , h(x) dx to a tolerance of e. 
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The iterated integral (43.142) could therefore be evaluated with code that implemented 
the function calls implied by 


Romberg(Inner-Romberg( f (£, y), y1(€). y2(X), £), a, b, £) 


A scheme such as this is implemented in the corresponding Maple worksheet. With £ = 
1074, the scheme returns a value of 0.009259126807, with an error of 0.132452 x 1075, 


which is well within the prescribed tolerance of 10~*. 

Alternatively, an adaptive integration technique could be used for both the inner and 
outer integrals. In either event, provision has to be made for the integrand of the inner 
integral to be a function of two variables and the integrand of the outer to be a function of 


one variable. 


EXERCISES 43.5 


1. In the computing language of your choice, implement a 
Romberg-based numeric approximation of iterated double 
integrals. The code should have the ability to gage error and deal 
with regions having curved boundaries. (Maple code for this task 6. 
will be found in the accompanying Maple worksheet.) 


4. 


In Exercises 2-11, use the results of Exercise 1 to approximate the given 8. 
integral numerically, with an error no worse than 107^. Where possible, 
determine the actual error made by the numeric integration. 


n x? 1 e 
2. f Í xsinydydx 3. f i ydydx 
0 Jo o Jo 


ji 
S 


Chapter Review 


1. What is a Newton-Cotes formula for numeric integration? 
2. What is an open formula? What is a closed formula? 


3. State the Trapezoid rule and the composite Trapezoid rule. Show 
how the composite rule is obtained from the Newton-Cotes 
formula. 


4. Detail how there is a loss of order in the truncation error for the 
composite Trapezoid rule. 


5. Show how the expression for the truncation error of the composite 
Trapezoid rule can be used to estimate the number of function 
evaluations needed to obtain a desired accuracy. 


6. What does it mean to say that the Trapezoid rule is polynomial 
exact of degree one? 


7. State the algorithm for the recursive Trapezoid rule. 


8. Suppose the composite Trapezoid rule, executed with n — 20, 
yields the value T[h]. Using the recursive Trapezoid rule, how 
many more function evaluations are required to obtain TI 


9. Describe the process of Romberg integration. Suppose the recursive 
Trapezoid rule were used to compute T [^] = 5 and T[4] — 6inthe 
first column of the Romberg table. What would be the extrapolated 


10. 


11. 


. Describe how the iterated double integral i FE 


e? dx dy 


f [^ 5. f / y sin x dy dx 
1 0 JA/ 1x? 
cos(sin x) 1 x p 
I | 7. Í Í x?y? dy dx 
sin(cos x) 0 x2 


1 cosh x 2z 1—cos6 
> s IS 
Í. y sinh x dy dx 9. Í Í r^ cos’ dr dé 
0 o Jo 


54-2 cos 8 z/6  p3cos30 
4 i rddrdo 1l. f r?4/1 4- 0 dr dé 
0 0 0 


xy? dy dx 


value on the diagonal in the second row? Suppose T[4] — 6.2 were 
the third entry in the first column of the Romberg table. What 
would be the extrapolated value on the diagonal in the third row? 


Show how polynomial exactness of degree 3 is used to obtain the 
Gauss-Legendre quadrature formula for the case n — 1. 


Obtain the Gauss-Legendre quadrature formula of Question 10 
using an appropriate Legendre polynomial. 


. Show how the Gauss-Legendre quadrature formulas, derived for 


the interval [—1, 1], are extended to the approximation of integrals 
on the interval [a, 5]. 


. Describe the error-test mechanism that is at the heart of adaptive 


integration. 


. Describe the structure and functioning of an adaptive quadrature 


algorithm. 


. Describe the strategy for minimizing function evaluations in an 


adaptive Simpson's rule quadrature algorithm. 


ae) f(x, y) dy dx is 


yıx) 
evaluated numerically. 


Chapter 44 


Approximation of Discrete Data 


INTRODUCTION Chapter 44 is related to Chapters 40 and 41. Chapter 40 
treats the interpolation problem, that of passing a curve, generally a polynomial, through 
each point in a collection of points. In essence, Chapter 41 also treats passing a curve, either 
a polynomial or a rational function, through each point in a collection of points, the points 
being taken from the graph of a given continuous function. The emphasis in Chapter 41 1s 
how well an approximating function approximates the given function. 

In Chapter 44, a curve such as a polynomial is passed "through" a set of points, but 
this time, the curve need not intersect any of the points. A successful curve will minimize 
some measure of the difference between the points and the curve. 

We begin with a discussion of the least-squares regression line whereby a linear function 
is made to fit a set of data points that may not all lie on any single straight line. This is the 
problem of "curve fitting,’ where a curve, this time a line, is fit to a set of data points. A 
linear function has two free parameters. If there are exactly two points in the data set, then 
fitting the function to the data becomes an interpolation problem. In general, then, there 
are more points than parameters in the fitting curve. Attempting to have each point lie on 
the fitting line leads to an overdetermined set of equations containing more equations than 
unknowns. Unless all the points were actually on one straight line, this set of equations has 
no solution. The least-squares solution is the one that minimizes the sum of the squares of 
the vertical deviations between the points and the fitting line. 

In this context, a curve of the form g(x) — 3 ud crx (x) is said to be a general linear 
model. The technique of least squares generalizes to fitting such models to data, the geo- 
metric aspects of which were seen in Section 33.6. The role of orthogonality in obtaining a 
least-squares fit is an essential insight here. 

We conclude the chapter by considering the computationally challenging problem of 
the nonlinear least-squares fit. In particular, we compare two different linearization schemes 
with a nonlinear fit of the Michaelis- Menton model to a medical data set. 


Least-Squares Regression Line 


Introduction 


In Section 33.6 we used the least-squares technique to fit a parabola to nine data points. Our 
intent was to motivate a study of the geometric structure of the least-squares problem. The 
present section uses the least-squares technique to fit a straight line to six data points, with 
an emphasis on the computational and visual aspects of the method. Often called "linear 
regression;" the process of fitting a straight line to data can be found in calculus texts (as an 
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EXAMPLE 44.1 


54+ 1 
—104- 
-154- ° 
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FIGURE 44.1 The six non-colinear data 
points of Example 44.1 


a +b = —22 
3a +b = —15 
4a +b = —8 
7a+b=1 
8a+b=4 
9a --b — 11 


TABLE 44.1 Example 44.1: The 
equations arising when the line y = ax +b 
is fit to the data points in Figure 44.1 


FIGURE 44.2 Example 44.1: The data 
points in Figure 44.1, the line 

y — 3x — 20, and the deviations of the data 
points from this line. Positive deviations 
are in black; negative, in color. 
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example of multivariable optimization) and in science labs, as a tool of data analysis. The 
prevalence of calculators and computer programs that perform linear regression makes this 
topic readily accessible in today's classrooms. 


The six data points (1, —22), (3, —15), (4, —8), (7, 1), (8, 4), (9, 11), graphed as the black 
dots in Figure 44.1, do not appear to lie on a single straight line. If we attempt to fit these 
six points with the line y — ax 4- b, we will get the overdetermined set of six equations in 
two unknowns in Table 44.1. 


Sum or Squares Figure 44.2 is the graph in Figure 44.1, along with a graph of the line 
y — 3x — 20 and the value of the sum of squares of the deviations of the points from this 
line. If the vertical black line segments are considered positive deviations, then the color 
segments would be negative deviations. If the totality of these deviations were to be added, 
some of the positive distances would cancel with some of the negative and the true "total 
deviation" of the points from the line would be smaller than it should be. If their absolute 
values were added, the “cancellation” problem would be avoided, but the sum of absolute 
values would not be a differentiable function. Instead, each deviation is squared so that the 
associated "error" is a positive number. The squares of all deviations between data points 
and the line are added and the sum is a differentiable function of a and b. The value of this 
sum, called the sum of squares of deviations or just sum of squares, appears in Figure 44.2 
as the number in the oval inset. The figure was created with a software simulation that gives 
the user the opportunity to lower the value of the sum of squares by varying the slope and 
intercept. (See the software accompanying the text.) 


MINIMIZING THE SUM OF SQUARES The sum of squares of deviations 
6 
S =) [yk — (ax, + b)P = 2208? + 58b — 78a + 64ab + 6b? + 911 
k=l 
is a function of the two parameters a and b. Figure 44.3, a graph of the surface defined by 
z = S(a, b), shows there is a point (a, b) that minimizes the value of S. 


FIGURE 44.3 In Example 44.1, the surface 
S(a, b) = Y 4 [yx — (axy + b) 


We can minimize S(a, b) by differentiating with respect to a and b, setting the deriva- 
tives equal to zero, obtaining the equations 


as as 
=. = 440a + 64b — 78 =0 and ab = 64a + 12b+58 =0 (44.1) 
a 
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The solution of (44.1) is a = #4, b = — 77, so the least-squares line is 
L2 581, 1907 
Y= n — 7 (44.2) 


and the minimum sum of squares is Um. Figure 44.4 shows the least-squares line and the 
deviations, both positive and negative. A comparison with Figure 44.2 shows that S has 
been reduced by a factor of about 5, achieved by increasing the deviations for the third, 
fourth, and fifth points but decreasing them for the first, second and sixth. e 


10 4- Sum of squares 


FIGURE 44.4 Example 44.1: The least-squares 
line, and the deviations when the sum of squares is 
minimized 

Reduction to a Formula 


From the general sum of squares of deviations $ = Ex [yx — (axi + b)]?, we obtain the 
equations 


N 
= $n n enin c Pon ca) iE bY eo 
k=l 
N 
[yk — (ax + b)] =J y-a u- piren 


k=1 k=l k=1 k=1 


| 

N| = 
is 
S| uà 
ive 


Replacing DT 1 with N and solving for a and b give 


/ N N 
2 a Xk Po Ye — N Ya XO 
N . \2 N .2 
(Yea) -N Erat 
N ON VQ. N 25N . 
2 ia Xk Dok XY — ka Xk Deka Yk 
aeo N 2 N 2 
(Xr=1 x) — NX 
To implement these formulas, sum xz, xz, yy; sum the products x, yg; and square the 
sum of the x+. In the late 1970s, the advent of affordable calculators that could obtain the 
first four sums from a single entry of the data impacted the teaching of statistics. Within a 
decade, however, even these calculators were obsolete as newer calculators appeared that 
solved for the parameters a and b, without the user having to manipulate the various sums. 


Simultaneously, spreadsheets and other computer software appeared and added the power 
of graphics to the task of regression and its analysis. 


a= 


(44.3) 
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EXERCISES 44.1 
| 
| 1. Use the formulas in (44.3) to obtain the coefficients a and b in 3. {(—10;:27); (I —4), Gs — 23, (06; —38); 4,395, C08, 559] 
| Gaal 4. ((—20, —185, (—17, —58), (—12, —85, (- 11, 111), (—7, —69), 
To the data set { (xz, y)), k = 1,..., N, given in each of Exercises 2-11, (—2, — +), (9, 99), (10, 2) 
fit the line y = ax + b. 5. ((—20, — 8), (-17, —84), (-7, —13), (-1, —12), (6, 3), (9, 33). 
(a) Write the equations ax, + b = yy, k =1,..., N, and show (11, 42), (18, 49.) 


they are inconsistent. 


6. ((—19, —*2), (—15, — 44), (—4, —16), (7, 4), (12, 56), 


(b) Form S(a, b) = Y (axe +b — y)?, the sum of squares of (14, 195), (15, a 


the deviations, and obtain its graph as a surface showing the 


existence of a minimum. 7. ((—16, 22), (—15, 82), (—15, 205), (-5, $), (—2, 1#), 
(c) Determine the critical point of S(a, b) by the techniques of (1, 2), (8, —44)} 
multivariable calculus. 8. ((—19, aiy, (5. a, (8, E59, (12, 168), (16, BA 
(d) Corroborate the minimizing values of a and b using (44.3). 9. (—9 1037 ), (-4, 2 ), (4, 289 .(8, 9, (9, Md ) 
(e) Graph the data points and the least-squares regression line. 10. ((—12, 36). (—9, gan Y (=a 36 y. (1, i. (16, 646 y 
(f) Determine the minimum value of S(a, b). 11. ((—18, —27.3), (—17, —25.8), (—16, —137.7), (—14, —120.7), 
2. ((—9, —3, (—8, —&), (2, 3), (4, 4), (10, 2), (17, 88) (—10, —86.7), (3, 23.8), (7, 10.2), (9, 13.2), (11, 91.8)] 


3 


The General Linear Model 


Introduction 


Not all data can be meaningfully fit to a straight line. In Section 33.6, for example, we 
showed how to least-squares fit a parabola to a set of data. In general, when the least- 
[ squares technique is used to fit data with a curve of the form 


n 
g(x) = Yo cede (x) 
k=1 
we say we are building a linear model for the data. Although the curve g(x) can be decidedly 
nonlinear, the parameters cy, k = 1,..., n, appear linearly in the model. The simplest case 
of the linear model is the one in which $; (x) = x^, making g(x) just a polynomial of degree 
n — 1. In this section, we will show how to perform a least-squares fit by both a polynomial 
and more general functions with a linear structure. 


EXAMPLE 44.2 Table 44.2 lists 12 points on, or almost on, a curve y (x) that was sketched on a sheet of graph 
paper. The curve that was originally sketched was intended to have a vertical asymptote at 
x = 0 and a horizontal asymptote for large x. Figure 44.5 contains a plot of these points 
and least-squares polynomials of degree 2, 3, 4, and 5, respectively, drawn as solid black, 
dashed, dotted, and solid color curves. The idea was to fit a general linear model to the data, 
and polynomials are the simplest functions to consider. Table 44.3 lists the least-squares 


polynomials. 
(1, 19) (2, 14) (3, 10) (5, 6) (9, 6) (12, 9) 
(13, 10) (15, 12) (18, 13) (21, 12) Q5, 2) (28, 11) 


TABLE 44.2 The data for Example 44.2 
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t + ! ! >x 
15 20 25 30 


Un -+ 
= 


FIGURE 44.5 Example 44.2: The data points and 
least-squares polynomials of degree 2 (solid black), 
3 (dashed), 4 (dotted), and 5 (solid color) 


f; = 13.893 — 0.6043 1x + 0.020706x? 

fs = 19.736 — 3.4584x + 0.27746x? — 0.005972x3 

fa = 25.447 — 7.3734x + 0.87488x? — 0.037836x? + 0.5481 x 10-3x4 

fs = 26.212 — 8.0756x + 1.0438x? — 0.053582x? + 0.1169 x 10-?x^ — 0.8679 x 10-535 


TABLE 44.3 The least-squares polynomials of Example 44.2 


Not surprisingly, the quadratic polynomial (solid black) does not fit the data very well. 
The cubic polynomial (dashed) just begins responding to the data but does not provide as 
good a fit as do the polynomials of degree 4 and 5. The fit of these last two polynomials 
is remarkable since both capture the asymptotic behavior at x — 0; however, neither is 
asymptotic to a horizontal line past the last data point at x — 28. Eg 


The Cubic Polynomial 


We next fit the given data with a least-squares cubic constructed from first principles. 
Substituting each data point into the fitting function g(x) — Y a a,x* gives the set of 
equations Au — y, where A, u, and y are given in (44.4). 


1 ] 1 1 19 
| 2 4 8 14 
1 3 9 57 10 
i 5 25 125 6 
1 9 81 729 do ! 
1 12 144 1728 ay 
A=|1 13 169 2197 zd P" y= 10 ae) 

1 15 225 3375 ay 12 
1 18 324 5832 13 
1 21 441 9261 12 
1 25 625 15,625 = 
1 28 784 21,952 T 


As seen in (44.5), the fifth row in the reduced row-echelon form of the augmented 
matrix [A, y] represents the inconsistent equation 0 — 1, so we know there is no solution 
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to Au — y. 
1000 0 
01 00 0 
001 0 0 
000 1 0 
mef([A,y])=|90 000 1 (44.5) 
000 0 0 
000 0 0 


5a cu 12 
A least-squares solution minimizes the sum of squares $ = )>,_,(g(xx) — ye)” by 
solving the normal equations 


1 as i 
~— = 152a; + 2832a; + 60,860a3 — ?€? + 12a) = 0 

2 dao 2 

1 as : 
23a 1,411,944a3 + 152ag + 2832aı + 60,860a2 — 3321 = 0 
4 odi 2 


1 ðS 
ne 1,411,944a5 + 34,391,612a3 + 2832a + 60,8600, — £% = 0 
Z 0025 ad 


1 as 
=—— = 1,411,944a, + 34,391,612a; + 865,560,552a3 + 60,860a, — 1355399 — 0 


2 0d3 


whose solution is 


Ze 21,833,515,650,511 a 5,738,838,682,124 

0 — 1.106,275,892,918 = 1,659,413,839,377 
227.8 25.2 2 

a = 1,227,806,681,771 a= 11,325,266,429 


4,425, 103,571,672 ~~ 1,896,472,959, 288 


The normal equations contain the same information as the original system Au = y. To 
see this, write the normal equations in the matrix form Mu = b, where the matrix M and 
the vector b are 


267 
12 152 2832 60,860 z 
152 2832 60,860 — 1,411,944 E 
M —| 2832 60,860 1,411,944 34,391,612} P^ 63.605 (44.6) 
60,860 1,411,944 34,391,612 865,560,552 bus 


A computation shows that M — ATA and that b — ATy. Thus, the least-squares solution 
of the overdetermined system Au — y is given by the solution of the determinate system 
Mu =b. 

We close this construction by noting the condition number of the matrix M is the very 
large 1.13 x 10°. As elegant as the theory in these calculations might be, the ill-conditioning 
of the matrix M precludes its use in practical applications. We escaped the perils of round- 
off because we worked with exact arithmetic. When working in floating-point arithmetic, 
roundoff poses a significant difficulty in least-squares calculations. The cure lies in orthog- 
onality, as we shall see in Section 44.3. 
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General Structure of the Linear Model 


The general linear model fits the curve g(x) — ae Css (x) to the m points (xz, ye), k = 
Ls sce ey m, by minimizing 


S= eo -— y} = P. » CPs (Xk) — n) 


k=1 k=1 \s=1 
the sum of the squares of the deviations between the data points and the fitting curve 
g(x). Differentiation with respect to each of the n parameters c, k = 1,..., n, leads to n 
equations of the form 

m n 


as 
ja 2. (x C56, Gu) — 2 or Gu) —0 


k=1 \s=1 


In each such equation, divide through by 2 and expand the outer sum to obtain 


m n m 


YP apapa- D> bre) yx = 0 


k=1 s=1 k=l 
Then, move the rightmost sum to the right-hand side of the equation and interchange the 
order of summation on the left-hand side to obtain 


m 


ba So br G6. G)) = ^60» 
ssl k=l k=l 


m 


as the rth equation in a list of n such, where r = 1,..., n. Shrewd observation recognizes 


this set of equations as the linear system 


m 


m 


m 


m 


Y paota D paoar) D bi (XK) bn Ga) D bi (XK) Ve 
k=l k=l k=l k=1 
m m m C m 
D RADA D papa) $5 paar) Pn Gu) a 2, p2 Gu)» 
k=l k=l k=1 3 k=1 
m m m Cr m 
$5 6,Q$i0) 3,6, Gi)02 04) $,6,Qi0,0) | | . $6, Gu) yk 
k=l k=! k=1 : k-1 
Cn 
p» Pn (Xk )ġi (xk) p» Pn (Xx bo (Xx ) 2 gn (xx Dn (xk ) p» Pn (Xx )Yk 
k-1 k=l k=l k=] 
(44.7) 
That this system is actually the set of normal equations Mu = b is established by ex- 
tending the formalism as follows. For r = l...., n, define the vectors 
Pr (xı) yı 
$, (x2) y2 
„= y=|. (44.8) 
Qr (Xm ) Ym 


and on the space of functions continuous on a closed interval [a, b] that contains xg, k = 
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lyssa m, define the pseudo-inner product 
m 
(Da, 5) = 5 Pa (bpr) 
k=1 
An inner product, like the ordinary dot product, satisfies u - u = 0 only when u is the 
zero vector. For a pseudo-inner product, (u, u) = 0 can be satisfied by a nonzero vector 
u. For this pseudo-inner product, any function w(x) that interpolates the nodes xg, k = 


d ost m, vanishes at each node. Hence, w(x) is not the zero function, but the pseudo-inner 
product of the vector V = [y (x1), ..., V (x)]T. with itself must necessarily vanish. 

The m x n matrix A in the system Au — y that arises when we attempt to interpolate 
the m data points (xy, yy), k = 1,..., m, with g(x), is just A = [®,, ®>,..., ®,], and 
Au=yis 

$1691) 4200) e+ bn) | | cr yı 
$1602) p2) - Praa) | | €2 y2 l 
; ' . .] =]. (44.9) 
$i (Xm) $» (Xm MEL Pn (Xm) Cn Ym 
The product ATA is then the matrix 
(i, Pi) (6,95 ... (9,06, 
($5,9,) (@2,@2) ... ($9, 
i . (44.10) 
(9,, $,) (,, 9$») SIS (®,,, ®,,) 


which is the same as the matrix in (44.7). Hence, we have shown that ATA = M. In addition. 
the product ATy is the vector 


(44.11) 


(®,, y) 
which is the same as the vector b on the right in (44.7). Thus, ATy = b, and multiplying 
Au — y by AT yields Mu — b, the normal equations. 
Finally, if we define the vector 


gGi) 
&(X2) 
8(Xm) 
then Au = G, that is, 
cii (x1) + e292 600) + +++ + en) (x1) gu) 
C191 (x2) ep €20» (x2) Tec Cn Qn (x2) (x2) 
Au = r = G = " 
C19) (Xm) + C22 (Xm) epos CnPn (Xm) &(Xm) 
Consequently, 
$ 2 Y (gu) — ye)? = [Au — yl (44.12) 


k=1 
Minimizing S, the sum of squares is equivalent to computing a vector projection. 


EXAMPLE 44.3 For the data in Table 44.2, we have g(x) — Y s a.x* so that the 
3, respectively. The vectors ®; and y are then 


x*k- 


ptt 


The matrix A = [®o 
matrix M in (44.6). Alternatively, the elements of M = (mij) are mij 
a calculation shows the equivalence of the two expressions for S in (44.12). 


EXERCISES 44.2 
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functions $;(x) are 


1 1 1 19 
2 4 8 14 
3 9 27 10 
5 25 125 6 
9 81 729 : 
12 144 1728 
13 $2 — | 169 B=] 25197 Y— (10 
15 225 3375 12 
18 324 5832 13 
21 441 9261 12 
25 625 15,625 E 
28 784 21,952 T 
-€— 9] is the matrix in (44.4), and the product ATA is the 


(9;, ®;). Finally, 


bod 


1. Write the overdetermined system (3x — 5, 7x — 11] in the matrix 
form Au — y. Obtain the normal equations Mu — b and the 
least-squares solution u — [x]. 

. Write the overdetermined system {x + y = 1, x — 2y = 5, 
2x — 3y = 7} in the matrix form Au = y. Obtain the normal 
equations Mu = b and the least-squares solution u = [x, y]. 


In Exercises 3-9, use the functions ¢,(x) = xl, k = 1,2,3, to fita 
general linear model g(x) — (acm C, Qy to each of the following sets of 
data points ((xy, yk)}, k = 1,...,m. 


] 


(a) Use calculus to minimize S = 37 ,(g(xi) — yx)*, obtain the 
least-squares g(x), compute Smin, and draw a graph showing 
g(x) and the data points. 

(b) From the equations g(x) = yg, form the matrix A and the 
vector y, thereby expressing the equations as Au — y, where 
u = [ci, c2, c3]'. Show that the augmented matrix [A, y] has 
rank greater than 3, making the system inconsistent. 

(c) Form the matrix M — ATA and the vector b — ATy. Obtain the 
condition number of M, solve Mu = b for u = 8, and show 
that the solution is the same as in part (a). 

(d) Form the matrix P = A(ATA)-!AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute Ad and verify that Ad = y4. 

(e) Form the vectors ®; = [$y(x1), .... de (%m)]", k = 1, 2, 3; 
compute M;; = 6; - ®; and b, = 9, - y. Compare to M and b 
in part (c). 


(f) Compute ||Aá — y||3 and verify that it is Smin- 


3. ((—19, 1684), (—17, 1343), (—14, 2110), (—12, 659), (—9, 850), 
(9, 951), (10, 1169), (17, 1425)] 

4. ((—20, 6350), (—16, 4099), (—9, 1338), (—5, 435), (—3, 165), 
(—2, 76), Q2, 5), (8, 155), (11, 1712), (18, 4735)] 

5. ((—18, 1518), (—16, 1206), (—14, 929), (—9, 1180), (—4, 86), 
(1, —5), (4, 56), (15, 2873), (17, 3716)] 

6. ((—19, 738), (—15, 462), (—8, 133), (—6, 223), (9, 448), 
(10, 187), (12, 272), (17, 557)} 

7. ((—17, 68), (—11, 72), (—4, —18), (—1, —8), (6, 106), (7, 40), 


(11, 80), (12, 92), (18, 722), (20, 216)} 
{(—18, 318), (—15, 193), (—6, —8), (—2, —14), (1, 15), (4, 72)} 
((—20, 411), (—13, 637), (—11, 109), (—7, 37), (3, 89), (15, 327)} 


8. 
9. 


In Exercises 10—15, use the functions Q4 (x) = x^^! k = 1,..., 
a general linear model g(x) — p cx, to each of the following sets 
of data points ((x4, y,)), k = 1 


m 


(a) Use calculus to minimize $ — Ded (e (x) — yx)’, obtain the 
least-squares g(x), compute Smin, and draw a graph showing 
g(x) and the data points. 


(b) From the equations g(x) = yg, form the matrix A and the 
vector y, thereby expressing the equations as Au — y, where 

T c4]’. Show that the augmented matrix [A, y] has 
rank greater than 4, making the system inconsistent. 

(c) Form the matrix M — ATA and the vector b — ATy. Obtain the 
condition number of M, solve Mu = b for à = ü, and show 
that the solution is the same as in part (a). 


1110 
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(d) Form the matrix P = A(ATA) ~} AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute At and p) that AU = y4. 

(e) Form the vectors 9, = [$,(x1), .... Qux. - ,4; 
compute M;; = ®; - 6; and b, = 6, - y. cols to M and b 
in part (c). 


(f) Compute || Au — yll and verify that it is Smin- 


10. ((—9, —1972), (—5, —156), (6, 1786), (7, 723), (10, 8742), 
(11, 2932), ( p 11143), (18, 13267), (20, 18294)] 

11. ((—13, —18798), (—11, —11541), (—10, —8747), (—8, —4591), 
(5, 901), (7, 2514), (9, 1355), (20, 15417)} 

12. ((—13, 5338), (—9, 2022), (—2, 40), (—1, 0), (4, 88), (10, —440), 
(15, —704), (18, —5624)} 

13. ((—20, B —18, 27438), (—17, 23085), (—16, 4804), 
(—1, —2), ( Tes 147), (7, —431), (8, —639)] 

14. ((—18, 8111), (—13, 3205), (—10, 1529), (—4, 120), (7, —875), 
(10, —3261), (11, —1134), (17, —4811), (19, —27525)] 

15. ((—20, 109394), (—19, 23382), (—14, 9164), (—11, 4348), 
(—10, 3232), (—7, 1052), (—5, 1418), (1, —42), (13, —34064), 
(20, —30236)} 

In Exercises 16—21, use the functions ¢; (x) = x*-l_k=1,...,5, to fit 


a general linear model g(x) = $>}; cx, to each of the following sets 
of data points {(a,, y,)), k = 


(a) Use calculus to minimize $ = $77 ,(g(x;) — yx)’, obtain the 
least-squares g(x), compute Smin, and draw a graph showing 
g(x) and the data points. 


(b) From the equations g(x,) = yg, form the matrix A and the 
vector y, thereby expressing the equations as Au = y, where 
T= Erg cs]". Show that the augmented matrix [A, y] has 
rank greater than 5, making the system inconsistent. 

(c) Form the matrix M = ATA and the vector b = ATy. Obtain the 
condition number of M, solve Mu = b for à = û, and show 
that the solution is the same as in part (a). 

(d) Form the matrix P = A(ATA)-! AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute Aü and pes that Au = y4. 


(e) Form the vectors ®, = [¢;(x,),..., Di om) V E E 
compute M;; = 6; - 6; and b; = 6, - y. E to M and b 
in part (c). 


(f) Compute || Au — yl and verify that it is Smin- 


{(—19, 404626), (—18, 325442), (—16, 809838), 
(—14, 472648), (—13, 350488), (—12, 253717), ( 
(—1, 31), (17, 278122), (18, 1394965)] 

{(—13, 86811), (—8, 13017), (4, 1939), (5, 1311 
(7, 22219), (11, 146296), (14, 394115), 
(19, 342491)] 

((—19, 268923), (—12, 11886), (— 
(—2, 24), (4, —95), (5, —123), 


16. 


—8, 12322), 


17. ), (6, 11536), 


(17, 871067), 


18. 9, 62191), (—4, 747), 


(10, 1273), (12, 3668)} 


19. {(—20, 392669), (—18, 248569), (—16, 148042), (—13, 57946), 


(—1, —10), (0, —1), (1, 19), (14, 160762), (20, 155911)] 
{(—16, 263458), (—13, 27463), (—8, 3365), (—5, 388), (—1, 2), 
(2, 197), (7, 16125), (14, 55101), (15, 287216)} 

21. {(—20, 476858), (—16, 48037), (—14, 111366), (1, 2), (2, 109), 
(7, 9693), (8, 4011), (14, 117619), (19, 452771)} 


20. 


In Exercises 22-26, use the functions ¢(x) = e~*"!* ,k = 1 
to fit a general linear model g(x) = y-4 CQ, to each of the following 
sets of data points ((x;, y,)), k = 1 


m 


(a) Use calculus to minimize $ = $ /, ,(g(xi) — y, obtain the 
least-squares g(x), compute Smin, = draw a graph showing 
g(x) and the data points. 


(b) From the equations g(x,) = yx, form the matrix A and the 
vector y, thereby expressing the equations as Au = y, where 
ü 65e c4]. Show that the augmented matrix [A, y] has 
rank greater than 4, making the system inconsistent. 

(c) Form the matrix M = ATA and the vector b = A'y. Obtain the 
condition number of M, solve Mu = b for û = à, and show 
that the solution is the same as in part (a). 

(d) Form the matrix P = A(ATA)-! AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute Adi and verify that Ad = y4. 

(e) Form the vectors 6, = [@(x1),..., x (Xm) I, k = 1 
compute M;; = 6; - 6; and b, = 6, + y. Compare to M and b 
in part (c). 


(f) Compute || Aü — yll3 and verify that it is Smin- 


22. ((0.060, 2.50), (0.20, 2.44), (0.54, 2.15), (0.60, 2.21), (0.64, 2.10). 
(0.70, 2.21), (0.74, 2.09), (0.76, 2.00), (0.86, 2.04), (0.94, 2.05)} 
23. ((0.040, 2.27), (0.060, 1.99), (0.16, 2.01), (0.34, 1.65), 
(0.56, 1.27), (0.78, 1.00), (0.82, 0.893), (0.88, 0.834), (1, 0.873)} 
24. ((0.040, 4.26), (0.10, 4.01), (0.16, 3.24), (0.28, 2.65), (0.34, 2.09). 
(0.64, 1.86), (0.68, 1.59), (0.78, 1.63), (0.96, 1.06)] 
25. ((0.14, —0.622), (0.16, —0.575), (0.18, —0.539), (0.30, —0.452), 


(0.36, —0.423), (0.42, —0.401 
(0.98, —0.368)] 
{(0.040, 1.18), (0.16, 0.934), (0.26, 0.277), (0.34, 0.0766), 


(0.38, —0.000916), (0.74, —0.896), (0.92, —0.498), 
(0.98, —0.550)] 


), (0.64, —0.394), (0.74, —0.335), 


26. 


xkl (x? + k), k 
= Ei CQ, to each of 


In Exercises 27-31, use the functions E. 
4, to fit a general linear model g(x 
the following sets of data points (xy. yx)}, 


(a) Use calculus to minimize $ — a1 (8 (XE) — ye), obtain the 
least-squares g(x), compute Smin, and draw a graph showing 
g(x) and the data points. 


(b) From the equations g(x;) = y,, form the matrix A and the 
vector y, thereby expressing the equations as Au — y, where 
c4]*. Show that the augmented matrix [A, y] has 


rank greater than 4, making the system inconsistent. 


In Exercises 32-36, use the functions ¢; (x) 
where J, = is the Bessel function of order À, to fit a general linear 


Uu 
N 


taa 
t 


(c) Form the matrix M = ATA and the vector b = ATy. Obtain the 
condition number of M, solve Mu — b for u — ü, and show 
that the solution is the same as in part (a). 

(d) Form the matrix P = A(ATA)-! AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute At and verify that Au = y4. 


(e) Form the vectors 9, = [$i (x1), .... $x(x4)] , k = 1,..., 4; 
compute M;; = ®; - 6; and b; = 9, + y. Compare to M and b 
in part (c). 

(f) Compute || Aa — y||5 and verify that it is Smin- 

((0.24, 4.07), (0.30, 2.86), (0.34, 4.41), (0.44, 3.01), (0.48, 2.07), 

(0.70, 1.44), (0.78, 1.79), (1.06, 2.78), (1.18, 2.31)} 


{(0.22, 22.0), (0.26, 8.19), (0.28, 14.7), (0.38, 6.09), (0.40, 3.59), 
(0.42, 5.62), (0.46, 2.04), (0.74, 1.05), (1.06, —0.443)] 


29. {(0.28, 13.0), (0.60, 4.39), (0.62, 3.09), (0.82, 1.61), 


(1.04, 0.759), (1.06, 1.16), (1.20, 1.22), (1.42, 0.722), 
(1.48, 0.180), (1.56, 0.142)} 


{(0.56, 10.6), (1.36, 1.84), (1.60, 2.77), (1.78, 2.02), (1.88, 3.35), 
(2.08, 2.38), (2.30, 2.19), (2.66, 3.34), (2.98, 2.50), (3.34, 3.12)] 


((0.58, 6.06), (0.82, 3.57), (1.04, 2.62), (1.60, 2.40), (1.74, 2.63), 
(2.08, 2.64), (3.30, 4.11), (3.38, 3.86), (3.84, 6.21), (3.92, 3.86)} 


Exi: (x), hk= I TEET 4, 


model g(x) = y C,Qy to each of the following sets of data points 
X ete oat T m. 


(a) Use calculus to minimize $ = » 7 4 (g(x) — yg)”, obtain the 
least-squares g(x), compute Smin, and draw a graph showing 
g(x) and the data points. 

(b) From the equations g(x,) = yg, form the matrix A and the 

vector y, thereby expressing the equations as Au — y, where 

ü = [6g c4]! . Show that the augmented matrix [A, y] has 

rank greater than 4, making the system inconsistent. 

Form the matrix M = ATA and the vector b = ATy. Obtain the 


condition number of M, solve Mu = b for u = 4, and show 
that the solution is the same as in part (a). 


(c 


(d) Form the matrix P = A(ATA)-! AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute Ad and vesity that Ad = y4. 

(e) Form the vectors 9, = [@;(%1),..-, "ie pe erem sso; 4; 
compute M;; = ; - 6; and b, = 6, - y. Compare to M and b 
in part (c). 

(f) Compute || Au — yll and verify that it is Smin- 


. ( LAIT (2, 1.675), (3, —0.01184), (4, —0.7530), 

(5, —0.1353), (7, 1.041), (9, —0.3137)} 

. {(1, 1.315), (3, 1.191), (5, 0.3636), (6, 0.1528), (7, 0.07776), 
(8, —0.2773)) 


p A 
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(0.20, 0.4249), (1.3, 1.703), (3.3, 0.9961), (5.6, —0.4003), 
6.5, —0.5670), ha —0.9468), (7, —0.4844), (7.6, —0.2618), 


at 
( 
(7.8, —0.3160), (9.4, 0.4108)] 
{ 


(0, 2.100), (1.2, 0.2304), (1.8, —0.06508), (4.6, 0.1420), 
(5.1, 0.6108), (6.3, 0.6364), (6.6, 0.4964), (8.2, —0.5039), 


(8.9, —0.6665), (9, —0.6642)] 
. {(0.50, —6.092), (1.2, — 1.178), (2.5, 2.839), (3.3, 1.430), 
(3.5, 3.046), (4, 1.743), (4.5, —0.02484), (5:1, i .567), 
(9.7, 1.413), (9.8, 1.354)} 
In Exercises 37—41, use the functions $,(x) = sin kx, k = 1,..., 5, to 
fit a general linear model g(x) = ee C, $4 to each of the following sets 
of data points (xi, y4)), k = 1,..., m. 


(a) Use calculus to minimize $ = $77 (g(x) — y)”, obtain the 
least-squares g(x), compute Spin, and draw a graph showing 
g(x) and the data points. 


(b) From the equations g(x;) = yk, form the matrix A and the 
vector y, thereby expressing the equations as Au — y, where 
ü [6:5 ca]. Show that the augmented matrix [A, y] has 
rank greater than 5, making the system inconsistent. 

(c) Form the matrix M = ATA and the vector b = Aly. Obtain the 
condition number of M, solve Mu = b for û = û, and show 
that the solution is the same as in part (a). 

(d) Form the matrix P = A(ATA)-! AT that projects vectors onto 
the column space of A, and compute y4, the component of y in 
the column space of A. Compute At and verify that Al = y4. 


(e) Form the vectors 9, = [p (x1), ..., km), k 21,..., 5: 
compute M;; = 6; - 6; and b; = 6, - y. Compare to M and b 
in part (c). 


(f) Compute || Ad — y||2 and verify that it is Smin- 


(1.9, 0.1312), (3.1, 0.1328), (4.1, —2.971), (5.9, —4.614), 
6.4, 1.721), (6.6, 16.38), (7.7, 0.1390), (8, —0.5887), (9, 4.255), 
9.4, 0.3169)} 


(2.2, 1.626), (2.5, 0.1581), (3.3, 0.1530), (3.9, —0.7341), 
(5.8, —0.2822), (6.9, 0.3997), (7.8, 2.399), (8, 0.8376), 
(8.3, 0.7503)} 


. ((1.2, —1.897), (1.5, —1.654), (2.2, —1.149), (5.5, 1.729), 


(6, 2.245), (6.2, 0.6745), (6.7, —1.070), (7.7, —5.223), 

(9.1, —2.225)} 

{(—4.9, 4.213), (—4.5, 4.986), (—3.4, 1.310), (—2.4, —4.252), 
(—1.8, —4.992), (1.2, 3.510), (2.3, 2.996), (2.4, 4.252), 

(2.6, 3.558)} 

{(—3.1, 0.03030), (—3, 0.2954), (—2.7, 0.5474), (—2.6, 0.4522), 
(—1.8, —2.951), ( 048. 1.064), (0.90, 3.987), (2, 1.842), 
(2.1, 1.314), (3.1, —0.03030)] 
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m The Role of Orthogonality 


Motivation 
In Section 44.2, we saw that in the general linear model of least-squares curve fitting, the 
function 
n 
g(x) = ` Css (x) 
s=1 
is fitted to the m points (xy, yk), k = 1,..., m, by minimizing 


s= Sew- => (Saeco -) 
k=l 


k=1 \s=1 
the sum of squares of the deviations between the points and g(x). The ordinary minimization 
techniques from multivariable calculus then give the normal equations in the form (44.7), 
that is, in the form Mu = b. In Section 44.2, we also showed that defining the vectors y 


and ®,,r=1...., n, as in (44.8), and the pseudo-inner product 
(Da, 65) = X ba(xe)bp (Xx) (44.13) 
k-1 


on the space of functions continuous on a closed interval [a, b] that contains x,, k. = 
1. iis m, allowed us to write the normal equations in the form Mu = b, where M is given 
by (44.10) and b is given by (44.11). Finally, we noted that, in general, the matrix M usually 
has a large condition number and, hence, tends to be ill-conditioned. 

In this section we will consider the role of orthogonality in dealing with the ill- 
conditioning of the normal equations. We will look for polynomials p(x), k = 1,..., 7, 
for which the associated vectors 
Pr (x1) 
Pr (X2) 


r= 


pr (Xn) 


are orthogonal under the pseudo-inner product (44.13). If we can find such polynomials, 
the normal equations will reduce to the diagonal system 


(9;, Dı) 0 d 0 (9,, y) 
0 ($5, $;) ILES 0 ($5, y) 
; . , u= ; 
0 0 ndi (6, $,) (Dn, y) 


from which the solution is immediately given by c; = (6;,y)/(6,, 6,), k = 1,....n. 
Below, we detail an algorithm by means of which the desired set of orthogonal polynomials 
PRX), BS dy sons n, can be constructed. 


An Algorithm for Generating Orthogonal Polynomials 


Based on [60], the following algorithm generates a set of polynomials p(x), k = 1,...,7, 
with the property that the normal equations are a diagonal system when fitting the m points 
Ge. Ve = ea; m, with the function g(x) = Y, cx px(x). 


EXAMPLE 44.4 
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1. Define the vector X = [x1, x2, ..., Xm]T. 
Obtain A = + SVL, xx, the average of the x;’s. 


Define po(x) = 1 and pi(x) 2 x — À. 


Po(X1) 1 pi (xı) Xj =X 
po(x2) 1 pi(x2) X= A 
4. Define the vectors Pp = . =|- | ád Pi = ' = . = X — AP, 
Po (Xm) 1 P\(Xm) Xm —% 
xı po(xı) xi xipiGa) 
. X2 po(x2) x2 X2 pi(x2) 
5. Define the vectors Qo = . —|.|2XandQ; = . = Xni, 
Xm Po Xm ) Xm Xm pi (Xm) 


where we have use the notation X+4P to indicate that corresponding components of 
the vectors X and P, are multiplied. (In the computer program Matlab, this operation 
is implemented by the syntax X. » Pı. In Maple, the zip command is used.) 


6. Fork = 2,3,...,n, recursively compute a, = (Q, 4, Pj .1))/(Pj i, PX), 6k-1 = 
(Qk-1, PX 2)/ (PX 2, Pr—2), prx) = (x — og) pia (x) — Bia Ppk-2 (x), and 


pxGa) xipyGa) 

px Go) X2 px (x2) " 
k= : Q = : = XP, 

Pk (Xm) Xm Pk (Xm ) 


7. Ifthe m points (xx, yk), k = 1,..., m, are least-squares fitted with the function g(x) = 
Si- Ck p(x), the normal equations ATAu = ATy will be a diagonal system. 


m 


For the m = 12 points listed in Table 44.2, Section 44.2, À = M b»4 = 3, The vectors 
X and y are then 
X = [1, 2, 3, 5, 9, 12, 13, 15, 18, 21, 25, 28]" 
y — [19, 14, 10, 6, 6, 9, 10, 12, 13, 12, 2, 11]T 
The polynomials po(x) and p; (x) are, respectively, 1 and x — 32. The vectors Po, P1, Qo, 
and Q; are 
Po — [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]T 
P; = I 35, —32, —29, —23, —11, —2, 1, 7, 16, 25, 37, 46]? 
Qo = [1, 2, 3, 5, 9, 12, 13, 15, 18, 21, 25, 28]! = X 
Qı 2 [- 3, — 8, —29, — H5, —33, —8, 8, 35, 96, 175, 25, B88 ]T 


3 
Table 44.4 lists az, By i, py (x), k — 2, ..., 5 
k OK Bx Px (x) 
2 14.89 75.56 x? = 27.56x + 113.1 
3 15.44 60.57 x? — 43.00x? + 477.9x — 978.5 
4 15.14 38.84 x^ — 58.13x? + 1090.0x? — 7143.0x + 1.042 x 10* 
5 13.36 52-1 x? — 71.49x* + 1814.0x? — 1.946 x 10^x? + 8.091 x 10^x — 8.817 x 104 


TABLE 44.4 Example 44.4: o, By, p(x), k —2,...,5 
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Respectively, the vectors P4, k = 2,...,5, are 
86.54 [ —542.5 4309.0 —2.497 x 104 
61.98 —186.6 44.14 9221.0 

39.42 95.35 —2688.0 2.287 x 104 

0.2956 461.3 —4688.0 1.514 x 10+ 

—53.95 569.2 —1398.0 —2.357 x 104 

—73.63 293.3 1940.0 —1.791 x 104 

—716.19 165.3 2606.0 —9542.0 

15.31 —108.6 2940.0 1.049 x 10* 

—58.99 —474.3 933.5 2.905 x 10^ 

—24.67 —642.0 —2806.0 1.2 x 10* 

49.09 —2T1.5 —4643.0 —3.961 x 10^ 

125.4 647.0 3451.0 1.683 x 10^ 

and the vectors Qi, k = 2,...,5, are 

86.54 —542.5 | | 4309.0 —2.497 x 104 
124.0 —373.2 88.27 1.844 x 10+ 
118.2 286.1 —8065.0 6.862 x 10+ 
1.478 2306.0 —2.344 x 104 7.568 x 10+ 
—485.5 5123.0 —1.258 x 10^ —2.121 x 10? 
—883.5 3520.0 2.327 x 10^ —2.149 x 10? 
—990.4 2149.0 3.388 x 10* —1.24 x 10? 
—1130.0 —1628.0 4.41 x 104 1.574 x 10° 
—1062.0 —8538.0 1.68 x 104 5.229 x 10° 
—518.1 —1.348 x 10^ —5.892 x 10^ 2.52] x 10? 
1227.0 —6937.0 —1.161 x 10° —9.902 x 105 
3511.0 1.812 x 10* | 9.664 x 104 4.712 x 10° 


The matrix M is the diagonal matrix of inner products 


12.0 0 0 0 0 0 
0 906.7 0 0 0 0 
M= 0 0 5.492 x 10* 0 0 0 
| 0 0 0 2.133 x 106 0 0 
0 0 0 0 1.111 x 108 0 
0 0 0 0 0 5.378 x 10? 


Note that M still has the large condition number 0.45 x 10?, but because the system 
is diagonal, there is little possibility of roundoff error invalidating the computation. (For a 
diagonal matrix, the condition numbers under the 1-norm, 2-norm, and oo-norm are all the 
same. See Exercise 1.) 

The vectors b and u in the normal equations Mu — b are then 


133.5 11.13 
—30.5 —3.364 x 107? 

b= 1137.0 _ | 2.071 x 107°? 
=| —1.274x10| "| -5.972 x 1073 
6.092 x 104 5.481 x 107^ 
—4.668 x 10* —8.679 x 1075 


Three potential fitting functions g,(x) = pem Ckpy(x), s = 3,4,5, are listed in 
Table 44.5. The small coefficient of x? in gs(x) would suggest little difference in the fits 
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provided by g4(x) and gs(x). The sums of squares for each of these three functions are 
$4 = 34.42, S, = 1.035, Ss = 0.630, respectively. The small change in $ between the 
quartic and quintic fitting functions is consistent with the observation about the coefficients. 


g3(x) = 19.736 — 3.4584x + 0.27746x? — 0.0059718x? 
ga(x) = 25.447 — 7.3734x + 0.87488x? — 0.037836x? + 0.00054813x4 
gs(x) = 26.212 — 8.0756x + 1.0438x? — 0.053582: + 0.0011686x* — 0.86792 x 1025? 


TABLE 44.5 Example 44.4: Least-squares polynomials of degree 3, 4, and 5 


Figure 44.6 shows the data points and graphs of all three fitting functions. The cubic 
function g3(x) (dashed) does not fit the data as well as the quartic g4(x) (dotted) or the 
quintic gs (x) (solid). As predicted, the data is fit nearly as well by g4(x) as by gs(x). 
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FIGURE 44.6 From Table 44.5, the least-squares 
polynomials g3(x) (dashed), g4(x) (dotted), and 
&5(x) (solid) 


Index of Determination 


For general linear models g(x) = $`% cx, (x) in which $, = 1, the index of determina- 
tion [60] of the linear least-squares function g is defined as 


20 EGO- ^w b-m$ 


R(g) = = 
kai — 9» iik — I? 
where $ = E Ya Ye is the mean (or average) of the y;'s. If the number of data points 


exceeds the number of parameters by at least three and R is close to 1, then g(x) fits the 
data well. In the fraction on the right, the symbol u - b represents the dot product between 
the vectors u and b pertinent to the model determined by Mu — b. 

(In the fraction on the left, the denominator is proportional to the variance, a measure 
of the dispersion of the y;'s about their mean y. The numerator indicates how much of this 
dispersion is accounted for by g(x).) 

For the data on which the polynomials in Table 44.5 are based, § = Ẹ, m = 12, Xg 
j = vM. and the index of determination for each of the three models in Table 44.5 would 
be R(g3) = 0.745, R(g4) = 0.9923, R(gs) = 0.9953. As already seen, both g4(x) and 
g5(x) fit the data well, with gs(x) fitting the data slightly better. 
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1. Show that for a diagonal matrix D, the condition numbers based on 


the 1-norm, 2-norm, and oco-norm are all the same and are, in fact, 
the ration of the largest diagonal element to the smallest. 


For the data given in each of Exercises 2-8: 


(a) Apply the orthogonal-polynomial algorithm to generate 
polynomials p, (x), k = 0, ..., 3, orthogonal under the 
pseudo-inner product 5 7^ , pi (Xn) p; (Xn). 


(b) Using the formalism of Section 44.2, fit the data with the 
general linear model g(x) — ppm Ck Di (x), taking d(x) as 
px(x), so 6, is P, = [piGxi), ..., p3(%»)]" and 


(c) Show that M — ATA is a diagonal matrix with Mij = 9; - ®;, 
and obtain its condition number. 


(d) Show that b, = 6, - y gives the vector b = ATy. 

(e) Show that u = [co. ..., c3]", the solution of Mu = b, is given 
by c, = b,/ My = (9, + y)/(9, + By). 

(f) Graph the data points and the polynomials 
ex) = Y ackPEGD. s = 1,2,3. 

(g) Show that g»(x) is the least-squares quadratic obtained in 
Section 44.2. 


(h) For s = 1,2,3, obtain S, = $77 4(g, (ay) — y)? and R(g,), 
the indices of determination, and compare the fit of the 
polynomials g, (x). 

. the data from Exercise 3, Section 44.2 
. the data from Exercise 4, Section 44.2 
. the data from Exercise 5, Section 44.2 
. the data from Exercise 6, Section 44.2 
. the data from Exercise 7, Section 44.2 


. the data from Exercise 8, Section 44.2 


o N A Un 4 U N 


. the data from Exercise 9, Section 44.2 
For the data given in each of Exercises 9-14: 


(a) Apply the orthogonal-polynomial algorithm to generate 
polynomials p(x), k =0,..., 4, orthogonal under the 
pseudo-inner product 3 7. , p(n) p; (Xn). 


(b) Using the formalism of Section 44.2, fit the data with the 
general linear model g(x) — xS n Ck py (X), taking $ (x) as 
pi, so 9, is P, = [piQa), .... pa(Xm)]" and 


(c) Show that M = ATA is a diagonal matrix with M;; = ©; - ®;, 
and obtain its condition number. 


(d) Show that b; = ®, - y gives the vector b = ATy. 


(e) Show that u = [co, ..., c4]", the solution of Mu = b, is given 
by c; = by / My, = (9, - y)/(9, + 9,). 


(f) Graph the data points and the polynomials 
p) = F CREO nS = 1,5 4, 

(g) Show that g3(x) is the least-squares cubic obtained in Section 
44.2. 

(h) For s =1,..., 4, obtain S, = Sy, (gs Gu) — yi)? and R(g;). 
the indices of determination, and compare the fit of the 
polynomials g, (x). 


. the data from Exercise 10, Section 44.2 
. the data from Exercise 11, Section 44.2 
. the data from Exercise 12, Section 44.2 
. the data from Exercise 13, Section 44.2 
. the data from Exercise 14, Section 44.2 
14. 


the data from Exercise 15, Section 44.2 


For the data in each of Exercises 15-20: 


(a) Apply the orthogonal-polynomial algorithm to generate 
polynomials p, (x), k =0,..., 5, orthogonal under the 


m 


pseudo-inner product $ 77 , pi(x,) p; (Xn). 

(b) Using the formalism of Section 44.2, fit the data with the 
general linear model g(x) — 5 a Cx py (x), taking $ (x) as 
pix), so 6, is P, = [py (x1), .... psx,)]? and 
A= [Pirre Ps]. 

(c) Show that M = ATA is a diagonal matrix with M;; = ®; - ®;. 
and obtain its condition number. 

(d) Show that b; = 6, - y gives the vector b = ATy. 

(e) Show that u = [co, ..., cs]', the solution of Mu = b, is given 
by c; = by / My, = (9 + y)/(9, + By). 

(f) Graph the data points and the polynomials 
BR) m De DEC) aS = Leu 

(g) Show that g4(x) is the least-squares quartic obtained in Section 
44.2. 

(h) Fors = 1,..., 5, obtain S, = Y, (e, Gu) — ye)? and R(g;). 
the indices of determination, and compare the fit of the 
polynomials g, (x). 


. the data from Exercise 16, Section 44.2 


. the data from Exercise 17, Section 44.2 


17. the data from Exercise 18, Section 44.2 


. the data from Exercise 19, Section 44.2 


. the data from Exercise 20, Section 44.2 


20. the data from Exercise 21, Section 44.2 


For the data in each of Exercises 21—25: 


(a) Apply the orthogonal-polynomial algorithm to generate 


polynomials p;(x), k = 0,...,5, orthogonal under the 


pseudo-inner product 3 7^ , pi) pj (Xn). 


(b) Using the formalism of Section 44.2, fit the data with the 
general linear model g(x) — a Cy pi (x), taking $, (x) as 
px (x), so 9, is P; = [py(xi), .... Ps(X»)]' and 
A= IP. Ps]. 

(c) Show that M = ATA is a diagonal matrix with M;; = ®; - ®;, 
and obtain its condition number. l 

(d) Show that b; = 9, » y gives the vector b = ATy. 

(e) Show that u = [co, ..., c5]! , the solution of Mu = b, is given 
by ck = by/ My, = (9, + y)/(9, + Bx). 

(f) Graph the data points and the polynomials 
g= Yina = Lesia: 

(g) Obtain the indices of determination R(g,), and compare to the 
index of determination R(g) computed for the fitting-function 
computed in Section 44.2. 


. the data from Exercise 22, Section 44.2 
. the data from Exercise 23, Section 44.2 
. the data from Exercise 24, Section 44.2 
. the data from Exercise 25, Section 44.2 


. the data from Exercise 26, Section 44.2 


" the data in each of Exercises 26 —30: 


(a) Apply the orthogonal-polynomial algorithm to generate 
polynomials p(x), k = 0,...,5, orthogonal under the 
pseudo-inner product 5 7 , pi(x,) pj Œn). 

(b) Using the formalism of Section 44.2, fit the data with the 
general linear model g(x) = Dm Ck pi (X), taking y (x) as 
px (x), so 6, is P; = [pyQa),..., Ps(X%m)]" and 
A= IP... P;]. 

(c) Show that M — ATA is a diagonal matrix with Mi; —9;-.6;, 
and obtain its condition number. 

(d) Show that b, = €, - y gives the vector b = ATy. 

(e) Show that u = [co, ..., C5]! , the solution of Mu = b, is given 
by cj = by/ My, = (9 + y/(9; + Bx). 

(f) Graph the data points and the polynomials 
E)-YLypRO s -1,...,5. 

(g) Obtain the indices of determination R(g,), and compare to the 
index of determination R(g) computed for the fitting-function 
computed in Section 44.2. 


26. the data from Exercise 27, Section 44.2 


For 


. the data from Exercise 28, Section 44.2 
. the data from Exercise 29, Section 44.2 
. the data from Exercise 30, Section 44.2 


. the data from Exercise 31, Section 44.2 


the data in each of Exercises 31—35: 


(a) Apply the orthogonal-polynomial algorithm to generate 
polynomials p(x), k = 0,...,5, orthogonal under the 
pseudo-inner product » 7^ , pi) pj (Xn). 
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(b) Using the formalism of Section 442, fit the data with the 
general linear model g(x) — Saar Cy Di (x), taking $, (x) as 


P(x), so 9, is Py = [pyGa), ..., Ds (Xm)]" and 
A= [P; pees Ps]. 
(c) Show that M = ATA is a diagonal matrix with Mi; —9;-.6;, 


and obtain its condition number. 

(d) Show that b, = €, - y gives the vector b = ATy. 

(e) Show that u = [co, .... cs]', the solution of Mu = b, is given 
by cy = b, / Mix = (9, - y)/(0, + 9). 

(f) Graph the data points and the polynomials 
gy = Yo Cee) 8 = 13,5. 

(g) Obtain the indices of determination R(g,), and compare to the 
index of determination R(g) computed for the fitting-function 
computed in Section 44.2. 

31. the data from Exercise 32, Section 44.2 
32. the data from Exercise 33, Section 44.2 
33. the data from Exercise 34, Section 44.2 
34. the data from Exercise 35, Section 44.2 


35. the data from Exercise 36, Section 44.2 
For the data in each of Exercises 36—40: 


(a) Apply the orthogonal-polynomial algorithm to generate 
polynomials p(x), k = 0,..., 5, orthogonal under the 
pseudo-inner product $" , pi(x,) p; (Xn). 

(b) Using the formalism of Section 44.2, fit the data with the 
general linear model g(x) — 2» C Di (x), taking $ (x) as 
pix), so 9, is P; = [pyi(xi), ..., Ps(Xm)]' and 
A= [P; m Ps]. 

(c) Show that M = ATA is a diagonal matrix with M;; = 6; - ®;, 
and obtain its condition number. 

(d) Show that b; = 6, - y gives the vector b = ATy. 

(e) Show that u = [co. .... cs]', the solution of Mu = b, is given 
by cy = by/ My = (9, < y)/(, + 9,). 

(f) Graph the data points and the polynomials 
gi m Ye ceps 21,5. 

(g) Obtain the indices of determination R(g,), and compare to the 
index of determination R(g) computed for the fitting-function 
computed in Section 44.2. 

36. the data from Exercise 37, Section 44.2 
37. the data from Exercise 38, Section 44.2 
38. the data from Exercise 39, Section 44.2 
39. the data from Exercise 40, Section 44.2 


40. the data from Exercise 41, Section 44.2 
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| Nonlinear Least Squares 


Introduction 


In Section 44.3 we developed an elegant formalism for least-squares fitting a general linear 
model to data. Unfortunately, there is no comparable formalism for fitting data with a 
function in which the parameters appear nonlinearly. For this problem, the two main options 
are linearizing the model or solving the nonlinear normal equations. 

Table 44.6 lists several nonlinear models and some possible linearizations. The nonlin- 
ear models in L3 and L4 are the same but have two different linearizations. The linearization 
in L5 follows from obvious algebra consequent to reciprocating each side of the nonlinear 
model, that is, from 


1 b+x b 1 
+ 


Linearization 

Index Model w = Á + Bz Zz w A B a b 
Ly y = ae" In y = Ina 4- bx % In y Ina b e^ B 
Lz y = ax? ln y = lna +blnx In x In y Ina b e^ B 
a 1 b 1 1 b 1 1 A 
L; y =- +x x = -= = — = 
` b+x y a a y a a B B 
L a a ( I ) a 1 A 1 
= =- —- |xy ) = - = 
i box b b s ? b b B B 
ax 1 ] |l l l | b 1 B 
Ls y= =-4 — m — — — — 
b+x y m az X y a a A A 

ax : y y 
Lg yes P y=a+ o = y a —b A —B 


TABLE 44.6 Some nonlinear models and their linearizations 


The linearization in L4 appears in [60] and is obtained by multiplying each side of the 
nonlinear model by ay to geta = by + xy. Then, divide through by b to obtain $ = y+ >. 
Solving for the isolated y on the right then gives y = 7 — E? 

The nonlinear models in Ls and Le, once again the same, are sometimes called the 
Michaelis-Menton model. To derive the linearization in Ls, write the reciprocal of each 
side of the nonlinear model, obtaining 

1 b+x bl 1 
= = + 


I bli 
+ 
y ax ax a a ax 


To obtain the linearization in Lg that also appears in [60], multiply each side of the 
nonlinear model by — to get (b + x) = a. Then, distribute the quotient on the left, 
obtaining b(*) + y =a, from which follows y = a + (—b)2. 

In the remainder of this section, we will illustrate the linearizations in Ls and Lg for the 
Michaelis-Menton model and demonstrate how to obtain and solve the nonlinear normal 


equations consequent to applying the least-squares technique to the nonlinear function 


fœ) = Pis n 
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EXAMPLE 44.5 The data in Table 44.7 represent the 46 data points (sp, uj), k = 1,..., 46, which pair 
blood-lactate concentrations s; with voltages v; measuring the steady-state saturation rates 
for an enzyme-catalyzed reaction in a pig weighing approximately 35 pounds. Figure 44.7 
contains a graph of the data points. Theoretical considerations (the response v plateaus at 
high concentrations s) suggest the Michaelis-Menton model, so we will fit this data with 
the function f(s) = $5. 
k Sk Uk k Sk Uk k Sk Uk 
1 0.50 0.484881 16 4.90 1.144826 31 9.54 1.860081 
2 0.54 0.539144 17 5.05 1.258919 32 10.39 2.007124 
3 0.67 0.614671 18 5.06 1.472855 33 10.64 1.845749 
4 1.60 0.752003 19 5.43 1.466318 34 11.31 2.336491 
3 1.88 0.851057 20 5.68 1.290979 35 11.50 2.088616 
6 2.46 0.944543 21 5.45 1.592607 36 11.80 1.924875 
7 2.80 1.070445 22 6.00 1.140909 37 12.18 1.836792 
8 2.92 1.261938 23 6.29 1.410909 38 12.62 1.945948 
9 3.15 1.167842 24 6.70 1.383805 39 13.89 2.170512 
10 3.34 0.740801 25 7.04 1.756296 40 14.01 2.089855 
11 4.10 0.993557 26 7.36 1.563731 41 14.10 2.174003 
12 4.15 0.820775 27 8.28 1.694899 42 15.58 2.287603 
13 4.18 1.062367 28 8.67 1.603329 43 15.75 2.379107 
14 4.61 1.142383 29 9.14 2.052710 44 16.05 2.593504 
15 4.75 1.430404 30 9.17 1.648573 45 16.28 2.422318 
46 17.95 2.497853 
TABLE 44.7 The data set of Example 44.5 
v 
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FIGURE 44.7 Plot of the data points in 


Example 44.5 


FIGURE 44.8 Example 44.5: The sum of 
squares of the deviations graphed as a function of 


the parameters a and b 


FITTING THE MicHAELIS-MENTON FUNCTION TO THE Dara The Michaelis-Menton 
as 


function f(s) = 745 will be fitted to the given data using the linearizations in Ls and Lg in 
Table 44.6. The nonlinear least-squares fit will follow from the nonlinear normal equations 


obtained from the sum of squares S$ = ee (f y) — vg). Figure 44.8, containing a graph 
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of the sum of squares as a function of the parameters a and b, suggest there is but a single 
minimum for small values in the first quadrant of the ab-plane. 

LINEARIZATION IN L4 The linearization 1 = 1 + Bl requires the computation of the 
reciprocals zz = 1/s; and wy = 1/v;. The least-squares regression line w = A+ Bz fitting 
the points (zi, wx) is 

w = 0.5458858609 + 0.8061236141z 

Sincea = 4 andb = B we obtain a, = 1.831884780 and b, = 1.476725579 for the values 
of a and b computed by the linearization in L5. With these values, the Michaelis-Menton 


model becomes 
1.831884780s 


= 1476725579 + s 


The value of the sum of squares for this realization of the Michaelis-Menton model is 
then SS; = 6.431917437. 


fils) 


LINEARIZATION IN Ig The linearization y = a + (—b)* requires computation of the ratios 
Zk = Vk/Sk consonant with the new independent variable z = -. The least-squares regression 
line w = A + Bz is then 


w = 2.078083532 — 1.921465149z 


Since a = A and b = — B, we obtain a» = 2.078083532 and b; = 1.921465149 for the 
parameters a and b as determined by the linearization in Lg. For the Michaelis-Menton 
model determined by this linearization, we obtain 
2.078083532 s 
Jobs] = a Ts 
1.921465149 + s 

and find SS; = 4.526899114 for the value of the sum of squares of deviations from this 
version of the nonlinear model. 


NONLINEAR Fir The nonlinear least-squares fit is obtained by forming the nonlinear 
normal equations 


18SS Sk ( asy ) 
ah == — Uk e 0 
b+ Sk 


135S Y Sk ( ask ) 
= UE = 
2 ab c (b+5) btm * 


With 46 data points, these equations turn out to be strikingly cumbersome, in spite of the 

elegance of their symbolic representation. However, their solution gives a3 = 3.477708271 

and b3 = 8.224627001, so the Michaelis-Menton function based on these parameters is 
3.477708271s 


HO = § 224627001 4-5 


The sum of squares of the deviations from this realization of the Michaelis-Menton mode! 
is then SS; = 1.622578613. 

This problem illustrates a typical difficulty in nonlinear optimization. The minimum 
lies in a long, narrow “trough,” making it difficult to locate and calculate. Indeed, the partial 
derivatives SS, and SS, at the critical point are the small numbers —0.513 x 1078 and 
0.69 x 107°, respectively, indicating the lack of sensitivity of the sum of squares to small 
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changes in the parameters near the critical point. This is seen clearly in Figure 44.9, a 
contour plot for the surface defined by SS(a, b). Contours corresponding to the four values 
SS = 1.7, 1.8, 1.9, 2.0, near $S3 = 1.622578613 are the thin, elongated ovals depicted in 
the figure. 


+ + +> a 
3 


t 
0 72 4 5 


FIGURE 44.9 A contour plot of the surface in Figure 44.8 


Comparisons [In this concluding part of the section we compare the three versions of the 
Michaelis-Menton model we have obtained. The sum of squares of the deviations for the 
three realizations of the Michaelis-Menton model were 


SS; = 6.431917437 SS» = 4.526899114 SS3 = 1.622578613 


Without a frame of reference for comparing these numbers, the first two might not be 
alarming. However, a graph is more revealing. In addition to the data points, Figure 44.10 
shows as dotted, the model determined by the linearization in Ls; as dashed, the model 
determined by the linearization in Ls; and as solid, the model determined by the nonlinear 
normal equations. 


15 20 


FIGURE 44.10 Example 44.5: Data points from 
Table 44.7, nonlinear model (solid), L;-linearized 
model (dotted), and L¢-linearized model (dashed) 
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The curves determined by linearization methods are remarkable for their poor fit. 
Though they track each other closely, they are far from the data. Not every data set brings 
out the pitfalls of linearization as dramatically as this set. However, the outcome in this 


example should be kept in mind when fitting any nonlinear model to data. et 


EXERCISES 44.4 


7 


1. Investigate the possibility of recovering a = b = 1 from the 
Michaelis-Menton model y = aoe using the three (exact) data 


points (1, 2 (2; 2), (3, 1). 


In Exercises 2—4, fit g(x) = In(1 + va + bx?) to the given sets of data 
points ((xx, yy)), k 2 1,..., m. 


(a) From the sum of squares $ — NN. (en) — yy)?, form and 


solve the nonlinear normal equations 19$ = 0, ! 2 = 0, 
thereby obtaining 2; (x) as the fitting fiumctiai. 
(b) Show that w = A + Bz, where z = x”, w = (e? — 1)’, 


A =a, B = b, is a linearization of g(x). 

(c) Fit w = A+ Bz to the data, and from this fit obtain g»(x) as 
the fitting function. 

(d) Graph gı (x), g(x), and the data points on the same set of axes. 


(e) Determine $, = S(g,),k = 1,2 
better fit? 


; which technique gives the 


2. {(1.465, 1.449), (2.198, 1.925), (2.726, 2.138), (4.294, 2.294), 
(4.537, 2.531), (5.254, 2.733), (6.441, 2.677), (6.765, 2.761), 
(8.129, 2.771), (8.455, 3.197)} 


{(1.873, 1.403), (2.491, 1.532), (3.293, 2.013), (4.226, 1.783), 

(4.689, 2.354), (5.643, 2.401), (6.028, 2.261), (6.935, 2.319), 
(7.454, 2.363), (7.841, 2.587)} 

4. {(1.10, 1.329), (1.14, 1.409), (1.16, 1.531), (1.58, 1.494), 

(1.61, 1.500), (2.34, 1.869), (2.46, 1.601), (3.01, 1.716), 
(3.64, 1.979), (4.58, 2.076)} 

5. The data points given here were generated by adding random 
“noise” to values of the function f(x) = x +2 + vx +5. Fit the 
data with the function g(x) = yx +a + vx + b, and then graph 
f (x), g(x) and the data points. 


((0.910, 4.152), 
(1.75, 4.557), 
(4.88, 5.723)} 


6. The data points given here were generated by adding random 


(1.02, 4.204), (1.24, 4.266), (1.25, 4.278), 


"noise" to values of the function f(x) = Vx +3+2/x +7. 
Fit the data with the function g(x) = yx +a -- 24/x +b, 


and then graph f (x), g(x) and the data points. Compare to the 
results in Exercise 5. Hint: Sum of squares has more than one 
local minimum! 


((0.910, 7.556), (1.02, 7.618), (1.24, 7.851), (1.25, 7.759), 
(1.75, 8.151), (3, 8.805), (3.48, 8.926), (3.87, 9.254), 
(4.56, 9.456), (4.88, 9.806)} 


(3, 5.086), (3.48, 5.205), (3.87, 5.443), (4.56, 5.645), 


7. The data points given here were generated by adding random 


10. 


. The data points given here were generated by randomly adding 


“noise” to the values of the function f (x) = 3e^?". Fit the data 
with the function g(x) = ae’*, obtaining gi (x), and then linearize 
according to L, in Table 44.6, obtaining g2(x). Graph the functions 
f(x), g1(x), 22 (x), and the given data. Compute S(g;) and S(g>). 


((0.27, 1.923), (0.72, 1.350), (1.25, 0.2955), (1.57, 0.1558), 
(1.78, 0.1109), (2.18, 0.01917), (3.93, 0.0004631), 
(4.36, 0.0002450), (4.79, 0.0003110)} 


g +2 
to the values of the function f(x) = 3e*^. Fit the data with the 
function g(x) = ae", obtaining gi (x), and then linearize 
according to L; in Table 44.6, obtaining g5(x). Graph the functions 
F(x), gi (x), go (x), and the given data. Compute 5(2;) and S(g>) 


((0.23, 5.141), (1.81, 2.308), (1.91, 2.395), (2.52, 2.965), 
(2.66, 7.106), (3.39, 7.910), (4.17, 8.909), (4.18, 8.921), 
(4.35, 9.161), (4.61, 5.542)] 


. The data points given here were generated by adding random 


*noise" to the values ye function f(x) = 5x74. Fit the data with 
the function g(x) — ax^ , obtaining gi (x). and then linearize 
Eripe e to L5 in Table 44.6, obtaining g2(x). Graph the functions 
f(x), g1(X), g2(x), and the given data. Compute S(g,) and S(g>). 


((0.79, 3.034), (1.13, 5.986), (1.58, 10.20), (2.51, 28.35), 
(2.52, 29.40), (2.82, 33.75), (4.10, 61.00), (4.25, 68.14), 
(4.32, 75.51)} 


The data points given here were reni by adding random 
“noise” to the values ol the function f(x z—.Fit the data with 
the function g(x) — Pm obtaining gi( bd lineni according to L3 
in Table 1, obtaining go(x); and linearize according to L4 in Table 
44.6, obtaining g3(x). Graph the functions f (x), g; (x), k = 1, 2. 3. 
and the given data. Compute S(g,), k = 1, 2, 3. 

{(0.77, 0.3397), (1 48, pet (1.52, 0.3221), (2.21, 0.2968), 


(2.59, 0.2846), (2.74, 0.2351), 
(3.21, 0.2582), (3.25, 0.2521 s 


For the data sets in Exercises 11 and 12, each of which was generated by 
adding random “noise” to the function f(x) = 


3X 1 
Tix 


(a) Fit the data with the function g(x) = -—, obtaining 2; (x). 
(b) Linearize according to Ls in Table 446, prm g(x). 
(c) Linearize according to Le in Table 44.6, obtaining g3(x). 


(d) Graph the functions f(x), g; (x), k = 1, 
data. 


, 3, and the given 


(e) Compute S(g;), k = 1,2,3 


11. 


13. 


((0.12, 0.05157), (1.34, 0.4386), (1.45, 0.5560), 
(1.60, 0.5414), (2.52, 0.7226), (2.60, 0.8775), (3.34, 1.027), 
(4.10, 1.141), (4.17, 1.042), (4.51, 1.234)} 


. ((0.13, 0.06564), (0.43, 0.2083), (1.10, 0.2037), 


(1.25, 0.3636), (1.43, 0.2544), (1.50, 1.006), (1.97, 1.252), 
(4.03, 2.083), (4.45, 1.749), (4.76, 0.4857)} 


The data points given here were generated by randomly +0.25 to 
the values of the function f(x) — t. Fit the data with the 


function g(x) — Pis obtaining 2; (x) (a will lie in [5, 6] and b will 


Chapter Review 


1. 


N 


Demonstrate the process of fitting the line y = ax + b to the data 
points (0, 1), (2, 0), (3, 3). Obtain the sum of squares of the 
deviations, and use the techniques of the calculus to minimize it. 
Exhibit and solve the normal equations. 


. Rework Question 1 with matrix methods, starting with three 


equations in two unknowns, leading to Au = y, and then 
ATAu = ATy =b. 


. Use the matrix methods of Question 2 to fit a quadratic to the data 


points (0, 1), (2, 0), (3, 3), (4, 6). Show that this is an example of a 
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lie in [14, 15]); linearize according to Ls in Table 44.6, obtaining 
g2(x); and linearize according to Le in Table 44.6, obtaining g3(x). 
Graph the functions f (x), g, (x), k = 1, 2, 3, and the given data. 
Compute S(g,), k = 1, 2, 3. Comment on the efficacy of the 
linearization process for data fitting. 


((0.07, 0.2797), (0.16, 0.3170), (0.86, 0.5782), (1.31, 0.2229), 
(2.77, 1.101), (2.95, 0.6394), (3.01, 0.6521), (4.26, 1.385), 
(4.72, 0.958), (4.94, 1.491)] 


general linear model. Exhibit the vectors $,, k = 0, 1, 2, the vector 
y, and the vector b. Also, exhibit the matrices A and ATA. 


. Answer Question 3 by means of the algorithm for generating 


orthogonal polynomials. 


. Describe the options available for fitting data with a nonlinear model 


ax 
b+x* 


such as y = 
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Chapter 45 


Numerical Calculation 
of Eigenvalues 


INTRODUCTION The algorithm for the pencil-and-paper calculation of 
eigenvalues of a 2 x 2 or 3 x 3 matrix is not the algorithm used for numeric computation. 
With pencil and paper, the characteristic polynomial must be obtained and its zeros found. 
Solving the quadratic equation that results from a 2 x 2 matrix is possible with the quadratic 
formula. Solving the cubic that results from a 3 x 3 matrix is a significantly harder problem. 

Chapter 45 describes several numeric methods for finding eigenvalues. None of these 
methods formulates or solves the characteristic equation. Essentially, this is because, as 
seen in Section 37.1, finding zeros of polynomials is inherently an unstable calculation 
on a finite-precision computing device. All numeric methods for finding eigenvalues are 
iterative. 

This chapter contains the most difficult computational mathematics of the text. It is 
difficult mathematics because the numeric computation of eigenvalues is a difficult problem. 
Readers willing to rely on professionally packaged code for computing eigenvalues might 
easily treat the first four sections as optional since they merely detail the methods used in 
modern software. But those algorithms can be found already coded, and the reader need not 
recode them in order to execute them. With the right set of tools available, these first four 
sections can certainly be considered optional. 

The various power methods converge linearly. Interesting as the underlying ideas might 
be, power methods are not generally found in production software. Except perhaps for large 
sparse matrices, there are better methods. 

The Householder reflection is a computational tool of paramount importance in the 
more efficient algorithms found in effective modern software packages. Multiplying a vector 
X by its Householder reflection matrix yields a vector that is the geometric equivalent of 
a reflection across a plane or line and has zeros for all components below a designated 
one in x. In addition, the Householder matrix is both symmetric and orthogonal and has 
determinant —1. 

A sequence of Householder reflections can be used to upper-triangularize a matrix 
A, thereby obtaining its QR decomposition without using the Gram-Schmidt process. At 
this point in the discussion, we simply have an alternative technique for obtaining the QR 
factorization of Section 34.3. The Gram-Schmidt process finds the factor Q, whereas the 
Householder reflection matrices lead to the factor R. 

We are in possession of the QR algorithm from Section 34.4. This computational 
technique for finding eigenvalues requires repeated QR factorizations for which we now 
have two different processes. Efficient implementation ofthe QR algorithm is best performed 
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on the upper Hessenberg matrix, a matrix that has only zeros below the diagonal, which is 
itself below the main diagonal. In other words, the upper Hessenberg matrix is one diagonal 
away from being an upper triangular matrix. 

A sequence of Householder reflections can be used to put a matrix A into upper Hessen- 
berg form. Moreover, this is accomplished with a similarity transform so that the resulting 
upper Hessenberg matrix has the same eigenvalues as A. Thus, the Householder reflections 
are used to precondition A, putting it into the form of an upper Hessenberg matrix with the 
same eigenvalues. 

At this point there are two choices. The QR factorization of A can be completed using 
annihilating Givens rotations, or the shifted QR-algorithm, which converges rapidly for 
matrices in upper Hessenberg form. Thus, a matrix is put into upper Hessenberg form 
by Householder reflections and then factored into its QR form using Givens rotations. 
Alternatively, the shifted QR-algorithm can be applied to the upper Hessenberg form of A. 
When applied to such matrices, this algorithm converges very rapidly. 

The chapter concludes with a discussion of the generalized eigenvalue problem, which 
appears, for example, when trying to obtain normal modes of vibration for coupled harmonic 
oscillators. 


Power Methods 


Introduction 


The various power methods use iteration to compute eigenvalues and eigenvectors of the 
n x n matrix A. If the eigenvalues of A are arranged in order of decreasing magnitude, so 
that |A1| > |A2| > -+-+ > |A,|, then any eigenvalues having largest magnitude will be called 
dominant and any having smallest magnitude, least dominant. 

If xo is an arbitrary initial vector, the iteration x; = A*xo, k = 1,2, ..., is the essence 
of the power method. Under the assumptions that |A;| > |A2| and that A has n linearly 
independent eigenvectors vj, ..., Vn, With Av; = A;V;, we can show how the power method 
leads to the dominant eigenvalue and its eigenvector. 

First, write xo in terms of the eigenvectors as 


Xo = QV + 2V2 +--+ + Og Vn 


Then, since A*v; — Avi, we have for x, = A*x 


l , . la k X, k 
Xk = aA vi + agA Eva ouv, = M «im +02 (2) Vo + On (=) Vn 
«1 1 


which, because of the strict dominance of A, tends to art v; as k increases. 

Clearly, if we simply carry out the iteration x, = A^xo, k = 1,2,..., the magnitude 
of x; will grow if |A;| > 1 or will shrink to zero if |A;| < 1. (See the ensuing discussion of 
the naive power method.) 

To extract the value of A; from xz, some sort of scaling must be used at each step. Either 
divide x; by the component with largest magnitude or consistently divide each iterate by the 
same component. Both options are explored in the discussion of the scaled power method, 
where we discover that the first technique converges slightly faster than the second. 

Suppose we scale with the first component so that the power iteration consists of the 
two steps y = Ax, and X41 = ty, where yj, the first component of y, is assumed to be 
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nonzero. The first component of x; is a 1, and the first component of y is approximately 7. 
since x, is approximately proportional to the eigenvector v;. Then, x; tends to that multiple 
of v; in which the first component of the eigenvector is 1, and the values of y; tend to 4. 


EXAMPLE 45.1 In (45.1), we have a matrix A and to its right, its eigenvalues. 
6 5 -1 2 A, = —10.08570923 
—5 -7 4 -6 A2= 9.458884520 
A=| i 6 6 7| à= 2950157561 cred) 
4 1 5 —3 Ag = —0.323332851 
Corresponding eigenvectors, scaled so that their first components are 1, are 
1.000000000 1.000000000 1.000000000 1.000000000 
—2.467783955 1.200899814 —0.8267558725 —1.698034948 
1.374495378 17.12862769 0.02545954948 0.1633114879 
—1.186147036 7.291506576 0.5546982303 1.165076683 
(45.2) 
This matrix and its eigenpairs will be used in the following discussions. e 
Naive Power Method 
If the power method is implemented without scaling, the magnitudes of the iterates x; will 
either grow or shrink, unless, perchance, |A;| = 1. For the matrix A in Example 45.1, this 
is not the case, and the power iterates, starting with xo = [1, 1, 1, 1]', will include 
12 42,412 —3,094,896,548 
a —14 Ta —77,816 "— 9,601,408,696 
| 39 > | 168,910 10 | 4,178,333,965 
7 10,591 8,208,895,693 
Without some form of scaling, a naive power method just isn’t useful. 
Scaled Power Method 
Next, we will execute the scaled power method in which the first component is always the 
scaling factor. The method then converges to v. 
For k = 50, 100, 150, and 200, Table 45.1 contains the power iterates x;, along with 
the values of y1, |y; — Ay], and ||x, — vj ||. The values of y; slowly converge to A), the eigen- 
k = 50 k = 100 k = 150 k = 200 
1.000 1.000 1.000 1.000 
" —2.510 —2.469 —2.468 —2.468 
* 1.194 1.367 1.374 1.374 
— 1.283 —1.190 —1.186 —1.186 
yı —9.852557242 —10.07617438 —10.08532355 —10.08569364 
[yı — Ail 0.233 0.953 x 10? 0.386 x 10? 0.156 x 107^ 
lxx — vill 0.209 0.836 x 10? 0.338 x 10? 0.137 x 107^ 


TABLE 45.1 Scaled power iterates for the matrix of Example 45.1 
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value of largest magnitude, and the x; slowly converge to v;, the corresponding eigenvector. 
Due note should be taken of the extremely large number of iterations required to obtain 
even modest accuracy. This is because the magnitude of A» is close to the magnitude of 1. 
The ratio [#2 | = 0.9378502101 is raised to powers. The closer this ratio is to 1, the slower 
the rate of convergence for the scaled power method. 

The speed of convergence can be increased slightly if, instead of dividing by the first 
component of y, = Ax; ;, we divide by the component of largest magnitude. This means 
extra coding to determine which component to divide by in each iteration. As a consequence, 
it becomes difficult to compare x, to v; because we don’t know beforehand the component 
with which to scale vı. With this modification, the x200 in (45.3) is obtained, along with the 
estimate 4; & —10.08571680, in error by 0.757 x 10 


—0.4052214073 
1.000000000 

—0.5569701743 
0.4806547389 


(45.3) 


X500 — 


Inverse Power Method 


If (A, X) is an eigenpair for the invertible matrix A, then G, x) is an eigenpair for the matrix 
A^, the inverse of A. Indeed, by assumption we have Ax = Ax so that, upon multiplication 
by the inverse of A, we have x = AA ^!x or ix = A^!x. Thus, x is an eigenvector for A^! 
and the eigenvalue is L, 

This observation clearly lets us compute the least dominant eigenvalue for A by com- 
puting the most dominant eigenvalue of the inverse, A~'. This adaptation is called the 
inverse power method and is illustrated for the matrix A given in (45.1). 

The inverse of A and its eigenvalues A, are given in (45.4). The reciprocal relation of 
the eigenvalues of A^! and A are noted to the right of A7 in (45.4). 


1 
Ay = — = —3.092788222 


Aa 
[22 xe 39 -US| ag = = 033964481 
VINE NL — — 2 3 
A —ai| 46 41 B -1 1 (45.4) 
345 262 52 —203 A3 = z = 0.1057207116 
1 
A4 — pe —0.0991501916 
1 
The eigenvectors of A~', scaled so that the first components are 1, and denoted by Vz, 
are given in (45.5). Comparison with (45.2) shows v, = Vs 4, k = 1,...,4, as expected. 
1.000000000 1.0000000000 1.000000000 1.000000000 
— 1.698034944 —0.8267558750 1.200899822 —2.467783955 
0.163311487 0.02545955023 17.12862777 1.374495380 
1.165076682 0.5546982336 7.291506608 —1.186147026 
(45.5) 


If we apply the scaled power method to the matrix A~', we should compute an ap- 
proximation to the reciprocal of the least dominant eigenvalue of A, that is, to 7 =Å S 
—3.092788222. After 200 iterations we compute, as an approximation to V, = v4, the 
X200 shown in (45.6). Also shown are yı, an approximation to Aj, the error |y — Aj], 
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and |[Xooo — V: ||, the norm of the difference between the approximate eigenvector and the 
actual eigenvector. The apparent greater accuracy in the calculation of the least dominant 
eigenvalue stems from the comparatively smaller ratio Fa = 0.1095984994. 


0.9999999999 
1.608034944 yi — —3.092788218 
X50 = | 9 1633114870 ln — Ai 2. 4 x 10-9 (45.6) 
165 lXooo — Vil] = 1x107! 


1.165076682 


Efficiency in the Inverse Power Method 


For a4 x 4 matrix, computing the inverse with modern software tools is effortless. However, 
in more realistic problems, the inverse of a matrix is generally too expensive to compute. 
Instead, in the inverse power method, the equation xy; = A~!x; is replaced by the equation 
AXx41 = X, and X+; is obtained from an L; U decomposition of A by forward and backward 
substitution. Thus, L;¢ = x; is solved for c by forward substitution and Ux; = cis solved 
for Xi. by back substitution. 


Shifted Inverse Power Method 


The most and least dominant eigenvalues can be computed by the scaled and inverse power 
methods, respectively. To compute other eigenvalues, shift eigenvalues according to the 
following prescription. 

The matrix A having eigenpair (A, x) is equivalent to the matrix (A — c7) having 
eigenpair (A — oc, X). This is verified by starting with Ax = Ax and subtracting ox from 
each side to obtain Ax — ox = Ax — ox or (A — o I)x = (A — o)x, which implies that 
A — o is an eigenvalue of A — c1, with eigenvector x. 

The utility of this observation hinges on finding o near enough to A, so that the differ- 
ence A; — ø is now the least dominant eigenvalue of the matrix A — o7. The inverse 
power method applied to A — o7 will then find the eigenvector x and the eigenvalue 
wi = 1/(; — o ) so that 4; = 1/a@; +v. 

For the matrix A in (45.1), to compute A? = 9.458884520, the eigenvalue with the 
second largest magnitude, set o = 7 because the differences 4, — o, k = 1,...,4, are 
then —17.1, 2.5, —4.0, and —7.3, respectively. Thus, A» — 7 = 2.5 is the least dominant 
eigenvalue for the matrix A — 77, and the inverse power method applied to this matrix will 
compute c», an approximation to "ER The matrix (A — 77)~!, and X2, the resulting 
approximation to v», appear in (45.7). The corresponding estimate of c» is 0.4066884797. 
SO A» is approximated as 9.458884502 with an error of just 1.8 x 1075. 


216 65 26 2 
623 622 22 9 
0 25-2. 0.999999999 
|224p-1.| 1246 ^16 — 83 178 _ | 1.20089981 
ae ST ow ni 207s | 7 99? = | 1712862763 p 
1246 1246 623 178 7.29150655 
121 53 114 3 
1246 1246 623 178 


Gerschgorin's Disk Theorem 


Initial guesses for the shifts in the shifted inverse power method are usually taken as the 
diagonal elements in A. Motivation for this suggestion stems from the Gerschgorin Disk 
Theorem. 


FIGURE 45.1 Eigenvalues and 
Gerschgorin disks for the matrix in 
Example 45.1 
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THEOREM 45.1 


Each eigenvalue of the matrix A lies in at least one of the circular disks D; = 

Z, |Z — akx| < rx}, where the radii of the disks are r} = 2. |axjl, J Æ k: More- 
over, if the union of any m disks intersects no other disk, then this union contains 
exactly m (possibly repeated) eigenvalues of A. Thus, the eigenvalues lie in the union 
of disks that have their centers at the diagonal elements of A and have radii that are 
the sums of the absolute values of the elements of the rows, exclusive of the diagonal 
elements. (See [60] for a proof.) 


For the matrix A in (45.1), the centers and radii of the Gerschgorin disks are given in 
Table 45.2. 


Centers (6,0) (—7,0) (6, 0) (—3,0) 
Radii 8 15 14 10 


TABLE 45.2 Centers and radii of the Gerschgorin disks for the 
matrix in Example 45.1 


A graph showing the disks and the actual eigenvalues (as black dots) is shown in Figure 
45.1. The shift of o = 7 is consistent with the information in Figure 45.1, but by no means 
is locating eigenvalues as mechanical as this one example might imply. The power method, 
and all its variants, is not really a modern “production” method for finding eigenvalues. 

Our approach to numeric computation remains the same. The typical user will not 
write code to perform routine computations but, rather, will use professionally written and 
well-tested packages and libraries. For those who eventually find they must write their own 
code, the underlying ideas presented here will serve as guidelines. 


A Matrix with Repeated Eigenvalues 


By design, the matrix A in (45.8) has the eigenvalue à = 3 with algebraic multiplicity 4 
and geometric multiplicity 2. Hence, A has just the two eigenvectors v, and v» given to the 
right of A in 


10,623 2269 1608 5207 
2650 2650 1325 2650 23 _45 
1199 7303 754 2641 E 14 
2650 2650 1325 2650 d = 
A= y= V = 45.8 
1503 241 5013 4177 l 17 a 0 (45.8) 
2650 2650 1325 2650 
0 17 
889 367 1138 1924 
1325 1325 1325 1325 


Applied to A with 500 iterations, the scaled power method yields 3.006 as an approx- 
imation to A = 3 and xsoo, shown in (45.9), as the companion eigenvector. Because of the 
repeated eigenvalue, it took a large number of iterations to approximate the single eigen- 
value à = 3. The vector returned by the method is an approximation to a linear combination 
of the two eigenvectors of A. It is surprisingly difficult to demonstrate that xsoo is close to 
being a linear combination of the eigenvectors v; and v». 


1.000000000 
_ | 0.705504797 
X500 = | _ 1588247513 
—1.183833025 


(45.9) 
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The matrices A; and A» are used in the exercises that follow. 


208 -16 0 a [38 86 -58 
Àim—| 4 232 -20| A= 307 —59 —46 
300|. 17 -16 225 186 | 5 2 -227 


1. Show that for A;, the maximum of the magnitudes of the 
eigenvalues is less than 1. Verify that the naive power method A* xo 
generates vectors of diminishing magnitudes. 


2. Show that for A2, the maximum of the magnitude of the 
eigenvalues is greater than 1. Verify that the naive power method 
A*xo generates vectors of increasing magnitudes. 


There are two ways to implement the scaled power method. The vector 
A* xo can be consistently divided by, say, the first component, or by the 
component with largest magnitude. In Exercises 3 and 4, use the given 
matrix to quantize the difference in these two implementations. For ex- 
ample, the errors in the approximation of 4, can be compared after a 
fixed number of iterations, or the number of iterations it takes to reduce 
the errors to a fixed tolerance can be compared. Is the improvement with 
the second method significant? 


3. Use matrix Aj. — 4. Use matrix A». 


For the matrices given in Exercises 5 and 6, apply the inverse power 
method to find the eigenvalue of smallest magnitude and its companion 
eigenvector. Implement the calculation in an "efficient" manner, solving 
the equation Ax,,; = X; for x; using forward and back substitutions 
with an L;U decomposition for A. (If A = PLU, where P is a per- 
mutation matrix so that P^! = PT, solve Ljc = P'x, for c by forward 
substitution and Ux;,, = c for x,,, by back substitution.) 


5. Use matrix A}. 6. Use matrix A». 


For the matrices given in Exercises 7 and 8, use the shifted inverse power 
method to find A» and its companion eigenvector, where the eigenvalues 
A, have been ordered |A;| > |A2| > |A3|. (Because part of the “plea- 
sure” of using this method is discovering appropriate shifts, we make no 
recommendations on the matter.) 


7. Use matrix A; 8. Use matrix A» 


For the matrices given in Exercises 9-12: 


(a) Obtain the eigenvalues (perhaps by using a software package). 


(b) Apply Gerschgorin's disk theorem, graphing the disks and 
eigenvalues. 


(c) Comment on the utility of the theorem to locate eigenvalues. 


5 8 4 —3 6i 3-4 6i 8 2i 
8 —9 7 5 —5 5i —4 —3i 1 
2. 0 4 4 2 10. —5 6 —1+8 2-—4i 
5 =$ 9 -—9 4 —2i 7 9 7 4- 3i 
—l— 4i  —8i —54-9i — -à 3-7 1 
1 9 — 6i 9 9 4- 9i -1 3 8 3 
11. 8+4i 4 9 4- 8i —8 = 3-9 -6 3 
—9 —3 — 2i 7 9+ 4i 9 -9 -5 6 


In the scaled power method, let 44, be the kth approximation to A,, 
the eigenvalue of largest magnitude. For each of the matrices des- 
ignated in Exercises 13 and 14, show that for k sufficiently large. 
Iis — ài l/u — àil & I2 < 1, verifying the linear convergence of 
the method. Caution: If xo is a linear combination of the eigenvectors 
corresponding to A, and A», then the limiting ratio turns out to be | 


In Exercise 13, xo = [1, 1, 1]T, for example, will make this happen.) 


13. Use matrix A;. 14. Use matrix A». 


An alternate implementation of the scaled power method begins with the 
unit vector Xo, computes v, = AX; and Hy = x; - Vy as an approximation 
to A,, and then sets X,; = Vx/||V«|l2, the normalized version of y;. Apply 
this method to each matrix designated in Exercises 15 and 16, and show 
the convergence is still linear, with |j41 — ài l/l — àil = fa «] 
holding for k large enough. 


15. Use matrix A}. 16. Use matrix A>. 


For A, asymmetric matrix, [16] shows the method in Exercises 15 and 16 
satisfies | ug+1 — A1|/ Ia — A4] S la |? < 1, so that the convergence, still 
linear, is more rapid than in the nonsymmetric case. For the given sym- 
metric matrices in Exercises 17 and 18, apply the algorithm of Exercises 
15 and 16 and verify the rate of convergence is as claimed. 


17. Use the matrix in Exercise B30, Section 32.2. 
18. Use the matrix in Exercise B33, Section 32.2. 


19. Suppose the symmetric n x n matrix A has eigenpairs 


Op mhk = lrs n, with à; as the eigenvalue of largest 
magnitude. Show that B — A — myy has eigenpairs 


(0, vi), (Ax, Ve), k = 2, ..., n. The matrix B is called the Hotelling 
Deflation of A. 


For each of the matrices in Exercises 20 and 21, use Hotelling Deflation 
to find åz, the eigenvalue of second-largest magnitude. Unfortunately, 
roundoff error vitiates this approach to finding a// eigenvalues of a matrix. 


20. Use the matrix in Exercise 17. — 21. Use the matrix in Exercise 18. 


Householder Reflections 


Introduction 


?) H . . ren! . 
If r = |X|; = V 3; , x? and signum x = +1, 0, accordingly as x is positive, negative, or 
zero, then a Householder reflection matrix is an orthogonal matrix H that maps the vector 


EXAMPLE 45.2 
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x to the vector y satisfying the conditions 
y =% È lssisa k—1 yy = —r signum x; y —-0 i-k-cl,...,n 


Thus, y agrees with x above the kth position, is zero below the kth position, and has 
yy — —r signum x; at the kth position. The vector y is displayed on the right in (45.10). 

At the end of this section we will prove that if the vectors u and y are as defined by 
(45.10) and the matrix H by H = I — 2uul, then Hx = y. We will also show that H is 
orthogonal, with det(H) = —1, so it represents not just a pure rotation but a reflection (see 
Section 32.2). In fact, we will show the vector y is the reflection of x across the subspace 
orthogonal to the vector u. 


0 XI 
l 0 Xk-1 
= ——— | signum(x;)(|x,| +r) y = | —r signum x; (45.10) 
Varr) Bud ^ 
Kn 0 


In practice, Householder reflections are used to “zero out,” or annihilate, entries of the 
vector x, creating zeros below the kth component. We will demonstrate two specific uses 
for these transformations. First, they provide an alternate path to the QR decomposition. In 
Section 34.3 we obtained the QR decomposition of a matrix A using the Gram-Schmidt 
process for finding Q. In Section 45.3 we will use Householder reflections to find R in the 
QR decomposition. 

Second, Householder reflections can be used to precondition a matrix prior to applica- 
tion of the QR algorithm for finding eigenvalues. The goal of the preconditioning is the upper 
Hessenberg form of the matrix. Thus, in Section 45.4 we will see how to use Householder 
reflections to generate a similarity transform of A into upper Hessenberg form. (Similar 
matrices have the same eigenvalues.) 

Articulation of the distinction between obtaining the QR decomposition by the Gram- 
Schmidt process or by Householder transformations follows from remarks in [89]. 


For the vector x = [3, —1, 6, —9, 6]", define the eight parameters in Table 45.3. 


k 1 2 3 4 
"o 38 V308 V102 26 
n ]— AS J/|54 —1 S17 =2 J/13 —3 
TABLE 45.3 The eight parameters defining the vectors uz, k = 1,..., 4, in Example 45.2 
In terms of the parameters in Table 45.3, the vectors uz, k = 1,..., 4, for the House- 


holder algorithm are given in (45.11). (See the software accompanying the text for a pro- 
cedure that returns u when given a vector x and an integer k representing the component in 
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X below which annihilation is to occur.) 


0 0 
154 0 
J63 —1 0 
— ji 2u2 ] 5 
uj = 0] 64, Un = 05 51 us; = 03 313 U4 = 04 
2 ———— —1 
zn -5 13 
H1 17 " 
JE 2» 2u3 E 
51 13 
(45.11) 
The Householder reflection matrices Hy, = I — 2u,u[, Es 4, are given in 
(45.12)-(45.15). The reader can verify that det Hy = —1 and that HT = H, ! or, equiv- 
alently, that HI H; = I, fork =1,..., 4. (These calculations appear in the software ac- 
companying the text.) 
—3h| hy —6h, 9h, —6h, 
, 3(51 +h) 3(1—3Ahj)) 9(3h;-1) 3(1—3A)) 
h 
i 154 TI 154 TI 
3(1—3h,) 54h; +59 27(1—3hj) 18(3h, — 1) l 
R= 6h; hea 
= 77 77 TT 77 y= TE 
" 9(3À4; —1) 27(1—3h)) 343h,--73 27(1—3A) 
h 
i 154 TI 154 77 
6l 3(1—3h;) 18(3h;,—1) 270 —3h,) 54h; +59 
1 
i TI 77 TI TI 
(45.12) 
1 0 0 0 0 
0 =h 6h» —9h» 6h» 
0 6h; 4h; 4-13 6(1 — hz) 4h, — 4 
B 17 17 17 ; (45.13 
2= 12 = 13) 
0 " 6(1 — ho) 9ho +8  6(1— h) Vv 154 
1%) 
E 17 17 17 
4h —4 6(1 — ho 4h; + 13 
0 6h — ni. Mer 
17 17 17 
1 0 0 0 0 
0 1 0 0 0 
0 0 —2ha 3h; —2h; 1 
H; = 2(9h3 +2 6(1 — 27 h; = —— 45.14) 
=i 0 % Ae o — um CS 
13 13 
6(1 — 2h 8h 9 
0 0 2h; ( 13) ta + 


13 13 


EXAMPLE 45.3 
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1 0 0 0 0 
0 1] 0 0 0 1 
Hy=}|}0 0 1 0 0 h4 = —— (45.15) 
0 0 O -3h, 2h, uis 
0 0 0 2h, 3h4 
The vectors y; obtained as the products H;x = yj, k = 1,...,4, are given in (45.16). 


Each Householder matrix H; has been constructed to “zero out” the components in x below 
the kth. Thus, we see that H;x = yj, in which all components below the first are zero. We 
then have H2x = yo, in which all components of x below the second are zero. In H3x = ya, 
we see that all components of x below the third have been annihilated. Finally, in H4x = y4, 
we have all components below the fourth annihilated. Since there are no components of x 
below the fifth, there are no other Householder reflections we can inflict on this particular 
vector X. 


—4/163 3 3 3 
0 A/154 -1 -1 
y= 0 y=] 0 ys = | -3417 u= 6 (45.16) 
0 0 0 —3 4/13 
0 0 0 0 " 


e 


In the remaining portion of the section, we illustrate the geometry that connects the 
vectors x, u, and Hx. 


In this example, we construct a Householder reflection of the specific vector x — [2, 1]T. 
In particular, we take k — 1 so that we "zero out" just the second component. 
The general 2 x 2 matrix H is given by 


hy h 
Hal" m 
h3 h4 
For H to be an orthogonal matrix, its transpose must be its inverse so that HTH = I. This 
generates the three conditions 
hl-d$-1  hcLhS-1  hhichyha-—0 
The requirement that H represent a reflection gives a fourth condition, 
det H = hih4 — hzh3 = —1 
There are two possible solutions to these four equations, leading to the matrices 


—ha4 Jl1- h? —h4 —,/1— hi 


A, = H» = 


Jl-hj ha -Jl-hi h4 


In agreement with (45.10), the parameter h4 is determined by the condition that H;x = 


y =[—V5, 0], j = 1 or 2. Using H and equating corresponding components we have the 


equations 
—J1-Al—2h,— —5 and —2,/1—hAZ +h, =0 
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FIGURE 45.2 The vectors x, y, Mx, U; 


and U; in Example 45.3 


EXAMPLE 45.4 


Generally, two equations in a single unknown might not have a solution if the two equations 
impose independent conditions on the unknown. However, there is a solution, namely, 
h4 = =. Surprisingly, the conditions imposed by Hıx = y are not compatible and the 


v 
x — h? — 2h, — —^45 and 2,/1 —hich, =0 
have no solution. 


equations 
Thus, the matrix H of the desired Householder reflection is given in (45.17), and we 
leave it to the reader to verify that det H = —1, that HT = H™', and that Hx = y = 


[A 5, O]T. 
1 [2 1 
i uns | 1 (45.17) 


In Figure 45.2, the vectors x and y are drawn. A vector along the bisector of the angle 
between x and y is given by 


M,-lxa«y-1p- V5, 1]" 


Unit vectors perpendicular to Mx, namely, the vectors U; and U}, are found by interchanging 
the components of Mx, negating one component, and normalizing. Thus, U; and U2 will 


point in opposite directions, and we have 
V5 2 
| y Uz = -Ui 


Te l 


10 


The vector component of x along M, is given by the projection 
Xx: M, 
Mx » Mx 


The vector y is the sum of M, and U;, while the vector x is the sum of M, and Up. 
The vector components of x along and perpendicular to Uj are, respectively, 


M, = 3[2 — v5, 1] = M, 


Xy, = (x - Uj)U, = [24 V5. d and Xiu, —X— Xp, = 1[2 — V5, i] = Mx 


The component of x perpendicular to U; is just My. Hence, from M, = ix + y), we have 
y = 2M, — x. Since x is the sum of its components along and perpendicular to Ui, that is. 
since X = Xy, + Xiu,, we have for y 


y= 2M, =J = 2X10, = (xu, + Xiu,) = Xiu; — XU, 
Thus, y is the difference between the components of x perpendicular to and along Uy. $ 
We next give a three-dimensional example of a reflection of the vector x = [2, 3, 4]" across 
the plane whose unit normal is u = [11, u2, u3]'. For the reflection y = Xy — Xu, consider 


the case k = 1 so that we “zero out" the second and third components of x. Using ||u|? = 1. 
the vectors xy = (X - U)U, Xiy = X — Xy, and y become, respectively, 


— 2(2u4 + 3u2 + 4u3)u, | 
2u, + 3u» + 4u3)uUr 
2u, + 3u2 + 4u3)u3 | 


N 


(2u; + 3u5 + Au3)u 2 — (Qui, + 3u2 + Au3)u 
(2u4 + 3u5 + 4u3)u» 3 — (2u; + 3u2 + Au3)u» 3 — 2( 
(2u4 + 3u2 + 4u3)u3 4 — (2u, + 3u5 + 4u3)u3 4 — 2( 
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The reflection y must have zeros for its second and third components, and its length 
must be ||x|| = 4/29. Thus, equating y with [—4/29, 0, 0]' gives three equations in ug, k = 
1, 2, 3, the solution of which leads to two vectors u, namely, 
2+ 429 

3 U; = —U; 

4 
Both unit vectors, simply pointing in opposite directions, generate the same reflection y. 

The projection of x onto the plane for which U; (or U2) is the unit normal is 


1682 — 1164/29 
290 


U = 


mm 


3 =i(x+y)=M 
4 


The normal to the plane containing x and y can be found as the cross-product N = x x i= 
[0, 4, —3]T. The vector N must lie in the plane across which x is reflected, that is, the 
plane for which U; (or U2) is the unit normal. This is confirmed by showing that N is 
orthogonal to either of the unit vectors and also to the vector M. In fact, the orthogonal- 
ity of N and M shows that M lies in the plane of reflection. Simple calculation shows 
N-U, ZN-U;-N.M-0O. 

Figure 45.3 displays the vectors x, y, M and the two unit vectors U; and U5. $ 


XS Xia 


-5 


—4 8 


A e 


FIGURE 45.3 The vectors x, y, M, U, and U, 
in Example 45.4 


Obtaining H in Terms of u 


We have already seen the equation y = x,y — Xu relating the vector y to the vectors x and 
u. Since Xi, = X — Xy, we have 


y = (X — Xu) — Xu = X — 2Xu 
Since u is a unit vector, the projection x, is given by 
T 
X, = (X: u)u = (x'u)u = u(x! u) =u (xu) = uux 


where we can go from the second to the third equality because (xTu) is a scalar and the 
transpose of a scalar is itself. Thus, the reflection becomes 
T) 


y =x — 2uu!x =(/ — 2uu!)x 


so the matrix H must be given by H = J — 2uu’. 
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FIGURE 45.4 The vectors x, y, X — y, 
Xiu, Xy and —x,, where u is parallel to 
x—y 


We next show that if u is a unit vector, then H = J — 2uuf is always an orthogonal 
matrix. Indeed, we need to show HTH = I, which we can do by remembering that the 
transpose operator distributes across sums. Thus, we write 


H"H = (I —2uu’)' (1 — 2uu) = (J — 2uu?)(1 — 2uu?) 


= I — 2uu? — 2uu! + 4uu? uu? = 7 — 4uu? + 4007 = 7 


; u— T T 
The product uu! is a symmetric matrix since (uu) = (uT) u” = uu’. Hence, we have 


the second equality. The fourth equality is true since u'u = u-u= 1. 

The proof that H = J — 2uu? has determinant —1 is more subtle. The argument we 
present is from [64], in which a matrix A is constructed with u as the first column and the 
remaining columns taken as independent and orthogonal to u so det(A) 4 0. This can be 
done ultimately on the strength of the Gram-Schmidt orthogonalization process. Then, for 
such a matrix A, we establish 


det(H A) = det H det A = —det A 


The first equality is always true for the product of matrices. The second equality then implies 
that det H = —1. To verify that vital second equality, consider the product 


HA = (I —2uu')A = A —2uu! A 


The product uA is the row vector [1,0, ..., 0], so u(uT A) = [u,0,..., 0], and H A is 
the matrix A except that all the elements in the first column have been negated. Hence, 
det HA = — det A and det H = —1. 

Thus, we have shown that for a unit vector u, the matrix H = I — 2uul is both 
orthogonal and a reflection. Next, we will show how to determine u so that Hx — y for 
f Tysses n — 1. 


Solving Hx =y foru 


Our construction of a unit vector u satisfying (J — 2uu')x = y is motivated by [60] and is 
guided by Figure 45.4. The unit vector u is taken parallel to the vector x — y. The vector 
X is resolved into xy and x,y, the vector components along and perpendicular to u. The 
vector x is the sum of x, and x,y, whereas the vector y is the sum of x |, and —x,. 

Analytically, we have y = X,y — Xu, a basis for the following fundamental claim. If 
|x|] = lly||, taking u = E and defining the matrix H = J — 2uu' means that Hx = y. 
We offer three ways to see this. 

First, since u is parallel to x — y, we see from Figure 45.4 that y is the sum of x,y and 
—Xy, and by earlier calculations, we know this leads to H = J — 2uufl. 


Second, we provide a numeric example where ||x|| = ||y|| = 1 and u =x — y. 
0.6119097028 —0.6592514624 0.7752094520 

x — | 0.6580915672 y= 0.4770898740 u = | 0.1103827172 
0.4387277114 —0.5811822103 0.6219854991 


The matrix H = J — 2uu’ is then given by (45.18), and a calculation shows Hx = y. 


—0.201899389  —0.1711394514  —0.9643380758 
H — | —0.171139451 0.9756313115 | —0.1373128989 (45.18) 
—0.964338076 | —0.1373128989 . 0.2262680778 
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Third, we show directly that if ||x|| = ||y||, u = ED H = I —2uu/, then Hx = y. 
To do this, we need 


Ix — yl? 2x—-y-:x-y-x-:x-x:y-y:x-y-y 
= ||x|/? + lly? — 2x - y = 2IxI? — 2x-y 


where the last equality is true in light of the assumption that |x|| = ||y||. Then, we have 
2(x — y)(x — y)? x|x — yl? — 2(x — y)x — y)"x 
Hx —|I > = E 
Ix — yl Ix — yll* 


for which, expanding the numerator and using ab = a - b, gives 
x|x — yl? — 2(xx* — xy? — yx! + yy)x 
= x|ix — yl? — 2(xxTx — xy?x — yx?x + yy? x) 
= x|x — yl? — 2[x(x- x) — x(y x) - yx) + (y+ x)] 
= x|x — yl? — 2[x||x||? — ylixi? — x& y) +y@-y)] 
= x[2Iixl? — 2x - y)] — 2[x||x||? — ylixl? — x - y) -- ya - y)] 
= 2x||x||? — 2x(x - y) — 2xlIixIl? + 2ylixil^ + 2x(x - y) — 2y(x - y) 
= yill? — 2(x - y] 


= yllx - yl? 
and finally, Hx = ey =y. 
All that remains is to describe u in terms of the vector y, which is determined from x 
by “zeroing out" entries in x. Start with the hypothesis ||x|| = |ly||, stated as ||x||? = Ilyll?, 


to get 
k-1 


n k-1 n 

2 2 2 2 
> x = J x +y + 1 0? and y= 3 x -5 xX = ) xj =r" 
i=l i=l i-k 


i=l i=k+1 


Then define r= / 37 , x and y, = — signum(x;)r, where signum x = +1, 0, accord- 
ingly as x is positive, negative, or zero. Thus, in the vector x — y, the kth component will 
be 

—(lxk| +r) x% «0 


sd. ee = signum (xz) (|x| +r) 
Xk p 


Xk — Yk = Xk + signum (x,)r = | 


where the difference has been expressed in a form that precludes subtractive cancellation 
generating roundoff error in this component. Next, obtain 


n 


Ixy? = Yo + (xk — yk)? + sa x? = [signum xy) (|x| +r)? + HAE x 
i=k+1 i=k+1 

= x? + 2r|xx| +r? "ES dale Daft Yd 

i- "ah i=k+1 


= 2r|xyl + rg B » = 2r|xg| + 2r? —2r(|xi] + r) 
1 l 
i=k i=k 


where lx |? = ae for x, real. Consequently, the vectors u and Hx = (J — 2uul)x = y are 
given by (45.10). 
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Al. Let u be the normalized version of 2i + 3j, and obtain the 
Householder reflection matrix H = J — 2uul. 


A2. Determine the equation of L;, the line that passes through the 
origin and is orthogonal to u in Exercise A1. 


A3. Sketch u, Li, x =i + j, and y = Hx. 


EXERCISES 45.2-Part B 


A4. Use (45.10) to obtain u for which H = J — 2uul is an annihilating 
Householder matrix for x = 3i + 4j. Calculate y = Hx. 

A5. Let x and y be as in Exercise A4. Show that u is the normalized 
version of x — y. 


B1. Let u be the normalized version of 2i — 3j + k, and obtain the 
Householder reflection matrix H = J — 2uul. Calculate y = Hx, 
where x — i 4- j 4- k. 

B2. Determine the equation of the plane that passes through the origin 
and is orthogonal to u in Exercise B1. 

B3. Use (45.10) to obtain u for which H = J — 2uul is an 
annihilating Householder matrix for x = i — 2j + 7k, annihilating 
all components below the first. Calculate y = Hx. 

B4. Let x be as given in Exercise B3, and let y = — ||x||;i. Show that 
normalizing x — y yields the vector u obtained in Exercise B3. 


In Exercises B5—8, construct Householder reflection matrices for every 
possible annihilation in the given vector x. Use (45.10) to obtain u, and 
from u obtain H. Verify that Hx gives the vector y determined by (45.10). 


l -8 5 

J a LELE 

B5. 7 B6. | B7 4 B8. | -8 
4 7 

-3 5 T 3 

i : ~9 5 


For each vector x given in Exercises B9-1 1: 
(a) Obtain H;, the Householder reflection matrix that maps x to 
yı = Hix = ai for some appropriate o. 
(b) Show ||x|| = lly |] = lel. 
(c) Obtain Hz, the Householder reflection matrix that maps x to 
yo = Hox = x,i+ Bj for some appropriate £. 
(d) Show ||x|| = ||y2l|. ^ (e) Sketch x, yı, and y2. 


-1 -T| -3 
B9. | —5 B10. 1 B11. | 8 
5 -1 | 3 


In Exercises B12-14, vectors vı, v2, and x are given. For each such set 
of vectors: 


(a) From v, x v2, obtain u, a unit vector orthogonal to the plane 
spanned by v; and v;. 


(b) Obtain the Householder reflection matrix H = J — 2uul. 


(c) If A = [v;, vo], obtain P = A (ATA) ^' AT, a matrix that 
projects onto the plane orthogonal to u. 


(d) Obtain y = Hx, and show ||x|| = ||yll. 


(e) Obtain M — (x + y) and show M = Px = Py; interpret 
this equality geometrically. 


(f) Show x — Px — —(y — Py); interpret this equality 


geometrically. 
[ 3] [ 3] [ 1] 
B12. v, = | -9 v=| 9 x-2|-7 
| —6 | |=] L-1]} 
[-1] 9] -3 ] 
B13. v; = | —4 v2 = | —7 x= |—-7 
2 |-7 -2 
[—7] [-3]] [ 2] 
B14. v; = 8 v= 6 x= 9 
L 5] [-8 | L-8] 
B15. Draw a sketch representing the geometry explored by Exercises 
B12-14. 


For each pair of vectors {x, Y] given in Exercises B16-19: 

(a) Normalize each to x and y, respectively, thus ensuring 
Ixl] = llyll. 

(b) Setu = EAT and form the Householder matrix 
H = I —2uul. 

(c) Show that Hx = y. 

x = [5, 21, —4]", y = [4, —8, —8]" 

[7, 9, 4, 6]", ¥ = [-3, 3, 2, 8]T 

X = [—9, —4, —6, —9, -6]", y = [-9, —4, 8, 9, —7]T 
[-1, —3, —9, —8, 9, —4]7, y = [1, —9, 2, 9, —5, —2]7 


B16. 
B17. 
B18. 
B19. x = 


B20. If x = [a, b]" is a real vector and H = TT j d 


b —a 
(a) Show that Hx = [Va? + P?, OJ". 
(b) Show that det H = —1 and that HT = H^. 


(c) Determine the unit vector u from which H, a Householder 
reflection matrix, was constructed. 


B21. Find a Householder matrix H so that Hi — j in the xy-plane. 


45.3 QR Decomposition via Householder Reflections 


r each pair of vectors x and v given in Exercises B22-26, obtain H, 
the Householder reflection matrix for which y = Hx is the reflection 
f x across the line whose direction is v. Also, obtain y, and sketch the 
ectors X, v, and y. 


B22. 


B24. x = [5] = H Nene [5] n B 
B26. x = H v= E 
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For each given vector x given in Exercises B27—31, find a Householder 
reflection matrix that reflects x across the given plane. In each case, find 
the reflected vector y. 


B27. x = [—7, 2, 3)", 5x —7y +z =0 
B28. x = [—2, -1, —1]7, 3x + 8y +3z = 0 
B29. x = [—3, 4, 1]", 9x — 9y — 52 =0 
B30. x = [—5, —8, 3], 2x + 9y — 72 =0 
B31. x = [2, 7, 6]’, 2x + 9y — 8z 20 


QR Decomposition via Householder Reflections 


Introduction 


Section 34.4 describes the use of the QR decomposition in the QR algorithm for computing 
eigenvalues of a matrix A. The QR decomposition as detailed in Section 34.3 applies the 
Gram-Schmidt orthogonalization process to orthonormalize the columns of A. This process 
yields the orthogonal factor Q (unitary, if A is complex), and from Q we obtain the upper 
triangular factor R = QT A. 

In this section we will see how the orthogonal Householder reflections can be used to 
transform A into R by successively “zeroing out” the columns of A. A sequence of reflection 


matrices Hp, k = 1,..., 


n — 1, are generated; and the product H, = H,—; Hn—2 -+ + H plays 


the role of Q" since H, A = R and A = HFR. 
As we saw in Section 45.2, Householder reflection matrices obtained as H = J —2uu™ 


are necessarily symmetric. Hence, A = H,H2--- 


Implementation 


H,-4R. 


The accompanying software suite contains an auxiliary procedure that returns H;, the 
Householder reflection matrix that “zeros out,” in the kth column of A = (aij), the el- 
ements below agg, the diagonal element in column k. The basic technique is that described 
in Section 45.2. However, the (n — k + 1)-component vector x, = [agg agii e - > "m 


must be extracted from the kth column of A and normalized to form u, which provides the 
p x p reflection matrix hp = Ip — 2u,u;, where p = n — k + 1. Then, the matrix A, is 
inserted into H; by the prescription 


Ik- Zi 
Zi hp 


where /;..; is the (k — 1) x (k — 1) identity matrix and Z; is a (k — 1) x (n — k + 1) matrix 


of zeros. 


EXAMPLE 45.5 Let A be the matrix. 


10 s 12 —9 3 
=7 e 0 5 =2 
A = | —4 7 -6 -7 —1 
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The Householder matrix H is 


—0.6593804734 
0.4615663314 
0.2637521894 

—0.2637521894 

—0.4615663314 


Hı = 


and A, = HA is then 


—15.16575089 


Aj = 0 


0 


0.4615663314 
0.8716126400 
—0.07336420573 
0.07336420573 

0.1283873600 


—6.330052544 
—3.014012526 
9.277707128 
8.722292868 
—10.98598747 


0.2637521894 
—0.07336420573 
0.9580775967 
0.04192240327 
0.07336420573 


—12.66010509 
6.859351679 
—2.080370467 

—12.91962953 
5.140648321 


—0.2637521894 
0.07336420573 
0.04192240327 
0.9580775967 

—0.07336420573 


10.87977781 
—0.5296758401 
—10.15981477 
0.1598147668 
—2.470324160 


—0.4615663314 
0.1283873600 
0.07336420573 

—0.07336420573 
0.8716126400 


3.626592604 
—3.843225279 
—2.053271589 

6.053271589 
—7.156774721 


As expected, the Householder reflection matrix H ;, when applied to A, has “zeroed out,” 
in the first column of A, the entries below the main diagonal. 

The Householder reflection matrix that annihilates, in the second column of A, all 
entries below the second, is 


1 0 0 0 
0 —0.1764027560 0.5430014283 0.5104943948 
Hj,-|0 0.5430014283 0.7493625804 | —0.2356328937 
0 0.5104943948  —0.2356328937 0.7784733793 
0  —0.6429828842 0.2967866428 0.2790193721 
and A2 => HA> is 
—15.16575089  —6.330052544  —12.66010509 10.87977781 
0 17.08597187  —12.24040002 —3.753396957 
A: = 0 0 6.735651427 . —8.671816580 
0 0 —4.631382896 1.558733253 
0 0 —5.298645000 | —4.232303628 


0 


—0.6429828842 


0.2967866428 
0.2790193721 
0.6485667963 


3.626592604 
7.254870993 
—7.175906756 
1.237305364 
—1.090921922 


in which the appropriate number of zeros have appeared in the second column. 
The Householder reflection matrix annihilating, in the third column of A, the elements 
below the main diagonal, is 


1 0 
0 1 
H;=|0 0 
0 0 
0 0 
and A3 = H3A» is 
—15.16575089 
0 
A3 = 0 
0 
0 


0 0 0 
0 0 0 
—0.6914478562 0.4754343079 0.5439320555 
0.4754343079 0.8663643219 | —0.1528891118 
0.5439320555 | —0.1528891118 0.8250835342 
—6.330052544  —12.66010509 10.87977781 3.626592604 
17.08597187 = —12.24040002 . —3.753396957 7.254870993 
0 —9.741372927 4.435098637 4.956635359 
0 0 —2.125375093  —2.172924955 
0 0 —8.447196395 —4.992477945 


which has the requisite number of zeros in the third column. 
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Finally, the last Householder reflection matrix needed to upper-triangularize A is 


i 0 0 0 0 

0 1 0 0 0 
H,=|0 0 l 0 0 

0 0 0 —0.2440022493 —0.9697746658 


© 
© 


0 —0.9697746658 0.2440022493 


and the upper triangular Ay = H4A3 is 


—15.16575089 —6.330052544  —12.66010509 10.87977781  3.626592604 

0 17.08597187 —12.24040002 —3.753396957  7.254870993 

A4 — 0 0 —9.741372927 4.435098637 4.956635359 
0 0 0 8.710473364  5.371777208 

0 0 0 0 0.889071724 


The matrix Ay is the upper triangular factor R in the QR decomposition of A. The 
factor Q is the transpose of Hs = H4:--Hj, so Q = H,---H4, which we find is 


—0.6593804734 0.2239314794 —0.6562919667 0.2210139795 | —0.1884297195 
0.4615663314 | —0.2386905996 —0.2999381978 0.0473700769 — —0.7986090863 

Q = | 0.2637521894 0.5074083748 —0.3644262409 —0.7288689812 0.0944195263 
—0.2637521894 0.5460874483 0.5804932902 —0.0752309072 —0.5381367225 
—0.4615663314 —0.5806950406 0.0976677366 | —0.6418716504 —0.1679630591 


Notice that Q is not symmetric even though it is the product of symmetric factors. Symmetry 
is not preserved for products, but orthogonality is. 

From [4] we learn that in a QR decomposition, once the signs on the main diagonal of 
R are fixed, the rest of the entries are unique. 

We leave to the reader the task of verifying that the matrices Hj, k = 1,..., 4, are 
orthogonal and have determinants of —1, thus showing they are Householder matrices. ** 


EXERCISES 45.3 


1. If A= li 1 , obtain the Householder matrix H = J — 2uuf that (d) If the factors Q and R differ from the factors q and r, reconcile 
annihilates the second entry in the first column of A. Show that the two decompositions by writing (QD)( DR) — qr, where D 
HA = R, an upper triangular matrix, so that A = H'R = QR is a diagonal matrix of 1’s and —1’s so that D^ = J. 
provides the QR decomposition of A. á à i 6 4 4 6 

: : : 2 -2 E E 3 A es : 

For each n x n matrix A in Exercises 2-5: ses 7 1 | 5 -—4 7 

5 = 
z ` 7 3 —8 -5 4 
(a) Obtain the Householder reflection matrices Hz, 
~ . n= T 9 
k=1,..., n — 1, for which H, = a H, = Q', where : ^ : i : 
iA = E á =L =2 
R = Q'A and A = QR. 4. 5 7 5 8 3 
(b) Obtain the factors Q and R, and demonstrate that A = QR. -1 7 3 -5 6 
—4 5 2 6 —1 


(c) Let A = qr be a QR factorization of A obtained by the 
Gram-Schmidt process as in Section 34.3. 
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EXAMPLE 45.6 


_ Upper Hessenberg Form, Givens Rotations, 


and the Shifted QR-Algorithm 


Introduction 


In Section 45.3 Householder reflection matrices were used to annihilate, in the kth column 
of a matrix A, all entries below the kth. A sequence of such Householder reflection matrices 
then upper-triangularized A, giving R = H,_,--- H4A. 

If, instead, Householder reflections were used to annihilate, in the kth column of A = 
{aij}, all components below a;+1,;, then a succession of such H; would transform A into 
upper Hessenberg form. Such a matrix has zeros for all entries below the subdiagonal. 
In other words, an upper Hessenberg matrix is “one diagonal away” from being an upper 
triangular matrix. In particular, the matrix C = {c;;} is in upper Hessenberg form if c;; = 0 
fori > j 42. 


A schematic for a 6 x 6 upper Hessenberg matrix appears in (45.19). The subdiagonal 
elements are denoted by sg, k = 1,...,5. Should all the elements in that subdiagonal be 
zero, the matrix would be upper triangular. 


aq, a 413 414 45 a6 


2 
$1 An 423 G24 25 26 


O so 433 34 @35 36 

j = i 45.19 
O0 O 3% da4 daà4s a4% ( ) 
0 0 0 $4 ss 56 
0 0 0 0 $5 56 et 


EIGENVALUES FROM THE UPPER HESSENBERG Form The QR algorithm finds the eigen- 
values of a matrix A by the factorization A — QR, where the orthogonal factor Q can be 
obtained either by the Gram-Schmidt process or by a succession of Householder reflec- 
tions. The eigenvalues of A are preserved neither in Q nor in R. They are preserved in 
Agi = Ri Qs, which we showed in Section 34.4 to be a similarity transform on A. Thus, 
the matrices A; converge to an upper triangular matrix in which the diagonal elements give 
the eigenvalues of A. 

The upper Hessenberg form of the matrix A is obtained using each Householder re- 
flection matrix to generate a similarity transformation on A, a transformation that therefore 
preserves the eigenvalues of A. The resulting upper Hessenberg form of A is then orthog- 
onally similar to A and, therefore, contains the same eigenvalues as A. 

Once A has been so transformed to an upper Hessenberg form containing the same 
eigenvalues, we have two alternatives, not necessarily mutually exclusive. 


1. Use Givens rotations, defined after Example 45.7, to upper-triangularize the upper 
Hessenberg form of A, thereby completing the QR factorization of A. 


2. Usethe shifted QR-algorithm, which converges rapidly for an upper Hessenberg matrix. 
(See this section's penultimate subsection) 


To explore either of these alternatives, it is useful to have tools for first obtaining the 
upper Hessenberg form of A. 


45.4 Upper Hessenberg Form, Givens Rotations, and the Shifted QR-Algorithm 


EXAMPLE 45.7 
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Implementation 


The software accompanying the text contains an auxiliary procedure for generating the 
Householder matrices that transform a matrix A to its upper Hessenberg form. It differs from 
the procedure used in Section 45.3 in that now, the Householder matrices must annihilate, in 
the kth column of A, all components below the subdiagonal instead of below the diagonal. 


Transform the matrix 


§ 327 4 ő 
6 —9 3 =l =i 

asl 8-8 9 3 (45.20) 
3 4 8 4 7 
8 -8 0 7 4 


to upper Hessenberg form with a sequence of Householder matrices, the first of which is 


0 0 0 0 
—0.5366563146  0.3577708764 . —0.2683281573 . —0.7155417528 
0.3577708764 0.9167022588 0.06247330590 | 0.1665954824 


—0.2683281573 
—0.7155417528 


0.06247330590 
0.1665954824 


0.9531450206 
—0.1249466118 


1 

0 
A,=1|0 

0 —0.1249466118 

0 0.6668090352 
and generates the similarity transform A; = Hj'AH, = Hi AH, = H, AH, with A4 
given by 


9 —6.797646652 —5.882991447 3.162243584 3.765982893 
—11.18033989  —5.936000002 . —1.826287990  —5.517373377  —11.64212898 
A, = 0 —8.814767591 —3.360352084 7.240157714  —2.019844601 
0 —7.543234603 10.14397360 1.102099565 —0.482535613 
0 —6.251670818 = —1.856577489 4.952645817 . —0.805747482 


Both A and A, have the same eigenvalues, namely, 
17.01106481, —16.77225262, —8.144827648, 7.397166441, 0.5088490206 (45.21) 


Continuing with the sequence of similarity transformations based on Householder re- 
flections, we obtain 


1 0 0 0 0 
0 1 0 0 0 

H= |0 0 -—0.6688536171 —0.5723712732  —0.4743690173 
0 0 —0.5723712732 . 0.8036922646  —0.1626956346 
0 0 -—0.4743690173 4 —0.1626956346 4 0.8651613525 


and A» = H5A, H5, with A» given by 


9 —6.797646652 0.338417119 5.296017035 5.534408497 
—11.18033989  —5.936000002 9.902170637 —1.494831960 —8.308333048 
A5 = 0 13.17891892 5.315429519 —5.081326641 4.281463723 
0 0 —5.041877096 | —9.352700813  —3.483710161 
0 0 0.5668673244 1.435661483 0.9732712911 
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Then, obtain 


l 0 0 0 0 
0 1 0 0 0 
Hi—-|0 0 1 0 0 
0 0 0 —0.9937388420 | 0.1117278482 
0 0 0  Á0.117278482 . 0.9937388429 
and A; = H3 A2 H3, with A3 given by 
9 —6.797646652  0.338417119 | —4.644510288 6.091469283 
—11.18033989 | —5.936000002 9.902170637 0.5572004084  —8.423327628 
A3 = 0 13.17891892 5.315429519 5.527870386 3.686931114 
0 0 5.073643977 | —8.996409178 4.604619294 
0 0 0 —0.3147523485 0.6169796558 
(45.22) 
The matrix A5 is the desired upper Hessenberg form of A, and a computation shows 
that A5 also has (45.21) for its eigenvalues. b 


Page 537 of [60] gives the details of how a product of the form HAH, where H is an 
annihilating Householder reflection, can be computed and stored in the memory allocated 
to A. Thus, reducing A to an upper Hessenberg form can be done using no more memory 
than it takes to store A itself. 


Givens Rotations 


Following [60], we define a Givens rotation as an n x n matrix Gj; = (55) that coincides 
with 7,, the n x n identity matrix, except for the four entries 


Bj =C  B$j-— S  Bij-—Ss  &ü-—C 


n(n—1 
— 


where c? + s? = 1 and 1 < j <i < n. The restriction j < i means that there are 
Givens rotations of dimension n x n. This is perhaps best seen by considering the cases 
n — 4 and n — 5, where, with fixed c and s, the Givens rotations are 


Gr, G3, G G 
Gr, Gà Ga i a j "d 


Bs Ga amd Gi; Ga) Gs 
Gas Ga G53 
` G54 


In the first case, the number of Givens rotations is 3 + 2 + 1 = 6, the sum of the first 
n — | integers. In the second case, the number of Givens rotations is 4+ 3 -- 2 4- 1 = 10, 
again the sum of the first n — 1 integers. The sum of the first n — 1 integers is known to be 
iae k = in(n — 1). 
The software accompanying the text contains an auxiliary procedure that creates the 
n x n Givens rotation G;; with the special values c and s. For example, the 5 x 5 Givens 
rotations G4» and G4, are 


l 0 0 0 0 c 0 0 —s 0 
0 E 0 —s 0 0 1 0 0 0 
Ga —|0 0 I 0 0 G4, = | 0 0 1 0 0 
0 S 0 C 0 S 0 0 C 0 
0 0 0 0 1 0 0 0 0 l 


l 
MIU 


O m OGU 
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ooroo 


node 


In G;;, the four special values c, —s, s, c form the corners of a “square” whose lower left 
corner is gij. 

A Givens rotation G;; is orthogonal, the general proof of which we leave to the exercises. 
We illustrate the claim for G4? and G41. 


1 0 0 0 0 e+s7 0 0 0 0 
0 +s? 0 0 0 0 1 0 0 0 
G5Go210 0 1 0 0 GìGu=| 0 0 1 0 OQ 
0 0 0 c?+s? 0 0 0 0 +s? 0 
0 0 0 0 l 0 0 0 0 1 


In each case, if we recall that c^ + 5? = 1, we see that the products G} G;j are just Js. 
Hence, the transpose is the inverse and the matrices are orthogonal. 

Multiplication of a vector x by the Givens rotation G;; changes the jth component to 
cx; — sx; and changes the ith component to sx; + cx;. Schematically, we have 


GijX = [x 71° Xj—1, CX; — SXi, Xj+1 ' tt Xi-1; SXj T CXi, Xi+1°° Xn] 


The only components of x that change are the jth and the ith. This suggests we can construct 
a Givens rotation to annihilate the ith component of a vector, leaving all other components 
except the jth unchanged. We will call such a Givens rotation an annihilating Givens 
rotation. 


Annihilating Givens Rotations 


If the vector x satisfies x; 7 0, then the choices c = xj/Wx; + xj and s = —x;/v x7 + x? 
in the Givens rotation matrix G;; implies that in the vector G;;x, the ith component will be 
0 and the jth component will be Vx + 3 that is, (G;;X); = 0 and (Gj;x); = vx -— X^ 


The fourth component of the vector x = [—3, 4, 3, — 1, 2]T can be annihilated with any of 
the Givens rotations listed in Table 45.4. 


0 l 0 0 0 0 1 0 0 0 0 

0 l 0 4 0 -l1 0 l 0 1 0 0 0 

0 — |0 0 i 0 0 — |0 0 3 —l 0 

0 v17 0 l 0 4 0 v10 0 0 l 3 0 

l 0 0 0 0 l 0 0 0 1 
Gy G33 


TABLE 45.4 The Givens annihilating rotations G4,, Gay, and G43 in Example 45.8 


Indeed, for the products G4;x, G42x, and G43x, we find, respectively, 


/10 -3 - 
4 JT 4 
Gyx = 3 Gyx=| 410 $ 


Ww 


G41X = 


NO 
N oO 
N oO 
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gun V, 


FIGURE 45.5 The vectors x, V; = G3)x, 
and V; = G3x in Example 45.9 
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A more geometrically accessible example consists of the vector x = [1, 2, 3]T and the two 
annihilating Givens rotations 


1 103 | 1 0 0 
G31 = —— 0 1 0 and G32 = — | 0 2 3 
V10|.3 o 1 vijo -3 2 
which both annihilate the third component of x. Indeed, we find 
10 l 
Vi = G31x = 2 and V> = G32X = J/13 
0 0 


as the two transformed versions of x. Figure 45.5 shows x, V;, and V2. The Givens rotation 
G3, rotates x so that it lies in the xy-plane. The Given rotation G32 rotates x so that it, too, 
lies in the xy-plane. Both V, and V; must lie in the xy-plane because the third component 
in each is zero. % 


QR Factorization of an Upper Hessenberg Matrix 
via Givens Rotations 


If the n x n matrix A is in upper Hessenberg form, then M = G5, 1G, 14-2::: G21, the 
product of n — 1 annihilating Givens rotations, will upper-triangularize A. Since MA — R 
and M is orthogonal because it is the product of orthogonal Givens rotations, we have 
A = M' R,so MT = Q and A = QR. With n — 1 annihilating Givens rotations, the upper 
Hessenberg matrix A is factored into Q and R. 

We demonstrate this process with the upper Hessenberg matrix (45.22) derived from 
the matrix (45.20). Starting at the “top” of the subdiagonal, we annihilate the (2, 1)-entry 
in A3 with the Givens rotation 


0.6270597126 | —0.7789711909 0 0 0 
0.7789711909 . 0.6270597126 0 0 0 

Ga = 0 0 1 0 0 
0 0 0 1 0 

0 0 0 0 1 


and then obtain Ay = G21 A3 as 


14.35270009 0.361442635 —7.501297913 —3.346428352 10.38124453 


0 —9.017397363 6.472869460 —3.268541782  —0.536850320 
A, = 0 13.17891892 5.315429519 5.527870386 3.686931114 

0 0 5.073643977 —8.996409178 4.604619294 

0 0 0 —0.3147523485 0.6169796558 


Next, the (3, 2)-element in A4 is annihilated by forming the Givens matrix 


1 0 0 0 0 
0  —0.5646942513 0.8253001895 0 

G32 = | 0 —0.8253001895 —0.5646942513 0 0 
1 
0 


0 0 0 
0 0 0 
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and computing the product A5 = G32 Ay, to get 


14.35270009 0.361442635 . —7.501297913 
0 15.96863673 0.731632816 
As = 0 0 —8.343652885 
0 0 5.073643977 
0 0 0 


—3.346428352 

6.407879231 
—0.424028477 
—8.996409178 


—0.3147523485 
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10.38124453 
3.345081237 
—1.638926134 
4.604619294 
0.6169796558 


The (4, 3)-element in As is annihilated by forming the Givens matrix 


1 0 0 0 0 
0 0 0 0 
Gy3=|0 O —0.8544304853 . 0.5195657280 0 
0 0 —0.5195657280 —0.8544304853 0 
0 0 0 0 1 


and computing the product Ag = G43 As to get 


14.35270009 0.361442635 | —7.501297913 —3.346428352 10.38124453 


0 15.96863673 0.731632816 6.407879231 3.345981237 
Ag — 0 0 9.765162911 | —4.311923027 3.792750828 

0 0 0 7.907116924  —3.082797248 

0 0 0 —0.3147523485 0.6169796558 


Finally, the (5, 4)-element in Ag is annihilated by forming the Givens matrix 


1 0 0 0 0 
0 1 0 0 0 
Gy=|0 0 l 0 0 
0 0 0  À0.9992086732  —0.03977470923 
0 0 0  0.03977470923 0.9992086732 
and computing the product A7; = Gs4A¢ to get 
14.35270009 0.361442635  —7.501297913  —3.346428352 . 10.38124453 
0 15.96863673 0.731632816 6.407879231 3.345981237 
A7 = 0 0 9.765162911 | —4.311923027 3.792750828 
0 0 0 7.913378993 —3.104897934 
0 0 0 0 0.4938740591 


The matrix A7 is the factor R for the QR decomposition of the matrix A5. The companion 
factor Q is found by transposing the product of the annihilating Givens rotations, that is, 
Q = (Gs4G43G32Ga1)", giving 


0.6270597126 —0.4398805534 0.5493006036 0.3337567304 0.01328559015 
—0.7789711909 —0.3540970149 0.4421784562 0.2686689853 0.01069469377 
Q= 0 0.8253001895 0.4824919832 0.293 1636078 0.01166973183 
0 0 0.5195657280 | —0.8537543516 —0.03398472411 

0 0 0 —0.03977470923 0.9992086732 


Reversing the factors Q and R in the QR algorithm gives another upper Hessenberg 
matrix that can be QR-factored again by n — 1 annihilating Givens rotations. The energy 
expended in bringing A into upper Hessenberg form is expended only once. The QR fac- 
torization of the upper Hessenberg matrix is accomplished with n — 1 annihilating Givens 
rotations. 
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Shifted QR 


In Section 34.4 we saw the QR algorithm for finding the eigenvalues of a matrix A. The 
matrix A in (45.20) was specially chosen because its eigenvalues, listed in (45.21), have 
two pairs with nearly equal magnitudes. The first and second have nearly equal magnitudes, 
and the third and fourth also have nearly equal magnitudes. 

The QR algorithm, like any power method, converges slowly in the presence of eigen- 
values with nearly equal magnitudes. In fact, if we visit 50 iterations of the QR algorithm 
upon A, we obtain for As; = QsoRso the matrix 


15.17427984 8.398117280 | —2.584141572 —2.082941449 3.447024830 

6.987150649 —14.93546771 0.5462226447 —3.203958976 5.971972090 
0 0 —8.170707217 —4.789143117 8.083392115 
0 0 0.08412563135 7.423045996 —6.147570340 
0 0 0 0 0.5088490204 


The QR algorithm is supposed to generate a sequence of matrices A; that converge to an 
upper triangular matrix on the diagonal of which the eigenvalues are found. Even after 50 
iterations we have elements as large as 6.987 on the subdiagonal. This is certainly not an 
efficient calculation. 

Starting with the upper Hessenberg form A3 in (45.22) fares no better, as the following 
recalculation of As; shows. 


15.17427985 —8.398117220 2.631951124 2.022193350 3.447024838 
—6.987150586 | —14.93546773 0.4714561593  —3.215811154  —5.971972064 
0 0 —8.271796584 . —4.423520230  —7.938026296 
0 0 0.4497485091 7.524135383 6.334160385 

0 0 0 0 0.5088490192 


There are still magnitudes as large as 6.987 on the subdiagonal. 

A more effective strategy is the shifted QR algorithm, in which the QR decomposition 
is obtained for Ag — z;/, = Q, Ry, not just Ay. The scalars zę are the shifts and can be 
chosen as the lower right element on the main diagonal of A,. Of course, the matrix J, is 
the n x n identity matrix. The next iterate, Az), is formed by reversing the factors and 
restoring the shift. Thus, we have the two steps 


Ay — Zkln = Oe Re Arii = Ri Qi + zkls 


The reader is referred to [4] for details, proofs of convergence, and an alternate strategy 
for selecting the shifts z;. We merely demonstrate the increased rate of convergence for 
the problem at hand. Starting with A in its upper Hessenberg form A3, we perform five 
iterations of the shifted QR algorithm, obtaining 


8.920147879  —13.75868934 1.166510523 3.945434098 | —6.809074160 
—15.10104281 —8.619714707 2.652155709 | —0.5944027224  —2.159106872 
0 0.3233152435 0.3775563492 . 10.46507754 —9.975915415 

0 0 5.688698425 . —1.186838537 0.3689963347 

0 0 0 0 0.5088490192 


The lower right element on the main diagonal of A; is again nearly the eigenvalue of 
smallest magnitude. However, this took only 5 iterations, not 50. To obtain the remaining 


45.4 Upper Hessenberg Form, Givens Rotations, and the Shifted QR-Algorithm 1149 


eigenvalues, “deflate” A, by selecting the (n — 1) x (n — 1) submatrix 


8.920147879 —13.75868934 1.166510523 3.945434098 
—15.10104281 —8.619714707 . 2.652155709 —0.5944027224 
0 0.3233152435  0.3775563492 10.46507754 
0 0 5.688698425 —1.186838537 


whose main diagonal coincides with the main diagonal of A; but excludes the eigenvalue 
just computed. 

Another five iterations of the shifted QR algorithm is applied to this submatrix. The 
shifts z, are again taken as the lower right elements on the main diagonal, but on the main 
diagonal of the deflated matrix and its subsequent iterates. We thereby obtain 


16.98307108 —1.898878980 1.869823995 —3.108769321 
—0.5214200038  —16.78430654 —2.511972534 —0.2815075194 

0 0.4035024727 7437214282 —4.866455806 

0 0 0.5153017568 x 10^. —8.144827814 


The lower right entry on the main diagonal of this iterate contains an estimate of the 
third eigenvalue, correct to five significant places. Another deflation is performed, resulting 
in the matrix 


16.98307108 —1.898878980 1.869823995 
—0.5214200038  —16.78430654 —2.511972534 
0 0.4035024727 7.437214282 


Again five iterations of the shifted QR algorithm are performed with the shifts being 
the lower right elements on the main diagonal of the new A;'s. We find 


—7.259678460 | —14.50553086 3.447074461 
—15.91649747 7.498490645 —0.1431097876 
0 0 7.397166630 


The lower right element on the main diagonal approximates the fourth eigenvalue 
7.397166441 to five significant places. A final deflation gives the matrix 


—7.259678460 —14.50553086 
—15.91649747 7.498490645 


upon which we visit the final five iterations of the shifted QR algorithm. The shifts z, are 
again taken as the lower right elements on the main diagonal of the depressed matrix and 
its iterates. We obtain 


—16.77225263 . 1.410966615 
0 17.01106480 


The main diagonal of this final iterate contains approximations of the first two eigen- 
values, 17.01106481 and —16.77225262. Both are accurate to seven significant places. 


Summary 


In practice, because of their potential inefficiency, power methods are not generally used for 
finding eigenvalues. However, in some special applications such as finding the eigenvalues 
of large sparse matrices, they can be useful. (See [4] for additional comments.) 
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Efficient codes for finding the eigenvalues of a matrix A generally begin with a reduction 
to upper Hessenberg form, a reduction performed by annihilating Householder reflections. 
The reduction is done “in place" by storing each of the matrices Aj,; = Hp A, Hy in the 
memory allocated to A itself. 

Then, the shifted QR algorithm is applied to the upper Hessenberg form of A. Annihi- 
lating Givens rotations are used to perform the QR decomposition of the upper Hessenberg 
matrices generated by the QR process. 

Writing and testing efficient code for finding eigenvalues would be a significant chal- 
lenge for the neophyte. Fortunately, modern computer software packages provide such code 


in convenient wrappers. 


EXERCISES 45.4 


1. Determine if the product of upper Hessenberg matrices is an upper 
Hessenberg matrix. 


2. Show that a general Givens rotation matrix G;; is orthogonal. 
For each vector x given in Exercises 3—5, obtain the annihilating Givens 


rotations G31, G32, G21. Compute u; = G31X, u; = G32X, uy = Gr x. 
Sketch the vectors x, u;, Uo, us. 


3.x=[-3,-7,-1]" 4. x-[-9,9,1T 5.x-—[3,7,—5]T 


Exercises 6 and 7 use the following 5 x 5 matrices Cz, k = 1,...,6. 
6 3 4 —3 —6 —8 6 7 9 87 
4 2 1 4 4 Ll -—-7 -7 =9 3 
Gi = 4 -1 -3 6 3 C= 8 —6 4 4 3 
| 6 8 9 0 4 6 -5 -2 -9 -5 
-8 -=3 7 5 4 3 6 3 8 2 1 
r3 6 8 0 3 9 5 6 4 2 7 
7 3 -3 3 1 -5 =6 —2 =8 4 
G= 6 0 —2 -8 7 C4 = 8 3 4 3 —2 
E 3 -2 0 2 8 -l -4 2 -8 
8 5 8 8 —8 8 2 4 —l 3 ] 
[—8 0 7 6 1 9 2 5 6 6 
8 -8 -2 -5 4 7 =A 5 —1 -8 
Cs=| 5 8 -5 9 9| Cg2|6 4 5 2 -4 
8  —6 l 6 7 9 7 1 1 =8 
-1 6 0 2 5 4 —9 5 =6 -1 


r 


6. Fix a matrix A = C, from the given list, and for it 


(a) obtain Householder transformation matrices H;, H», H3 and 
the matrix H = [],_, H for which HTAH is both similar to A 
and in upper Hessenberg form. 

(b) show that A and B = HT AH have the same eigenvalues. 

(c) verify that each H; is both symmetric and orthogonal. 


7. For the matrix A = C, selected in Exercise 6 and transformed to 
B = HAH": 


(a) Construct the annihilating Givens rotation matrices G21, G32, 
G43, G4 that will upper-triangularize B. 


(b) Obtain the upper triangular matrix R = QT B, where 
QT = Gs4G43G32G2. 

(c) Show that the eigenvalues of R are not the same as the 
eigenvalues of A. 

(d) Show that B; = RQ is again upper Hessenberg and has the 
same eigenvalues as B. 

(e) Construct the annihilating Givens rotation matrices 
G5j, Gy, G4, G5, that will upper-triangularize By. 

(f) Obtain the upper triangular matrix Rı = QT Bi, where 
QT = G4,6456365. 

(g) Show that the eigenvalues of R, are not the same as the 
eigenvalues of A. 

(h) Show that B; = R; Qj is again upper Hessenberg and has the 
same eigenvalues as B;. 


(i) Describe the matrix M = lim; B, if the sequence of 
matrices {Bz} were formed by the construction started in this 
exercise. 


For each of the symmetric matrices A given in Exercises 8-13: 


(a) Obtain Householder transformation matrices H,, H2, H4 and 
the matrix H = Da H; for which HT AH is both similar to A 
and in upper Hessenberg form. 

(b) Show that A and HT AH have the same eigenvalues. 


(c) Verify that each H; is orthogonal. Note that the upper 
Hessenberg form of a symmetric matrix is a tridiagonal matrix. 


8 4-5 8 3 -9 5 4-9 4 
4-5 3 5 -4 5 8-3 7 4 
8. 5 3 -5 l 5 9. 4-3 8 5 2 
8 5-1 0 -2 -9 7 S O0 S 
3 —4 -5 -2 -l 4 4 2 5 -5 
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y4 4 2 —5 1 3 9 -9 6-7 2 -7 —2 8 -6 -8 
—8 2 —l 5 =l 3 —9 —-5 O -1 9 —2 -7 5 -8 I 
3 11. 5 T 2 =9 12. 6 0 ] e =7 13 8 5-3 2 9 
5 1-1 3 8 -6 —7 -1 -1 -4 -7 —6 -8 2 9 5 
—9 3 —9 —6 3 2 9 -7 -7 -3 —8 l 9 5 1 


EXAMPLE 45.10 


©. The Generalized Eigenvalue Problem 


Introduction 


In Section 12.17 we considered the mechanical system consisting of three springs attached 
to two masses and formulated the differential equation 


MX" + KX=0 


where M is a matrix whose entries are the masses and K is a matrix whose entries are related 
to the spring constants for the springs. The vector X contains the displacements of the masses 
from equilibrium, and primes on X represent differentiation with respect to time, f. 

We then uncoupled the differential equations by multiplying through by the inverse of 
M to get 


X”+M'KX=0 
or 
xX" +UX=0 
where U = M~'!K, and then diagonalized U, writing it as U = PDP~!, to get 
X" + PDP 'X=0 
Next, we multiplied through by the inverse of P to obtain 
PX" + DPX =0 


By defining R = P^!X we wrote the differential equation as R” + DR = 0. Since D was a 
diagonal matrix, we uncoupled the equations and were led to the normal modes of vibration 
for the physical system. 

Alternatively, we could have assumed a solution of the form X = e^ Y, in which case 
we would have faced a generalized eigenvalue problem of the form 


MY - KY 20 
In the present section, we will discuss the generalized eigenvalue problem of the form 
Ax -ABx — 0 (45.23) 


where A and B are n x n matrices and B is not singular. 


By way of an example, consider the matrices 


—4 —6 —4 —6 
Te 3 and saf 5 j 


and write equation (45.23) as (A — AB)x = 0, recognizing that the matrix C = (A — AB) 
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must have a vanishing determinant if we want x Z 0. Thus, we obtain 


Ää -—64-6 


ee e A -5-9 


|= -2+ 28-62 =o 


as the characteristic equation whose solutions are the eigenvalues 1 and H, 

To find the corresponding solutions x, substitute each eigenvalue, in turn, into the matrix 
C, and solve Cx — 0. Noting that any such x is in the null space of the respective matrix, 
we have the two generalized eigenvectors 


PE, _3 
x=] 1 and v=] 1 


Thus, the eigenpairs (1, xı) and (4, X5) satisfy (45.23). Moreover, these eigenpairs are 
actually the eigenpairs of the matrix 


Our final observation is that the eigenpairs (1, x;) and (4, X2) are eigenpairs neither 
for A nor for B since the eigenpairs of A and B are, respectively, 


Cer» ODL) + 


In general, the eigenvectors of F = B~'A are not the eigenvectors of either A or B, as 
we have just seen. However, it is possible that they are, as the next example shows. 


The matrices 


—32 —26 84 —2 1 —7 
A=] 158 152 —84| and B= 9 6 7 
32 32 —18 2 2 —2 


each have the same set of eigenvectors, which are then the eigenvectors for Ax = A Bx. 
Moreover, if (uk, Xx) is an eigenpair for B and (åz, X4) is an eigenpair for Ax = A Bx, 
then (0%, X+) is an eigenpair for A, with o; = A;44. This might seem like the only way for 
(45.23) to have a solution. Surprisingly, it is the exceptional way. 

The eigenpairs for Ax = A Bx are most easily found from the matrix 


12 10 -49 
F=B'A=] 6 8 49 
2 2 9 


The eigenpairs of A, B, and F are then given in Table 45.5. All three matrices have 
the same eigenvectors, and the eigenvalues are related by o; = Àk Mk. 

Because A, B, and F = B~'A all share the same eigenvectors, it is possible to di- 
agonalize A and B simultaneously with the transition matrix $ = [xi, X2, X3]. The matrix 
S and the products S7! AS and S^! BS are given in (45.24), where the resulting diagonal 
matrices of eigenvalues can be seen. Thus, with the same transition matrix S, both A and 
B are similar to diagonal matrices. 


1 1 1 126 0 0 7 0 0 

S=|—19 -1 =! S'AS=| 0 -18 0 S'BS=|0 -2 0 

Al 6 0 0 -8 B 0 3 
(45.24) 
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Matrix Eigenvalues Eigenvectors 


A 126, —18, —6 1 l l 
B 7, —2, —3 -19 |,| —1 |,| -1 
F 18,9, 2 —4| |-+ 0 


TABLE 45.5 The eigenvalues and eigenvectors of the matrices 
A, B, and F = B^! A in Example 45.11 


In general, not every solution of the generalized eigenvalue problem leads to the simul- 
taneous diagonalization of the two matrices A and B. We were able to diagonalize A and 
B simultaneously in Example 45.11 because of the special outcome that the eigenvectors 
of A and B were the same. 

We will next examine conditions under which we are guaranteed simultaneous diago- 
nalization of the two matrices A and B in the generalized eigenvalue problem Ax = À Bx. 


Symmetry 


Recall that a real matrix B is positive definite if it is symmetric and has positive eigenvalues. 
(Positivity of the eigenvalues is equivalent to the condition that xT Bx > 0 for all vectors 
X Æ 0, as discussed in Section 33.4.) Therefore, a positive-definite matrix is invertible 
because a singular matrix must have at least one zero eigenvalue. 

If, in the generalized eigenvalue problem Ax = A.Bx, A is symmetric and B is positive 


definite, then A and B can be simultaneously diagonalized by a matrix $ = [xi, ..., Xj]. 
where 
Ax, =A, Bx, k=1,...,n Ap ew O 
STAS =A and A= : . : 
STBS=1 B om J 


Solving the generalized eigenvalue problem for eigenpairs (A4, X4) leads to the ma- 
trices S and A of the simultaneous diagonalization. However, neither diagonalization is a 
similarity transform, since $ is not necessarily an orthogonal matrix. Recall that a simi- 
larity transformation P^! MP = D uses the inverse of P as one of the factors. If P is 
orthogonal, then the transpose is the inverse and the matrix M is said to be orthogonally 
similar to a diagonal matrix D. Since S will not necessarily be an orthogonal matrix, ST 
will not necessarily be $7!, so STAS = A and ST BS = I will not necessarily be similarity 
transforms. 

Because B is invertible, the eigenpairs (Aj, X4) can still be found from the matrix 
F = B-! A. However, this approach vitiates the advantages of symmetry, since the inverse 
of a symmetric matrix is not necessarily symmetric. 

An algorithm that preserves symmetry, finds S, and still simultaneously diagonalizes 
A and B will be given shortly. First, however, we give an example where A is symmetric, 
B is positive definite, and S is obtained from B^!A. 

In (45.25), the matrices A and B are clearly symmetric. The eigenvalues of B are 
0.01, 0.05, 0.13, so B is positive definite. 


, [-4 107135 
A=——|107 67 -105| B 
1352 | 135 —105 215 


347 —7 —29 
-7 43 -15 (45.25) 
—29 —15 131 
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The matrix F = B~'A and its eigenpairs (À, px) are given in 


(—2, [-2, -1]") 
i 3 15 25 ae 
F= |155 73 -95 (3. [1 2, 3] ) (45.26) 
72 -30 80 E 
(5. [0, -3, 1) 


The matrices P = [pi. p2, p3], ^ = diag(A1, Az, 43), and D = diag(a, b, c) are given 
in 


1 0 -à 6 0 a 0 0 
P=|-2 3 + A=| 030 D=|0 b 0 (45.27) 
a 8 3 005 0 0c 


The matrix $ = [api, bp2, cp3] = PD must satisfy both STAS = A and ST BS = I. 
The columns of § are simply the scaled eigenvectors of F = B7! A, where the scale factors 
a — 2, b = 2, c = 3 are determined by the equations 


1,9 
qa 0 0 100 

(PD)'B(PD)=| 0 iP? 0|-2|01 0|-I 
0 0 ic P €i 


The resulting matrix S, given on the left in (45.28), is not orthogonal, as verified by 
the product STS, given on the right in (45.28). Computation shows that STAS = A and 
verifies that $T BS = J. 


2 9 ü 24 —22 14 
S=PD=|-4 5 -5 STS = | -22 38 -16| ÆI (45.28) 
-3 8 8 14 —16 34 


In the final part of this section, we find S (or its equivalent) with symmetry-preserving 
algorithms taken from [60], [27], and [64]. 


Symmetry-Preserving Algorithms 


ALGORITHM 1 If A is symmetric and B is positive definite, the generalized eigenvalue 
problem (45.23) can be solved and the matrices A and B simultaneously diagonalized 
by a matrix S obeying both $T AS = A and ST BS = I, via the following algorithm that 
preserves the symmetry in A and B. 


1. Usethe Cholesky decomposition (Section 34.1) to factor B into the product L LT, where 
L is a lower triangular matrix. 


2. Form the (symmetric) matrix C = L^! A (L^! ) f 


3. Obtain v, k =1,..., n, the normalized eigenvectors of C, and A1, ..., An, the corre- 
sponding eigenvalues. 
j T 
4, Obtain x = (E^) vp k=1,..., n. 
5. The matrix S is given by S = [X1,..., X], and the matrix A is the diagonal matrix 
with A1, ..., Àn on the diagonal. 


6. The eigenpairs (àx, x,) satisfy the generalized eigenvalue problem (45.23). 
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EXAMPLE 45.12 Before explaining why these are the appropriate steps, we first illustrate them for the matrices 
A and B from (45.25). The factor L in the Cholesky decomposition B — LL’ and the 
symmetric matrix C = L~'A (xy are given in (45.29). 


V347 0 0 82 1417 /2 7242 
32 347 347 V TI J/83817 
L = | -134 AL ý C= 1417 /2 12700 381/347 
18044 694 347 V 1M 3817 3817 
294/347 24/2 l 7242 3814/347 32 
18044 J3817 422 J8817 3817 11 
(45.29) 
The eigenvalues of C are A; = —2,A2 = 3, À3 = 5. The corresponding eigenvectors, 


vi, k = 1,2,3, are on the left in Table 45.6. The vectors x; = (L3) ve, k = 1,2,3, are 
on the right in Table 45.6. The matrix S = [X1, X2, x3] is then identical to the matrix S in 


(45.28). se 
vy, k 21,2,3 xj, k =1,2,3 
1S EN NM 
d 347 Jai 2 2 0 
. 18/2 43 67 4 5 5 
V3817 7634 7634 E 
; í IE = 3 -3 
-/& 22 J/22 


TABLE 45.6 The eigenvectors v; and the vectors x, = (L-1)* v, k = 1, 2,3, in 
Example 45.12 


Returning to our discussion of Algorithm 1, we note we have already verified that the 
matrix S simultaneously diagonalizes A and B and that its columns are the eigenvectors 
x; for which the eigenpairs (àz, x.) satisfy the generalized eigenvalue problem. All that 
remains is to justify the steps of the symmetry-preserving algorithm. After obtaining the 
Cholesky decomposition of B so that B = LL", the generalized eigenvalue problem (45.23) 
becomes Ax = ALL!x, or L^! Ax = AL!x, upon left-multiplication by L~', the inverse 
of L. Between A and x on the left, insert Z = (L1)! LT, obtaining 


1 


ECAY he Bee 


: ; ; ; m -į 
Since the inverse of the transpose is the transpose of the inverse, that is, since (£1) = 
HAL 
(L!) , we have 
E NV 
L'A (L) x=AL'x 


Defining the matrix C = L7!A (L3). and the vector v = LTx brings the generalized 
eigenvalue problem into the form Cv = Av, which is similar to the form B-'Ax = dx, 
except that C is symmetric and B~'A generally is not. 
The symmetry of C is established by showing CT = C. Since C is of the form RART, its 
transpose is (RT) AT RT, which simplifies to RART = C because A is assumed symmetric. 
If vj, k = 1,...,n, are the normalized eigenvectors of C, Aj, k = 1,...,n, the 
corresponding eigenvalues, and x, = (L3) vg, then $ = [xi, ..., Xn] will simultaneously 
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diagonalize A and B by satisfying both ST AS = A and ST BS = I. To see the second claim, 
note that the 7 j-entry in the product $7 BS is given by 


(STBS); =x? Bx; = vIL-! B (L-!)! v; = vIL-!LLT (LT) ' vj 


1 i=j 
M Vj J 0 i xz j 
which indicates ST BS = I. 
The first equation is likewise verified with 


T 


(STAS); = x} AX; = VETIA (L~) v= viCvj = vIA;N = AjVIVj = A jij 


so that STAS = A, a diagonal matrix whose main-diagonal entries are A, ..., Án. 
ArcoRITHM2 Detailed in [27] and sketched in [64], the following algorithm also preserves 


the symmetry in A and B but obtains S from a diagonalization of B. We still assume that 
B is positive definite and that the generalized eigenvalue problem is given by (45.23). 


1. For B, obtain the eigenpairs (o;, uz), where the u% are unit eigenvectors. 


2. Form K = [u,;, ..., u,] and the diagonal matrix P whose main-diagonal entries are 
1/ ox, k = 1,...,n. Because B is symmetric and u;, ..., u, are unit vectors, K is 


an orthogonal matrix. 

3. Form the matrix M = (K P)T A(K P) and obtain its eigenpairs (Ax, ys), where the y; 
are unit eigenvectors. 

4. Form the matrix W =[y,..., Yn], an orthogonal matrix since M is symmetric and 
the y; are unit vectors. 

5. The matrix T = KPW satisfies both TT AT = A’ and TT BT = I, where A’ is the 


diagonal matrix whose main-diagonal elements are A,,..., An. The columns of T, 
along with the àz, give the solutions to the generalized eigenvalue problem. 


Using floating-point arithmetic, we illustrate Algorithm 2 by finding K, the orthogonal 
matrix whose columns are the normalized eigenvectors of B. The matrix K and the corre- 
sponding eigenvalues of B are given in 


—0.0389430473 —0.1247095323  —0.9914287526 o = 0.0148148836 


K = | —0.9838516582 0.1782489827 0.0162238945 o = 0.0480895058 
—0.1746978924 | —0.9760506302 0.1296372388 03 — 0.1297731253 
(45.30) 
The diagonal matrix P containing 1/,/oz, k = 1, 2, 3, on the main diagonal, is 
8.215819287 0 0 
P 0 4.560105000 0 
0 0 2.775924296 


The matrix M = (K P)' A(K P) is then 


2.261392409 —1.451792172 2.246419733 
M = | —1.451792172 = 4.167526127 0.716119721 
2.246419734  0.716119721 —0.428918542 
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The matrix W, whose columns are y, the normalized eigenvectors of M, along with 
Ax, the eigenvalues of M, are given in 


—0.5349636425 
0.8375677321 
—0.1108791932 


W = 


—0.6720252544 —0.5120507367 Ay =5 
—0.5013757467 | —0.2170314638 An =3 (45.31) 
—0.5449811171 0.8310844643 Ag = —2 


Finally, the matrix T = KPW is given in (45.32). Comparing T to S in (45.28), we see 
that the first and third columns are interchanged and have opposite signs. Thus, calculation 
shows both that TTAT = A’ = diag(5, 3, —2) and TT BT = I. 


EXERCISES 45.5 


0 2.0 —2.0 
T=| 50 50 40 (45.32) 
-30 30. 20 m 


The following pairs of matrices A, and Bz, k = 1,...,5, are used in 


Exercises 1-3 
7 1 -2 
Hsi X 8 
-2 -3 7 


EN 
Il 

| d 
N U 
Eod 
=N 

| 

Ra) 
Em 


[9 -9 0 
Ag 2|—9 4 -8 


1. Select a pair of matrices A = Ag, B = B, from the list. 
(a) Show B is positive definite. 


(b) Obtain (ju, zę), k = 1, 2, 3, the eigenpairs of F = B^!A, and 
show that they are solutions of Ax = A Bx. 


(c) Show that the eigenvalues in part (b) are the solutions of the 
characteristic equation det(A — AB) = 0. 


2. For the pair of matrices selected in Exercise 1: 


(a) Apply Algorithm 1 for the simultaneous diagonalization of A 
and B, obtaining the vectors x, and the matrices 
S= Ix), X2, x3] and A = diag(àı, À2, À3). 


(b) Verify that STAS = A and that STBS = I. 
(c) Verify that (àz, Xj), k = 1, 2, 3, are solutions of Ax = A Bx. 
(d) Show that the sets {jz,} and {àz} contain the same members. 


(e) Show that if ug = Àx, then zz is proportional to x;. 


3. For the pair of matrices selected in Exercise 1: 


(a) Apply Algorithm 2 for the simultaneous diagonalization of A 
and B, obtaining the matrices K, P, M, W, and T, and Ax, 
k = 1,2, 3, the eigenvalues of M. 


(b) If T = [ti, ty, t5], verify that TT AT = diag(A,, Az, A3) and that 


TBE si. 
(c) Show that the pairs (Àx, tz), k = 1, 2,3, are solutions of 
Ax = ABx. 
The following pairs of matrices Aj, By, k = 1,..., 5, are used in Exer- 


cises 4 and 5. 


5 7 6 3 9 
aL | sal àl a= [> 
lt « [2.1 f» 4 [s 4 
A - |; d sp | “=l; 1 n=l; «| 

8 2 7 5 
As- |; 1 5 -[: i| 


4. Select a pair of matrices A = Az, B = B; from the given list. 
Suppose the given pair of matrices A and B are the matrix 
coefficients of the vector differential equation Ax" + Bx = 0 for 
which the initial condition is x(0) = [1, —2]’, x'(0) = [2, —3]T. 
(a) Multiply by A^! to obtain x” + Ux = 0 write U = PDP^! 
(where D is a diagonal matrix), define R — P~!x, and obtain 
R" + DR=0. 

(b) Solve the diagonalized system, and from this solution find the 
solution of the original initial value problem. 

5. For the initial value problem chosen in Exercise 4: 


(a) Assume a solution of the form x = er, and obtain the 
algebraic equation o? Ar + Br = 0. 

(b) Put this equation into the form Ar = A Br, and use either 
Algorithm 1 or 2 to obtain solutions x, = e'r, k = 1,2. 

(c) Use the solutions in part (b) to solve the given initial value 
problem. 
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1. 


Demonstrate the use of the scaled power method for finding an 


eigenpair of the matrix A — b a 


. Demonstrate the inverse power method for finding the other 


eigenpair of the matrix in Question 1. How should the calculations 
be implemented if computational efficiency is warranted? 


. Describe Gerschgorin's disk theorem. 


. Find the Householder reflection matrix that transforms 


x = [1, 1, 1]! to y = [—43, 0, oJ". 


. Find the Householder reflection matrix that transforms 


2 3 


1 
A-|-2 -1 0] to upper Hessenberg form. 
3 l 
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. Describe how Householder reflections are used to generate a QR 


decomposition of a matrix A. 


7. Describe the Givens rotations. Give an example. 


8. What is an annihilating Givens rotation? 


9. Describe how annihilating Givens rotations are used to obtain the 


10. 


QR decomposition of a matrix in upper Hessenberg form. 
Describe the shifted QR-algorithm for matrices in upper 
Hessenberg form. Where are the shifts obtained? Where do the 
eigenvalues appear? 


Answers to Selected Exercises 


CHAPTER 1 


Exercises 1.2—Part A, Page 14 
(a) linear (b) nonhomogeneous (c) first degree, first order (d) dependent variable y, independent variable t 


ho 


Un 


(a) nonlinear (b) nonhomogeneous (c) first degree, first order (d) dependent variable y, independent variable x 


13. (a) nonlinear (b)homogeneous (c) first degree, third order (d) dependent variable y, independent variable x 


17. (a) boundary value (b)correct (c) nonlinear (d) second order 20. Upon substitution both sides equal —1y43ex3:c= 2. 
Exercises 1.2-Part B, Page 15 
2. Upon substitution both sides equal cosx;c — 2. 3. Performing implicit differentiation on x?y? — 1y^ = c gives @ = —23—: c =-1. 
7. Upon substitution both sides equal 13xe?"?* , moreover y(0) = E — 4. 10. Upon substitution both sides equal 0; a = —2, b = -i. 
14. Upon substitution both sides equal 0; a — 2, b — —4. 
Exercises 1.3—Part A, Page 17 
1 yx) y(x) 
A A 
VANS VAS SSS AY YN SAN 
SOSA 
NNNNNANVSVS 20 VAN SNNNNNN 
PRANAN NNNNA N 
yy NN 1 NNNN 
EE ANNS 
E a abs 
X E z 
T 
SS 
NN 
Nullclines clines 
Solution curves 
Exercises 1.3—Part B, Page 18 
L v 9. Oisa source; 1 is a sink; 2 is a source. 


eje wA SSNS RAR A Re 


A-1 


» 
A-2 Answers to Selected Exercises 


Exercises 1.4—Part A, Page 19 


l. Exact solution 1x? + 1; $9 = 1, $1 = 13? 1,4; = 4x? +1,.... 3. Exact solution e!/?* ; Maclaurin expansion 1 + ix? + ixt + 
Axi +O) bo = 1,01 = 327 + 1,45 = Gxt + Gx? + Lids = Axi + ix* + $x^ 4-1. 
Exercises 1.4—Part B, Page 19 
1. Upon substitution both sides equal je" — 4 — x; ho = 15) = 4x? 42x + 1, ġa = Ext + i 2x4 2x +1,¢3 = i6 iu + 3x3 + 
2x? + 2x + 1, ġa = x6 + Exh + 2x4 + $x? + 2x? + 2x + 1; Taylor polynomial 1 + 2x + 2x? + 3x? + 2x4 + Ox). 
5. Upon substitution both sides equal cos x; Taylor polynomial 1 — 2x + 3x? — ie — ix t zx + O (x); ġo = 1; $j = —x? — cos x — 2x +2, 
à» = HM + $x? +2sin(x) — 3 cos(x) — 4x + 4, $3 = Jx! ix 24 } jx? + 10sinx —3cosx — 12x + 4, $4 = xX" ES ax) + 


ix$ 4 zo — 2x4 + 4x? + 8x? + 26 sin x + 13 cos x — 28x — 12; Taylor polynomial for $4: 1 — 2x + 3x? = ix = AM + ux + O (x9). 


Exercises 1.5, Page 22 
2. The determinant of the coefficient matrix equals zero. Infinitely many solutions x — i T Št, y=t. 


3. The determinant of the coefficient matrix equals zero. No solutions, because adding two times the first equation to the second equation 


produces 0 = —7. 7. The determinant of the coefficient matrix equals zero. Infinitely many solutions x = 2 — llt, y = t, z = 7t — 1. 
- i : - : 4/3. : LPS S s 
12. Substitution of y = 0 yields 0 = 0. Substitution of y = (2x) P yields 131/221/3x1/3 = 131/321/3x1/3, This does not contradict Picard’s 
theorem because 4 y^ = 1 is not continuous at 0. 
14. Since both f(x, y) and f, (x, y) are continuous in the entire plane, Picard’s theorem guarantees existence and uniqueness on |x| < h where 
h = min {oo, 5] = min {oo, z^] = zL. Since 4 attains a maximum }, existence and uniqueness is guaranteed on |x| < 1. Observe 


that this result is based exclusively on the function f(x, y) = 1 + y? and not on the solution tan(x). 


16. Picard's theorem does not guarantee existence and uniqueness, because f,(x, y) — 1 — is not continuous at y — 0; solutions y — 0 and 
| 2 5 


Eu 
y-sx. 
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Exercises 2.1, Page 25 
l k= $ In 13 years. 3. 1112 = 6.9402 years. 5. 5000 51? — 33,219 years. 7. k  1In2 = 0.13863 or 13.86% annually. 


In3 =5 


dP k 
8 dt — JP 


Exercises 2.2—Part A, Page 27 


Aa kar 2a? —Akl Hel 
1. P(O = ——————— — A. Py = 4 E — 5 hma = tka’; new equilibrium level la. 


(a — A)e-** + A 
Exercises 2.2—Part B, Page 27 


4,879,681' 
1, a = SS = 99.929, Py = 10, k = ;20. In BY = 4.9634 x 10°; P(t) = 1,153,680 Sood 
a 2309 0 115,368 D 185 x (t) 11,545(4,879,681)' + 103,823(34,225)! 
2 A ) 
A P(3)= —230.736 _ — 82.047. S. y= —— — —,.A € (0, 1); t = Ini). 


2309--37 /185 A -- (1 — Ae 


dx 


=re—% 2. cV;c Over time the contents of the tank becomes similar to the inflowing solution. 


Answers to Selected Exercises 


Exercises 2.3—Part B, Page 29 


1. & = 6 — 4x, x(0) = 20; x(t) = 400 — 3806/20 : 400 Ib 
H + +> t 
Ol 100 200 300 400 500 
5. & = 6—2, x0) = 10; x(200) = 379 —578.89]b 8. SF = 5 — 5g x(0) = 30; 5 Ib/gal 


Exercises 2.4—Part B, Page 32 


1. Ug = 1.5881°F; U, = 29.888°F, k = —0.12846 A 


3. U(t) = 1309.3 — 1203.2e0-0051154 


is higher than the temperature of the object, the temperature 
of the object is decreasing rather than increasing. 


4. Death could have occurred as much as 90.32 or as little as 81.30 minutes prior to 1.27 PM. 


CHAPTER 3 


Exercises 3.1—Part A, Page 36 


1. If x = xo and y = yo, the equation reduces to 0 = 0. 4. y(x) 2 —2,/3 tanh(2(arctan x +C)V/3) 5. x)= 


Observe from the graph that even though the ambient temperature 


at+ bec 0*9)—06) 


Un 


ek(—b+a)(t—C) + 1 


Exercises 3.1—Part B, Page 36 


-A (a) y(x) TAB rx 


Y] x 
to | — dt =} 
Qo & p f 


Inx+l 


b) } Oya) =- @ ? 


1 y-1 1 
dt > ` ln(x) > y 
y Inx —1 


Exercises 3.2—Part A, Page 38 
1. F(Ax, Ay) = (Ax) f(2) = X FQ, y) 2. F(x, y) 2 3F(1, 2) = x* f), with fu) = FC, u) 
3. Substituting F(x, y) = x* f (2) in xt +y 2 followed by simplification, yields: x Zx" f(2) Hy 5 faz x*kf (2). 


x ay 


A-4 


Answers to Selected Exercises 


Exercises 3.2—Part B, Page 38 
Ce arctan((x--2y)/x) 


2. (a) |= 


2xy + 2y? + x2 


mH ; ; 
Ol 04 os 12 16 2 


(d) 1 InQ? +24 +1) 
by the right hand side of the result. 


—4 arctan((x+2y)/x)+4 arctan(3) 
Se 


J2xy + 2y? + x? 


(c) l= 


6 h= p k= 3; d = ee, i n2 + In(16x — 11) — 1n(-160yx 
9 . 1 (80x4-227—192y)4/47 
3; V 47 arctan(z icr 7) = — In 16 + In(16x 2 11) - C 
Exercises 3.3—Part A, Page 41 
3 M = & yields 6xy? = 6xy?; y = zm 4. 
2.5 
z LS 
1 
0.5 
0 


2 2 B 2 xdx ydy 
_— —x* p^ ) = — —x* £) —EX— 272 —0 
y— yx +c"), y yx? +c’) Meu m 


5. —ydx +xdy — 0 The equation is not exact; use separation of variables to obtain y = Cx & f(x, y) = EU 


f. dx + f,dy =0 & —19 4-9 =0 & —ydx e xdy — 0. 


= 
X* x 


Exercises 3.3—Part B, Page 41 


1l. —pdx +q dy 20; 2? = —8 2. 2 = — 694 24x? 29 -24x?; -0xy — 8x3y + Oy? =e 


dy ax oy Ox 


9, B= 


oy 


Exercises 3.4—Part A, Page 44 


1. U(t)=1+ icost + sint + Ce" Yes, the solution tends toward a periodic function with the same period 27 as U,. 


5. u(x) = di } dx — t dy =0 > y = Cx 


454y + 103x + 298 + 192y? + 96x?) — 


-34 € 24xy! + Sy? — 3x? — 60x3y? = 24xy? + 15y? — 3x? — 60x°y?; —4x? y? — 5xy? + x3y + 5xty? =c 


y 


t 
2 


> 


x 


4 arctan(1 + 22) =Inx — 1 In5 — 4arctan3 To show equivalence with (c), exponentiate both sides and divide 


Answers to Selected Exercises A-5 


Exercises 3.4—Part B, Page 45 


1. 2 (Qx + 3y)u(x, y) = 2 ((5x + Ty)u(x, y)) & -2u(x, y) + (2x + 3y) A u(x, y) — (5x + Ty) Au(x, y)=0 
dy ly 8x3 —16x24+2x-1, dy 1.9. .— 10x?--5x—6, 
6. dx T Dx fx * 13. dx + 22-x ^. x—2 ? 
YA) = af + 2x7? MeL. ya = E P. Bx? + CVD == 
y y 
A A 
10 
1500 + 
54 1000 + 
0 x 
E > X 
-10 
==]. 0; 1 C = —100, 0, 100 
dx 9 "E : ^ 3 
17. i = 3 4m. x0) = 75; 2 
Tey ess 27 4 a NERONE 
x(t) = —7390.000,000" + 7,250,000" — so! + jot +75 
X 
! ! ! ! t 
O! 100 200 300 400 500 
Exercises 3.5—Part A, Page 47 
i co P vote) ms gp to PU) = Cer 3. Rewrite the equation as = = —py = f(x, y, then, since f and f, are continuous in the entire 
xy-plane, the existence and uniqueness of the solution to the initial value problem - + py = 0, y(xo) = 0 is guaranteed. Since y = 0 is a 
solution, it must be the only solution. 5. x, = Cx’, X —x? cos x 
Exercises 3.5—Part B, Page 47 
1. Æ = k(U — 1 — e™); k = —1.205419580; 3. € = 10 + 5te™ — Z:x(r), x) = 50; 


U (t) = 1 + 5.868085116e™ — 3.8680851166- 1205119580: x(t) = -e7 — ret + 200 — 32.50 9-1/20r 


361 


361 


(mom doa coxI 
ud O! 20 40 60 80 100120140 


N+ 


| 
t 
2535 39 


slightly larger than the second. See graph. n 
44 
34 


E——173 >i 
9 20 60 100 140 
This makes sense, because in the second case the incoming brine contains less salt. 


A-6 Answers to Selected Exercises 


, dy y 73-6x? dy ., ?5cos2x., __ " š 
4. dx +25 ps x ? 9. dx TA z= 16x + 3; 
ax AE - l p2 " 1 16x cos? x—8 sin x cos x—8x+3 cos? x 
Yh = 3, yp = — 7 x* (14x — 15), p= "IEEE ES: 8sinx : 
zh a EP 10 ( ) Yn Sinx cosx? JP 2 sin x cos x * 
M m e, € lx( l4x — 15) y [e] _ 1 16x cos? x—8 sin x cos x—8x+3 cos? x , 
i di 10 7 — sinxcosx 2 sin x cosx i 
y j 
Y y 
A A C=-5,0,5 


19, 2 1:2 tll, y = C Ve; Yp = —6x +22; y = C /x — 6x + 22 
26. Z —24y = —Ax! + Tx 5; yy = C(x? — 4); y, = —1 (x? — 4)(16x — 31n(x — 2) — 25 In(x + 2)); 


y = C(x? — 4) — F(x? — 4)(16x — 31n(x — 2) — 25In(x + 2) 


Exercises 3.6—Part A, Page 49 


1. Substitute z = y!™ into d + p(l — s)z = r(1 — s) and simplify the resulting expression. 


dy ) , dz z zk+1(_9 + 16x? dz z 
2. => 52 ds 34x 4-3)"; : 2 = ( +i Choose k = —1; +2- = 9 — 16x- 
dx % dx kx k dx x 
dy y  (x?+5)y?? dz z  zktD/2(y2 +5) dz 1z 1x?4-5 
5. —-—--— —$ — = Choose k = —2; = 
dx x x3 dx kx kx3 dx 2x 2 x 
Exercises 3.6—Part B, Page 49 
1. y(x) = m 2. Itis not a Bernoulli equation. 
3. e -= 32 = —(2x? + 5x — 14)y?; a T Drs = 2x? + 5x — 14; y(x) = 21 DU tC 
; y y 
7 C=6 A c=0 
21 
A E i E 3 -$ = T 
eh l 
C--10i 
7. Z + Bry = — (4x? + 13x — 3)y?; i 
dz E c E A " 
A —niz-—4x*-413x—3; 
y(x) = cos x 


4x? sin x—11 sin x+8x cos x+-13 cos x+13x sinx+C 


C - -50, 0, 50 
CHAPTER 4 


Exercises 4.1—Part A, Page 55 
3 Yapprox (£) — approx (h) ch* — C ey 


2k —] 2k —] 
5. y= —l, yo := 1, y3 := —1, y4 := 1, ys :— —1; take h = 0.0001 


1. y; = 1.20000; y; = 1.46500 


Exercises 4.1—Part B, Page 55 


(e) 


(i) 


] 


- Ota fF WN — 


CQ «o oo 


Cn 4 C) N 


sa 


C «oO oo 


(a) y(t) = 


9r5--512—5 1, 
Yexact — Yapprox 


h 


1.3491576916414886760 
1.5161943703554599664 
1.6172854495413053544 
1.6733790078835392128 
1.7029993702267577888 
1.718229723544798 1888 
1.7259535397271942528 
1.72984307406648028 16 
1.731794807 1854947840 
1.7327724227253112832 


Yexact 


7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 
7.3820424022299 180674 


Yexact — Yapprox 


nt 


87,396 87,396 
— y(—6) = 


o0 


= 7.3820424022299180674 (b) h = 0.1, y(—6) = 7.2181184243918785567 


a 


0.3790485926 
0.2021606812 
0.1045861880 


Wv N 


(d) 


CO ooco-109v t FÉ 


= 


j 1 j ] 
2y approx ( 3h) — approx (h ) 


7.2985240628729324226 
7.3567696324334567202 
7.375030707437 1388349 
7.3801911295834669064 
7.3815664536887293045 
7.3819217176020681293 
7.3820120152428923957 
7.3820347782724219172 
7.382040492824566863 1 


Yexact 


1 
Yexact — approx ( 2 


0.05321873032 
0.02684733943 
0.01348401203 
0.006757199508 
0.003382411733 
0.001692160569 


h) Yapprox ( ih) — approx (A) 


0.2955302532 
0.1768879114 
0.09757449320 
0.05136745767 
0.02637139089 
0.01336332740 
0.006726812521 
0.003374787775 
0.001690251164 


(£) h = 0.1, y(—6) = 7.3820418889193688876 


3 1 
e Yapprox ( 2 h ) 


0.0041870723765596704000 
0.0047579289551821056000 
0.0050688203689312256000 
0.0052308689524555776000 
0.0053135712715800576000 
0.0053553451816189952000 
0.0053763379482853376000 
0.0053868635172634623999 
0.0053920325104041983999 
0.0053970627761012736000 


(h) 


Ww N 


v e 


ona 


Oo 


0.0000185856599811801 
0.12375049728836 x 107? 
0.798167259591 x 1077 
0.50674164501 x 1075 
0.3192034472 x 107? 
0.200284196 x 107!° 
0.12542269 x 107! 
0.784644 x 107^ 
0.49086 x 10-4 


Yexact 


7.38204240222991 80674 
7.3820424022299180674 
7.3820424022299180674 
7.3820424022299180674 
7.3820424022299180674 
7.38204240222991 80674 
7.3820424022299180674 
7.38204240222991 80674 
7.38204240222991 80674 


16 1 A à 
15 Yapprox ( 2 h) — T5 Yapprox (h) 


7.3820400236608404742 
7.3820423212686124038 
7.3820423995924085702 
7.3820424021457889181 
7.3820424022272621539 
7.3820424022298346499 
7.3820424022299154536 
7.3820424022299179874 
7.38204240222991 80628 


Answers to Selected Exercises 


difference 


—0.0835183394 
—0.0252727698 
—0.00701 169480 
—0.00185127265 
—0.00047594854 
—0.00012068463 


fi 1 its 
15 approx ( 2 h) — 15 approx (h) 


0.00001620709090358662 
0.115654366721976 x 105 
0.7717921646164 x 1077 
0.498328730060 x 10-5 
0.31654753352 x 107? 
0.1994500184 x 10-1? 
0.125161285 x 107! 
0.7838417 x 10-33 
0.490372 x 10-4 | 


—0.000030386987 
—0.7623958 x 107? 
—0.1909405 x 107? 


A-8 Answers to Selected Exercises 


5. (a) y(t) = tev 9927147. (9) = —5.333321276529206733490626 (b) h = 0.1, y(9) = —5.325830351763656112262388 


2t 2 


Yexact — Yapprox 


5 h S Yexact — Yapprox ( jh) Yapprox (ŻA) — Yapprox (A) 
l| 0.07843439248783619225341800 2 —0.019048352079363353900250 —0.020168844164554742226459 
2 0,0761934083174534 1560100000 3 —0,009390032503739046665053 —0.009658319575624307235197 
3 10073120200029212 37532042400 4 —0.004662183904225304226109 —0.004727848599513742438944 
© : pb ned det Lie iei (a) | 5 —0.002322969662369749766789 — —0.002339214241855554459320 
0743350291958319925372 6 —0.001159464852837532577294 —0.001163504809532217189495 
G 10.07420575038160208474681600 7 —0.000579228748039465071484 —0.000580236104798067505810 
T 0.07414127974305152314935200 8 —0.000289488618450782782956 —0.000289740129588682288528 
S 10.07410908632040037243572600 9 —0.000144712890805236016191 —0.000144775727645546766765 
F (0.07407300002228084028972200 10 —0.000072348593354645567598 —0.000072364297450590448593 
10 0.07408495959515706122035200 
RY exact 2 y prox (+) — Yapprox (Å) 
2 —5.333321276529206733490626 —5.334441768614398121816833 
3 —5.333321276529206733490626 —5.333589563601091994060774 
4  —5.333321276529206733490626 —5.333386941224495171703457 
(e) 5 —5.333321276529206733490626 | —5.333337521108692538183153 | (f) nh =0.1, y(9) = —5.333321276529177021179194 
6 —5.333321276529206733490626 —5.333325316485901418102823 
7 —5.333321276529206733490626 —5.333322283885965335924948 
8 —5.333321276529206733490626 —5.333321528040344632996198 
9 —5.333321276529206733490626 —5.33332133936604704424 1200 
10 —5.333321276529206733490626 —5.333321292233302678371625 
d oW [5 aos — Sana id I yp CS — Dune 
qoo ae as 2. —0.1173780614233 x 10-!!  —0.11960272228995 x 107"! 
a M a 3 —0.72678702150 x 10-1? —0.734067941388 x 10-1? 
dic RÀ 0 rein 4 —0.4520628858 x 10-4  —0.45438715528 x 10-4 
Wo] = nosssessezuspRCOIX p> | do| AR cp s —0.2825851648 x 10-5 
6 0.2951801334661 120000000000 x 10-? 5 ee ee 
7 0.2949984865484800000000000 x 10-2 TP “hie EERSTE xe NEU 
8 0.2948795696414720000000000 x 10-9 8 Oana? x C go H 10 
9 0.2954937499647999999999999 x 10-9 S x ee 
-29949 10 —0.279 x 10?! —0.2680 x 1072! 
10  0.3067637441495040000000000 x 10-9 t 


[2] 


] 16 ., 1 li 
Yexact 15 Yapprox ( 2 h = 15 Yapprox (h) 


—5.333321276529206733490626 —5.333321276529228980099294 
—5.333321276529206733490626 —5.333321276529207461582616 
—5.333321276529206733490626 | —5.333321276529206756733323 
—5.333321276529206733490626 | —5.333321276529206734224406 
—5.333321276529206733490626 —5.3333212765292067335 13673 
—5.333321276529206733490626 | —5.333321276529206733491350 
—5.333321276529206733490626 | —5.333321276529206733490657 
—5.333321276529206733490626 | —5.333321276529206733490619 
—5.333321276529206733490626 | —5.333321276529206733490617 


(i) 


CO woO00-1OQNvUtA RU T2 


1 


1 u 3 14 4312 

É (a v(iy- dL ugd4. E 
13. (a) y(t) = ss — aa t y 60 
[ Yexact — Yapprox 


h 


$ 


Fo ; 1 
Yapprox ( 3h) 


M exact — 
1 5.4978395061728395062 2 —1.6195131704382433245 
2 6.4780526817529732980 3  —0.87300094178607550622 
5 ueteris 4 | —0.45180512828156976006 
9| t ce eta deni in (a) | 5 —0.22962378687300318896 
5 73 3 6 —0.11572781723608448667 
6 —7.4065805051094071469 7 —0.05809108017467045684 
a I 8  —0.02910210856404805469 
sip eas c a 9  —0.01456516854299415443 
3 1431300224013 p 10 —0.00728610936922706351 
|10 7.4609759940885130342 
[5 exact 2 Yapprox ( ih) — approx (h) 
2 —0.99583333333333333333 —0.5057267455432664375 
3 —0.99583333333333333333 | —0.86934462019942564539 
4 —0,99583333333333333333 —0.96522401855626931939 


Un 


(e) 


Yexact — Yapprox 


ht 


Ye xact 


(i) 


—0.99583333333333333333 
6 —0.99583333333333333333 
7 —0.99583333333333333333 
8 —0.99583333333333333333 
9 —0.99583333333333333333 
0 —0.99583333333333333333 


2.2116956552902748158 
3.4102782095350476723 
3.9857020261116057600 
4.1947422529651946291 
4.2684148561119857869 
6  4.2964545452679731610 
7  4.3081804966384369664 
8 4.3134612688397664255 
9  4.3159551017428923186 
10 4.3171635550443326669 


2 —0.99583333333333333333 
3. —0.99583333333333333333 
4  —0.99583333333333333333 
5. —0.99583333333333333333 
6 —0.99583333333333333333 
7  —0.99583333333333333333 
8 —0.99583333333333333333 
9 —0.99583333333333333333 
—0.99583333333333333333 


—0.98839088786889671543 
—0.99400148573416754893 
—0.99537899022007690634 
—0.99572019637990768081 
—0.99580510481139307916 
—0.99582628313787336070 


a 


> Yapprox ( i h) 


exact 


(h) 


—0.100430596360 x 1078 
—0.6280541277 x 107? 
—0.392643738 x 107! 


SFCOAANIADAN FWY 


16 l l: a 
xs Vapprox ( 3h) 785 approx (h ) 


—0.99083923935731344651 
—0.99568348338109985474 
—0.99582993098589105486 
—0.9958332583896859265 | 
—0.99583333 155061790754 
—0.99583333328673858900 
—0.99583333333202183935 
—0.99583333333329462402 
—0.99583333333333216103 


—0.01332139925599627997 
—0.00097307178371865375 
—0.00006400668720955192 
—0.407067762004088 x 10? 
—0.25608864696431 x 1076 
—0.1604922300815 x 1077 


A-9 


Answers to Selected Exercises 


, ¥(2) = —0.99583333333333333333 (b) h = 0.01, y(2) = —0.92155801415404984819 


1 
approx ( ;h )— Yapprox (h) 


—1.1294065826481764286 

—0.74651222865216781828 
—0.42119581350450574616 
—0.22218134140856657110 
—0.11389596963691870229 
—0.05763673706141402983 
—0.02898897161062240215 
—0.01453694002105390026 
—0.00727905917376709092 


(f) h = 0.1, y(2) = —0.99542551694636814077 


1 1 1 
15 approx ( 2 h) - Y Yapprox (h) 


—0.008327305279976393068 
—0.000823221831485175081 
—0.000060604339767273455 
—0.3995733972634070 x 10? 
—0.254305931538438 x 1079 
—0.16002628263744 x 1077 
—0.1002994469636 x 1075 
—0.62766703389 x 107'° 
—0.3925265026 x 107! 


A-10 


16. (a) y(t) = —3P? — 11/2 + Br? y(2) = —21.566756826189699494 


(c) 


(e) 


(g) 


(i) 


Yexact — Yapprox 


h 


5.94291045551 "n 
5.9140269696708665560 
5.9054341697266924560 
5.9023287584307443680 
5.9010423623762397 120 
5.900462018 1063693440 
5.900187 1085822877440 
5.9000534 140830499840 
ee | 


Ss 


WN — 


SCOANIADAUASL 


paš 


5.8999547754610462720 
5 Yexact 


2 —21.566756826189699494 
3 —21.566756826189699494 
4  —21.566756826189699494 
5. —21.566756826189699494 
6  —21.566756826189699494 
7 —21.566756826189699494 
8 
9 
0 


—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 


Yexact — Yapprox 
n* 


1 0.002092245 1322711360000 
2  0.0024128146216243200000 
3 0.0026682765423575040000 
4 0.0028244575928975360000 
5 0.0029096870265487360000 
6 0.0029540350196449280000 
7  0.0029766327216373760000 
8  0.0029880516975001600000 
9  0.0029940388819107839999 
10 0.0029972686973 173760000 | 


S Yexact 


—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 
—21.566756826189699494 


O 00-10 t &R C t2 


(d) 


Answers to Selected Exercises 


; " 1 
Yexact — Y approx ( 5h) 


—1.478506742417716639 
—0.73817927 1215836557 
—0.368895547401921523 
—0.184407573824257491 


(b) y(2) = —20.976346453651710192 


3 1 
Yapprox ( 5h) — Yapprox (h) 


—1.492948485341528434 
—0.74032747 1201880082 
—0.369283723813915034 
—0.184487973577664032 


—0.092194719032912021 —0.092212854791345470 
—0.046095211785799123 —0.046099507247112898 
—0.023047083648761914 —0.023048128137037209 


—0.011523413086009819 
—0.005761674585411178 


, 1 ) 
2y approx ( 2 h) — Yapprox (h) 


(h) 


—21.581198569113511289 
—21.568905026175743019 
—21.567145002601693005 
—21.566837225943 106035 
—21.566774961948132943 
—21.566761121651013269 
—21.566757870677974789 
—21.566757083666441770 
—21.566756890104886957 


z ; 1 
5 Yexact — Yapprox ( 2 h) 


2 —0.9425057115720 x 10? 
3 —0.651434702724 x 107$ 
4  —0.43097802626 x 10-7 

5. —0.2774893786 x 1075 

6  —0.176074208 x 107? 

7  —0.11088821 x 1077? 

8 —0.695710 x 107? 

9 —0.43569 x 107? 

0 —0.2726 x 107! 


18. 1 D. 
38 Yapprox (5 71) — 75 Yapprox (h) 


—21.566755490483493857 
—21.566756759663 157637 
—21.566756823647690209 
—21.566756826102999632 
—21.566756826 186879925 
—21.566756826 189609700 
—21.566756826189696659 
—21.566756826189699402 
—21.566756826189699492 


—0.011523670562752095 
—0.005761738500598641 


(f) h = 0.1, y(2) = —21.566756553345677966 


1 1 1 
15 approx ( ;h )— 15 Yapprox (h) 


—0.80893509100817 x 1075 
—0.5849081608664 x 1076 
—0.405557933399 x 1077 
—0.26881939227 x 1075 
—0.1732546385 x 107? 
—0.109990258 x 10-10 
—0.6928741 x 107! 
—0.434760 x 10-8 
—0.27229 x 10-4 


(i) 


(920,7197,824154+1,778,663,216t33 —9,763,030,079)!/4 


Answers to Selected Exercises 


18718 


exact — Yapprox 


h 


121.45868186108642696 
8.9243694051861423632 
5.1986347530016428632 
0.0041047359376042144000 
0.0041361325656049984000 
0.0041521831962812160000 
0.0041602731412752384000 
0.0041643353827658240000 
0.0041663711739617792000 
0.0041673903102025728000 


Yexact 


2y 


a 


, ; l 
Yexact — Y approx ( 2 h ) 


2.2310923512965355908 
—0.6498293441252053579 
—0.0002565459961002634 
—0.0001292541426751562 
—0.0000648778624418940 
—0.0000325021339162128 
—0.0000162669350889290 
—0.81374436991441 x 10? 
—0.40697170998072 x 1075 


Cn 4 Wb 


(d) 


ona 


Qe o 


l ) 
approx ( ;h = approx (h) 


» ¥(2) = 2.3972670724285390400 


Un AWN 


oO WON AD 


— 


r 


-d20 t 4 t t2 7 


) OO 


2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 


Yexact — Yapprox 


ri 
211.74671270923663608 

91799.540932228263140 

19996.614987861805505 


5.1993359095077208064 

0.55387105436033351680 
0.48714212083331235840 
0.45618709401027215360 
0.44126713557832171519 
0.43394582781037117439 


58.664423300378681338 


5.9280181119754853466 
1.7479508202955342089 
2.3972690347177890890 
2.3972675740107476718 


v ) " 1 
5 Yexact — Yapprox ( 3h) 


358.59195676651665289 
114.8819860810209486096 
4 — 0.0000793355699082599 
3 0.5282125991443 x 1075 
6 0.290359330674 x 1077 

7 0.16994293556 x 107? 

8 
| 9 

10 


(h) 


0.1027405112 x 107? 
0.63147429 x 107"! 
0.3913743 x 107? 


0.43032059366269255680 


Yexact 


2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 
2.3972670724285390400 


16:2, 1 L 
T5 Yapprox ( 571) = 15 Vapprox (h) 


—379.21854217556740474 


21.095945703773970715 
2.7228174357711710913 
2.3972612199637727355 
2.3972670766710503779 
2.3972670725515432652 
2.3972670724322444518 
2.3972670724286526818 
2.3972670724285425570 


, 1 ) 
y approx ( 2 h) —2 approx (A ) 


58.498248579246677889 
2.88092 169542 17409487 
—0.649572798 1291050945 
—0.0001272918534251072 
—0.0000643762802332622 
—0.00003237572852568 12 
—0.000016235 1988272838 
—0.81294913897849 x 1075 
—0.40677265993369 x 10? 


(f) h = 0.1, y(2) = —2.3974454619799884869 


ieee 1 E g ] 
15 y approx ( 2 h) — Ns b approx (h) 


—23.02385248 1479290875 

23.5806647 12366380285 
0.32547102777272379 130 

—0.532425216716028 x 10? 
0.3327844440512 x 107? 
0.182243358079 x 1078 
0.10644592296 x 107? 
0.642838455 x 107! 
0.39489124 x 107? 


(b) h = 0.1, y(2) = 2.5901906545021546936 


A-12 Answers to Selected Exercises 


Exercises 4.2- Part A, Page 57 


1. f(t, y) 2 Ay > Yeu = yk thay, = (1 + hd) ye 4. In this case h = a 5. ye = yo(l + (10) (4))“ = yo(0) = 0 
Exercises 4.2—Part B, Page 57 
1. A . We expect good results as long as 0 < h < c = 02. 
h=0.25 
40+ 
20+ . i 
0 F ! > 
-02-. 02 +0608 1 1214 al 05 1"725,3 39 
-0.4+ 
a06+ * -404- * 
h — 0.1 h=02 
x B Yexact x y Yexact 
0 2.0 2.0 0 2.0 2.0 
1.0 5.987656250000000 6.000000306 1.0 — 26.88000000000001 6.000000306 
2.0 14.98666763305664 15.00 2.0 1066.279999999997 15.00 
3.0 27.98666666761041 28.00 3.0 —33613.83999999973 28.00 
4.0 44 .98666666666759 45.00 4.0 0.1076582999999986 x 107 45.00 
5.0 65.98666666666666 66.00 5.0 — 0.3444915087999938 x 108 66.00 
6.0 90.98666666666668 91.00 6.0 0.1102375030279974 x 10? — 91.00 
7.0 119.9866666666667 120.00 7.0 — 0.3527599793783899 x 10!! — 120.00 
8.0 152.9866666666667 153.00 8.0 0.1128831938002963 x 10? 153.00 
9.0 189.9866666666667 190.00 9.0 — 0.3612262201100780 x 10^ 190.00 
10.0 — 230.9866666666666 231.00 10.0 0.1155923904358498 x 10/6. 231.00 


Ya =e! y, — 2t?+3t+1 Even though y; stops contributing for positive values of t away from zero, the stepsize necessary for stability 
of the method is regulated by the inequality |1 — 154| < 1 = 0 < h < 0.133. 
— approx] < 1.0550456, on t € [0, 500] 


| Yexact 


0! 100 200 300 400 500 al 109 200 300 400 500” 
Exercises 4.3—Part A, Page 59 
l. z ae oe pt + a pr + aa aa + ae mod + imu 
3. l-x+ x F uU m ^ F T ig ut dl nap = ma 


4. Ifthe differential equation is written in the form Z = g(x, y(x), a), then the function g (and its derivatives) cannot be evaluated at x = 0. 


5. Substitute y(x) = x in the differential equation. No, it does not contradict Exercise 4, because this solution cannot be generated using a Taylor 
series method. 


Exercises 4.3—Part B, Page 59 


13 42 26,3 13,4 13,5 2587 299 ,7 19,279 221,9 27,157 410 y 
1. (a) Yapprox = 1 - 2 + BP — Brt Bp + S8 t I8, 4 


6 
720 t 420 40,320 648 403,200 


y 13 26,3 13 44 
(b) yeaa = 1 — Ft + Ft wt 


Answers to Selected Exercises 


13,5 2587 ,6 299 ,7 19,279 ,8 221 ,9 27,157 ,10 y 
3! + 720! 4201 30,3204 i Fri 403,200 (c) 


Ol ds T 15 2 55 3 


A-13 


2,386,780,960,480 ,3 


87,396 1 87,396 1,438,704,761,959,840 164, 126,041,874, 144 6,504, 147,357,220 ,2 
26 | y(—6) = = 7.382 (b) Vexact © + t+ t 


3. (a) Yexact (t) = 57249145? 


11,839 10,430,249,423,049 3,476,749,807,683 1,158,916,602,561 


(€ Yer = ye(2,103,731,511,225h2 + 596,695,240, 120h3 + 13,904,381,742,381h2k2 + 729h!?k!? — 61,2365! K'! + 2,358,801 51010 — 
764,700,592, 880h^k + 30,993, 185, 160h7k* — 144,913,611,380h°K? + 420,555,240h°k® — 4,420,850,760h518 — 25,728, 840h!°K7 + 


918,540h k* — 14,580h'7k? + 1,916,530,494, 140h*k? — 2,992,584,041,440h3k + 7290h? k'? + 6,591,467,421,280/? K? + 


181,402,946,475h°k* — 727,685,295, 540h°k? + 3,686,249,520h*k9 — 31,023,654,480h7k° — 300,487,320h°k’ + 16,082, 145h'°K§ — 


510,300A!! X? + 435,759,932, 580h°k? — 2916h ? k'! + 224,532h''k!° — 9,269,587,828,254h7k + 801,038,197, 190h°k* — 


2,813,578,332,440h^ I? + 22,758,873, 984h7k® — 159,719,537, 698h°k? — 2,317,577,040h8k’ + 165,286, 170h°k® — 7,862,670h'? &? — 


17,784,269, 852,454hk + 2,110,183,749,330Ah^k* — 6,591,467,421,280/? X? + 79,859,768, 849h°K® — 480,622,918,314/^ IJ? + 
5,928,089,950,818h — 9,753,803, 136h7k’ + 869,091,390h8k® + 10,430,249,423,049 — 55,095,390h°k?) /(21,849 — 12,418hk + 


2651h2k2 — 252h3k? + 9h*k4*)3, h = 0.1, Yapprox(—6) = 7.381908764, error = 0.000133638 (d) h = 0.05, Yapprox = 7.382025117, error 


= 0.000017285 
h 


0.10000000000000000000 
(e) | 0.050000000000000000000 
0.025000000000000000000 
0.012500000000000000000 
0.0062500000000000000000 


9. (a) yalt) = za. V) = $ —0.11321 (b) HE — 758; + 370,2 (c) yess = y (828hk + 31788? + 6076118 + 


Yapprox — exact 
k? 


—0.13364495900473560000 


—0.13825143678992480000 (£) A 
—0.14061383598020480000 E. he : 
—0.14181012677616640000 P le 
—0.14241208423505920000 Pd +55 

a +5 
ai +45 

Pt TA 

ref 
-7 -68 -66 -64 -62 -6 0 


6955h*k^ --5076h? k^ +2358hŚkÉ --6A8h" k? +81h8kë --81 —414h —3178h7k —91 143k? — 13,910h*k3 — 12,6907? k* — 707Ah8 I5 — 2268h7 k6 — 
324h8k7 + 15854? +7170h3k + 14,925h* ? + 17,820h°k? + 12,555 R6 K^ 4- 48607 IÓ + 81055 k9) /(9 4- A6hk + 59h? K? + 36h? I? --9h* Kk*y?, h = 
0.1, Yapprox = 0.1363495218, error: = 0.0231419746 (d) h = 0.05, Yapprox = 0.1176571769, error = 0.0044496297 


h 


0.10000000000000000000 
(e) | 0.050000000000000000000 
0.025000000000000000000 
0.012500000000000000000 
0.0062500000000000000000 


Exercises 4.4—Part A, Page 64 


1. y= 58 2.32; y 26,841 


25 10,000 


Exercises 4.4—Part B, Page 64 


Yapprox — exact 


h* 


2.3141974722643724420 
1.7798519576705287440 | (f) A 


1.5826089509250509120 2 
1.4975483066273326720 15+ 
1.4579903273736245760 
I 4 
054 
0 | 12 14 16 18 > = 
2.6841 — 3. y, = $2 = 3.331; y; = H8826 = 3.7354 — 5. yı = 0.9132946446; y; = 0.8504279079 


l. yj = yk + Ë (AYk + aYk41) > yea = Iw Yk 3. Substitute y(t) = yoe“ into the differential equation. 


A-14 


Answers to Selected Exercises 


5. Yea = 20? c 3t 4 12- e PY A | n 


0 5 4 


—— 
0 2 4 6 8 10 6 8 10 


h Yapprox — Yexact 


Tr Yapprox — Yexact 
7 h LM 
h* 


n? 
—0.12619272285064639400 
—0.12536922283563788400 
—0.12516985999467780800 
—0.12512041101257881600 
—0.12510807301565388800 
—0.12510499002831564800 
—0.12510421937594777600 
—0.12510402671876505600 
—0.125103978555 17900800 


0.10000000000000000000 
0.050000000000000000000 
0.025000000000000000000 
15. | 0.012500000000000000000 
0.0062500000000000000000 
0.0031250000000000000000 
0.0015625000000000000000 
0.00078125000000000000000 
0.00039062500000000000000 


26.0051513621544100 
28.1518639060855078 
29.273279636088965 
29.84450042689287 19. 
30.13249676338164 
30.2770573421625 
30.3494737261168 
30.385715362301 
30.40384446817 


0.10000000000000000000 
0.050000000000000000000 
0.025000000000000000000 
0.012500000000000000000 
0.0062500000000000000000 
0.0031250000000000000000 
0.0015625000000000000000 
0.00078125000000000000000 
0.00039062500000000000000 


Exercises 4.5—Part A, Page 67 
1. yo = 0.3333333333, y, = 0.3460606761, y2 = 0.3622411960 3. 
ys = 0.5882352941, y, = 0.6249876808 


yo = 0.5000000000, yı = 0.5263157895, y; = 0.5555555556, 


n TU (t — fa heh n—-1l 7 a t — fy " 
5, y= fs ni ^ ) i Y =e «f fa Cni ^ A dt = y, t (fa — ifa )h 
Exercises 4.5—Part B, Page 67 
h — ee 
h = $, yo = 1, yi = 1.000394771 
a 0.50000000000000000000 0.22222222222222222200 


0.25000000000000000000 
0.12500000000000000000 
0.062500000000000000000 
0.031250000000000000000 
0.015625000000000000000 
0.0078125000000000000000 
0.0039062500000000000000 
0.0019531250000000000000 


0.25174603174603174560 
0.28168234843003361280 
0.29699798756829678080 
0.30472101398986741760 
0.30860253023530926080 
0.31054912373753610240 
0.31152400660968898560 
0.31201186190673838080 


0.00097656250000000000000 — 0.31225589527425843200 
5. tc:-[seq(t[n]-k*h, k=0..4)]; fc:=[seq(f[n-k], k=0..4)]; poly:=interp(tc, fc, s); method:=y[n+1]=y[n]+factor(int(poly, s-t[n]..t[n]--h)); 
Yn = Yn + z5 A (0901 fa 4-251 f, 4 — 2774 fai — 1274 fa-3 + 2616 f, 2) 
7. Substitute y, = r* in the difference equation and note that r* 4 0 for r Æ 0. 


8. r?—(L+ 3A)r + $A =0;7, 2 1 IA 1A AA 9A, rm 1 3A LA E 4A 942 4 


Exercises 4.6—Part A, Page 70 


1. y4, = 0.4134585597 3. y2 = 0.3627537798 5. ya = 0.6756782192 


Exercises 4.6—Part B, Page 71 
2. T:=[seq(t[k]+n*h, n=-1..0)]; F:=[seq(f[k+n], n=-1..0)]; p[1]:=interp(T, F, s); predictor:=y[k+1]=y[k]+simplify(int(p[1],s=t[k]..t[k]+h)); 
Predictor: yy4; = Yk — 1h(—3 fi + fia); T:=[seq(t{k]+n*h, n=0..1)]; F:=[seq(f[k+n], n=0..1)]; p[2]:=interp(T, F, s); 
corrector:=y[k+1]=y[k]+simplify(int(p[2], s=t[k]..t{k]+h)); Corrector: yi.) = yg + SAC fer + fk). 


Answers to Selected Exercises 


" oo C. Cy», p — Ya) 
3 / 5. Yexact — Y2,c C- Č, 

i+ —0.00001178725152467777 | —0.000039080060764375985454 
0.9 4- 
0.8+ 
07+ 
0.6+- 
0.5 
eei 

+ + + t ! rt: 
0 1 12 14 16 18 2 


Exercises 4.7—Part A, Page 74 


1. y4 = 0.4134523839 3. Substitute x, = (—2)* in the difference equation, and also observe that (—2)° = 1; 
[1, —2, 4, —8, 16, —32, 64, —128, 256, —512, 1024]. 


6. Solution: 1(—3)* + 22*; r, = —3, r = 2,a = 1, b = 2; (2, 3, 9, 9, 45, 9, 261, —207, 1773, —3015, 13,653]. 


Exercises 4.7—Part B, Page 74 


Be aware that eventually, even with h = 0.01, Milne's 
method will diverge. Just try to extend your computation 
to the interval [1, 10]. 


Yexact — 4 
0.24365563469 x 10-8 
(a) Solution: (5 — 2i)(2 — 3i)" + (5 + 2i)(2+3i)" (b) and (c) [1, 1, —9, —49, —79, 321, 2311, 5071, —9759, — 104,959] 


N 


1 1 
29 J4.p — 39 Y4,c 
Solve Section 4.1 problem B3; l ra | 


0.214143797616 x 1078 


(d) ri 22-31,75 224-3,a 2 —-iLb-2i-i. 
Exercises 4.8, Page 76 
tk y(t) Ys [yes — «| Error 
6.1 —7.0723421515030 —7.0723421515022 0.685 x 10-!? —0.685818 x 10-9 
6.2 —7.1460202100500 —7.1460202100485 0.659 x 10-1? —0.659262 x 10-9 
6.3 —7.2209819764892  —7.2209819764873 0.633 x 107? —0.631642 x 10-9 
64 —7.2971760251442  —7.2971760251419 0.603 x 10-!? — —0.603344 x 10-1? 
2. Solve Section 4.1 problem B3; | 6 5.7 3745518811578 —7.3745518811548 0.574 x 10? —0.574713 x 10-9 
6.6 —7.4530601700514 | —7.4530601700478 0.547 x 10-1? —0.546037 x 10-19 
6.7 —7.5326527414142 —7.5326527414101 0.517 x 107? — 20.517578 x 10-10 
6.8 —7.6132827687735 —7.6132827687693 0.489 x 10-1? — —0.489554 x 10-1? 
6.9 —7.6949048277664 | —7.6949048277620 0.464 x 10-? — 20.462136 x 10-10 
7.0 —7.7114149547400 —7.7774749547356 0.436 x 10-9 — —0.435486 x 10-19 


CHAPTER 5 


Exercises 5.1—Part A, Page 80 
L +22 +10y=0 2 +32|2|+10y=0 3. 


dt? 


E. g 0.6308489604; 1.678046512 


Upon substitution and simplification both sides will equal zero. 


6. m=1,b=2,k = 10 Itrepresents a damped motion. 
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7. $ —artan(j), € — v10 8. It provides the amplitude and the phase-shift. 9. a= V17, b = EY 


10. Applying the initial conditions to the general solution given in Exercise 3 results in A = —3 and —A + 3B = 0. 


Exercises 5.1—Part B, Page 80 
1. Ae^* cos2t + Be~* sin2f 2. A=1, B = 1; y(t) = e^* cos2t + e^ sin 2t 


3 y UL — 1.1781 4. y(t) = Ae 4/3630) di Bet 6-30) 


0 1 2 3 4 5 
5. y(t) = (7g; 30 + pe OHIO 1:01. 44/30) /30e 3/3630 y t = 2.278913602 


Exercises 5.2—Part A, Page 84 
1. (a) linear (b) nonlinear (c) nonlinear 2. (a) and (c) are nonhomogeneous (b) is homogeneous 
3 (93 (02 (04 4 @k=% bk=F 5. f" Budu=2=09205 6 k=! 


1 11 JO 1I 


Exercises 5.2—Part B, Page 84 


l. $42 + 6y —0, (0) 2 — B, 20) 20; y(r) = — & cos(4/31) 2. —20 ft? — 3 


Y 23 fus? 


Exercises 5.3—Part A, Page 88 
l. y(t) 2 Ce 2. 7A+5=05A=-3 3. Upon substitution both sides will equal zero. 
7. (a) 3? +9 +20 2 (4 3-5). +4) =0 (b) -5, 4 (0 e^", e (d) y(t) = cie^* + coe 
Exercises 5.3—Part B, Page 88 
1. (7A — 3)(2a —3)(54 +4) =0;A=3,A=3,A= — $5 (et, e/t, 674/51 y(t) = crel” 4 ezel" 4 cu eA 
2. (a) A+4)(A 4-3) = 0; —4, —3; (e? , e"; che! + re (d) of 95 ! 15 2 25 3 t = 0.4444970568 
(b) ci = —7, co = 5, y(t) = —7e^ + 5e-* 


(c) y(t) = —7e^* + 5e-^ 


A-17 


Answers to Selected Exercises 


(0 —2e-9 --2e-9 (d) ? fmax = In6 — In 5 = In 1.2 © 0.18232, Ymax = 325; ~ 0.13395 
0.12 
0.1 
0.08 
0.06 
0.04 
0.02 
F 
0 0.5 l 1.5 2 
4 b-24/15 5 k=% 6 m2 7. yt) 25e —4e? » No, just look at this graph. 


The solution is first increasing 
before it starts to move 
down towards zero. 


Exercises 5.4—Part A, Page 91 


1. Upon substitution one obtains 0 — 0, Wronskian: -4 # Ofort > 0 
2. Upon substitution one obtains 0 = 0, Wronskian: -3 #0fot>0 3. Upon substitution one obtains 0 = 0, Wronskian: —e^? Æ 0, Vt 
4. Upon substitution one obtains 0 = 0, Wronskian: —43e?' 0, V. — 5. 424242 —15y-0 6 $1342 109 +24y=0 


Exercises 5.4-Part B, Page 91 
1. False! Look at exercises A1 and 2. 
2. (a)Setan arbitrary linear combination equal to zero, and differentiate this equation two times. This results in three equations: 
cite sint + cote! cost + c3t?e = 0, cy (e! sint + te! sint + te’ cost) + co(e! cost + te! cost — te’ sint) + c3(2te! + te) = 0, 
ci (2e! sin t + 2e! cost + 2te' cost) + c; (2e! cost — 2e! sint — 2te' sint) + c3(2e! + 4te! + re) 202» c; 20,0; 20,04 = 0. 
(b) Wronskian: —:^e? The set is linearly independent. 


2,4 2 —l (et, e?!) 
3 8 y 
>t 


e? 


(c) —7e^! + 4e?! 


General solution: cje7' + coe? (b) —7e^! +4 
0.133531393, Ynin = -i = —3.062500000 


(a) . --2)0. 2-1) 20, A = 
2.5 


i» Ímin = In 1 


(d) ua 


v= i 5cos(2t — arctan D 7. ad — bc should not equal zero. 


Exercises 5.5—Part A, Page 94 
l. cos3t = 4e + 3e^?, sin3t = —Jile 
B 


Upon substitution and simplification both sides equal zero. 


4. 23/87 — i 2 «9. A łiy2 + /2; cos E ES iV2 — V2 The second is the real part of the first. 


3it 2 


p 


Upon substitution and simplification both sides equal zero. 


— e 31); Wronskian: 


A-18 Answers to Selected Exercises 


Un 


. [1.0, 0.9950041653 — 0.09983341665i, 0.9800665778 — 0.19866933087, 0.9553364891 — 0.29552020677, 0.9210609940 — 
0.3894183423i, 0.8775825619 — 0.4794255386i, 0.8253356149 — 0.5646424734i, 0.7648421873 — 0.6442176872i, 0.6967067093 — 
0.7173560909i, 0.6216099683 — 0.7833269096i, 0.5403023059 — 0.8414709848i] 

6. ¥34cos(—2t — arctan 35 amplitude: 4/34; period: sr; frequency: 1; angular frequency: 2 7. —0.4161468366 = —0.4161468365 


8. (a)z+2=4;2-Z2%=6i 9. (a) az = 22471 (b 212 = —V2 —243 + i(V3 — 242) 


(c) zz; = $e? cos3 + te? sin3 + i(—4e? cos3 + te? sin3) 10. (a) -- 2i — 11. @i © Z-Fi 


Exercises 5.5—Part B, Page 95 

it~ v ia iza Dod Dae de dos 148 i +9 
L (abet & 1 it — 531^ — git + x tmi — 3st — sagi! + xx! + snas! 

f s 1.24 1,4_ 136 L 8 i5 idi Ig D 47 149 

(b) gm 1 p af e aa! 70! T 30.320/ T i(t s! T 120! 50404 D 360,880! ) 

zu demandas. ye -— Er E 147 1 
(c) cost & 1 — 50 + a, — zt + agat 5 Sint St — ef vgl — sug + 362880 

(d) Compare the real and imaginary parts of (b) with the results found in (c). 


2. (a) y(t) = —2cos2t — + sin 2t (b)(e?,e-?') (c) (1e + le, z (e? —e™™)} (d) y(t) = cı cos 2t + c» sin2t 
(e) -2cos2t — 3sin2t. (f) 3 /17cos(2t — arctan} +x) See plot; 


t? 


y 
À 
+ 


Exercises 5.6—Part A, Page 98 


5 


i. (a) —1, —2; overdamped (b) —2 + 11/23, —5 — 1i./23; underdamped; T = 22/23, f = 4,0 = 123 
(c) —1, —1; critically damped. 

2. (a) —1 4- 2i, —1 — 2i; (e C19?! , e141}. (e7! cos 2t, e™ sin2t); c1e^' cos2t + coe! sin 2t 
(b) —5 + ii —-j- ii; [eC 21/30r, qC1/271/301)- (9-1/2! cos 3t, e 7 sin 11); ce?! cos it + c5e 1? sin it 

3. Yes! Leti? =4MK. — 4. k=2+ ix? = 2.5483 


5. m, b, and k can be determined up to a multiplicative constant; m = 3-k, b = Ek, for any k > 0. 


Exercises 5.6—Part B, Page 99 


1. m — 0.6176687004, m — 2.624609175 2. (a)À24-244-520;4— —1-2i, 4 — —1— 2i (b) (e 1?2?t, e0121}, 
[3e 19r + lecia, O € eC1-2Dt)) (c) (e^ cos 2t, e^ sin 21) (d) ci 22, =c; + 2c) = 3300 = 5 c =2 


2? 


(e) e™(2cos2t + 3 sin 2f) (f) 2e cos2t + Že™ sin2t eee 
: T 2 
; (g) 1 /41e7 cos(2r — arctan 2); 


gy mg = +,@ —2,9 = arctan 3 
1.54 
14 
0.5+ 
0 
-0.54- 


3. (a) 2 +84 +25 = 0; à = —4 + 31,4 = —4 — 3i (b) TAT e C43)»; {i eC ^01 eC4-90). lg(C 630r JE letn 
, 2 2 


(c) c1e^^ cos3t + c;e"" sin3t (d) cj = —3, —4c) + 3c) = 1; ci = —3, 65 = -4 
(e) —3e7* cos 3t — Het sin 3t (f) —3e^* cos 3t — He sin 3f (h) 4 (i) 0.9645266633 
0 0.5 l 2. (B) 1/202e-* cos(3t — arctan 5 +7); " 


zg P 31 ; 11 
T = iz, f = 57,0 —3,Q9 = arctan > — 7 


"10.6 0.8 1 


1.2 1.4 


Answers to Selected Exercises A-19 


4. (a) 2 + 8A +41 5 0; Àà2É2-—4 + 5i, À2-—4-—5i (b) (e ^*5)r, eic t 995): {Fe 44-50)t 4 oo, a; (e 4699 m eC ^-501)) 
(c) cie^* cos5t + c;e^^ sin 5t (e) 5e^*' cos 5t + $e" sin 5t : (f) Se cos5t + Se sin5r 


(d) cji = 5, —4ci + 5c, = —4ce) = 5,0 = B A 


ol 92047708 1 1214 


ig, f —il,e-5,9-actani? (h) (i) 1.020918998 


(g) 14/881e^ cos(—5t + arctan 32); T 


Exercises 5.7—Part A, Page 102 


1. After three times integration one obtains: e + v = 0, v = de", resulting in: du = de™, u =a + bt + ct? + de^! (where —d has been 
replaced by d). 2. (1,1,£,€7) 3. The characteristic roots for the equation in u are: 0, 0, —4i, —4i, resulting in the fundamental 
solution set (1, t, e^ *', te~*"}. Multiplication of this solution set by e?* gives (e?! , te’, e~7'", re~?'}, resulting in: 

{cos 2t, sin 2t, t cos 2t, t sin 2t). 4. (Lt, &', te’, tey, cq toot 4 cse! + cate’ + cst? 


5. (e^! cost, e™ sint, te cost, te sint); cje ! cos(t) + c2e™ sint + c3te cost + cate sint 
6. cie! +eote + ce cos 2t + cae sin 2t 7. cı + Cat + c3 cos 3t + c4 sin 3t 


Exercises 5.7—Part B, Page 102 


1l. yeu; e? 63 =0;u=a+bt;y = e" (a + bt); w =e" 


P A 
2. Upon substitution both sides equal zero; y = x?^u; x* au +x PE —0;u-a-blnx; y = x?(a + bln x); w = x?. The Wronskian is nonzero 


on any interval which does not contain the origin. 


(a) y(t) = —isinte?' + $ coste ?' + 2 sinte™ + T coste (b) i 


Uu 


2 4 6 8 
(c) (A? +2 +2)? -44 4-5) 20 ()A=—-14+i,A=—-1-i,A=—-24+i,A=-2-i 
(e) (cos te^, sin te™, coste ?', sinte 7); w = 5e* (f) ci coste" +. co sinte^' + c4 coste? + casin te” 


2t 


(g) ci +c3 = 3, —€1 + Ce — 203 +e, = —3, —2c€5 + 3c3 — 4c4 =% 2ci + 2c» — 2€3 + 11c4 = 1; c2 = 2,¢3 = $64 = =}, cı = 5 
y(t) = -isinte? + 3 coste? + 2 sinte' + 2 coste" 
Exercises 5.8—Part A, Page 105 
į: = 1.473537570 s; A = 1.76 ft. 2. Using 62.5 lb/ft? as the density of water, one obtains o = 97.65625005. 
3. y(t) = 8 cos( 2 31) A T = in v/3;, A = Ž 4. w= J£, Yi@y=0 


(a) fourth quadrant, (b) third quadrant, (c) second quadrant. 


Un 


A-20 Answers to Selected Exercises 


Exercises 5.8—Part » le 105 
1. (a) y(t) = 107 


10x 


(b  ? (0T = Z/10x,A = 45/625 + 9 


2b 1 2 —1/2bt cing l 2 
2 3€ /!^"bsin(z 4/ 1000z —9b*t) e sin( g 4/ 1000z —9b*t) 
(d) y(t) = 1e !?" cos(? /1000z — 9P?r) + 3 IT -2 : 
A/ 10002 —9b- A/ 10002 —9b- 


(eo- iy 1000x — 9b? ° (f) B :— 1 10x 


t—t—+ t H= b 

4 6 8 10 12 14 16 18 f i 

(g) T : 27 2; [[b = 3B, T = 2/300 ~ 0.77665], [b = 0, T = å 10x &0.67259] (h) 7 
10002 —9b- a es 2: 


>b 
(i) o = $4/1000z — 95?; [[b = 3 B, co = $307 ~ 8.09011], [b = 0, œ = 3/107 ~ 9.34165]] 
2. o= " eat Ly +y =0 3. Z V 10 cos(/ 10t + arctan( 5; /10)); A= iv 10, o = V10, 
T= inJ/10, F = 1 vi = —arctan(+/10) : 
Exercises 5.9—Part A, Page 109 
3. yp =2 4. yp = it 5. @)yp=2 (by,-it-$i Oy, =te* 
6. The constant “a” merely generates a linear combination of y; and y»; i.e., a solution of the homogeneous equation. 
yg J » g q 
Exercises 5.9—Part B, Page 109 
1. (a) yy :— 5x (d) y, = x? sin x — x? cos x k YP = x5e* —4x4e* + 12x3e* — 24x7e* + 24xe" (f) y, = —x^sinx + 2x? sin x — 2x? cos x 
2. (a) y(t) = Acos2t + Pisin 2t — 1 cos 2t —2:—2 iln( — cos f + sint) sin2t + 1 ; In(—cost — sint)sin2t (b) y, = Acos2t + B sin2t, 
Yp = 4 COS 2t Ed iln( cost + sia f)sin or +i 1 In(— cost — 9nd) sm au (c) cos2t,sin2t (d) W 22 
(e) y, = sin 2t f 1 1 cos 2t tan? 2t dt — cos 2r f 1 sin2t tan? 2t dt = —1 Pi 1 sin 2t In(2 Deua) (f) Clearly the term — uS in the particular 
solution found in part (b) of this problem can be omitted. Observe that — “cost j is a solution of the E equation, 
4, (a) y(t) = -4 cost + $ sint + Ae? cos2t + Be? sin2t (b) Yn = Ae" cos 2t + Be~™ sin2t, y= -4 Em + ee baa 
(c) e~* cos2t, e sin2t (d) W 22e-9* (e) y, = Le-* sin 2t f cos2t sin te” dt — 1e cos2t f sin 2t sin te” dt = —4 cost + qs sint 
- 2p — p : 2 ; T 
(£) In this case, the two versions of the particular solution totally agree. 
" 11 A B R j B . I 1 1 i fx? dx— fx dx; 11 
6 @y@=j2tats b) y =4+5 y =z OF4 (W---A (9y---—797*-214 


(f) The two versions of the particular solution totally agree. 


r2 


N 


Answers to Selected Exercises 


365 6-3/4 cos(3 /3r) + 2H sin(3 V3 V3 + % 


y(t) = 


ap AE Wk 
E =; eS, y, = 


sor = 


193 
365 
Cy = -i 


—3 + 3i v3, 3, à = —3 — $i /3; e?" cos(3 3t), e7?/* sin(3 /3t); yy = ce cos(3 /3t) + c2e ?/^* sin(3 3t); 
ier sin(3 Pp AA colnet dt — 
6 sin2t; 2 — ce “3/4 b. 3 Jt) + coe 3I sin(4 3 Bt) — 15 cos 2t + s Æ sin2t; 2 = 
e oin sin(2 3 Jat) + 36 3$ sin2t — 


E e ^ G 2 4/30 f sin($ vn cone dt — 


;—7-2 ict uL 30, /3 = 3; 
4 cos(3 /31) + H 


(a) y(t) = =-2 


» 


2 


(a) y, — 
(o) 2 e = 


Exercises 5.10—Part A, Page 116 
= cite? + csin 5t + c3 cos 5t 


(a) yp 


aie cos(21) + He" sin(21); (b) y, = —3; 


Hx + Ax? + Bx? + Cx? E. Cs: DUE TAE args _ 


Az w(x) = = 


* i kon —— 


(b) y, = cı + c2 sin2t+c3cos2t (c) yy — cite?! +c) sint + c3 cost 


(d) yp = cie' +e 
(f) yp = ci sin 3t + c? cos3t + cst sin 3t + c4t cos 3t 


(h) yp = 


1 


MS 5 


= (c + ten +.03t7)t? + (c4 + est) te” 
(g) yp = cie" sin t + ce" cost + t(c3e" sint + cae" cost) 
(ci + tco +0307) (i) yp = eie? + este? + c3t°e” (j) y, = ci cost + sel? + (c3 cost E c4 sin i 

3 1 -t 1 ,—2t 
— zc zt +e = 3€ 


3 3 NTC 3 
t- — Cost + 35 Sint + 5e 


No, yi Æ y2 + ys 


Exercises 5.10—Part B, Page 116 


= -5 cos 2t + i sin 2t = a + arctan 2) d = Me 


(a) [-1, i, —i] ene ae ae (€) 2y +42 -- 572 459 4394 


(d) (—1, i, 
(e) y(t) = ci sint + c2 iini Ad caet 


(a) 50 e 


i} -(-1-i, HAT i, —i} 


~ cost Just let c4 and cs equal zero. 


13 


2 
+ 


(b) cr = [—2, —2]; Ir = 


(c) y, = cie? + cote; Y» = ay sin 3t + a Cos 3t 
(e) yg = cie ? + cote” 
y(t) = -ite -20 __ 
yg = 6167 ?' t c5 sin 3t + c3 cos3t + cate 


Exercises 5.11—Part A, Page 121 
(b) This system has no damping: og = wy = Vi (c) y(t) = $21: sin(3 211) + c; cos(4-V21t) + c; sin(4 211) 


3; amplitude at resonance -5 + 


(a) oy = 


ON :— i 


4 _ 23. sin 3t — 


Æ p" 4-188 4. m. 
Choose c, aud C4 equal to zero. 


+22 =0 (gQi,—3i -2, 2]; 


A-22 Answers to Selected Exercises 


Exercises 5.11—Part B, Page 122 


1 1 


1 1 1 
7. l : , ; i à " 
| 2070246404 +169” A// —20492- 6404-169" A/—19992--64954-169' 4/ —192a-649^--169 «/— 18302 +6409+169  A/ — 1720 4649-169 


1 1 
/—159w2+64wt+169" A/ — 1449) 640-169 


ol gs 1 15 2 25 3 


p. l D. L l A. 1 3 3/9 ØR 9, 2——m 
8. wr = [35 V 46, 1/102, 5398, 1v6, 366, 1/86, 1/318, 2/2] : RUN 
126 | 
122 | 
118 | 
1.14 
1.10 I. 
1.06 | 
+—}—+— +++ +> b 
9 12 $46 T $ 
A 1 2 wy 
10. Oo ll. wy := gy b? + 416 x 
0.77 1.26 + 
or 124 4- 
05+ 
0.4 4- 1.224- 
0.3 F 124 
024 1.18 
Ml a 
f O ESE E b rA t t—1+-> b 
0 | à 34556258 DEERE: 
12. -4 Clearly the ratio of the two frequencies is approximately one. 13. 
e 
— — — a e 
9 22 83 4 5 67 8 


Exercises 5.12—Part A, Page 124 
1. (a) cos24/21n2) — i sin(24/21n2) 2. (a) y(t) = cit?" cos( Int) + ct?” sin(2 In f) 3. (c) [?, P In t] 


Exercises 5.12—Part B, Page 124 
l1. 33-3? — 14A +24 = 0; à = —4, 2,3; y(t) = 4 eot? es 2. =. Py — 142 +24y = 0; y(x) = cie? + coe -- c4e ^5; 


ydnt) = ci? +0 +9 3 Ora Q 2—a)x 2 by 20 4. (a) yt) ctc)? (b)A2—344+2=0;A 21,2; 


y(t) = cyt ot (c) 2y PA +3 = 0; y(x) = cie* + coe”; y(Int) = et + cot? 
(b) A? — 6A + 13 = 0; à = 3 + 2i, 3 — 2i; y(t) = cıt? cos(2 Int) + cof? sin(2In t) 


12. (a) y(t) = ci? sin(2 Int) + co? cos(2 Int) 
(c) 13y — 6 is + £2 = 0; y(x) = cie? sin2x + coe? cos 2x; y(Int) = cit? sin(2 Int) + cof? cos(2 Int) 


3 
dx* 


c] co Int 


22. (a) y(t) = 3h + 2t (h) 902 + 300 +25 20; = —3, -3 Let y(t) = u(t)t^?5; t ty + e = 0; u(t) = ci +c) Int; y(t) = IE 


15/3 


emt 


(c) 25y +302 +9 m. ¥ = 0; y = cie? + cyxe-5/*; y(Int) = 


Exercises 5.13—Part A, Page 128 
0 lex 


1. (a) y; = cie? +e"! + (-1 + iDte; y(t) = —e? +e~ (-1-4 ipte" (b) G(t, x) — los ee (c) Subtraction of 


the results in (a) and (b) gives zero. (d) Differentiate G with respect to t and compute the one-sided limits. The difference equals 1. 


Exercises 5.13-Part B, Page 128 


Answers to Selected Exercises 


‘ ; : - d e 0 fex 
2. (a) yt) =—Ftcost+ H cost + trsint+ å sint — te” Xe? (b) GU, x) = = oo pay 
(c) y(t) = —4tcost + £ cost + trsint + $ sint + (—1e' + x)e 
(d) l 08 og ^ (e) l 08 9g em (f) Differentiate G with respect to t and compute 
i G E v 2 . . B e 
mmu? 0 = the one-sided limits. The difference equals 1. 
po 0.8 
0.15 dG 06 
G 0.1 dt oa 
gios 0.8 0 0.8 
i | 
0 0 
5 LM nac 17 2,-3/2 _ 60 ,-4/3 x 
/. (a) y(t) = — 3g; Cos 3t + 55; sin 3t + $e it we far (d) 1 08 0.6 94 T. (e) 
0 t<x 
b) G(t, x) = : 
(b) G(t, x) eM3x-4/3t APR py y "" - 
14 17 60 TE es jg 0l 
= 5 ; —4/3t | 2,-3/2 
(c) y(t) = — z7 cos 3t + 3j; Sin 3t — Fe 4 + 29 3/2 G in T 006 
01 0.8 0.02 
9 : -0.02 
ut 
(f) Differentiate G with respect to and compute the one-sided limits. The difference equals e 
3 3 col VI9Int) — 7g V9 sin(. /T9 Int) 0 t<x D 
9. (a) y(t) = 5r 139 5 2641 iB (b) G(t, x) = 1 JV 19 sin( i VJ19 Int— l V/191In x) (c) Integrating this G proves to 
19 x4/511/5 
‘ : g sin(1I9Inr) 19 3 cos(i 191 
be a little too much for Maple. Instead, compute y(t) = f; g(t, x) (3:2) dx = Bt — d E Wo Sia m 


(d) 
4 
3 
G 2 
1 
0 
CHAPTER 6 


Exercises 6.1—Part A, Page 133 


l qst 1 
1. No, because f <a> f 
o t€ 0 


Exercises 6.1—Part B, Page 134 


l — st 


5 


1. (a) fo te“ dt=4,5>0 (fy eledr- 4 


0 $3 
2(t — 3) 
0 t5 


12. 


(a) f(t) = 


Exercises 6.2—Part A, Page 137 


_ V3-6 | 1346 = 
s-V3 is 6 5-3 5. (c) 


Exercises 6.2—Part B, Page 138 


6(cos | sin 1)s—18—s?-+5? cos? 1 


5. (a) 


3«t«5 (b2 


1052--1152 1954-22 
555--855 -1352--165--6 


(b) Use f(t) = 1 — 1cos2cos6t —}sin2sin6r (c) fj" sin(3t — 1e * dt = 


x 
08 06 o4 4 


(f) Differentiate G with respect to t and compute the 
= 0 one-sided limits. The difference equals ET 


dG 20 
dt 10 


0 — 0.8 


D . ; 3 2(s +5 
dt and the latter integral diverges. 4. — NA 5) 6. 3cos 2t 
2 853-25 
d; 522 5. (a)fj3PsinGDe^" dt = 54 53,1545 3. > 0 


(—e^5 + 2s + 1)e5 


g2 


6. (b) —4cosh 2t + 2 sinh 2t = —2e? — Be 


1 +s? cos 2--6s sin 2—52—36 
2 s(s24-36) 


5(52--36) 
(This formula is equivalent to that given under (a).) 7. (a) 5cos2t — 2sin2t. (b) 5; — Ta 
12. (a) F(s) = SS (b) f"(t) = 4e"! cos3t — 6e” sin3t — Ste” cos3t — 12te™ sin3t (c) L[f"()] = SEH 


(d) s? F(s) — sf (0) — f'(0) = 


s2? (s? —4s—5) 
2 2 1 
(s^—4s4-13) 


A-24 Answers to Selected Exercises 


14. (a) Y(s) 2 —3 SIME y(t) = wee us uw = cos 3t iis sin 3t; — ge ^ us p = 55 COS 3t = sin 3 
16. (a) y(t) = 313 +2e-" (b) Y¥(s)= 154 +2 255 
Exercises 6.3—Part A, Page 140 
3 (19 " 
1. (b) g(t) = é'cos(40); G(s) = d F(s) = G(s +2) = cos . (b) F(s) = zi: O = e" cos(V27) 


. @ FO) = 4455: f0 =fe%+ he" (b) O34: CW) = 5-5 gl) = 3cosht — 2sinht = je + Ze; 


2 (s+2)?—1? —1’ 


fi) = _ e? g(t) = T P —3t + le^ 


Exercises 6.3—Part B, Page 141 


2. Y() = 4-539 y(t) = Ite? + £e — Be cost + Be~ sint 


ST E855 42357-30518 ? 
4. (a) g(t) = e cosh 2t; G(s) = F(s) = G6 +3) = EH b) SS 


9. (a) F(s) = ——;:G(s)— " 25 g(t) = — V21 sinh(V211) + 4 cosh(/211); 


(s--4)^ —21* 


ft) S e*g(t) = -Be-* 2] se Si, + dg cosh(4/211) 
21 


parer 6.4—Part A, Page 145 
. (a) Z 5, (d) L(sin3t) = 3215 = G(s); F(s) = -G'(s — 2) = 62 


543 ((s—2)2--9)? 


rm 


Exercises 6.4—Part B, Page 146 
2. (a) F(s) = 2843, (b) g(x) = cos 2x; G(s) = igi h(x) = xe g(x); H(s) = —G'(s — 3) = Set; F(s) = EO = 6 


(s^--6s--13)^s (s2—6s4-13)2 * s (s2—6s4-13)? s 
6. f(t) =cos2t; F(s) = ; Lle~ fo cos 2z dz] = 17. (a) f) =} że (b) F(s) =3 


= 3 3 
me = 4s 4 s44 


sh FTO TE +4 
3/2t ac 
23. (a) f(t) u- sini (b) —~ arctan(2s — 3) = —2—~__, 
te = t ds — 7HQs-3? 
PT. -a e 5e 227 —5/6t onl. /> _ 14h _ 35 5 : 9s3 —12s? ~36s—34 
25. (a) y(t) = cos(2 V 23t) — iis; V 23e sin(c4/231) — | $in 2t — i5 cos2t (b) Y(s) = TUO NET STREET: 


Exercises 6.5—Part A, Page 150 
2l 1 +25 42e 


1+2 2s? " 
1. (a) g(t) = f(t -2)H (t — 2) with f(t) = (t -2); F(s) = — = F(s)e = 3 
2. (a) F(s) 3 za ; f(t) = cos(t); g(t) = cos(t — D) H(t — 1) 
Exercises 6.5—Part B, Page 150 
0 <i e312-1/2s 

7. (a) À (b) f(t) = 2D l f(De^' dt = 
184 gre "à s—1 
ul (o fi) = Pigs -}) 
o+ 
pe e3/2-1/2s 3/2 " 3/2-1/2s 
ST (d) F(s) = (e) g(t) = e^? G(s) = y F6) = Gu t” = L1 
24- $— j— 


a oe Ba ea 
0 02 06 1 14 18 


0 
11. (a) f(t) = FH (t — 3) sinh(4t — 12) (b) G(s) = 5: g(t) = 3 sinh(40; f(t) = g(t —3)H(t —3) O f= taa, 


gt—3) t23' 


Exercises 6.6—Part A, Page 153 
1 
1. H(t) - H(t— 1) 4. tH(t) --(1— 0) H(t — 1); 


2 2 
$^ $^ 


Answers to Selected Exercises 


5. y(t) = (it + $ — Ze! cos(2t — 2) + Se! sinQt — 2) H(t — 1) + it — 2 + Ze cos(2r) — se! sinQr) 


Exercises 6.6—Part B, Page 153 
L. (a) e (L[?] -2L[] + LUD =e (25 +24 +t) We *L[(t+ 17] =e°24425 42) 
2. (a) LLf(] = 6 er +8 Se) LIF) = É Lleol] +3) = —6 $5 + 8 


((s-+3)2+16)2 ((s+3)2+16) ((s+3)2+16) ((s+3)2 +16) 


e™ (s? cos 1 + s cos 1 — s? sin 1 — sin 1 +s? cos 1 — cos 1 — 2s sin 1) 


4. (a) LIH] = 
(a) L[f (t)] SEE 
. d, e™ (s? cos 1 + s cos 1 — s? sin 1 — sin 1 + s? cos 1 — cos 1 — 2s sin 1) 
G) LO) = -77 L[cos(t + 1)]) = P 338 +1 
o (a) f= Be WFQ) =—$4+ BI - Bis © Liat) de] = Sig) o - + Res 
f(t) = OF = —ttt+ H — pe 
"s — 1 
10. (a) 7) (b) Pj=- 
$^ 
0 i43 
Oso = t-5 t>3 
a Qs — De-* 
(0) gr) =t = 2; LIF) =e Lg(] = ———7, — 
2s — 1)e* e 50s — 1 
(e) h(t) =1 — 5; LLF =r Lia + 3)] = — 2 De 7 o f i EO auus a 
S 0 AY 
2 —2s 92 —2s 9 p—2s 
14. (a) 4 (by ? +4e~s T s 4- 2e 
16+ s 
T 1 t<2 
12+ 
104 (c) 14-2? t>2 
"ti r 1 j s? + 4e 755? 4+ 4e 5s + 2e-2s 
4-- (d) g(t) 2 (t +24; LIFO] = z +e *L[g(t)] = 3 
2T ' 9 25.2 2 5 
—— — A: 1 2 4 hes? 4 des 4. 2075 
0 1 2 3 4 (e) h(t) 2 0; LIFO] = = +e Liat +2] =~ = s Asi 
s s? 
en. ó , 4e ^5? + Ase 75 4 2e-5 +s? st + s3 4-5? + Ae? 4 des + 26725 
(f) 1+ H(r-2)e " dt = Y(s) — à 
| i i m ga ever s3(s? +25 + 2) ' 


A-25 


y(t) = Se cost — Se sint + 3 + 3H(t — 2) - 3H (t — 2)e "? cos(t — 2) - 3H (t — 2)e* sin(t — 2) — H(t —2)t + i? H(t — 2) 


se‘ cost — Se sint + 1 t<2 
se‘ cost — le" sint + 1 — 1e? cos(t — 2) — ze sin(t —2) —t+ in t>2 


With the constant forcing function on [0, 2], the damped oscillation 
approaches the steady state solution y(t) = i For t > 2, 
the new forcing function 1 + t? pushes the solution ever upward. 


(ae a ee el dE 3:3] 


0'0206 1 141822 


t++++> E 
26 3 


Exercises 6.7—Part A, Page 156 
e75-]1 shee” 


3. =e See plot. 
Lee tt i (eon — 1s? yc = 
| -— 0 2 4 6 s 10 


A-26 Answers to Selected Exercises 


Exercises 6.7—Part B, Page 156 


_ft üsrsl " a eM e Es- De 
1. (a) g(t) = li p (b) F(s) = CEES 
Š Y( etal R 1 —2e^ + 2e-5 2e-35 + Ie = Ie 
2 ESO = 50 +s? + 52e-* + 25 + 2se-*4+ 100-4) s(s? + 2s + 10) 


Exercises 6.8—Part A, Page 159 
1. in? 4. łe! +3 cost —}sint — 1 


Exercises 6.8—Part B, Page 159 
2. (a) fo (t — x)’ cos 5x dx; f; cos(—St -- 5x)? dx (b)—jsinSt-- Zt (c) + 


2 t = r 9/3% 
4. (a) X gpl (b) g(t) = 1 62/31; A(t) = Lge, fe 2 gum 2/3x x 92/3% dy — List 


Exercises 6.9—Part A, Page 162 


L HG) = —; G(s) = —"—; H(t — 2) cos3t = 1H (t — 2) sin(3r — 6) 
5 s? 4-9 s 
2. (See plot.) R fj HG — 2) cos(—3t + 3x) dx = 4 pt 0 
A 0 f; cos(—3t + 3x) dx 
LEGE NE GEN 
Exercises 6.9—Part B, Page 162 
L F(s) = cou: GG) = -ah 25 5: (Gt — 4e! + 25te + 4e™ cost — 22e" sint) 
2. fs € ? (sin x)(t — x) cosh(t — x) dx = a; (Gt — 4)e'! + 25te + 4e™ cost — 22e~ sint) 
—3s S 2. 1 
3. (a) F(s) = e ; G(s) = ; E - D? H(t — 3)(t sin(t — 3) — 3sin(t — 3) + cos(t — 3) — 1) 
AY j^ P. 


(b) f; H(x —3)(t — x) cos(-t + x) dx = H(t — 3)(t sin(t — 3) — 3 sin(t — 3) — 1 + cos(t — 3)) 


t 


2. _1t 21 
(d) 35 52405 + 25 52 
1 
(e) 21335) 


(f) — 45 sin5t + Zt 


i2 


is2 


= 4 H(t — 2)sin(3t — 6) 


Answers to Selected Exercises A-27 


-s -3s —2s —4s 
È hieme * S H(t -3t -3H(t —3) -2H(t — 5t + 10H(t —5) + H(t — 7t —7H(t — 7) 
F : 
(b) The integral is too difficult for Maple. Investigate the region on which the integrand is nonzero. It is bounded by the lines 
v=l.x=3,f=x+2andt=x+4 i 
8-4 


6+ 


>x 

0 2 4 6 8 

Assume t € (3, 5), then fae — 1) — A(x — 3))(A(t — x —2) — H(t — x —4)) dx = t —3andift e (5,7), then 
0 res 

3 t—3 3<t<5 

| (A(x — 1) - H(x -3)(H(t x — 2) — H(t — x —4)) dx 27—t; Pi 3(t) x P34(t) = 

4 T=} S<tf<7 


0 t>7 


Exercises 6.10—Part A, Page 166 
0 fal 


1. y(t) = H(t — 1) sin(t — 1); y'(t) = ô(t — 1) sin(t — 1) + H(t — 1) cos(t — 1) = asti tsil 


lim; 1- y'(t) = 0; lim; + y(t) = 1 


2. (a) F = ——————; y(t) = 4 A(t — 1je™+! sin(2t — 2 
(a) F5 y(t) = 5H( )e in( ) 


Exercises 6.10—Part B, Page 166 


ih. <t<a —2sa 2e 
a? I e . ee . 
l. £0= = 3 d fate" dt = eaten. de SP (Hint: Convert the function f,(t) to Heaviside form, before attempting the 
t-2a ed - 

en cfe a 


. : e^ — Qe? + 1 ; . . 
integration); lim Es =1 2. y(t) = 5e"! sin 2t (for both) A 
a—0- s^a^ » 
Exercises 6.11—Part A, Page 168 
dn Eus 1 1 E 
1. (a) F(s) = s 12:45)" y(t) =4 ze cos 2t — +e ‘sin2t— ; H(t — 1) c H(t — De ERL cos(2t — 2) 4- 
H(t — Det sin(2t —2) (b) V(s) = Tras (c) v(t) = $e" sin2t (d) g(t, x) = 1e" sint — 2x) 
" [o 1e7* singt —2x)0 — H(x — Dis = 3 — ie! cos 2t — Ge sin2t — } H(t — 1) + 3H (t — 1)e **! cosQr — 2) + 
H(x) 


HHE- De sinr- 2) (UG) VA s u(x) = je ^ sinQr — 2x) 


A-28 Answers to Selected Exercises 


Exercises — B, "e 168 
2. (a) y(t) = — Ë cos3t — 2: sin3t + Ze cos2t + Se sin 2t; y(0) = 0, y'(0) 20 n 


(b) V(s) 2 ai (©) v(t) = ie^sin2r (d) fvt — x) f(x) dx = Ke~ cos2t + Be~ sin2t — 2 cos3t — 3 sin3t 
s-+2s+5 2 0 
: es 0 t d E 
(e) e™ cos 2t, e sin 2t; g(t, x) = te" sinQt — 2x); G(t, x) = ba sin(2t— 2x) t a p (f) v(t — x) = — 1e" sin(—2t + 2x) 
(g) y(t) = 1H(t — x)e™* sinQt — 2x) Of course, if t > x this equals v(t — x) = 1e-'** sin(2t — 2x). 
g 2 
= (e3/2 + 4e? — 12e!/6 + 6)e 1/3" M5 eie y __ 4el/2 + 12e/6 — 6) 
m 1 y 1/21 
7. (a) y(t) =—5 +t + 12e AUS —] 6e + 208 
(b) y(t) = —5 + t — 4e?! — 2867 V?t — Gbe-V?t 4 96711 + 39671/t + be“ 1t; p = 1 1 eei De6 ao]; 
: 4g Mara 
y(t) = —(Sel/6 — 5 — tels 4 t + Ge M3t — g- 93/2. 4e-1/3t+1/2 _ Ge71/2+1/6 4 e-1/21+3/2 4 oa n 


CHAPTER 7 
Exercises 7.1—Part A, Page 174 


5 


k 
1. [0, 1, 1,2, a limi oo 55 =0 5. [1.0, 1.187500000, 1.264404297, 1.299759667, 1.316757849]; fixed points are $, and 4. 


Exercises 7.1—Part B, Page 174 
l. g(x) =1+ Zx? Observe that for x > 5, x + + < g(x). This implies that x,_; + 4 < x, and therefore lim, , 4x, = oo. 


12 20 30 42 56 72 90 110 À : Rk 1 
2. (a) [2. § > 7? 17? 31? 49° 71° 97° 127° 161° i5] (b) limi; yz = 3 


1.87 (c) 6; 501; 50001 
144 (d) Take N (e) = 3. 


} } 
0 12345267 8910 


2 _ kl 
6. (a) [1 1 2 3 24 5 720 315 4480 567 ] A (b) dm =0 


' 2^ 9» 32° 625° 324° 117,649° 131,072° 4,782,969° 1,562,500 m 

087 (c) 4; 9; 14 

0.64- 

o (d) Take N (e) = = 
04+ 
02+ o 
o 
— o 
0 1234252678910 


Answers to Selected Exercises 


2 25 p) 51? -1 kok+1 
11. (a) [—4, 2, lé 2, se, UNES 1024 2) E. 7 (b) lim. 5 does not exist. 
-T (c) 9; 18; 25 
10+ 
5 o 
54 
o —— HHHH 
510 2 4° 6 6 8 10 
-104- 
-154 ü 
16. (a) [2.0, 5.062500000, 13.31829498, 35.52713679, 95.39621664, 257.0895515, 694.3931083, 1878.284768, 5085.770231, 13780.61234] 
A im; 1 Po% 3: 8: 12 
btn (b) limi. ss; + 1) co (c) 3; 8; 1 
12,000 + 
10,000 + 
8000 + 
60004 
o 
4000 + 
2000 4- o 
—1—$—$—$9—6—9—1—1—1——1—- 
0 123456 7 8 9 10 
5 5 sk 5 3 sk 
(-29D5-3.4—— i4 - DE- m) 
18. (a)u,— (b) _ A 
—3 — 413 3/13 50+ : 
40+ 
30+ 
20+ 
10+ 
o 
0 > o t t H 
: 1 5 3 4 5 
-10+ p 
-20+ 
(c) The limit does not exist since u, = 2.109400392(0.3027756378)* — 0.1094003939(—3.302775640)* (d) [4, —13, 43] = [4, —13, 43] 
23. (a) Linear, nonconstant coefficients (b) [2, —1, 3, —7,24] (c) mel 
T o 
204 
15+ 
10+ 
0 — fi } — 
ail l 2 3 4 5 
-104 


28. (a)r = 2 = 1/6 = 1.310102051 (b) [1.3, 1.310000000, 1.310100000, 1.310102010, 1.310102051, 1.310102051] 
31. (a) 2.199999850 (b) [2.19, 2.191843290, 2.193343033, 2.194564511, 2.195560190, 2.196372362] 
5 25 425 221 sinh 7 
36. (a) [2. 9s (x 144° ml ium (c) x (d) iat 
34 ó 9 36 o 9 9 
2.84 o 344 ? 
o 
2.64 xad 
2.44 a 35 
ag: 2.8 F 
2.6 + 
t 9% 24} 
o e a a S 
l 2 3 3 5 9! 20 40 60 80 100 120 
Exercises 7.2—Part A, Page 178 
. 1 1 l 2^ "3 x 42" n n 
a (e) 2n +1 ii 201) e 2n41 UY 2n*1 xi 2n+1 = 2 This ai mat Diet i 2 l T Pm 3 zi * 3. 


0.0901861527, —0.0764805139, 0.0663766289, —0.0586233711, 0.0524877400, —0.0475122600] 


[0.3068528194, —0.1931471806, 0.1401861527, —0.1098138473, 


A-29 


A-30 


Answers to Selected Exercises 


Exercises 7.2—Part B, Page 178 
2. Once the general term i becomes smaller than the number of digits carried by a computer system, it will cease to contribute to the overall sum. 


The value returned will be the partial sum up to the point where i adds “0” to the sum. 


10 41 103 62,353 6,235,301 
3. (a) (b) f= [2, 3, 32 12” 302 18,144? 1,814,400 


1237 433 69,281 
360 ° 126? 20160” 


A 


1 |, 


2 o 4+ 0000000 
3.2+ 
3+ 
2.8 + 


2.6+ 


4 


7 


$—e 


8 


9 


1 


0 


> 


I—- 


0 


ol l 


I 
ocean e | Le a 


34567 8 


| | 
t t 
2 9 1 


(d) This series converges (to 2e). 


. (a) 


(c) 


Un 


21. (a) S :— [0.8569292341, 0.8744215282, 0.8747785215, 0.8747 
0.8747859589, 0.8747859589] 


A 


0.354 
0.34 
0.254 
0.24 
0.154 
0.14 
0.057 


[——L— 151—111 


o 


o 


(b) S :— [0, 0.3465735903, 0.7127776866, 1.059351277, 1.381238859, 1.679865437, 1.957852601, 
2.217782794, 2.461918858, 2.692177367] 


(d) This series diverges (because the general term of this series is greater than the general term 
of the harmonic series, and the harmonic series diverges). 


+> 


t 
4 


it 


; 
5 6 7 8 9 10 


(a) S :— [0.04978706837, 0.05226582055, 0.05238923035, 0.05239537456, 0.05239568046, 0.05239569569, 0.05239569645, 
0.05239569649, 0.05239569649, 0.05239569649] (b) — T 


e 


A CR 
e-3-1 


(c) lim,.,55 S, eum 


gor 990020 99 


0.052 +- 
0.0515 T 
0.0517 
0.0505 +- 


(d) imoa = 0 


eee et 4 


6 7 8 9 10 
1, 0.8747859558, 0.8747859588, 0.8747859589, 0.8747859589, 


A 4087.1: 
(c) lim, Sn limy-+ 04 = 0 


> 


EE 
85807 


A 
0.874 + 


(b) 


4672? 


gaoid d aÓ 


Answers to Selected Exercises A-31 


Exercises 7.3—Part A, Page 180 


The ratio test: limpo Łk (£H y +4(4 y = limi i + 1)(1 + p — oo The root test: limp oo 


3 


ktl 1p — 
k qk = 00 


= 0; the series converges. 


4 


Use the ratio test: lim; ss d 


Exercises 7.3—Part B, Page 180 


1. f(x) is continuous, positive, and decreasing for x > 1 and IPs zdx-l. 

4. (a) ^ (b) The ratio test is inconclusive: lim, 55 Te zx 

5+ o © 
9 = i , 1/k 
4+ = (c) The root test is inconclusive: lim, (3) H9 s] 
o 
dn 9 (d) yes 
wp os (e) Observe that In? k < k for all k > 2, and since the harmonic series diverges, so will this series. 
1 aje 
t=- 

0 12345267 8910 

10. (a) Hint: Use the mul command in your CAS to code the individual terms. (b) The ratio test: o = lim; ,4; x EI 

n (1/k) 

+ . r(k+ T(kt Dm 1 
wii "d ee (c) The root test: r — lim => 
ET o koo V T(kK+ TEHDA =37 
is e (d) yes 
exl o (e) Does not apply, because the series diverges. 

044- 
024- 
Bp pp 
0 1234567 89 10 
` 1 9 1 25 1 49 1 8 1 1 3 15 31 87 175 399 799 1679 3359 s alki 0 M ak 
a. e [i gag ic 35> Spb Toe? 356° sIP a (b) [5. 3. 8" 16° 32° 64° 128° 256" 512^ n] (c) lim. d bn =0 
-*e9 Ak > A2k-1 
A A 
; 1/2k — 1/@k-1) 1 
at 351 "e (d) jim a». ; lima Gu 0 
lẹ SL o o o 
o o 
0.8 + o 254 
064 — p o 9 
0.4 o ISt 
02+ ° ó jd: 
o 
S473 29-92-9279 A 05+ o 
l 2 4 6 8 10 2 
—— ae eee 
0 1234567 8910 
21. (a) Use the definition of o; to evaluate o1, o2, and os. (b) In the definition of op, which contains a summation of the S,,, first write the 
individual S, as a summation, then switch the order of the summations to obtain the desired result. (c) 2. (d) 5 1 (e) Investigate the sum of 
the partial sums and observe that 20 — 2) = PES < «oy, Z - = za Tz 2), Taking the limit for k +> oo of cna part of this double 
anequaly yields the desired result. (f) Similar to (e); investigate the sum of the partial sums and observe that 
20 — 2) = = 3 ES << iE = ed Ti z). Taking the limit for k +> oo of each part of this double inequality yields the desired result 
0 if k is even (h) Mapi 4 i 
(g) ox = ; E aple produces 5. 
— ifkisodd : 
Exercises 7.4—Part A, Page 184 
1D Lh Ly ot tf 4 d 1 i Âi i 33. 3 101 163 — 641 4531 7303 
S (a) [5. PET T PP PIP x] (b) [5 6? 30° 60’ 420° 420°  1260' 2520’ 27,720" ae 
A A 
044 0.4 + 
0.3+ 9 031 ° 
0.2 o xd 
0.14 2 o o 0.27 
D ao 0.1 + 
yiti $ S Teo? 
P g* wu M 
B i o it 2 406 s" 8 10 
-044- ak 9 «6 9 
-0.5 4- o 
= -0.34 " $ 


A-32 Answers to Selected Exercises 


(c) Even though the series is alternating, {az} (as in the Leibniz criterion) is ep Pul decreasing. (d) Observe that if H5,,, denotes the 


n 


Qn + 1)-st partial sum of the harmonic series; then Ho,41 = 1+ (3 1G zi) = 1+ Occ lan-ail + lax). So the given series does 
not converge absolutely. (e)s, = X5 oga + dom) = am Ga PN = S41 — 1 (Is —In2) + 112, = 

[0.6401861524, 0.1401861527, 0.3401861524, 0.0901861527, 0.2330432956, 0.0663766289, 0.1774877400, 0. (524877400, 

0.1433968309, 0.0433968309] (g 2° (sty — $2) =P C im) 


3. (a) lim. +00 zr =1 (b) Even though the series is alternating, {az} (as in the Leibniz criterion) is not monotonically decreasing 


(c) 4 Observe that the sequence of even-indexed partial sums consists of negative terms and is monotone 
o . . . . . eae 
0.6+ o @ 8 decreasing, while the sequence of odd-indexed partial sums consists of positive terms 
o H . H . H 
04+ and is monotone increasing. The series must therefore diverge. 
024 
0 [———3—3————-—-—-—- 
12345267 8910 
-0.2+ S € & Ø 
-0.4+ 


Exercises 7.4—Part B, Page 184 


3. (a) S o (b) zt Í = 5 lim;>% 75 =0 
0.8 + 
0.6 + * 
04-- 
02-- 
fe} 
aft Se 
1 2 34 5 6 7 8 9 I0 
(c) [1.0, 0.8750000000, 0.9120370370, 0.8964120370, 0.9044120370, 0.8997824074, 0.9026978593, 0.9007447343, 0.9021164764, 
0.9011164764] A (d) n = 10 
1t o P 
098+ (e) HALTI = 0.9011164764 
036er (£) hypergeom([1, 1, 1, 1], [2, 2, 2], — 1) & 0.0004262010 
0.94 4- 
yor (g) According to the integral test, the series 5 7- , E will converge. 
0.94 ? 5 202000 Therefore the given series converges absolutely. 
088+ o 
0.86 + 
(1334567891 


CHAPTER 8 


Exercises 8.1—Part A, Page 189 
(See plot.) 


0 02 04 06 08 1 


Exercises 8.1—Part B, Page 189 
L lim... fo f(x) dx = limo zl; = 0; fy f(x) dx =0 


Answers to Selected Exercises A-33 


(b) [1, 2222, 2artan3, 5 arctand | ) arctan] ~ [(0,5000000000, 0.7048327646, 0.7951672348, 0.8440417392, 08743340834] 
5. (a) [52.5.22] © 4 


0 902 04 06 


i2 4 06 i 1 y 0.8 1 
(d) [ —x+ ix? + In(1 + x), ix? — ix + iln(ül 42x), ix? — ix + 5 In(1 + 3x), ix? E ix = i In(1 + 4x), ix? — ix + x In(1 4- 5x)] 
A 
04+ 
03+ 
oat 
ot 
1 ——— 
0 02 04 06 08 1 
lim;., 9 arctan (k: à 
9. (a)2 Hog BETA — sgn(x) Observe that xsgn(x) = |x|. 10. (a) A 
x 
64 
(x) — fk (0 tan(kx | 
(b) lim fex) — f0) = tin 238 an(kx) D" 4 
aot ^ TD i: 25) a 2 et 2 2 
: |x| I—1—31—- x 
(© lim, so- |Œ = —1; lim — =1 - 
x x>0+ x | 
-6+ 


(b) [—1.0, —1.596071638, —2.180607124, —2.759002710, —3.333551485] 


Exercises 8.2- Part A, Page 190 


1 p= ] »x20zxe«f 
l. limi sss fi(x) = 2. limgsoo f(x) = j 
0 0«xz5 0 x= F 
Exercises 8.2—Part B, Page 191 
l. lim, fy fex) dx —1n2; fo f(x) dx = In2 2. (a) f(x) = 0; domain [-10, 10] (b) N% £) = [#4], [u] denotes the greatest integer 
function. 
P . In(*) . 1 x=0 
3. (a) f(x) = 0; domain [0,1] (b) N(x, £) = < 5. (a) f(x) = 0; domain [0, 1] (b) N(x, £) = 
x [1] 0<x<1 


[+] 04x =1 
(e) F(x) = piecewise (x =0,0,0<x<1,1) (f) No 16. (a) f(x) = 0; domain [-1, 1] (b) g(x) = 0; domain [—1, 1] - (c) Yes 


18. f(x) = piecewise (x =0,0,0 < x < 2z, —ix T im, x = 27,0); |f (0.5) — fooo0(0.5)| = 0.0003447398606 


1 x = 0 
11. (a) f(x) = 0; domain [0, 1] (b) N(x, £) = | (c) g(x) = piecewise (x = 0, œ,0 < x € 1,0) (d) No 
) 


Exercises 8.3, Page 196 


1. (a) f(x) 20 (b) FG) =e! (c)g(x)= n 0 pn 1 (d) The limit function is h(x) = 0. | fo fe(t) dt| < £, whenever k > 


N (e) = L, Hint: Use the fact that —1 < (—kx — 1)e™™ < 0. It’s fortuitous! The theorem does not apply, since the convergence of f; (x) is not 


uniform. 
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2. The limit function is |x| N (e) = cot(1ez) 


scd Eel denis € a _ Joo x=0 , 
6. (a) The limit function is f(x) = 0; f( 5i — s (b)The limit function is g(x) = | 0 erzi The convergence cannot be uniform 
up m 0 x=0 
since the limit function is not continuous, while the g,(x) are continuous. (c) The limit function is h(x) = tod 5° The 
2 X x 


convergence cannot be uniform since the limit function is not continuous, while the A(x) are continuous. 
0 x=0 


1 0 <1 Because the limit function is not continuous and the f; are, the convergence cannot be 
«XX 


8. (a) The limit function is f(x) — | 


oo x=0 
0 0<x<l'’ 
the convergence cannot be uniform. (c) The limit function is h(x) = x; N(e) = i. Hint: Use the fact that In(1 +k) < 4/k, whenever 1 < k. 
0 x=0 
1 Oxsar 
consequence of Theorem 2, because, { f. (x)) does not converge uniformly, the theorem does not apply. 


uniform. (b) The limit function is g(x) — | Because the limit function is not continuous and the derivatives of f(x) are, 


(d) Recall f(x) = | and clearly f f(x)dx = x, which in turn equals lim; >o f fi(x) dx = h(x) = x. This is not a 


Exercises 8.4—Part A, Page 199 
1. The integral equals zero; | f(x) — g(x)| < |f (*) — g(x*)| = 23 forx* = 1x £. 


3. Hint: To show that f(x) converges in the mean to zero, use the u-substitution u = x^*; observe that 


EE dee Lf HEP N ee i i if 0, 1], b 
= — S = . t , , 
Í (+ xy x Ah Oru u < x], ray u; f(x) 1 - e convergence is not uniform on [0, 1], because 
the sequence f; (x) converges pointwise to this discontinuous function. 
Exercises 8.4—Part B, Page 199 
l. , 2 (a) f(x) =0 i 

08 (b) No, the convergence is not uniform. FG) = j 
0.6 (c) The limit function is again: f(x) = 0; lim, os fo fea)? dx = lim.,4,1£ —0 
04 (d)D 


X 
E =05 0 0.5 1 


I1. (a) f(x) = |x] (5) f, CQ — IxD? dx = 0.2430698712, f1 (fŒ) — Ixl)? dx = 0.1078922519, f! (f(x) — Ix? dx = 0.05904471962, 
[4 (fal) — Ix? dx = 0.03691412747, f? (fs(x) — |x|)? dx = 0.02517651952, f (f(x) — |x|)? dx = 0.01824108593], 
Si 056) — |x|)? dx = 0.01381344015, f (fa(x) — |x|)? dx = 001081847805, f1, (fo(x) — |x|)? dx = 0.008699868768, 
ffi) — |x)? dx = 0.007146820452 
13. [x, (4/2 + Dx? + V2x, (V3 — V6 + 1)x3 + (-2V3 + V6) x2 + 3x, (34/2 — 2 — 24/3 + 1)x4 + (6 +273 — 6/2)x3 + (—6 + 3/2) x? + 
2x, (—V5 + 24/15 — 24/10 + 1)x5 + (—24/5 + 64/10 — 4/15) x4 + (6/5 — 64/10 + 24/15)x? + (—44/5 + 2/10) x? + A/5x] 
A 


L+ 


0.8 + 
0.6 + 
0.4+- 
0.24 


; 
i 
0 02 04 06 08 1 
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A-35 


19. [0.1600000000 — 0.02000000000z, —0.05200000000z? + 0.03200000000z + 0.4720000000, 0.01216000000z? — 0.07584000000z? — 
0.02928000000z + 0.5420800000, 0.002488615385z* + 0.006025846150z? — 0.09077169231z? — 0.00376123077z + 
0.5639532308, —0.001152000000z? + 0.007680000000z* + 0.01152000000z? — 0.1273600000z? — 0.00976000000z + 


0.6223360000] 


n 
T 
zm = 


1 


Exercises 8.5—Part A, Page 204 


1. For all values of x. Use the Weierstrass M-test. 


1 — x% E 
=r X= =z, and ) —. converges. 
(1+ x2) 7p i 


3. Verify the conditions of Theorem 5. Let f(x) = mE. Observe that (1) f(x) is differentiable for all k and x, (2) xr Sf, (0) = 0, (3) 


cos kx 


Exercises 8.5—Part B, Page 205 
L r« ———— 71.7632 Hint: Solve |x Inx| < 1. 


Lambert W (1) 


3. (a) 


25-7 
a+ 
LST 
l m 
0.5-- 


it = 
e Qi! ^ T 4 Ok + DOW! 


à (=x um (—1)'x**k 2 
d = 2 = 
( P» (2k)! 2. x (2k)! 2. (2k — 1)! 


0 


20. (a) 


[1,8 2x? — i, 

(b) We verify th 
2 
0 

the matrix: | 9 
0 
0 


3 
5- 
e 


x^ 


in 


» 32544 


1 oo | g OO  coskx SÉ ^ 
ro | < z and cu zz converges, so par “z converges uniformly on (—oo, oc). 


CO 2k 


k=0 
oo x t1 ex) 2k-+1 ( 1)£ TY ]yx?kr 


XU 
(2k + 1)! 


(—1)x2€71 oo 


k 
q^ E ; : 

= , and J converges for all x according to the ratio test. 
(2k)! (2k)! 


See Exercise B4. 


(—1) t 241 


k=0 k=l k=l 
See Exercise B4 
(b) True! (c) False! 
y A 
Bi (gl 0 n25.10,15,20 
st 
0 P 
4+ gpl 05 1 T5 
3+ n=5, 10, 15, 20 -20+ 
r 24 -307 
"d -40+ 
b di -504- 
— i 


15.2 3 63.5 35 3 5 231 6 2 


sin x 


O fa) > —oo) 


315.3 35, 6435.8 _ 306 


35 


0 


volto 


L 
4% TB 3° 4° 


(€) [0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0]; [0, x, x, x, x, x, x, x, x, x, x] 


CENE GM 315.4 | 105,2 — 5 429,7 
x iru g% 16 * 16 xc 16 x 16° 16" 


validity of this assertion by computing the associated dot products, Vie P, (x) Pj (x) dx, the results of which are displayed in 


X 


03 ,.6 
16 " 16"? 128° 32 " d: 


(See plot.) 
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(d) [2,0, 2,0,0,0,0,0,0,0,0] [2, 1, 32,32, 32,32, 32, 32, 32, 32, x] i (See plot.) 


3 $X.X ,.X XX 5,2 T 


WIN 


; ' — 
-1 -05 0 OS 1 


(e) [0, 0, —1.519817754, 0, 0.5824466982, 0, —0.06611447688, 0, 0.003595814764, 0, —0.0001233341248] 


CHAPTER 9 


Exercises 9.1—Part A, Page 209 
1l. x - 2x? 3. p3(x) = 1 - 2x + 2x? + $x5; pi(x) = 2 + Ax + Ax? 


Exercises 9.1—Part B, Page 209 


i 1 i " x? +f 6(xt — 17/2) di 1 1 
ð E Ps : s= 
x41 (1 4- x)? 0 (14-1) * xt+1 x-cl 


2 


2. (a) Rax) = a ine DS Sey J 6cos( 25:2) Ga oum t-aet leas) Seine aor RES 


A p H^ é : RE Gu 3c42 (3c+2)2 (3c+2) 
: 2c— 2 2c-3 2c—3 2c—3 \ 2 i 2c-3 4 E 
4sin(s5 (aaa —3 Gert) (Gras 162 Gant) teosena an T IMM Dx—2Ff (b) c = 2.178519784 
(c) c = 2.323751209 (d) d M :— 0.979559308 Hur (See plot.) 
ys. 0.64- 
0.5+ 
0.67 04+ 
04+ 03+ 
ag 0.2+ 
0.1 
mm +> x | 5 
0 o5 1 15 2 25 3 35 4 0 os | 15 2 25 3 35 4 


(f) [1.465646879, 2.534353121] (gk = 12 
(h) —0.2784055688 + 0.2015401512x — 0.07814958182(x — 2.0)? + 0.02888468605(x — 2.0)? — 0.01014516745(x — 2.0) 


A (See plots.) 
034- A 
3 p 
024 a 
0.14- | 
0 — TQ p> x 
V.S 2 2.5 
—0.1 S 
—0.2 + 
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a)0.2452812035 (b) Use Ps); 0.2462610930 A 0.0509885424 17. (a) x + ix? 
0.6+ 
0.5+ 
0.44- 
0.34- 
0.24- 
01+ 
0| o2 04 06 0 ag 
Exercises 9.2-Part A, Page 212 
| rE i i1 1 —1 *( y 
2+x 2145 21— (-i) a= 2 
l ~ 1 PENE i I 1 = l 
4. = x)*; =- see = 1k (1 j 
T 2 ggg ae ee 2i J^ 
k=0 k=0 k=0 
Exercises 9.2—Part B, Page 212 
2k 
Ll uus guru ias )*(G + 2) 
2. (a) f(x) = cosx; f™-1(0) 20; f™ (0) 2(—-D* (b) 0 < jim [Rel = li tim FO, RM lim JE =0 The latter limit 
PT T ud um 1 T5 T ioo (2k + 1)! 
1 x 
equals zero, because it is the general term of a convergent series. (c) Jim DERE im à = 0, Vx 
ak k>œ2 (2k + 1)(k + 1) 
. ; 4 : . 2 ~~, CC D*x* 
7 5x-17 oo k¢2Q(-k 34ksC-k EL Top 5x—17 2 3 s / : 
~ (a) 4x2 441x445 ^. X sl 1) (59 ics 545 ^et (b) jim —— a = g^" R =} (c) 4x? -41x4-45 x+9 4x+5” x+9 nid 2 Qe ” 
1 k=0 
1y**l4*x -k 9 4k 
"T e Uk 
T EN -Y3€ Sic C3 D M 2 TE 
mm k=0 
(e) 5x — 17 = 45a + (45a; + 41ao)x + 35:5 (4ai-2 + 41a. + 45a,)x*; —17 = 45a > a; = —1:5 = 45a, - SF > a = 2; 
4a,» + 4la,_; + 45a, =0,Vk>2=> a = 2( D 2( ay 
10). (a) f(g(x)) 2x;g(f(x) =xfor-—><x<F (b) A (See plot.) 
oo v oo —E i) E 
(— 1): yl (2k)!4 k; x2 " r á : " 
(c) f(x) 2 ——————— 5 g(x ; ao d aix + aox^ d-aax^ +a4x" +asx- +a xo — lig +ayx +a2x* +a x 
f(x) 3 Qk 4 DI g(x) = array Qk+1 0 1 3 4 5 6 6 Mo 1 2 13 
vp aget + agx°)? + 729 (40 + ax tax + asx" taa Tur + agx ey e —Xx- 4 540" T x ag? c a java | 
3; do^ ai — L= =i; a — ja, ag — 24209" + na 209? *3 3; d2do* = = 0; az — ga — aza; = 24340" t z2ao “a + pando: -— i; ao? aj? = 0; 
a4 — taya? = say? 2a» — d3a9d, — taom? + 30200" a? xn 7340 3952 "al 41340" [^4] TA 24400 +s gj tado" — = 0; asao" — a4a9a,— 


1 5 2 5 1 š ‘ 
545d9° — a3d9a2z — laja T ga = ta? a3 «i dado 3a + taa 3a3 + tanaoa’? 4 fag” 20145? + qa” 209? 204 +as = 0 > a = 0; aq = 1; 


k 
134 = 0; as = 3 13. (b) = lye, (1 — 1x) 


a = 0; a3 = £5 


Exercises 9.3—Part A, Page 220 


) EPEN dis S. bd Dad, nea eee TE du l 5 
2 sin(x) & x — 2x3 cogo 5; cos(x) X — 3X t za% 5 tan(x) © x t gx? t gw qum t3 ti“ 
(—1)*4-*x „2k d, 9e = ak -2k h (—D*47*x -2k+1 . . . . 
5. Jo(x) = —— 75 x) 2——————;J —- — — — — —— Hint: Replace k by m + 1 in the power series for 
i E: QD dx =} E: s Em P+ 1) [UN p 
x Jo(x). 
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Exercises 9.3—Part B, Page 220 
1. F(a) = Ja+4+ ialn( bur dr i a41 Sa In(1 tJat+l);Vatx2 x4 la is + Le 58 + ES: 
A 


Fla) © 3+ $inQa— ga?-+ gla? — Wat cn 
S9 = y y 
2. (a : (See plot.) 
2 k41 d 
(b) lim “+! = —x; R = 
k—oo dk 
Z (=1) = (—1)* 
(c) Y converges; e ) diverges! 
mer l k=0 k+1 
(d) » ——— =In2=In(1+1) 
2x1 
oo oo t. 2k [os oo t oo oo 2k ot 1 „k k 
j (—T1) x? *H ; x^ À 217* sin(tkr)x 
7. (a) J a=) pri be = i) ees! = $F © Ce = bis (C) = 10, 1, 1, 3,0, 35) 
k=0 k=0 k=0 k=0 k=0 k=0 n=0 
{cx} = {0, 1, 1, 4,0, -4 
as oo T oo oo y co oo I2E s eaa. „k 
: Ty S co x* . 21/2 sin(3kz )x 
17. (a ax moy —— y bx =) — (cb) xk = 4 c) do = 0; di + do = 1; d; + di + tdo = 0; 
(a) a RE »- x a 2, ki (c) do dı + do ay 1 + 740 
ds +d + id + odo =~ : da +a, +5 pucr id + + z% = 0; ds Ld, 4-1 id; + id, + zd + wh = BS 


ds + ds + 3d, + 1ds + $d) + + ud Ld, = 0; (4) = (0. l, 1, 3, 0,—4. 4 (d) » = sin 1 + (cos 1)x + 


720' 
(—} sin 1 + 4 cos 1)x? tan tha? + (7-4; cos 1 — } sin 1)x — + sin 1)x° 5 + (d sin 1 — 35 cos 1)x® 


130 


(e) f (g(x)) ~ Es ak pem bmx” y ey pet Se) = ee 
{S} = {0.8414709848, 0.5403023059, —0.1505843394, —0.4207354920, —0.3229307250, —0.1386192282, —0.01696363818}: 
{sz} = {0.8414709848, 0.5403023059, —0.1505843394, —0.4207354924, —0.3229307266, —0.1386192330, —0.01696365021} 


34. v ebur + 2x3 — ix Ay Rgs F(X) 2x + 2x? 10 x3 4 D x4 X; 


120 
C 4 
d (x x? 2x3 sta 101 x?) zx 2x ds ix? _ Ley 4 LEN 


dx 6 120 * 


5 


44. (b) 0.3862943611; x —1 — 2x - D? - x - D? 1x — D^ +: 1x - D? — £x — D6 + 3i — 1)! — $(x — D5 + (x — 15: 0.3912698413 


a 


CHAPTER 10 
Exercises 10.1—Part A, Page 227 


T . LATA 
L. ao = 2; an = 0, Yn > 2; bp, = 2c; lim, ,4,0 = 0; lim,..2— = 0 


nit 
IE" LEET = 1)? 


5. ao =1-— 5, an = p = We compute the overshoot of S59. At 0: 8.882701730%; At x: 6.147235972 %. 


z > 
TH ni 


Exercises 10.1—Part B, Page 228 


oo 


3 ((—1)" — 1) cos(nz x) sin(nzx) 
1. A 2. b ( 
(b) 4 T 2, n?n? nu ) 
RÈ, (c) lim = — — = l; lim, +40 — + =0 
AAS a 
x 
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(d) ^ (e) 051 
: 0.508 


S599(0) = 0.5005066018 (£) A 


0.506 
0.504 


0.502 


s t t ! + x ? ARE E 
0 05 1 LS 2 2 4 6 8 1012 14 16 18 20 Z 3 4 


(g) We compute the overshoot of S10. At 0: 8.9371663 96. (h) Using the partial sum of the first 500 terms: 1.333130894, compare this to the 
value of the integral 1.333333333. 


((—1)" — 1) cos(nz x) 
18. (a) (b) 1 5 m Daa 
= wt 
—L 5 — 1 
(c) lagi s = 0;lim,,4,0—0 


a 05 0 05 1 
(e) In this case there is no discontinuity. (f) 


(g) In this case there is no discontinuity 


(h) Using the partial sum of the first 500 terms: 0.6666666662, 
compare this to the value of the integral 0.6666666667. 


Exercises 10.2, Page 231 


1. Multiply the series together and integrate. Simplify the result using the orthogonality of the trigonometric functions involved. 


lx? O<x<1 


2. ned . (d) 4 
Xo 1=x% <2 1.64 


100th partial sums 


b kJ e yop 1 (3222? + 2(—1)"*! + 2) sin(nzx), 


Zw 272 2 nôn? 
n= 


3 sin(nz x)(—1)" — sin(nz x) + cos(nz x)nz 1 
eiue ) 


n?m? n?z? 


nzl 


0.5 
(e) The result of termwise integration of the Fourier series of f(x), will converge pointwise to FO), at all points of [0, 2L] whether f is 
continuous at x or not. The Fourier series of F(x), will converge pointwise to F( x) on (0, 2L), but convergence at 0 and 2L happens only if 


F(0) = F(2L). (f) Hints: Observe that 9 ^7 ,(— z) = = —,;, and expand 2: 4 — g ina Fourier series. (g) Yes, Theorem | applies. The result 
of termwise integration of the Fourier series of f (x), will Give pointwise to F (x), at all points of [0, 2L]. 
(h) fax) = lo : Í 7 7 : (k) 7 — we (See plot.) (1) Clearly, termwise differentiation 


is not valid in this case. 


o A ak S ((—1)" — lee] 


n=1 


o WZ 
Jet ((—1)" — 1) sin(nzx) cos(nz)) 4 | 


nv 


nzl 


(I) The evidence is negative. (m) Theorem 2 does not apply because f (L) does not equal f (0). 


| 


NI NI 
bie wre 
ES 
m 


x -1<x<0 1 &/ CD 1+6” l sin(axx)(( D" — D 
9 
(b = + X ( = +2 it ) sinar») © 5 x +5 F 1 


n?z? 


sral 


= = n=1 


] 
18. (a) F(x) = | 


n=1 
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1007 partial sums (e) The result of termwise integration of the Fourier series of f (x), will converge pointwise to F(x), 
at all points of [—L, L] whether f is continuous at x or not. The Fourier series of F (x), will converge 
pointwise to F(x) on (—L, L), but convergence at —L and L happens only if F(—L) = F(L). 
(f) Hint: Expand € + 1 in a Fourier series. 
(g) Yes, Theorem 1 applies. The result of termwise integration of the Fourier series of f (x), will converge 
pointwise to F(x), at all points of [—L, L]. 


(h) f (x) = A lerap (k) ^  100rh partial sums (1) Clearly termwise differentiation is valid in this case. 
` 1 O<x<Il 1 à : ; ; 
| In fact, the series are identical. 
"m ((—1)" — 1) sin(nz x) 93 (m) Yes, all the requirements of Theorem 2 are satisfied. 
(i) > 2 H : - 
Ac nyc | “05 s 05 1 
= ((—1)" — 1) sin(nzx) | l 
: ) ' | 
9 2 nz i 


Exercises 10.3—Part A, Page 234 


1. (a) f(—x)g(—x) = (—f(x))(—g(x)) = f(x)g(x) (b) f(—x)g(—x) = f G)g(x) 
3. (a) neither (b)even (e) odd 


(c) f (—x)g(—x) = (—f(x))g(x) = —fG)g(x) 


Exercises 10.3—Part B, Page 234 


oo oo ni . 
b Fog (2(—1)^* +2 + n?22) sin(nz x) — 
l; e` dt+ J (2] e cos(nzt) dt) cos(nzx) 3. (a) ` 2 3 (b) The function is odd. 
0 0 nm 
n-l n-l 
A (c) 100¢h partial sum (See plot.) 
ffs {Fo and 10th partial sum N 
0.84- 10rh partial sum 0.5 y 
0.74 i | , 
0.6- - -1 1 3 
05+ 
04+ 
t ; ; fone +—+— t+—}+—_}-»> x 
-1 -05 0 OS 1 iA OG tS 


3 

10. The function is even. (c) b, = Í |x| sin(nztx) dx = 0; ao = la Ix|dx = 1 = 26 |x| dx; 
= 

i-i 2 f 


1 
an aj |x| cos(nz x) dx = 2 Ix|cos(nzx) dx, n > 1 
= 


na?  1J, 
Exercises 10.4—Part A, Page 237 
1. (a) (b) A (c) (d) 
d x 
-1 cos 0 0.5 1 T d -2 -l 0 1 2 TY 
l e E — Danke) X (—1)!" sin(nz x) 
(047 + 22 -A (£) (See plot.) (g a (h) (See plot.) 


A 100¢h partial sum n=l 


| 100th partial sum 
l 


0.5 
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Exercises 10.4—Part B, Page 237 


—f(-x) -2<x<0 b) D C2 sin(3nz) + (-1)"nz) sin(3nzx) 


f(x) Das Au (d) 200th partial sum 


2. (a) Zoaa(x) = | 


n=1 


(c) See (b). 

" 3 " = ol all cos(inzx) "m 
el An^ 

(g) See (f). 


100/h partial sum 


t t =} >x 
m x 2 


(i) Averaging the Foutier sine and cosine series of f will result in zero on the interval [—2, 0), because — f (—x) + f (—x) = 0, and f(x) on 


[0, = because (f(x) + £02 = = F(x). 
Q1 uM Si (2 —1+cos(4 NI )) cos( nx) " (—nx veer) kj) 


See plot. 
ue n?n? n?n? nin RU 
o 
t t + » x 
-6 4 2 0 2 4 6 
Exercises 10.5—Part A, Page 239 
1 1 — cos 3t 1 e sin 3t + 3e *' — 3 cos 3t)e™ 
l. (a) yo(t) = 2———— (b) a(t) = = 
e! a? --9 
1 3t 3e 0*9! — 3 P. 3t. 1 1 
(c) lim ee i e" cos3t (d) The mean square norm of the considered difference is given by: 
a>03 a +9 9 9 
V fe ec — ec 0t00)2 dt = i2 [rej EE alime 4/2 EEEE =0 
(e i 11-—cos3t  lae-sin3t + 3e- (0*9! — 3e-' cos 3t yd NET (3a? + 15a + 38)a? 
9 e! 3 a? 4-9 (1+a)(a + 2)(a? +4a 4+ 13) 


(3a? + 15a + 38)a? B 
ial M Faa +a +4a+ 13) 


1 s 

t —st t -$ —s 
2. (a) 4 w) ^ d e^5s-ce - 
1T 1 — eC? (—1 + eC9)s? 


t mt 
Ol os 1 15 2 25 3 


Exercises 10.5—Part B, Page 240 


l. y(t) = Ik(3K? te^ + eK? sin(3t) — 6e ^'k cost) + 6ke™ — 6kte™ — 2e™'k sin(3t) + 6e™ cos(3t) — 6e * + 30re^" — 8e~ sin(31))/ 
(10 — 2k + k?)*; limi, sys (t) = 0 


A-42 Answers to Selected Exercises 


se“ +e] 1 les (ey? le 2 
2. (a) Y(s) = b) Ys) & —- : + ; c) y(t) X it— 4 + 
VU TS s2(s? + 2s + 5)(e^ — ;9 id s2(—s? — 2s — 5) s?—2s —5 Par ta sm 
Ee" eost — ae sin 2t + ci E ner cos(2t — 2) + pet sin(2t — 2) H(t — 1) + i + ie"? cos(2t — 4) + 
ue? sin(2t — 4))H (t — 2) 
A (d) We use the Fourier series: } — Yf, E, (f) — 4 
0.124 
0.14 (e) The formulae are long and are best studied 
0.084 graphically. See (f). 
0.064 
0.04 4- 
0.02 4- 
j t T + >t 
9. Qs 1 15 2 925 3 
18. (a) y(t) = (2 S 2 ste sint + Be cost + it — X (b)See(a). (c) -. (See plot.) 
3 
"i 
1.5-H 
1 
— sf 
Ol 02 04 06 08 
k : 
ET l+n sin t 
iape ui Me a. | (f) The formulae are long (g), 4 
ni ; 3.5-r k=1.2 
n=l and are best studied mA C. 
graphically. See (g). IE ff bh 
254 / bu 
24 WW 
15 7 
1 £ 
1 m — 1 


Exercises 10.6—Part A, Page 243 


2. i$; = 2, = -4 5. Hint: Use the — cos(mx) cos(nx) = $ cos((m +n)x)+ 1 cos((m — n)x). ya i sin x sin 3x dx = 0; 
AO VEE - -/2 LED = -M2 ECD - M1 
Exercises 10.6—Part B, Page 243 
3. (a) (bt) = [2. 21, $, 21, 2] A 
3 "n 
(b) [ — 20 +. zb; =0, x zb; =0, —32 + rb; =0, ir b zb,—-0,—2m +2b5=0]; 55] 
{bx} = 2, -1, 3, -}, 2] bei 
(c) [4b =, inb = —im, inb; = = in, inb, = = —in, i lab; = ix] $4 
(d) ps := 2sinx — sin 2x +3 isin3x — + sin4x + : sin 5x - -- u 
ol gs 1 152253 
(e) fp CF) — ps(x))? dx = — 98m cim? (€) f pa) dx = z5 b= i87; So foy dx = ir 
(g) {x,} = [0.1, 0.2, 1.0, 1.7, 2.7]; P5 :— . 116589166 sinx — 1. 124872731 sin 2x 4- 0.6446286627 sin 3x — 0.2645677405 sin 4x 4- 
0.051516073sin5x (h) ^4 (See plot.) (i) F4 Cf (x) — P5(x))? dx = 1.463720052 


Answers to Selected Exercises 


4 9 
13. (a) {a,} = [. = 2,0; = 0, - +] (b) taor — in? = 0, aix +4 — 0, ax = 0, azm + a —0,a4z = 0, ES +asx = 0; 
4 4 4 oe a | " 1 2 1 1 2 1 E 
(ax) = [z, <9, sO TA (c) 57 = 5 Ag, 0 = 5427, — 55 = 7457, -221iAw,-$i-iAm,0-—iA 
_— lo _ goosx _ 4cos3x _ 4 cos5x A ii Pi x Pay». — l3 2 410,648 1 
(d) ps = 5c 4985 — jme — m , . (e) fy GG) — psa)" dx = 137 — 30635 x 
2.5+ 
ope 
154 
1+ 
0.5 + 
a a aH’ 
Ol 95 Y 15 2 25 3 
1 50,625z* +1642, 592. x 1 _ 50,6257* +1,64, 592. 
(f) I ps dx = 202,500 > 14) +3 pe T — 202.500 3^ fY dx= im? 


(g) (xx) = [0.1, 0.2, 1.0, 1.7, 2 why 3:0]; Py : := 1.597746580 — 1. 248896090 cos x+0. 04631135028 cos 2x — 0.08386740858 cos 3x — 
0.08882569584 cos 4x — 0.1578683330 cos 5x 


h) 4 (i) fo CF (x) — Ps(x))? dx = 0.04401576; 57° — SPSS z = 0.001864922 

git 

25 Z 
Iq a ° 

05T 7 
st Ht S 

os I I$ 2 25 3 
23. (a) (ax) = (2x, 0, 0, 0]; (bx) = [2, —1, $] A (See plot.) (e) [Z (f(x) — p3? dx = ix? — Pa 


(b) —2z? + rap = 0,2aiz = 0,2a5z = 0, 
2a4z = 0, —4z --2biz = 0, 
27 + 2bon = 0, —1z 2bjn =0 

(c) See (b). 


(d) ps :— 1 + 2sinx — sin2x + 2 sin 3x; 4 1.42 m 12 
(£) f", p(x) dx = 27 + Pn; Za? m yyy (ap + bf) = 200 + Ga; f" f) dx = $7? 

(g) {xx} = [-2.8, —1.5, —0.5, 0.1, 1:2; 2:7, 3.01]; Bs = 2.137654488 + l 904594013 cos x + 1.709229628 sin x + 
1.737964417 cos 2x — 1.122162776 sin 2x — 3.178577969 cos 3x + 2.011540815 sin 3x 


(h) (See plot.) à) SZ (f(x) — P3(x))? dx = 68.51998842; [A (f (x) — p3(x))* dx = 3.56662446 


. (y (x)) = (1, 1 — 2x, 1 — 6x + 6x7, 1 — 12x + 30x? — 20:8, 1 — 20x + 90x? — 140x? + 70x^, 1 — 30x + 210x? — 560x? + 630x* — 252x>} 
. (—0.00575321 + 0.2222222221B, = 0, —0.055605469 + 0.2857142854 B4 = 0, 0.1374170530 + 0.3999999996 B; = 


A em 


0, 0.1205952214 + 0.6666666661B, = 0, —0.6366197719 + 1.999999999 By = 0, 0.00255930 + 0.181818181785 = 0}; 
ts(x) = 0.00030685770 — 0.007892638x + 3.151377003x? + 0.36573887 1x? — 7.055713355x* + 3.547189803x° 


Ww Ut 
Oo o0 


Exercises 10.7—Part A, Page 246 
1 


1. [7 fe! ie -3e^, — 367 + $e] 3. For instance hs dx = 4, so the dot product of x and 1 is non-zero; 
a=75ln2 = 51, b = —4081n2 2 4-282, c = 3901n2 — 270. The normal equations are now coupled. 


Exercises 10.7—Part B, Page 246 
. [0, —0.60792710185402662864, 0, —0.65302545150713002139, 0, 0. 29306711860909452345, 0, —0.033906772750252246539, 0, 
0.0018501528556370603135, 0]; Sine o2 i) = = 0.38399392484990531795; I x? cos(x)? dx = 0.38399392515450221906 


A-44 Answers to Selected Exercises 


3. (a) {sz} = [0, 2,0, 72545, 0, 11 50995] (e) 0.00003694684603 
(b) See (a). 
(c) See (a). 
2 3&5 3 ub —À ES 5 > X 
(d) Á - 32 m TÉ GEOP dem -1l pi utemi 4-33 x x) =j 


16. 


30. 


(£) X := [—0.9, —0.3, —0.1, 0.13, 0.54, 0.8]; s2 = 0.0129556010, s4 = —1.127103955, sọ = 0.00523873425, s, = 0.9637195018, 
ss = 0.2591528103, s, = 0.0029339603; F5 := —0.000138831137 + 3.140286954x + 0.00843105037x? — 5.085346978x? + 
0.01283607631x* + 2.040828381x? (g) ^ (See plot.) (h) 0.0007783701479 


IT An 


[1, x, 2x? — 1, 4x? — 3x, 8x* — 8x? + 1, 16x? — 20x? + 5x] 18. (a) f(x) = —1.336037419x> + 0.2123519542x 

(b) 0.02973207946 c) (x) = [—0.8, —0.1, 0.2, 0.7]; so = —0.0736731188, sı = —1.250827998, sı = —0.0730184302, 

$3 = —0.7367344394; F3(x) = —0.0006546886 + 0.959375320x — 0.1460368604x? — 2.946937758x? (d) 0.6439695296 
(e) (See plot.) 


(a) fs(x) 2 —ux*- i -ix-ix-li(e ? (See plot.) 

(b) 0.009375000000 Polynomials are not bounded on an infinite interval. 
(c) F5(x) = x — ix 4 me 
(d) 165.6500000 


CHAPTER 11 
Exercises 11.1—Part A, Page 251 
; - ; : = a - j s t i] t 
1. Substitution into the differential equation and differentiating termwise yields x^ y" + (3x + 1)y' + y =| -° ES =~ n = ^a P. 
0 xt)’ 


a 


oo —x)ket N (k 1)! je -t 
3. With u = c integration by parts yields k! / iz AS ity = Hx a [ ee ae 
i 0 0 


xt) k+) (1 + xt)? 


Exercises 11.1—Part B, Page 251 


. (a) (4 fre za a) =(2 re" ds) (4 "s = iD ej-dsdr- (4 fr" ae) (re ar) - QD = 1 
2 —1)* f t* dt Exe 
(b) >> k! =) uorrn 


Answers to Selected Exercises A-45 


2. (a) L 1 | eXmerf(/s) — en(-1-erf(s) (b) Ss 
~ VET /s i Js AZ 4 (kl 
1 2 (=1)* (2k)! dg xS (—1) (2)! NM 1+ 2k 
L = L[t]2 ) — ——— l =] In the integré arts process, make s 
-=| 2 FED [tC] 2 TRES, (c) lim 3 ims isl (d) In the integration by parts process, make sure 


you always integrate e. (e)s = l,n = 2, error = 0.2421278437 (f) s 22, n = 3, error = 0.0463692298; 
s =3,n=4, error —0.0115115812; s = 4,n = 5, error = 0.0031939938; s =5,n = 6, error = 0.0009429715 
Exercises 11.2—Part A, Page 256 


1. (a) |x2| < 2Ix|, |x] <2 (b) {sin x| <1, d «oo (¢)|sinx| < |x|, |x| «oo. (i? < [xl [x] <1 @ let] Lx 1 
(£) |x| < x? x z 1. (g) limyo/ 2— 


e* 


2. (a) True! lim, „œe ~= — 0 (b) True! lim ^ 


— 0 (c) True! Observe that lim,_.9 E 3 — 1 = there exists an a such that | sinh x| < 2|x| 


for all x with |x| <a (d) False! lim, sia =1 (e) True! |5e* — $e | < e* forallx (f) False! limpo | $**| = oo 


[x] 
(g) True! lim... [ex — 0 (h) False! lim,.,4;|Inx| = co 


€ : F@)| 0; : G(x) F(x)G@) | e F(x) | | G(x) m : F(x) : G(x) _ 

y. limi $97 0 and lim, ., zGy| = = 0y > lim,.., ^ | = Tim; s; ( Fay || ee ) = (lim, | E ) (lim, | a ) ext) 
Exercises 11.2—Part B, Page 256 

2. (a) sinx =x — ix? cos& This implies that | sin x — x| < Lx. (See plot.) A 


— l 
-2 -1 0 1 2 


x /209 D ail n+l 
3. (a) lim |- My = lim [x17 —0(b)a, = (-D (c) According to the ratio test, the series converges for 0 < x < 1 and diverges for 
x - Xx n 
xcd Tenani the series converges at x = 1. 
In(1 „k+1 k 1 x 4 kl ta (1/2k4-1/2) 
4. ( - Li Es lim a z = 0 for k > 1. Moreover lim,.,o In(1 + x) = 0. 5. lim llc —0 
x20| In(1 + x4) k x20|1-4x**! x20|  tan(x!/2*) 


8. (a) limpo Gt does not exist. (b) sin(x + ./x) = tan(,/x) + tan(x) — 1tan(x??) — + tan(x?) — à tan(x?/2) + O (tan(x)?) 


Exercises 11.3, Page 261 


d x (—1)" (2m)! z (—1)"*! (m + 1)(2m)! ji 1 91 15 1 525 1 1 
L = = —— O — 
(a) ds ), 4mm sm 2 4n msn? 5? g s 4st PA 16 sê La 
e e n erf(A/s 1 e’./merf(/s) | ee? 9 5 2 
t f^ - au SD EE EE -bek-ibe A EHO) O See and 
5.(FQ)21-Le-£-5445 § + Ob): G@) =4=-3+3-a+23-2+37-2+0G) 
(b) FUSE s fg) =45-34+5-44+45-4+4+0(5) (9100.1, —2,2,0, —4, 8, —8] 
1 


x6 
(d f(g(x)) =4-454+ 3 jp. S l-i To s +H, EJ E + O(-5) The composition of the asymptotic series does not have a 
series development. (e) gU 0) zl i tZ 4 ^ T à 5s + 3 i n O( 4) The composition of the asymptotic series does not have 
a series development. (f) m =x+1+ H = 4 T + + O(À) Observe that even though the expansions match, they are not an asymptotic 


series with respect to the original rd yoia (g) 3 = x + 1; This is not an asymptotic series with respect to the original asymptotic 
; l 2 
basis. (h) PS = =l-3+3 E + 4 T + E: + whe 5) The series agree, and they are asymptotic expansions with respect to the 


original asymptotic basis. (i) This particular function f (x) is not sufficiently well behaved and the integral diverges. (j) The integral of the 
first term diverges. (k) This particular function ie is not sufficiently well behaved and the integral diverges. 


10. (a) F(x) = 5 — 4x? + ix - ixt + xi — Lir +3 x8 + 0O); Gœ) =1—x +x? —x34x4 54x — x? 4x8 + O) 
(b) F(x)G(x) = Fosa) = I dx ix s-i et TIN t Cte (x?) E pa a ie 0, 5] | 
2 4 68 5 22 2688 7 3.2. 3 
(d) f(g@)) 2 $ oe ita x$ ias st ctos — 725 x + 390,625 * 1953, T I es oe = x uu ] a xX + 
Syt €. 067 Since g(0) a . the series do not match. (e) g(f(x)) = 2 9j gue + Éx'- Exh + Exo — 4x5 O°); 


G(F (x j= = H 4 Zx? 2x3 + xt Bx + O(x5); Since f (0) # 0 the series Pis not match. 


A-46 Answers to Selected Exercises 


(f) x = = F =2 + x? — x? + xt — x + O(x°) The expansions match, and are asymptotic series with respect to the original asymptotic 
basis. (g) — zm = = ais =1+.x Again these are Paso series with respect to the original asymptotic basis. 
(h) re = FO S54 bx — ix t {axt ix? + bxs — 5x8 + OQ) These series agree, and they are asymptotic opins with respect 
to the original asymptotic basis. (i) fi(x) = $x — 5x? + axt — q^ bod ps t 0G) Gi) f, a= Ix 5x5 + txt 
Hx + px? — gx + Ox?) The results agree. (k) fj att) T fo GQ) dt =x — 3x? + ix? — ixt t bx - ix eyi ix? + O (x?) 
CHAPTER 12 
Exercises 12.1—Part A, Page 268 
1. — Ex% + 35 Yoo = = 0, xo; + Yoo = 75 These two equations determine xə and yo. 
4. (a) x(t) = 3e? cos(1 / 119r) — 15e"?! /119 sin(4 /1191), y(t) = — 25e"? /119sin(3 119r) — e"?! cos(3 / 1192) 


Exercises 12.1—Part B, Page 269 


1. x(t) = (—8e^?' + 965a + (18e?! — 18e->')b, y(t) = (—4e^?' + 4e?')a + (Ve — Be"); lim, oox (t) = 0; lim;..y(t) 20 The 
parametric curve approaches the origin, as t > oo. 


. (a) & = -5x dy, Z = Sx — Sy; x) = 0, y(0) = 2250 (b) Total amount of salt 2250 Ib divided over 1750 gal, results in a limit 
concentration of 2 Ib/gal. So Xoo = 2000 Yoo = TU (c) Xoo = 2000 Yoo = = (d) x(t) — s En 2000 97/2001. y(t) = 2000 7/2001 + $79 
(e)... į (g 4 (h) y = 2250— x 
2500 4- 2200 : 31 
Dy dy 20054— 599 . ot 55 r 
2000 4 f () = ;y(x)22250—x 
2000 1800 -+ dx — prt d» - 
ST 1400+ Hint: Use the initial condition y(0) = 2250. 
1000 + T 
1000 4- 
5004 | 
600 4- 
+ - - >t 
0 100 200 300 400 a LL 
0 400 800 1200 1600 
üt 1 1 dy 1 NET zl _ 7327 . .. 4741 
7. (a) = px + au T = GX Gx) = =2,y() 244 (b) Concentration: zm Ib/gal. So xz; = cT. Yoo = |G 
— 7327 " — 4741 m = 1327, as eg 0148. — 4741 _ 2057 p—61/748t 
(c) Xoo = 244 ' YOO — “6] (d) x( — 044 T ^e yt) = 61 61 e 
A A E 
e h) y = —x + — 
( wl (g) 80+ ( y= + 
1 E 
70-4 754 (i) dy _ ys 2n 
» 704- dx m 
es . 3 
o5 G) yx) = —x + 4 
50 60+ 
55-4 5 
aj 55 Hint: Use the initial condition y( 2 25 ) = 44. 
504- 
304 set 
^ - : >r o WE tt - 
0 20 40 60 80 30 35 40 45 50 55 60 70 


19. r = — Œ In $2 = 5.4068 — 30. (a) x(t) = —0.765030050460.81773006/0 cos(12 642339451) — 3.05195461062517730064t 
sin(12.642339451) — 0.2349699496¢'5 3453987281660 y(t) — —3,975718508625177399 cos(12.642339451) — 5.920935674e2 5771064 
sin(12.642339451) + 5.975718508e 6 3645398728166) , 20) = = 3,254282568e781773%64 cos(12.64233945r) + 3.553416603e? 517730064 
sin(12.64233945t) — 2.254282568e 6:36453987281660 
(b) A (c) 0 y (d) It's equivalent, but the solution is huge. 

800 


-100 4- 
-150 4 


Exercises 12.2—Part A, Page 272 
3 


1. Let x’ and y’ equal to zero and solve the resulting equations: x.) = ao, Yo = af. 4. (a) a =g zu a ds] 


x(0) = 140, y(0) = 50 (b) In the steady state situation the entire system contains a 30% brine; x. = 120, yo = 
to zero and solve the resulting equations. 


dy o uae saga 
dr — 400% — 259° 


(c) Let x' and y' equal 


M < 


rae 12.2-Part B, Page 272 


a =} 


2 


2 3 y 
 () — 5 — XX t 200) He 
Ze 13/901 cosh(ai v 1331) — 


3429 
266 


= 25 


x— ay; x(0) = p» 


Answers to Selected Exercises 


828 


133 


y(0) 228 (b)x,4 —225,y4, = 100 (c) same as (b) 
133e 13/9"! sin( zis V133t), y(t) = 100—72e- 9/9 cosh( 1/1331) — 


A-47 


(d) x(t) = 225— 
133e- 19"! sinh(./1331) 


(e) uc (f) lim, ,4,x(r) = 225; lim,,.y(t) = 100 (g) eal 
200 T aT 
160 s 
120 60+ 
50+ 
80 40+ 
40 nae 
Ul aks oa I———- or 
9! 2000 6000 10,000 0 100 140 180 220 
dy 2 x-5? 153 . 
h) Z [dg y(>-) = 28 ml (i) same as (d). 
90+ 
80+ 
70+ 
60+ à 
504- 
40+ 
30 
9 Nte x 
100 140 180 220 
2. (a) x(t) = 474e* — 117e! — 364e", y(t) = —474e* — 78e' + 560e", z(t) = 711e* — 39e' — 672e~"' 
(b) (See plot.) A (c) -60,000 ? (d) See (a). 
100,000 + —30,000 
T 0 
60,000 -- 10,0000 
20,000 2 SERA 
"0 A 20,000 
-20,000+ 0.2 04 0. 0 
T 30,000 
—60,000 + 60000 x 
12. (a) & 24 — x ty, 2 = Éx — Ky, x) = 200, y(0) = 2 (b) and (c) x, = 500, yoo = 580 (d) 
x(t) = 500 — 3006 162/18125 eohi gig HH t) oe ou Beas raum. AO t), y(t) = 
580 — 251 eg 162/18125¢ cosh( x45: n /4494. 4t) — uu g 162/18, 125t /4494 sinh( 5 /4494 4t) 
(£) Bir. = 580; lim;>œx (t) = 500 (g) - 
500 
400 
300 
200 
100 
: E bx ee 5 ——- 
0 S00 1000 1500 2000 ol : 


= -i*-th” 2,000) = 
4- deos Y * 


23. (a) and (b) x(t) = —1 + *Be* — 69 


5 1 4 313 
e, y(t) = —5 + et — 


200 250 300 350 400 450 500 


(i) The answer is huge, but the solutions agree. 


«— — de 
200 250 300 350 400 450 500 


161e* 


A-48 


Exercises 12.3—Part A, Page 276 


8 —9 12 g 
? <= ha — — 
2 ax=b;4 =; Apes 5. A 
Exercises 12.3—Part B, Page 277 
1. (b)B+3C= 26 | (d) AD = 
i ~ {14 -2 E g 


á MIE $89 — 1 
oj B ep d 


2 -3 5 
26. Ax = b; A = —] 4 —8 
12 7 —13 


Exercises 12.4—Part A, Page 280 
l. |A x B| = 29 3. x = —3, y = —4 


Exercises 12.4—Part B, Page 281 


35 4 -1l 
bl-? i6 5 2. Ax Bl — 1 
28 6 8 


Answers to Selected Exercises 


1 
l eG-v 892 sp | : | eO 892 

3 19 

2 — m V 89 


6. |(A x B).C| = 102 


_ 103 457 
IL E b J 

9 65 

2 2 12 


EX 
200 
3 }x=[ 


200 


oa 1s 
3. (I +At+iA?+14s=| ? , 
a un 8 1835 ie 


1 e 
6. = es mm 
5. Ax = b; A h _ 


0 
20 


25 
ger == 5 


30. (a) det(AB) = det(A) det(B) = det(BA) = 1023 (b) det( ABC) = det(A) det(B) det(C) = det(BCA) = det(ACB) = —12276 


(c) det(A — AI) = 31 — 101 +22 


-10 -10 — 
34 30 
32. = 
(a) and (b) det(A) = 10 (c) 8 10 
14 10 


Exercises 12.5—Part A, Page 284 


(d) det(A + B) = 125, det(A) + det(B) = 64 


20 
67 
19 
22 


10 
—25 
-—» 
—10 


1. No, because the leftmost entries in each row are not necessarily ones. 


2. False, because the leftmost nonzero entries in the rows need not be one. 


—3 —3 
—3 -3 3 -8 -3 
4 ? 49 <1 4 77|| 9 = 
: 5 —4 8 0 -I2/| 9 0 
10 8 11 7 
0 0 
Exercises 12.5—Part B, Page 284 
14,589 
—51 ^ "3014 
1. x= | —91 5. x= s 14. x 
14 6939 
4007 


18. (a) —2x; + 11x3 = —12, —10x, + 9x; — 4x3 = —8, —4x, + X? + 10x3 


(e) x; — 


9 Diss i : 
102 T 3X3 = 5X2 2 X3 


3 -8 -3 279 
58 
6 —3 0 1361 
3 T 1160 
77 149 gomme 4547 
€ Uw OT =e 
> 3873 
0 A m ~ 1160 
_ 128 
5 
_ | -19 
i 219 
E 
20 
=-6 (b)|0 
0 
_ 41s 1 0 0 
27 
128 — 542 
5» (x-|-3|! (9/0 1 0 
-8 0 0 1 


0 


415 
mn 


_ 542 


(e) det(B — 27) = 13, det(B) — 2 = 31 


Ho 6 
1 
(f) See (d). 


Answers to Selected Exercises A-49 


xercises 12.6—Part A, Page 289 


1 0 | 0 

(a) rank(A) = 1 3, (a) 0 l 5. (a)x= c Ojl+ce]| 1 

—$ E _§6 E 

5 5 5 5 

Exercises 12.6—Part B, Page 289 

1 —10 26 —24 0 
a)rank(A) = 2; 4 2. det(A) = 0; 69 | —12 | +33 | 13| +7 57 | = 10 
3 —45 96 —9 0 


t 1 0 
We use the first matrix. (a)0 (b) Does not apply (c)x = —3t x is (d) -$ ; -3 (e) 2 
0 I 
0 
3 
1 


M 
[1 2$ 1 l 0 1 
lo o o :al-3|tée|-$| &1|-2p.|- (h)rank(A) 21 @14+2=3. 
[000 0 1 0 
v a 1/149 5 H 4 i149 5 
15. (a4; = -3 + 57149, A. = —3 — 4 V149 C=] ^ — sgl 7 
j us =7 —2 — 1/149 -7 —J + 1/149 


C2 atad -šan -io 149 
(d) v = jm j ; AV; = ; AV. = “ p 
—-i+5v149 1 c4(—35 — pv 149) Ici — 45e) 149 He, + c2 /149 


29 23 29 
9 * ty 3 2 
20. (D N = 1 (c)X = t (d) X, :— 0 ls X= t 
10 
-£ —12— Di —12 = 
Exercises 12.7—Part A, Page 291 
(a) det(A) = -2 #0 (b) Bii +2B21 = 1, Bio +2B22 = 0, 3B; ı + 4B21 = 0, 3B 2 + 4B22 = 1 >; 
0 -2 | 
By, = —3, By, = $, Bir = 1, By, = —2 ol, i : 4 AC=I15CA=I1,B=I1B=(CA)B=C(AB)=CI=C 
Exercises 12.7—Part B, Page 292 
r 6 
-363 1 0 0 -3 -5 T d 
X-|-£2 :méf(AY)-|0 1 0 -%4 2. (a)det(A) = —65 (A! =|-# -i$ H| (QAM! -A7A-I 
LG 0 0 ! B + r5 0 


d) Let AB = I, then 118,1 = 12B5, +7B3 = i, 11B,5 = 12B > +7B3> = 0, 118,5 = 12B54 +7B33 = 0, —11B,, + 12B>, + 10B3 , = 
. —11815 + 12B5» + 10B35 = = (m —1 1B) 3 + 12B>3 + 10B33 = = 9, B, 1 T 3B; T 7B34 = 0, Bi5 + 3B5; + 7B32 = 0, Bi3 +3B23 + 


7B. — I2 Baa = lL Bi = 4, B33 = 0, B32 = 4, Bog = -Ẹ, Bin = +, B31 = $, Bo = 2, Bis = í 
6. ex A 1 0 © m9 =l á 
85 51 E 85 51 15 5A 105 —204 
e)X:-|-2;X- -i;X-H|601 0-2 55 Gzo--u| 8 70 -187 
à i i j —45 —45 0 
Sp) “a 0 0 0 1 37 z 0 
(a) and (b) (-#, 3) 
Exercises 12.8—Part A, Page 294 
In section 12.7 we have introduced the transpose of a vector. From this point in the answer key, column vectors will be displayed as transposed row 


ectors; e.g., the vector v = | will be displayed as v = [1, 2]T. 


A-50 Answers to Selected Exercises 


5 34s 
72—17s+s? 72—17s+s? 


Q5 6]... [-6e-* 4+ 7e* —6e? + 6e” 
BVH BVIT] Get ate tet EF 
Exercises 12.8—Part B, Page 294 
8 9t = 8t 9t 
l. g' za bs 45e 48e + 54e l = Ag 2. (a) v(t) - [30e7* - 32e!, —24e! + 30e-* J" 


eo ei 6e% — 5e” — Get + 6e” 1 0 
L ð= 2. $0 = bec pce »]eo- lo 1 


40e? — 45e” —40e* + 54e” 
(c) v(t) = [30, 30]Te* + [—32, —24]Te' 
9r wu» UG (d) AB, = [—150, —150]T = 5[—13, —30]T = 4,Bi;; AB; = [—32, —24]T = 1[—32, —24]T = A3B; 


»1 TY 


—3e^ + 4e! || 4e — 4e! 
(e) b(t) = pce 4e-5t — 3e! 
(f) e(r)vo = [30e — 32e', —24e! + 30e*']T 
(g) v! = [-150e7?' — 32e', —24e' — 150e7?']T = Av, v(0) = [—2, 6j 


(h) $(0) = : d (i) X, = [15e ?' + 4e, 15e?! + 3e']? = AX), X; = [-20e^*' — 4e', —20e?' — 3e']T = AX; 


—5t t —5t t 
Oe =| sse cesse] xo [;]xo- fi] 
13. (a) v(t) = [—444e-?' + 398e^' + 35e?', 199e*! — 222e-?' + 35e”, —199e* + 333e?' — 140e?']T 
(b) À (c) v(t) = [398, 199, —199]Te^' + [—444, —222, 333]Te-?' + [35, 35, — 140]T e? 
(d) AB, = [1592, 796, —796]" = 4[398, 199, —199]" = A;B,, 
AB; = [888, 444, —666]* = —2[—444, —222, 333]T = A;5B;, 
AB; = [315, 315, —1260]T = 9[35, 35, —140]7 = 3B; 
—10e* — e? + 12e-7 26e* + 2e% —28e-7* 4e ™ 4+ de 
(e) $(t) = | —5e* — e” + 6e?! 13e* -- 2e? — 14e?! —2e ™ +. 2^ 
5e” + 4g?! — 99 —]13e* — 8e” + 21e 3e 7t — 2g*t 
(f) O(t)vo = [—444e?' + 398e + 35&?', 199e” — 2220-7! + 35e?! , —199e^t + 333e-?! — 140e?']T 
(g) v'(t) = [888e?' + 1592e^ + 315e?', 796e^' + 444e-7 + 315e?', —796e^' — 666e — 1260e?']T; v(0) = [—11, 12, —6]T 
1 0 0 
(h)¢(O)=]}0 1 O0 à) X; =[ 40e“ — 9e” — 24e, —20e*! — 9e” — 12e”, 20e” + 36e?! + 18e ?!]T = AX), xX, = 
0 0 1 
[104e*" + 18e?! + 56e?! . 52e” + 182% + 28e-*", —52e*! — 72e?! 42e ]T = AX, X, = [8e + 16e"! , 4e?! + Be, —6e77? — 8e ]T = AX; 
©) e' = [X}, X, X4] = [AX), AX;, AX3] = A[Xi, X2, Xs] = Ag (K) X?) = [1, 0, OJ", X2(0) = [0, 1, OJ", X3(0) = [0, 0, 1]” 


Exercises 12.9—Part A, Page: 297 


A k AF oo Ak tk 
2, Ae ay a = -(E5-) —e"A 4. ó(n- 


k=0 k=0 


4e! — 3e% — —2g +2e” 
6e? — 6e? —3g! + 4e” 
Exercises 12.9—Part B, Page 297 
: D4-:—20—-3in60-326 trit 24 4 (ADF t— 2h — $0541 x + dui a 
1 ~ i l : == T 
E mri -t -2 20 $t 3r c AC 4+ P 2r 1 


t—2)7 —20 — 31 — 2. 1432442 4+ DP 2r = 


-25-9t t AM 5t m" 
2, ana 0 - | ot df el (c) X, = [73679 + 4e!, 3e! — 3e-9]T, X, = [—4e! + de“, de“ — 3e'' 


+ ant [-986 PP — EM 3 —24t + 481? — 84 + 104 fe) Ast = [EH eme ou, 
| 8t—36?--630 —78^ — —23t + lr — BR g BETA a. ] e 15e? +3e —3e' — 20e 


15e -- 4e! | —4e! — 20e^* 4e^! — 3e* 4e? — 4e7 


1 = _ At -l Ll = = 
Cee) = pe +3e' —-3e — onal =o Pa = & +3e%  —3e* | =o) 


12e?! — 10e“ — e? 2e? + 26e" — 28e 
—5e*! + 6e? — e”  -14e7? + 2e?! + 13e^ 
5e“ — 9e? +. Ae — -8e?' — 13e + 21e7? 


12. (a) and (b) g(t) = 


Answers to Selected Exercises 


At —2t 
4e"! — 4e 
2e“ m 2e? 
3e?! Sas 2e* 


c) X; = [12e7? — 10e* — e”, —Se + Ge?! — e”, 5e” — 997?! + de" J", 


X. = [2e?' + 26e” — 28e?! , 14e? + 2e + 13e”, —8e?' — 13e” + 21e7?']7; X, = [4e** — 4e ?', 2e" — 2e”, 3e?! — 2e*]T 


—24e-?' — 40e* — 9e” 18e” + 104e4 + 5607 16e” + 8e? 


d) Ae^' — 12e-?' — 20e* — 9e? 18e?! + 52e*! + 28e! 


8e” -- 4e?! | = e^! A 


18e? + 20e + 366? — —72e?! — 52e" — 42e?! —8e — 6e? 
e? —40e* — 9e” — 18e?! + 104e" -- 56e? — 16e* + 8e? 


e)ó'(r) 2| e^? — 20e“ — 9e” 18e” + 52e” + 28e?! 


8e^ + 4e?! | = Ae“ 


e^? + 20e* + 36e? 72e" — 52e" =42e Z Bet — 6e? 


2t 


—e^?! — 10e7^ + 12e? 26e-** — 28e* --2e ? 
f) p] = e? — 5e ™ + 6e7# 2e + 13e — 14e? 
—9e? + dem" --5e-* — —13e7*' — Be 4+ 21e? 


Exercises 12.10-Part A, Page 299 


1 (a)x(r) = [(—6e" + 7e8)a + (—6e* + 665) B, (Je — Te*)a + (Te* — 689 )B]* (b) x(t) = all, te” +b[1, 1]Te8 


—4e + 4e“ 
—2e^t + 2e * zz $(—t) 
—2e^ + 3e? 


(c) Av, = [5. 2]T = Aivi, Ava = [8, 8|] = Xov (d) 0 in'both cases, as expected 


(e) Bases for the nullspaces are given by ([1, 2]"} and ([1, 1]"}. 


Exercises 12.10—Part B, Page 300 


2.(a) x(t) = [(—3e™ + 4)a + (12e? — 12e), (—e* +e“ )a + (4e! — 


(b) x(t) = a[—4, 1]Te?' + b[—3, 1]Te7 
(c) Av; = [—-12, 3r = AN Av = [3, =1]E = A2V2 


3e?)8]T (g) 


o 
[i 
= 
© 

Le 
UA 
Y 
© 
3 
UA 


-1+ 


E 


(d) 0 in both cases Al 
(e) Bases for the nullspaces are given by {[—4, 1]"} and ([—3, 1]"}. Pl 
(f) See (b). Y 
Exercises 12.11-Part A, Page 301 
2. x(t) = —7e"[1, 1, — 1] — 9e? [1, 2, 2]T + 13e'[1, 2, 1]? 
1 1 1 —4e' + 2e?! +. 3e! —2e* — e” 4 3e! euo e 
3. w(0)- 1 2 2|:;w(nw-(0)-1| 2e" — 8e + 6e* 6e —4e! e” 2e” —2ef |: 
—] 2 1 —2g? — 4e! + 6e% | —4e +e%+43e' —e! 4 2e 


V (r)y-!(0)x = [13e' — 7e? — 9e”, —7e?* + 26e! — 18e”, 7e? + 13e! — 18e*]7 


Exercises 12.11—Part B, Page 301 


A-51 


2. (a) à; = 6, vi = [-5, 1, 6]", A> = 2, v = [-13, 1, 66], 44 = 7, v4 -[ 4, 1, 6] (b) Av, = [30, —6, 36]? = Aivi, 

Av» = [—26, 2, 132]? = A5v;, Av3 = [28, —7, 42]! 2Aava (e) x(t) = aye [—5, 1, —6]T + ane” [—13, 1, 66)" + ase" [—-4, 1, —6]T 
(d) {—5a, — 13a; — 4a3 = —6, a, + a +43 = 8, —6ai + 66a; — 6a; = 10}; (a; = 22 d = 388 ay = 13); 
x(t) = —36-9[—5, 1, —6]7 + Be*[—13, 1, 66]" + 5e" [-4, 1, —6]" 

4e" 4 5e-6 Son $e? D e Bg m Somir _ te 
(e) $(t) = —e 8 pe" He" 4 Let — De® Le" — te 6 pie 

6e-6 € 6e" He” + Te _ 34e! -ie7" a He” + že“ 

(f) x(t) =[ 1456 gt + 665 q-6r ie EI gu En 76 ae gt Be, 392,6 228 qt | 319 gar] 


Exercises 12.12—Part A, Page 305 
i. Avi = [3, 3]T = 3v; Av; = [—3, 6]T = —3v; 3. A-3] = | 


Exercises 12.12-Part B, Page 305 


2. (442 —4 vi = [-2, 1", ao = 1, vz = [- 2, 1] (b) det(A — AD) 


2 4 2 
Basari 7 


= 224324 — 4 = 0; à; = —4, àa =1 (c) Making the rows 


proportional results in a homogeneous linear system which has non-trivial solutions if and only if det(A — AI) = 0. 


A-52 Answers to Selected Exercises 


(d) v; = [-2, 1)", v; = [-2, 1]. (©) = (72, 177), v; = {[-2.1]"] (f)1+1=2. (g) Avi = [8, —4]" = Xivi, 


-2 -Ẹ -4 0 
Av; = [- Ë, 1] = devo; rank(A — AI) = 1 and dim(nul(A — 241) = 1, for both k = 1,2 (h) P := i 3 Pars | 0 j 


T : T 
(i) Ay = —4, 0; = — arctan (4), u; = [2v5, -iv5] ,À) = 1,6; = — arctan (4), w = |: 185, & VI85] 


12. (a) ài =M 275, vı = [-5.1]" (b) det(A — A) = 22 — 144 +49 —0; 4 =7 (c) A basis for the nullspace of A — ÀZ. is: [-3. 1] 


: 
(d) [-3.1] (e) rank(A — 77) = 1, dim(nul(A — 77) = 1 


2. (442-2 vı = [1, -2, 2], i; = 1, v2 = [-5 L1] 34 =3, vs = [-$, S, 1] (b) det(A- 4D) = x? - 222 — 54-6 = 0; 
A= 1,3,-2 (©) rank(A — A4J) = 2 for each k 21,2,3 (vi = [1, -2, E], v = [-5, 1, 1J", vs = [-4, L1] © See (0). 
-à 0 0 
(f)PAP=| 0 1 0 
0 0 3 
Exercises 12.13—Part A, Page 307 
0 1 
1. x" +x — 12x = 0; x(t) = cie" + ce”; x(t) = [x(0, x'(0] = [cie " + cze”, cie + 2e56?] 4 M= E E A= —4,3 


Exercises 12.13—Part B, Page 307 


5 7 7 u 
—sP3— ¿P4 nP t Ps 


1. v= Px > v = PX,v = Mv Px’ = MPx > x' —PMPx;P- | | for any real values of p3 and p4 


P5 P4 
4. (a) x(t) = ce [- 2, 1] + ene [-2, 1T. (b) x” 43x’ — 4x 20 Ox) = Cie + Cee) = Cu 6 = -10 


|| no = [0, -i sint]" 


14. x(t) = [y(, y OJT; A = l 


2 
3 


Wir 


Exercises 12.14—Part A, Page 310 
2. ey, = [cos 3t +i sin 3t, —2 cos 3t — 3 sin 3t + i(3cos3t — 2 sin 3r)]* 


2 ; | 4-3; 
5. a-a [ta l Jose aan =| 5 5 | 


-13 -24-3i o q 


6. Complex roots of polynomials with real coefficients come in pairs. If a number r is a zero of a polynomial p with real coefficients, then its 
complex conjugate r is also a zero of p. 


Exercises 12.14—Part B, Page 311 


-3t ; 


—3t —3t oi 
E ae a, i ATA se Bar ET. » |e ^ cos3t  —e"" sin3t 
2. (a) à; = —3 + 3i, vı = [i, 1,453 = —3 — 3i, v =[-i, 1] (b) $(0) = Is abi : eed 


x(t) = [—6e^* cos 3t — 8e^?' sin 3t, —6e ?' sin 3t + 8e^?' cos 31]? 
(c) x" + 6x’ + 18x = 0, x(0) = —6, x'(0) = —6; x(t) = —6e~* cos 3t — 8e~* sin 3t; y = -ix — x => y(t) = —6e^ sin 3t + 8e^?' cos3t 


(d) fi, 1]! (e) xi(r) = [e^ sin3t, e~* cos 3t]", x;(t) = [e^ cos3t, e sin31]* (f) x, = [3e~* sin 3t — 3e~* cos3t, 

—3e^? cos3t — 3e^ sin 3r]’ = Ax), x = [—3e^?' cos3t — 3e~* sin 3t, —3e^?' sin 3t + 3e? cos 3t]! = Ax; 

(g) x(t) = a[—e~* sin 3t, e cos 3t]! + b[e ?' cos3t, e? sin 3t]’; b = —6, a = 8; 

x(t) = [—8e~*' sin 3t — 6e cos 3t, 8e~* cos 3t — 6e? sin3t] (h) à A (i) ia 
6 


-4 
-6 


p 


-6 -5 -4 


i "PE. : : ; T PME. 
12. (a) x(t) = ci [e* cost, —e* cost, 2e? cost — te” sint] c; [e* sint, —e* sint, že” sint + je cost] +c [-3e~, e~, 2e] 
(b) [—33e* cos t + 326e* sin t + 45e™, 33e” cost — 326e” sint — 36e™ , 52e? cost + 137e” sint — 54e~']! 


Answers to Selected Exercises A-53 


—4e* cost + Se + 38e? sint —4e* cost + 5e™ + 38e” sint 5e? sint 
(060 =| 4e* cost — 4e — 38e* sint 5e” cost — 4e™ — 40e sint —5e sint 
6e? cost — 6e™ + 16e* sint 6e? cost — 6e™ + 17e* sint e” cost + 2e? sint 

x(t) = [—33e?' cos t + 326e* sin t + 45e~', 33e* cost — 326e?' sint — 36e~', 52e* cost + 137e?' sint — 54e7]T 


Exercises 12.15-Part A, Page 313 
3. x — ax, + bx; = ae? v + b(tv + [1, 0]T + 3v)e? = (a + 3b)e?' v + b(tv + [1, 0] )e?', the coefficient a in (12.50) is now a + 3b. 
5. (a) u' — Au 4-4u 20. (b) u(t) 2 cie? + coe? t (e) x(t) = [u(t), —iu'(t) — tult)" = [cie? +c et, —}c,e E ice"t — loer] 


(d) cı = b — 3a, c2 = —3b 
Exercises 12.15—Part B, Page 313 


0 1 0 
1l. (a) (A2? 20 (b)y(r) 2 cie? ete? +t” (c)A-| 0 0 1| (dài;224;2252-2 
" ! —8 -12 -6 
4 
(e) rref (A 3-27) 2 |0 1 + |, dim(nul(A 4-2/)) =n — rank(A +271) =3—2=1 (f) [l, —2, 4]" 
0 0 0 
(g) x(t) = Ly, y’, y] = [Cei + eot + cst2)e?', (—2e3t? + (—2c2 + 203)t — 2c) + c3)e 7, (Aet? + (45 — 8c3)t + 4c, — 4c; + 203)e 7? ]T 


d= e” + 56te” 64te”™ 
- E —49te" e" — 56r et 


(cb =35,a =2;x(t) =a HeT t b[e™(—$r = 5) ie" 


|: x(t) = [-3e" — 40te”, 35te" --2e"]T (b) x(t) = a[—$e", e] + ble” (- 8t — 4), re"]T 


e? + 4te ^?! J tpe’ —4te—3t E tpe’ —fe ?t 
13. (a) $(r) = 4te ? ie ? p — Ate — Ste —te™ |; x(t) = [-1— 28t — 30, —28t — 3t? + 5, 6t + AT 
—tfe ^? te ^?! e? * 


(b) Does not apply. (c) Does not apply. 
(d) x(t) = a[l, 1, 0]Te* + b([0, 0, — 1]T + z[1, 1,0]T)e7' + c([1, 0, 4]T + £[0, 0, —1]T + irp, 1, 0]7)e* 
(e) a = 5, b = —28,c = —6; x(t) = [(—1 — 28t — 312)e^*', (—28t — 3t? + 5)e^?!, (6t + Aye ]™ 


27. (aA 22 (b)vi 2 [4, 1,0]; vo = [2,0,1]" (c) x(t) = avie” + bve” + c((v; — v5)t  [1, 0, 0] ) e? 


Exercises 12.16—Part A, Page 317 

3. If A= P-1 BP and B = Q-!CQ, then A = P~'O-'COP — (QP)-1C(QP). 
1 1 " 

4. Pa E MI = [ec + eco, —2e^!c, — 4e' c2]! 


Exercises 12.16—Part B, Page 317 


=4 -3 3 0| d B ox. d NA. 
2. (a) P= l | if D= j AJ (-b ar Arama + COs — Bae = 
( 15 te umo )b TA 48 rr 13 ae )d = 0, as -A T 4 FITT )a + (48 mE T 13 a ) = 0, 
i z a . . m . —3c -—4d|. 
(S erase | 4D H (48 =a T 134 = B;a = —4c,b = —3d,c=c,d=d,a=3,pB=-1;P= a d | 
D = E 1] (c) u(t) = [e "C, e*C,]" (d) x(t) = [23e C; — 4e? Ci, e C5 - C]? (ee; = 40; 305,6 = C5 + Cy 
—]3 -4 -—5 2 0 0 
8. (a) P= 1 1 1 |;D=] 0 -7 0 
66 —6 -—6 0 0 -6 


(b) x(t) = [-13e* C, — 4e77 C4 — Se Co, e” C, tem" C4 4- e79 C5, 668? C, — 6e" C4 — 6e Cy]? 
(c) x(t) = e^'c, where c = [—13C, — 5C; — 403, C; + C2 + C3, 66C, — 6C; — 6C3]", gives the solution in (b). 


Exercises 12.17—Part A, Page 321 


ky +k3 EN 3 
= mı my 2 2 
3. M'K= | | 5. c = iai ła, c3 = — ta + ta; cp = tbi + ib, c4 = — (bi — b) 22 


A-54 Answers to Selected Exercises 


Exercises 12.17—Part B, Page 321 


2 


po 


10. 


11. 


13. 


E J31bi Bla, . - V3lay —5 V 31bi 
(b) b = SEN Pise: 92 = Aa SENT 62 iby = 7481-62 


WEBI 0 
@D=| -— : 
0 4 _ 2/31 


(c) Use the uncoupled system to obtain the desired result; [—2.161349044 cos(2.894565524r) + 0.7953312575 sin(2.894565524r) + 
1.161349044 cos(0.9771508366r) — 0.3092034807 sin(0.977 15083664), 0.5958880704 cos(2.8945655241) — 

0.2192743508 sin(2.8945655241) + 1.4041 11930 cos(0.9771508366r) — 0.3738379071 sin(0.9771508366r)]" 

(d) | (e) + (f) 


-2 F 
= tI t I——— t 
05 2 4 6 8 1012 14 16 18 
(a) x; — x1 + 2x5 = 0, x1 + 2x1 — x5 = cos(t) (c) ! 
(b) [xi (6), xo(0]* = [4 cost — 1 cos(V3r) + 1sin()t, —} cost + isin()t + i cos(/31)] DAT 


—0.44 
—0.8 + 


siZ 


(a) mox — kx, + kx; = 0, mıx} + kxı — kx = 0 (b) xi(t) = eid eot + ese" + cae **, x(t) = 6 + ct — mlc4e* — “eye, where 


k + 7 k + : : 
im je The natural frequencies are 0 and ,/ "2 (e) u” = 0, y" + M2") y = 0; The normal modes are harmonic motions 


minm mom, 


with angular frequency 0 and VETE 


mim 


Make the substitution x = Pr in x" + Ax’ + Ex = F, resulting in Pr’ + APr’ + EPr = G > r” + PAPY + P^ EPr = 
Pg => r” + Dir + Dor = PG 


2 i2 i9 
(a) A:= 5 1 = h ; (b) P = È * ()P- l p 3l (d) v" + 11v + 11v — 0, u" + Tw + Su = —/2cost 
* p P2 =i luo 

(e) r(t) = [u(t), v(t)]" = [1.149933684c, e 9907417596 _ 0.1499336838c, e 919258405 + 0.1856953382 0,0 08074175965r _ 

0.1856953382c,e- 519258245 — 0.08702852689 cos t — 0.1522999221 sin t, —0.1267831698c5e-? 597492195. | 126783170c5e- 1112517807" 4 
0.1139605764c,e- 1112517807" — 0.1139605764c,e 9597492195 IT (f) x(t) = [0.8131259057c, e 93074175965: — 9.1060191245c, e~ © 192582405" 4 
0.1313064328c5e 9507417595: — 0.1313064328c5e- © 192582405: _ 0.06153846 k51 cost — 0.1076923077 sin t — 0.08964923908c,e 9 587482195: +. 
0.7967560202c5e- 1112517807! .- 6.08058229634c,e-1-112517807 — 0.08058229634c,0 5 557492195. —0.8131259057c, e-08074175965r 4. 
0.1060191245c,e-$.192582405' — 0.1313064328c, e 05074175965 4. 0131306432805 e 5192582405 + 0.06153846151 cos t + 0.1076923077 sin t — 
0.08964923908c,e 9887482195" +. 0796756020264 6 1-123787 + 0.08058229634c, e 1-12517807' — 0.08058229634c, e? 887482195r]T 


Exercises 12.18- Rart A, Page 323 


p 


Zig a ie" —1lgÀ 4 les 
a=] ? A, 


2 3 o a 2 
—2e% + te 3t le 3r 4 Ze” 
E 3 3 3 


Exercises 12.18—Part B, Page 323 


5 


3 et ple -=t let lgé-5t 
(a) x(t) = [irt 4 — Be 107,35 A 4 Be 367] (o = ji ue : PA || 
16 em EET 4€ Tie 
(c) x, (t) = [Ge + Lee + (Let — Leer, (3e — Bec + (1e + e)a] 
(d) x,(t) =[4 + ir— Ze, 44-44 Se]! f) 4 (g) 
(e) ci = —6,0 =8 : 


Answers to Selected Exercises A-55 


12. (a)x(t) =[- $ cost + 5 Z sint — 2e~* cos3t — De sin 3t, $ cost + & sint + Ze* cos3t — P$ e^? sin 3] 
—3t cos3 je k g aai 
(b) $ = ls ear - = coss (c) x, (t) = [e7? cos(3t)c, — e^? sin(3t)er, e^? sin(3t)cı + e^? cos(3t)c2]" 
(d) x,(t) = [4 sint — $ cost + 5 Xe" sin(3t) + £e cos(3t), A sint + = cos(t) + xe " sin(3t) — xe cosa] 
(e) c; = —6,0 = 8 (f) (g) f 


—L— 
-=$ c 


= 2 el 3e - 1 —3 
22. (a) x(t) = [e + e M e=! H cost $ sint, Se Pe ! ie — d cost — L sini] 


—525-3t —3t —D.-3t —5t m 
(bé = | eur. al > a k ()x4(0 = [2e + 3e- )ey + (2e 4-275), Qe? — Bee, + Ge — 267) 
(d)x,(t) =[- 5e? +e ET 


(t)! 


aid 577. 
sin f 2e E me *) * (9c; = -3,Q = 1 


3 x 
130 cost 


. 


"re  11e^* — 10e? 
(c) x, (t) = [C-10e7* + 1le™ Jey + (S679 — Beep, (—4e7? + 4e*#")e, + (11e — 10e?*)c; 

(d) x,(t) = [- IL o C720 — 3t + 127 } et a+ le ECT (e) ci 25,0 = —4 

(f) @ 


—10e7* E lle? 55 9—2t = 55-4 
28. (a)x() =[—3r + 2 + Be — 347,1 2 pe +3le*]' (b)¢= | i ] | 


7t 7t 7t 
113 576 a Tt 4 0,7 lé 80 — 358,,7: | 31,777 _ |e" t 56te 64te 
34. (a) x(t) = E: id x bel pe. a oe TE ae ] (b) = | —49re"! e" — 56te 


(c) x, (t) = [(e" + ate + 6Ate! c), —A9te" c, + (e" — 56te7')c;]? 


T 
(A) x,() = [S5 + pt — See" pre c e ime] 
(9c; 22,0; =—1 (f) ut (g o : 4 $ 8 10 m UL 
104- 4 
5+ -4+ 
0 1| mt -6+ 
-54+ -8+ 
-10+ -10+ 
Y 
Exercises 12.19, Page 327 
di 
2. (a)Ai2 =5 xS; 7; Saddle (x) = ete [- 3 slg pnt ci HUE 
(c) xi (t) = [C-414/37 + De6*5»r (7$ — 1/37) + 4 013 + /37) 37e d 4 + 1/37), C0 437 e pete galt +f lI SY 


xo e [va b MC 4 1490 + C3 + TE e + SD GST ed pee + (73 + VFI) 1e 6-9 
x3(t) = [G14/87 — Deeg — 1437) — 4:01 + 57) 4/3166 + 34/3), Gg - DeGt/ hr. Tans vaya al P 


A-56 Answers to Selected Exercises 


xr) = [C 3/37 — er —3 — 1/37) — 173 + VED /37e 8-50 (L5 4. 1/37), (- 4. /37 — Lety — A (3 4 37) /31e 6-/500]T 
(d) (e) x! 29x — 3y, y! = —7x + y; (£) y 


Check your directions, by looking at (f). 


gd- 
(g) Generate, and plot the separatrices 
eGt F pl 14/37, — 1", gie. - _ ! /31, iy, 
4 T 
r 


e6-v [$ = 1437, ~1]', e6 vm i 


Exercises 12.20—Part A, Page 331 
1. A12 = £37; Center; Orbitally stable y 


Exercises 12.20—Part B, Page 331 
- (@) diz = $ + 3 V145; Saddle (b) Unstable (c) x,(1) = cie /2€1/2485« [15 — 1/145, 1]" + cze- 1/215 [15 4 1/145, 1] 
(d) xi (t) = [0.7076136993¢7520797290 + 959538630086 452079729. 0, 956750139207 52079779? + 0.04324986086274- 5207972900) 7, 
X2(t) = [—0.7076136993e797079729% — 0.2923863008e~452079729 | _0.9567501392e7 52079729 _ 0.04324986086e-^- 5207912901 sea (t= 
[—0.7076136993e79707°729% — 0.59538630086—4520797290!. 0). 9567501 392¢7-5207972901 . 0.04324986086e 520797290 TT. x(t) = 
[—0.953295897367 520797299 +. 1.95359589779—4520797290....1 288932059¢7-520797290t 0.28893205866 4520797290 ]T 
(e) A -0.2 -01 0 O01 02 


Ae 4 o i "7 
[lim,., x1 (t), lim... 5, y1(0)]* = [oo, oc]"; [lim,.0X2(t), lim. ..0y2(t)]" = [oo, oo]"; [lim,, xs (t), lim, y3(0] = [—00, —oo]!; 
(lim, 0%4(t), lim;—..0.ya(t)]’ = [—00, —oo]" (f) See (h). (h) y 

(g) x’ = —6x + 10y, y' = —2x + 9y; DA 
Check your directions by looking at (h). LEE 


A-57 


x=20,y = 14 


, 4) Node in. 


fg yat 
T 
(4 
cı cos(—(1 + ci)t + c3); 
+ 


H 


y 


2) Saddle; 
), x(t) 


5 


(0, 
(h) (t) 


y(t) dt. Now solve for 


(—2, 1) appears to bea center. 4. 


Answers to Selected Exercises 
The y-population will vanish. 


T 
0 


S 
cı sin(—(1 + ci)f +c 


1 
2 


Snes At 
SS /ff 
SS 
SA 

SS 
SS 
San] 


IIRA 
LT 


2777.6 
(0, 0) Node out; (2, 0) Saddle; 


(f) It is an outward spiral. 


LLL 
a7 


er for the non-linear system. 


(d) (0, 0) Node in; (3, 0) Saddle; (0, 3) Saddle; (18, 15) Node out. 


| 
ER em 
ll E 
e = 
E 5 
S E 
* a 
o uo} 
= S 
bs 5 
NVLULZL444440 \\ [5 eenaa 
g NULLUM M = Seneca 
5S NIALL TLL M a BRASS 
TIPO G 4934 +\ NN 
z ML INS Hg AUAUNNN o) NS 
g LL IN mr LLL INN Ss > t 
o zzzi NS mme !HLLLMNNS ` 
o & ZU NNSS [INNS 5 PER 
zi ZEEL AN NSS S e ASS 2 ine 
"3 = ALTRI he = N 
© o 277A TAN Y) NNNSSSSST—— [^ 9 N 
5 3 22277 TV ANNSNNNA DIM 2 o0 IN 
2 Es 222777 1 E ENNAN YZ = N 
© 5 — LA ANNSNSNST Z- [5] E (maaan 
o og —À 4! / ANON fom o n eect lta, I Mw 
Es oO TT A INN f n aon 
= a a RN Ha a a Sr e e - 
Q ci ——— MN V OQ aa 
E S Sat = = "Bp C 
B 
2 [i Ves SNNNN : S E = 
3 o T $ eb © 
a & 9 8 T | a 8835 
a "T" 
«€ & H ow ae SAA EE o os Wm 4 
E 5 M 29 o 
v o oo NI o9 c § v 
D S o oD - on = ^ eb Il 
S "bb i S ow = WS S 98g S 
S 2 B. A —Mee€s€eMT Rm ^? o0 A = 
JS 9 ua eo is OE ow E 
* d a Pc c TS S a a B ale 
- c O *- N CB SSAA | + o + f——À 
E Ei 3 B - M Ni. E lom # =O 
S ae E S c e MM MÀ X" EA & on = Ls 
ES SR o 0 0 EY ——— 1 ll — Sici: E: tog 
| — 5 [D 2 e L = 9 [ on 
rt MR. o ms w a A a A | 
NAN D A f > m EL. N = E 
a 2 ad S dco? des 5 
v z bb 2S c = o0 @ ta 9 v 9 oc 
o - eb Y o = o ooo Q O — o o =< n: Q 
'Ü Be ono C 5) EL (a Boe = Ss 
w = v > S = 2 2 9y% SP = 
u a " Y . 9 . 
M o- [T2 M y N 4 ec "M oM 
Ld h HJ ud 


58.37470931, 4.62529069, node out 


3, —15, saddle; (0, 3), A = —6, 9, saddle; (18, 15), à 


2. (0,0), 4 = —3, —9, node in; (3, 0), A 


A-58 Answers to Selected Exercises 


Exercises 12.23, Page 338 


3. x! =y, y = _ by .. gsinx 


xL z > Equilibrium points are [nz, 0]. Use b = 1, L = 20, g = 32, and m =} to generate a 


plot. y (2nz,, 0) represents a center, while ((2n — 1)z, 0) represents a saddle. 


\AN\AN Bede y 7. 
XXE 
SANNA) 
ry * ` 
dy : a Nx 


» 
1 


CHAPTER 13 


Exercises 13.1, Page 341 


1. (a) [[1, 3.141592654], [1.1, 3.422941139], [1.2, 3.719500953], [1.3, 4.026698028], [1.4, 4.341088334], 2 
[1.5, 4.660005718], [1.6, 4.981341922], [1.7, 5.303404449], [1.8, 5.624821973], [1.9, 5.944479696], “+ 
[2.0, 6.261474045], [2.1, 6.575080133], [2.2, 6.884727770], [2.3, 7.189983290], [2.4, 7.490535351], of 
[2.5, 7.786183465], [2.6, 8.076828413], [2.7, 8.362463932], [2.8, 8.643169275], [2.9, 8.919102336], + 
[3.0, 9.190493146], [3.1, 9.457637600], [3.2, 9.720891309], [3.3, 9.980663530], [3.4, 10.23741113], ST 
[3.5, 10.49163258], [3.6, 10.74386194], [3.7, 10.99466290], [3.8, 11.24462287], [3.9, 11.49434707], al 
[4.0, 11.74445278]] £ +—+—_}—+—_}—_ + > 
0 71 15 2 25 3 35 4 


The results of the rkn4 solution and Maple's solution are indistinguishable. 


(a) y(t) = (F25 cos V191) + gpa V19 sinG V/19r))e-9 + (HZ — 21) cos(3r) + (— 25 + Zr) sinn) 
(b) —9.59243971344358, 0.347498327359458, 0.352966462263838, 0.354547353937737, 0.354650900447056 
S Jer appro 


9.94709732136080 


0 

1 0.114548488924224 , clearly the method is fourth-order. 
2  0.432933287266304 
3 
4 


r2 


(c) 


0.451600299970560 
0.439580764798976 


Exercises 13.2, Page 342 
| 3j 


12 


N 


9 


a ee ae T 
[^r 


u 
1 
t 


CHAPTER 14 


Exercises 14.1—Part A, Page 348 


L y —-2fh 2 — 5 t - APP + Le? + O07); y, S Af, Ay, = DP — 152 + at^ — 0? + oe!) 


3. 2t'r? tr 4 500p 4 71090 — er = Setting the coefficient of t” equal to zero yields: 2r? +r — 1 = 0. 


8. 12a, +2 = 0; 32a) + 4a, = 0; a, = as. di = i 


Exercises 14.1—Part B, Page 349 


2. (a) 1 -2t — 3? - 5? Ttt — S5 (b) yexact = Š cosQr) + + sinQr) + Bet cos(3t) — He~ sin(3t) ~ 1 — 2t — 37? 4523 — ate XD 


15 
oo  cos(imm)2";m 


(c) same as (a) (d) same as (a) (e) Hint: Write cos(21) = PAM ae (n? + 3n + 2)Gn42 + Qn + 2)4,44 + 10a, = 


cos(4nz)2" 


n! 


Answers to Selected Exercises A-59 


(f) same as (e) y 


(g) same as (a) 1 


(h) (See plot.) 0.54 
0 MR t + t 


1 
" D 
dx i 
1 

[ 


5 (a)? 29,2 635,3 859,4  3061,5 " du " : 
12. (a)2-t ut 2541 amt rd (b)sameas(a) (c)same as (a) 


(d) 18a, 9 + (5n? + 6n + 6)a, + ( C91? — 26n — V1)a,44 + (Tn? +21n -14)a4,5 — 0. (e) same as (d) (f) same as (a) 


27. (a) y" 4 G ily’ + ( z2 - 2ly 20 (b) r? tr ; ira = i p=; (c) —8na, + (—6n? + 5n + 11)a1,, = 0; 
d 


(-8n — €)b, + (-23 — 6i? — 20n)b,,, 20. @ (r) = Ss x) = PPA- Sr + BSP — Ep Set US 


; 7/3 68 136 ,2 544 ,3 | 544 ,4 2176 ,5 6 _C20+0(t9)) 
(e) y(t) = C1" a go! T 21t — gst + gos! mais! + OED + 


d 5 
2835! ia 9963! T7313! ) 


42. (a) y’+(-3 -2)yY4+G+3py=0 br’? -3r+2=0;0=1,6 =2 
(c) y(t) =_C1P (1 - it + O(t$)) + _C2(t In(t)(—3¢ + 2g? + O(t®)) +t 4 à 21 72 2.73 di 2 d A + O (19) 
(d) (—3n + 3)a, + 2n? + 6n -4)a4,, 20 (©) yt) = P — iD (f) (6 — 3n)b, + (2n + 2n7)b\,, =O (g) Does not apply 
(h) (6 — 3n)b, + (2n + 2n?)b,,,, = 0; Choose bo : 0, by := 1; t(t — 317), which is essentially y; 
OyO = InP — 30 — 1 ($ EdP + bP — à — 3.6 — Qo Observe that d; (P — ££) = — 70-2? is a multiple of the 
first solution of this differential equation and can be safely omitted or included with any choice for d». It turns out that Maple makes the choice 
d; = ? resulting in: In(t)t?(1 — $t) — it — 31? + $8 — $65 — 3; — 4515; Observe this is the answer obtained in (c), with. C1 = 0 and 
C22 =}, 


Exercises 14.2, Page 352 


-t ip 3a 3 1 
e'"(1 zd 55m s + O(3)) . 2 ^ 87+917 f i 
4. y(t) = L 2r t f 5. (a) Observe that f (r) = 9555 and f (+) = —— HH The zeros of the denominator of 
t T3 T: E: J or 
"EI ia A... 1 i /119: ^71 3 . . . a cadi c a 1/2 2 eile £ Š 
(+) are: t = —— + —iV/119; So f(-) has a Mclaurin series with a radius of convergence 2. A similar argument holds for g(t). 
JT | 16 — 16 IM; à E 2 E 8 
: 6)-8-9 3 251 931 1079 1 1). 204921 _ 1 , 151 _ 851 225 1 Tii 
(b) f(t) — 4243148 2 Se 32 #2 + 128 #3 + OC ); g(t) = 42431438 2 | 8r 32 12 128 13 + OC E 
3 25 5 55 1 k E 246 — 336635 1). 
a —3,b-2ia2-5,bh-5 (c) {A=—l,a = 10}, {a=—2,A=—-5} (d) y(t) =e a d is 2 na 3); 
=1/2t 4763 1 , 28,468,561 1 208,343,062,235 1 
e (Pc a t 499» P) 
y(t) = E 
155/8 
a.) 3 E, ed er l T 5 n . o 
(e) p(x) = es q(x) = —— EE ; Observe that p(x) has a singularity of order 2 at the origin. 


Exercises 14.3-Part A, Page 354 
1. [—3.179841638, 1.260128370, 1.919713268]; [—2.899262132, 1.449631066 — 0.2330036097i, 1.449631066 + 0.23300360971] 
5. x=1+a+3a? + 12a? + 55a* + 213a? + O (a6) 


Exercises 14.3-Part B, Page 354 


1. (a) (See plot.) (b) 1 +a + 3a? + 12a? + 55a* + 273a5 


. 3 5 
2. (a) x 20,1, —1 (c) ^ (d) xy 2 0 +a +a 4- 3a 
3 5 
1 xX. =) ia gd ia? at ža’ 
oan x = —1— ja $a? — ja? + Bat — 3a’ 


t + Ia 


m 
0.2 0.4 0.6 0.8 1 (e) same as (d) 


Answers to Selected Exercises 


A-60 


8. (ax 214 ae à? + iaoe + Sateh I (b) 


Exercises 14.4—Part B, Page 357 
T 11+ JT — 4a)eV2C V-V1-4a) " l4 4- JT — 4a)e-V20-- 1-48) 
. (a) y(t) = 
i 2 V1 — 4a 2 /1 — 4a 
(b) 1 - (—t 4-1 — ea + (2t + 1? +3 — te^! — 3e7)a? + (—6t + 30 — 1P + 10 —e "(+ 300) — 10e —3e7'r)a? + O(a*) 
(c) same as (b) (d) (See plot.) mi (e) (See plot.) at 
a ee ee LM en t 
-47-2 2 4 6 8 10 -4 f2, 2 4 6 8 TO 
j T f -24 
3 a 
i -a4 # -at 
EA à -64 
3 s 
P T i -8T 
å 2194 4 _iot 
Exercises 14.5, Page 362 
5. (2T —— aT ra? AIO 4 2 rat A? 35 ma’ A® St ma? A* inas? +2r (b) (See 14.39.) 
7. uj (1) = (w, Ar — $ Ar) sint — $A? cost + 4A? cos(3r) 10 (a) xo(t) = A cost, xi(t) = —3A? cos(2r) + 5A? — 1 A? cost, 
x(t) = 4; A? cos(3t) + GA cost + Z4: sint + iA cost) — 4 A5; Clearly x2(t) contains secular terms. 
(b) o = 1— 3A?a? + $ A°a?; U(t) = Acos t + (14? cos(2t) + 14? — 14? cos t)a + (3; A? cos(3t) + 22 A^ cost + ; A? cos(27) — 
1 A5)? + (-$ A* cos(2r) + $A* — d; A* cos(4t) — 12 A* cost — i A*cos(3t))a? (c) Use t = or with c as in (b). 
(d) x Yes, the dependence is clearly visible. (e) 2x 


e Vt /4 — a? sin(1A/4 — a?t) 
a—2 


Exercises 14.6, Page 369 
3. 0) e 1"! q cos(1 /4 — at) 
3. (a = ; 
s a—2 a—2 


e7!/2at cog( 1/4 — a?t) 


(b) y(t) = e-!?*! Ao sin(t + ġo) 
(c) With a = 0.1 and the initial conditions: 1.450000000e'-9000000) sin (t + 38 46012460) 


—u — au?, u(0) = 1, v(0) = 0; equilibrium points (0, 0) and (-:, 0) (b) (0, 0), It is a center in the linearized system and 


6. (a)u’ =v, v = 
can be either a center or a spiral in the non- linear system; (-i, 0) is a saddle in the linearized system and will be a saddle in the non-linear 
system. (c) yp(t) = cost + (2 cos(2t) — 3 + 1cost)a + (3; cos(3t) + 27 cost + Stsint + 5 cos(2t) — 1a? 
: 5 cos(2r) E Da? + G cos(21) — 


(4 cos(3r) + 22 cost 4 2 + ug cos(4r) + 


432 
S 43. 
2 q* — 32 ))a + 


(d) y, (T) = cos t + (—4 + i cos(2r) + } cos t)a 

ag COS(3T) + 15 cos t)a*; y, (t) = cost (1 — $a? — $a?) + (-1 + EeosQt(1 — $a? — 4a*)) + + cos(t(1 — 3 

(4 cosQt (1 za. — 5a) + =) cos(t(1 ža’ ga) + E cos(2r(1 — 3a? áo) ia? E cos(2t (1 za? 2a?) z 
I2 cos(t(1 — 5a? — a2))a (e) Aosin(t + o) After implementation of 


1 B a 15 28 l i 
33; Cos (4t (1 14 gt 38 cost (1 — Fa" — 45a) + we 
the initial conditions: yx g(t) = sin(t + =) = cost 


* 


Answers to Selected Exercises A-61 


(f) xD (g) A Poincare A Lindstedt A Krylov-Bugoliubov 
A Numeric 


x(t) (h) v 


Numeric 


4 
2222773 


Miss 


CHAPTER 15 


Exercises 15.1—Part A, Page 374 
5. G(0,t) 2 t(H(t) — 1) = 0 fort on [0, 1]; G(1,?) = 0; y(x) = fy G(x, D)? dt 2 —Lxcdx 


6. u(x) 2x The temperature varies linearly inside the rod. 7. u(x) = $x$ - t + ix A 


Exercises 15.1—Part B, Page 374 
1. (a) yi (x) = e™, y, (0) + yi) 20. (b) yo(x) —3e7**! 22e7?, (1) — (1) 20. (©) W(x) 22e? 
(e) y(x) = ix- 34 Bel de 4 iet! 
(—1 ee elje itx (e+ 1)e-i*32x 
—1 + e^? -1 + e!/? 


2. (a) y(x) = (b) E (c) y, (x) = cie? + c; e??* 


(d) -1 = c; +e, 1 = cie + c5; 
LI AM (+e) 
T ~ eee 1) 0 7 ee -]) 
age 
—1 + e!/? —14 e 
I2. (a) y(x) = cie" + ere? (b) (10 + 1997/8) c, + (A + 9309/20, = 8, (2 + Bec + (8 + 189/2)c, = —4; 
5344e?/? — 5664 1256 + 2328/5 
Ol = ~ 71972 - 1438 + 2709775 4 38862955 ^ T —1972 — 11438 + 27090778 + 38866378 
(—5344e?/? — 5664)e7/8" (1256 + 2328e7/5) 9s 


(c) YO) = —1972 — 114307 $ 2709078 4 3886635" —1972 — 11430? + 27097755 + 3886078 


(d) oj 92 04 06 08 x . (e) (0) = —0.6477974718, y(1) = —0.7448917049 (f) Maple did not succeed. 


A-62 Answers to Selected Exercises 


53 1 (es sg 8 4 62)e-1/5+1/5x (— 2% 4 Bel/5)e-1/5+9/8x 
P TES un > 81 ! 
22. (a) y(x) = 81 i g` + —1 + e/40 A —] + e37/40 
(b) op 02 04 06 08 1 
i — & 


—0.0002 4- 


—0.0006 + 


—0.001 4- 


—0.0014 + 


Y 


53 


ia "T 
(c) yx) =F + ix + cye/5* + eze! 


(— 


53 9/8 |. 624 ,—1/5 62 | 3361/5)6-1/5 
"LM udin at gee 


OM 20 £ m 25 4 n 9/8 et 
(d) ap ity + =0, si T Cie T C2€ zu o - —] 4 e/ : €2 —2 ea 


(e) same as (a) 


i (—e1/5t J e? 8 (e! /5+1/5x __ e 9/8*9 Sey 0 
<x 
37 —g53/401—9/8 ce 553/401—1/5 Szar 


(£f) G(x, t) = 


/5. 9/8. —1/ —9/8--9/8. 
i (—eV5x + g9/8x Y (e 1/51/51 _ e 9/8 8t) 


37 e5340 -9/8 | 253/401-1/5 t<x<l 
(g) y(x) = ap n + 9x = 53e-31/40 _ Oxe- ^ 40 — 53e/5x ds 5369/8x-31/40 at. 62e79/84+1/5x _ 62e -9/819/8x 
32. (a) yy(x) 20 (b) v(x) = x + Be cos(5x) — ze 7*sin(5x) (C) Ye(x) = x + cie cos 5x + coe sin 5x 
1 —1/27 X I 05. d i 95: mie OF us A 91/20 — 
(d) xz +a =1, as T cef Pm) — —1 (ec 20 0 36 m3 36 + HE “cos 5x — 55 sin(5x)e" xx 


-i sin(5x)cos(5t)e?"* O<x <t 
(g) G(x, t) = Pan ; ya) = n G (x, £)0.1 dt 
-i sin5t)cos(5x)e? ^" t<x<1 i 


Exercises 15.2—Part A, Page 378 
1. y(x) = —0.02352941176 cos x + 0.1058823529 sin x + 0.02352941176e~ cos(3x) + 17.95594223e™ sin(3x) 
Exercises 15.2—Part B, Page 378 


y(x) = Qa + b)e™ — (a + b)e~**, where a = —0.1411201300, b = 0.9712219318 


9 94/3 a? he 9 5-2 , 1819, ELE 
- (a) y@) = xe? LC ub Ua + ie iam ote 
S —e + e =e pe" 
(b) (c) y'(0) = —0.019379023 
(—e* + UE (et! — e 44r ü 
x —e1/31—4[3 + e7/3t 1 Sre 
(d) G(x, t) = 
(e! — ear) ( —g- lx Ji. e 44x T 
—e1/3t—4[3 + e7/3t-1 bm 


(e) y(x) = — ay (19e7! + 30xe-! — 19e-45 — 3Üxe i — e i + 1819610/5x-4/3 + 4993x—13/3 — 49910/3x-13/3 _ 99909 77/3-3x 4 
900e-7/2*10/1e7?1*1 /(e713 — 1) (f) yx) = xe + 35:67?* — 8.052974063e* + 6.0318629526*/?* 
(g) [[0, —2.], [ 35. —1.988697965], [+, —1.944083449]. [ 5. —1. 257855410] [ 2, —1.720136278], [+, —1.519423766], 


10° 


[5.—1.242064045], [5 —0.8720094058], [$, —0.3903906907]. [ 7, 0.2249502508], [1, 1.1] d) |! 


Answers to Selected Exercises 


(Bel/3 — 1 — 4163/2 4 6e77/6+3/2x 4. 123e!/3+7/6x — 6e-7/6+1/6x)e—* 


2 (a) y(x)= L 


21 A 
b) 2054 (e) »/(0) = 0.082870995 
nit el/6x-1/6+1/6t (p1/3x — 1) (e71/3+1/3t _ 3) | 
: = gge 4 52/517 1/2 O<x<t 
i (d) G(x, t) = el/6x—1/6+1/6t (e1/3t — 1)(e71/3+1/3x _ 3) 
5 t<x<l 


—3e2/3-1/6 4 ari 


+ + + I x 
0| 93 o4 06 08 1 
e) y(x) = ze? _ 3e—1/6 + 41¢63/2*-1/2 = 123e7/6:-1/6 — 6e3/2x-5/3 + 6e7/6:-5/539 7x16 /(—3 4 e71/3) (f) ge^ — 0.584e!/2* +2.537e1/& 
(g) [[0, 2.], | 5, 2.008147986], [3, 2.015906774], [ 3. 2023168603], [5. 2.029825774], [ 5, 2.035770074], [5 , 2.040892224], 


2 2.045081350], [ 4, 2.048224471], 3.. 2.050206003], [1, 2.050907264]] (h) 
L 10 5 10 2.05 


2.04 +- 
2.03 +- 
2.02 4- 
2.01 +- 


0 + D t t 
02 04 06 08 1 


27. (a) y@)=x(imnx +4- $13)4-1(-2- 33) (b) (c) »'(1) = 1.264061175 


> x 


(d) ye(x) = $In(@x)x — ix cix + 2 (9 —} +e, +o =—1, 2n3 — 3 4+3e; + io 2050 = 2 - 103,0 = 103-5 
1 (2-1)(02—9) 

oa 1 ane) (cx: 

(D y(x) =i max- ix +G- S n3 + 3507-1 (gGQ, n1, 7 


4 16 NET E 
LONG £l] 
16 x 


h) y(x) = — 2b — Sines sei 32469: in3-9im3 (p (1, —1.], [1.2, -0.7681114772], [1.4, —0.5608240471], [1.6, —0.3651906372], 
(1.8, —0.1744139613], [2, 0.0152936615], [2.2, 0.2061271646], [2.4, 0.3993872182], [2.6, 0.5958490489], [2.8, 0.7959681174], [3, 1.1] 


G) (3xInx — 0.1179694045) x — 9882099955. (k) 


0.5 
0 > X 
-0.5 
-1 
37. (a) y(x) = $ cos2x — i3. sin 2x --cie" +ce*/™ (b) [is — 456i — e, — 33 cos2 — ag sin2 + 47cye! + Zoe? = 4, 
zs + 15c, + Be, + I cos2 — 2$ sin2 — 13cye? + 4ere*/? = 2}; c; = 0.0000259604620, c; = 0.1030061702 
(c) y(x) = Ay cos2x — 133. sin 2x + 0.0000259604620e” + 0.1030061702e*/ (d) y(0) = 0.1088376459, y'(0) = 0.1012388132 


(e) Maple fails to find the answer 
0.4 
0.35 
0.3 


0.15 


A-64 Answers to Selected Exercises 


(f) [[0, 0.1103462696], [ +, 0.1214549006], [ +, 0.1346006006], [ +, 0.1502529820], i 


2, 0.1689416342], [+, 0.1912788802], [2, 0.2180092986], [ 7. 02501151570], 
4, 0.2890393433], [%, 0.3371563605], [1, 0.3987686582]] 


rir. 


+ : ; 
O 02 04 06 08 


ell 
1 


Exercises 15.3—Part A, Page 385 
2. do =(—2+e)x +2 3. R =2b + 6cx — e” 5. yo(x) = (—2 + e)x + 2 + (—108e + 294)x (x — 1) + (70e — 190)x (x? — 1) 


Exercises 15.3—Part B, Page 385 


l; 


3. 


(a) yc (x) = 0.718281828x + 2. + 0.3703407888x (x — 1.) + 0.3147964947x (x? — 1.) 
2425 55 Ly 1 Q425e5--28799/5* ^ 1 (2879 + 2425e7/5)e8/ 


(8) YO) = coi; + 288" * 24^ — 6912. ep e85 "6912 —e5 elis 
(b) R = 24c2x? + (—165c5 + 24c, — 1)x? + (—134c, + 126c; + 24)x + 105c, + 55e; — 55 
(e) (d) (e) yı (x) = x + 0.1714535005x (x — 1) + 0.5029923293x (x? — 1) 


(£) V; (x) = 105 — 110x + 24x (x — 1), vo(x) = 150x — 165x? + 55 + 24x(x? — 1) In either case the equations to be satisfied are: 
(=e » 22043 , 46913. — () 170.761, , 33,163 90670 _ ¢ 1,534,194,599 Sep ARUM] 
10 “2 10 B L0 eg CUR to Cl 30 — ~» “l — 8,948,167.223' “2 — 26,844,501,669 


(g) yo(x) = x + SOB y(x — 1) + B939x (x32 1) (h) y, (x) = x 4-0.1221067873x (x — 1.) + 0.5131101363x (x? — L) 


253,051 253.051 
(i) y4(x) = x 4-0.1167120326x (x — 1.) + 0.4997545775x x? — 1.) Gj) ys(x) = x + 0.1421180937x (x — 1) + 0.5009487037x (x? — 1) 
(k) AÀ (1) 0.00003743513267, 0.000002775013713, 0.000002717524599, 


0.00002709478662, 0.000002436542892 


wil (m) u = 0.2613605398, v = 0.6973911555 
044- 
0.2 
0 02 04 Y 08 T 
(a) y.(x) = (oro Doo Ll C236 = 800 + 30 77e — 1 Qe" — 3el”? + 800e 5 — 
a) Ye) = (7 45* — 800 — 800 ed) — eT) 800 el — e(-1/3)) 


(b) R = (—7c; — 27c;7) sin(a x) + 120c: cos(2zxt x)x. — 108c; sin(2ztx)x? + 60 + 60c; cos(ztx)z — xe™ — 7x — Tes sin(2zt x) 
(c) (d -1 305 0 o5 1 (e) y1(x) = x + 0.1971999664 sin(zt x) + 0.0214251537 sin(2z x) 
€i 


(£) v, (x) = —27 sin(ztx)z? + 60cos(zx)z — 7sin(ztx); W(x) = —108 sin(2zx)z? + 120cos(2z:x)z — 7 sin(2z x); 

iz Ryg dx = 0 => [—9507.452925 + 55160.75689c, — 63955.03656c; = 0, —1242.363810 + 646636.8915c; — 63955.03650c, = 0], 
[ci = 0.1971999667, c; = 0.02142515383]; = = 0 = [110321.5138c, — 19014.90584 — 127910.0731c2 = 0, 0.1293273784 x 107 

c» — 2484.72762 — 127910.0731c; = 0], [c; = 0.1971999664, c; = 0.0214251537] 

(g) yo (x) = x + 0.2395646350 sin(z x) + 0.03789949370sin(2ztx) (h) y3(x) = x + 0.2525194691 sin(x x) + 0.02413669873 sin(27 x) 
(i) y4(x) = x + 0.2186372303 sin(zx) + 0.02348802950 sin(2ztx) (j) ys(x) = x + 0.2403681672 sin(x x) + 0.03406883470 sin(2zt x) 


14. 


20. 


Answers to Selected Exercises A-65 


(k) A (1) 0.001114407803, 0.0001103894851, 0.0002258804084, 0.0003948232125, 0.0001027296791 
Z (m) u = 0.2722753697, v = 0.6626012022 


i t i >x 


0| 92 04 06 08 | 
(a) y«(x) = 0.1040293916 cos(x) sin(2.141592654x) + 0.1040293916 sin(x) cos(2.141592654x) + 

0.1943028548 cos(x) cos(2.141592654x) — 0.1943028548 sin(x) sin(2.141592654x) + 0.1249244088 sin(x) cos(4.141592654x) — 
0.1206534966 cos(x) cos(4.141592654x) — 0.1249244088 cos(x) sin(4.141592654x) — 0.1324728877 cos(x)e- ^^ + 

1.207571974 sin(x)e^-^* + 0.05882352941 — 0.1206534966 sin(x) sin(4.141592654x) (b) R = (17c; — cix? + 2) sin(x x) — 

i sin(3ztx)z? + 16c; cos(2zt x) — 4c; sin(2zt x)z? + 4 cos(27tx)z + 8c; cos(ztx)z — 1+ 17 sin( irx) + 17c: sin (27 x) 

(c) (d -1 -05 0 os l 


DES 


H ! 


0.5 


pa 


-0.5 
-1 


(e) y(x) = sin(37tx) — 0.2148730324 sin(zt x) + 0.002492468535 sin(2zx) (f) En Ry, dx = 0 => [341.2486116c, + 74.11231366 — 
315.8273408c; = 0, 1515.948993c, — 315.8273408c, — 71.64123363 = 0], [cı = —0.2148730322, c; = 0.002492468591]; as =a 
[148.2246273 + 682.4972230c, — 631.6546816c2 = 0, —143.2824672 + 3031.897986c2 — 631.6546816c; = 0], [cı = —0.2 148730324, 
€; = 0.002492468535] (g) y2:(x) = sin(ġ xx) + 1.857450548 sin(ztx) + 1.733129877sin(2zx) (h) y3(x) = sin(Àzx) + 

8.672870801 sin(zx) + 4.347237362 sinQz x) (i) y4(x) = sin(x x) + 1.961001914 sin(x x) + 1.247392042 sin(2z x) 

(D ys(x) = sin izx + 4.311186561 sin mx + 2.307418075 sin2zx (k) at 


I 


ol 92 04 06 O8 | 
(I) 13.44952427, 3.725889204, 12.14315159, 3.874087058, 0.5505755259 (m) 0.3287755369; 0.7135107996 


(a) y.(x) = 0.02958579882 cos x — 0.07100591716 sin x — 0.02958579882e!-500000000x + 950486077] 1 5x —1.300000000--1.500000000» 
(b) R = 32c; — 3e;x — 12 — 42c1x — 36c2x? + 36e; + 9x + 9c) x? + 902x? — cos x 
(© -05 0 035 (e) yı (x) = x — 0.008532855333x(x — 2) + 0.3375053608x (x? — 3) 


(£) hk Ry, dx = 0 => [—142.7947960 + 287.2000000c; + 430.3500000c; = 0, —230.8844684 + 430.3500000c, + 

694.9714286c5 = 0], [cı = —0.008532849677, c; = 0.3375053572]; a = 0 => [-285.5895919 + 574.4000000c, + 

860.7000000c, = 0, —461.7689369 + 860.7000000c, + 1389.942857c; = 0], [c1 = —0.008532855668, c; = 0.3375053611] 

(g) y2(x) = x — 0.1153918451x(x — 2) + 0.3934737610x (x? — 3) (h) y3(x) = x — 0.09789258545x (x — 2.) + 0.3924027147x (x? — 3.) 
(i) ya(x) = x — 0.0499673048x (x — 2.) + 0.3476915661x (x? —3.) (j) ys(x) = x — 0.09065911075x (x — 2) + 0.3794035018x (x? — 3) 


Answers to Selected Exercises 


(1) 0.00001541336419, 0.000007488651317, 0.0001692199443, 0.0002172925221, 
0.000004204434673 (m) u = 0.2791420730, v = 0.7705196768 


+> xX 


A i 
02 04 06 O8 1 
(a) y. (x) = 1.566222222 — 1.026666667x + 0.2000000000x? + 3.396425277860-7500000000—2.500000000x — 4 13625627 1 g0.7500000000—0.7500000000x 
(b) R = 26c; sin(ztx)z + (—15c, + 8c1x?) cos(ztx) + (—15c5 + 32c5z?) cos(2zt x) + 525 sin(2zt x) + 20x + 26 + 15e; + 15c; — 3x? 
(c) (d -~ 0.5 1 


ci <a 


-0.5 0 


(e) yı (x) = x — 0.2967824228 + 0.2972858395 cos(mx) — 0.0005034167296cos(2zx) (f) W(x) = 8cos(zx)z? +26 sin(x x) + 
15 — 15cos(z x), ya (x) = 32cos(2zt x)z? + 52 sinQz x)z + 15 — 15cos(2z x); h Ry, dx = 0 => [7166.164678c, + 2130.286014 + 
225.0000000c2 = 0, 58817.24968c2 + 37.2797265 + 225.0000000c, = 0, c; = 0.0005034167283, c, = —0.2972858395]; a =0 > 
[450.0000000c; + 4260.572025 + 14332.32935c, = 0, 450.0000000c, + 117634.4993c2 + 74.5594528 = 0, c; = 0.0005034167296, 
cı = —0.2972858395] (g) y2(x) = x — 33.10971754 + 20.56301239 cos(mx) + 12.54670515 cos(2z x) 

(h) y3(x) = x — 0.1674038060 + 0.3003342164 cos(mx) — 0.1329304104 cos(2ztx) (i) y4(x) = x — 0.1958708135 + 
0.2789497518 cos(z x) — 0.08307893833 cos(2z x) (j) ys(x) = x — 2.694300648 + 1.712663726 cos(z x) + 0.981636922 cos(2zt x) 


(k) oj 02 04 06 08 1 (I) 7.508674812, 1169.917443, 8.280309210, 8.113363516, 0.2766340718 
- (m) u = 0.4139848220; v = 08439175331 
-20l 
sap 
AH 
-50- 


y 


Exercises 15.4—Part A, Page 393 
2. bi(x) = 3xH(x) - 6xH (x — 1) -3xH(x — 3) + 2H (x — 


3 EG — $) 3x HOC — 3) — 


1) -2H(x — 2), n(x) = -H (x 
23 


" 


34 
! 2 ! N _ | 9 9 
6x H(x — $) +3xH(x — 1) - 3H(x — 1) 4. a= ä 3 
9 


Exercises 15.4—Part B, Page 394 


169 121 ,5/84 ,—5/8+2x 121 2 1694 ,—5/84-5/8x 
7. (a) yx) = E "E m E “im? = b) Y'-Z2y 4 $y =-Bx 4B 

(c) C = [—0.1404524267, 0.1267097136, —0.8653753166, —1.011004235, 0.2063583810, —0.3356858305] See the graph in (d). 

(d ^ (e) C = [—0.4895360087, —0.8403407602, —0.9701248947, (g) + l 
ud —0.7534917225] See the graph in (g). a Fi 

It (f) C = [—0.2563615107, —0.4856976182, —0.6807326824, 14 / 

p —0.8324902876, —0.9299094158, —0.9593748457, "Y zu "i Sa 
PI: 08 1 —0.9041426571, —0.7436374746, —0.4525928723] sl 02 Ode os 1 — 
al See the graph in (g). “1 ÀÁ 


1 
13. (a) (13 = 


66 (3 —2x 
3 cos(3x)e + 


1 (—66 cos(3)e~* — 66 sin(3)e~* + 1e^! + 2) sinx)e>* 


13 


— sin(3) + cos(3) 


)e 


X 


(b) Y" + 6Y' + 18Y = e^ + 78 — 36x 


(c) [—2.620297908, 0.7879018147, —0.7305695647, 1.674431980, 2.975569321, 3.262824375] See (d). 


Answers to Selected Exercises 


Y 
2 _ 80,3/5 6) 5—3/549/2x 80 39/2 _ 5 —3/5—9/5x 
19. (a) y(x) = e? + VH e dii. an = x i 5 (i17 ll (d) 4 
: 13 2189/10 +5 2e!89/10 LS 4 
1 
mo My! ix ; EIS Bil. Ps - 4 
(b) r'—Zy'— PY = fo + 43g — 5x5 u(x) = —2x +7 03731 
(c) C = [—6.086198464, —5.499030713, —4.486573561, 0.6 T X 
—3.381211450, 0.533576468, —1.288960660] See the graph in (d). 04r. 
0.2+ h 
0 05 ji js * H 3 25 Tau 


25. (a) y(x) = Qxe* — 4e* — že" cosx + iG sin | — 2)e + 3(-8e! +3sin1 —2)xe)e* (d) o 
(b) Y" --2Y" + Y = —6x -3sinx — 1 ix 


(c) [—4.812251130, —4.737266400, 
—4.587641202, —4.423532829, —4.293943981, —4.239363745] See the graph in (d). 


» 


(x) = Ay — 2x 


Y 
CHAPTER 16 
Exercises 16.1—Part A, Page 401 
4 à.— i (1); Pn = cos (E229 x) 5. L*- 32 = 42 +5; J(u, v) = 3(vu' — uv’) + 4uv 


Exercises 16.1—Part B, Page 402 
1. (a) y(x) = cie? ege (b) cy ten + 31-0 3c) /X = 0; ce ^? + coe + 2c | Ae ?* — 2c / Xe ^* — 0 
l ^ 34A l= 3 /A €i 0 T. 125-AÀx Jan Van Van Jian 
(c) dn M" 2 en m 2 Xe n gl 18 ;e 4 Ae — 6ìe —e + Xe + 6Ae =0 
à = 0, à = 0.09758526109 (e) —2sin(xz) + 2x cos(xz) — 12x? sin(xz) = 0 


(d) 4 


Yes, there are infinitely many purely imaginary solutions. 
(£) ó; = sin(1.043803405x) — 3.131410215 cos(1.043803405x); ¢2 = sin(2.025121443x) — 6.075364329 cos(2.025121443x); 
63 = sin(3.017249769x) — 9.051749307 cos(3.017249769x); b4 = sin(4.013076924x) — 12.03923077 cos(4.013076924x); 
os = sin(5.010514411x) — 15.03154323 cos(5.010514411x); s = sin(6.008786212x) — 18.02635864 cos(6.008786212x) 


75 0 0 0 0 0 

0 62 0 0 0 0 

a |] 0 0 mpm. 0 0 0 
(Jo (iójd*— à o o 230. 0 0 
0 0 0 0 35. 0 

0 0 0 0 0 513 


A-67 


A-68 Answers to Selected Exercises 


(i) y(x) = cix + c»; There is just the trivial solution c; = 0 and c; = 0. 


2. (a)23, 25 — (28^; dn = cos( A 1 4-2n)x) (b) p $ió; dx = i The operator is self-adjoint and the eigenfunctions 
0 3x 0 are orthogonal. 
0 0 0 ix 
(d) Yes, the eigenspaces are one-dimensional. 


0.3827144327 . 0.2086427837 . 0.06753784106  0.03209888979 
0.2086427837 . 0.4502522738 . 0.2407416735  0.08274906653 
0.06753784106 | 0.2407416735 . 0.4654634992 . 0.2503713404 
0.03209888979 0.08274906653  0.2503713404 . 0.4710331479 

The operator is not self-adjoint, and the eigenfunctions are not orthogonal. (c) A (d) Yes, the eigenspaces are 
one-dimensional. 


12. (a)A, = i +n’; Qa = e™!/™ sin(nx) (b) sy ġib; dx = 


24. (a) L* = x4 + xt — 6; J(u, v) = x?(vu' — uv')+ xuv (b) The operator is not self-adjoint. 
(c) J(u, v) = = m?’ (v(m )u' (1) — u(m)v'(x)) -zu(z)v(x) (d)0 (e)xzu(z)v(z) (€)rul()v(r) (g) rulau) 


h) xu(z)v(x) ()z?^(v(0)u'(0) — u(0)v/(0)) + zu(0)v(0) 


Exercises 16.2—Part A, Page 406 
2. px)miqG)21-5 5. 30,360, 5 


Exercises 16.2—Part B, Page 407 
11. (b) ji = 4.809651115, pr = 11.04015622, u3 = 17.30745583, u4 = 23.58306888, us = 29.86183542, pig = 36.14212794, 
ju; = 42.42327326, ug = 48.70494306, j9 = 54.98695826, 11,9 = 61.26921294 
0.03368926550 0 0 
(à) f, ^ Jo(uir) Jo(ujr)dr = 0 0.01447251732 0 
0 0 0.009210793888 


Answers to Selected Exercises A-69 


(e) A; = 0.4894450750, A; = 0.1179577229, 
A3 = 0.06720759094, A4 = 0.03925210731, 
As = 0.02918459202, Ag = 0.02093283345, 
Az = 0.01711565354, Ag = 0.01345662186, 
Ag = 0.01155372437, A19 = 0.009569030722 


3i 2. 21 
22, y" + f. 25 =0 


Exercises 16.3, Page 411 


A 7. co = 0, yc = 0.7377095900, c = 0, c3 = —0.03369954076, c4 = 0, 
cs = 0.0004341503171, ce = 0, c; = —0.2623664554 x 105, cy = 0, 
co = 0.9193460530 x x 1078, cio = 0; f, sin? x dx — Do 9c,? = —0.1 x 107? 


-10+ 


. co = —0.3535533905, c, = 0.8164965810, c; = —0.1976423538, c3 = —0.4677071734, 

c4 = 0.04419417381, cs = 0.2931509850, c6 = —0.01991804498, c; = —0.2139541240, 

cg = 0.01138857792, co = 0.1685581954, cio = —0.007383656395, c, = —0.1390907516, 

€i? = 0.005179004743, ci = 0.1184079515, cig = —0.003834846687, ci = —0.1030868341, 

c16 = 0.002954451223, c17 = 009127989485, cig = —0.002346291566, cig = —0.08190159100, c»; = 0.001908531303; 
J! f? dx — Y ge? = 0.062101493 

. (a) ®@) =l- (2+2) b) $ 
0.8 + 


— m: 
1 iD 2 2:5 3 


- (a) Qo(x) —arctanh(x), Q1(x) = xG In( — 44) — 2), Q0) = Gx? - DG In( - 44) - 3444), 


x—1 
XA 3 1 l-x 41 25 X 
Qs(x) = Gx — 309 G In(-15D0 — $5 — S Haas) 


© 


(b) Substitute the functions into the equation and simplify. (c) w(x) = 


RE 
Ly (x)? 


Exercises 16.4, Page 414 


1. (a) à = : + KEn?, g(x) = e? sin(kzx) 


. (a) {àz} = [11.00687363, 39.26502026, 83.22320794, 138.6074491, 200.0000000, 


(b) {ux} = [11.94074806, 40.02724532, 83.77299040, 138.8958450, 200.0000000, 
261.1041550, 316.2270096, 359.9727547, 388.0592519]; 
u; = [0.2350421184, 0.3843638658, 0.4548226193, 0.4596754192, 0.4155329789, 
0.3397600920, 0.2484758729, 0.1552050363, 0.07015038021]T 


261.3925509, 316.7767921, 360.7349797, 388.9931264]; 

u; = [0.1585935874, 0.2967633452, 0.3974907951, 0.4498736215, 0.4506144855, 
0.4040480561, 0.3207975853, 0.2154398977, 0.1037340939]T, ur = [0.3070358890, 
0.4886277961, 0.4750006069, 0.2810904526, —0.00402875055, —0.2604871836, 
—0.3914216907, —0.3615873767, —0.2047124490]T 


A-70 Answers to Selected Exercises 


10. (a) {Ax} = [—0.2494863806, —2.208669595, —5.935257520, —11.06446576, (b ^4 
—17.09421169, —23.43426175, —29.46400768, —34.59321592, —38.31980385, —40.27898706]; Q4 p 
u; — [—0.4264014350, —0.4211517255, —0.4055318640, —0.3799264578, —0.3449660059, 03T 
—0.3015113434, —0.2506324721, —0.1935821975, —0.1317652873, —0.06670387898]T 02-- 
0.14- 
0 os 1 15 2 45 à 
18. (a) {Ax} = [1.231051496, 4.073642324, 8.501081338, 14.07997996, 20.26423672, (b) 
26.44849348, 32.02739210, 36.45483112, 39.29742194]; ui € — —— NN 
ol Qs | 15 2 25 3 


u; = [0.2402468162, 0.3900368246, 0.4582011971, 0.4597445082, 0.4125930182, 
0.3349190487, 0.2431659819, 0.1507910303, 0.06766293567]" 
CHAPTER 17 


Exercises 17.1—Part A, Page 420 
2. R(p) = [8, — 1, 2]7 + p[2, 8, —6]T 3. ya -D x 


Exercises 17.1—Part B, Page 420 
3. (a R(p) = [p,2p? — 3p + 1]T 
go. 3. D dT pr 
(c) v10, V2, V26 
T T 5 
(à) [54/10, -$ 10]. [142, 12] '. [£V26, £V26]" 


(£)[1,4p —3]" (g) /104- 16p? — 24p 


(h) () Pm = $, (5, 1) 
^ ; 1 1 p T 
13. (a) (d) (e) R' (p) = I vi+p’ Js 


1 250—15p?+10p3 
(f) p(p) = 10V ^ (-+p)(—10+p2) 


1 


Aiie 1—3 
+ 1 1214 16 18 2 


25. (a) y- $42 = 44/2 — jx) 
(b) (304 — 4/2 + J/2n)4/2, 3) 


(90342—12342—1 


(o [194 — 4/2-- J2m)V2 - 1x, 3 - 12] 


(d) R2) = [1, 12] 


Exercises 17.2, Page 425 


Answers to Selected Exercises 


A-71 


1. 3426 — i In(—5 + /26) + 2/10 — į In(—3 + //10) ~ 4.8891 


11. (a) 1.096434414 (b) i ai 


N 
G2 
~ 
E 
LS 
> 


I n | i 1 je 


T T T T T 
10 15 20 25 30 


29. (a) f(g(x)) =x = gCf Go) 


05 5 


Exercises 17.3—Part A, Page 427 
lL k= Z5 2. k= xs v17 


Exercises 17.3—Part B, Page 428 


E 


L @B = [i E] Ba = [Ri 


5 
e^ 


traya O9) 


2. (a) k(x) — 


(à) gman (5 


>p 
2. 3 4 5 


(b) s(p) = 9p + ip? 


(c) ^ 


1 


ds , Gp. 
() $ =94p; 2 = 


dp 


9+p 


(d) [ — 80 + 9/81 + 2s — 1(—9 + /81 F 2s)?, 1+ 4(—9 + /81 F 25) J" 


T 
‘ on JET LA 9 EIER 
(e) ES 814-25 ,6 4/814-25 


(b) f'(x) = cosh(x); g'(x) = 


(e)k = 


(g) v(p) = /10 + 16p? — 24p; T(p) | 


l (c) cosh(arcsinh(x)) = vx? + 1. 


a/x2+1 


(c) «(0) = 4V5 

4 e? A/1 + 4e** 
8e^* + 16e** + 1 

(e) R(p) = [p. e?^]* 


(d) « = 


(f) v(p) = V1 + 4e*r; T(p) = | 


(g (0) = 4V5 


(c) «(0) = 3: /10 


(d) x — 3: absolute maximum 


A/ 10+16x2—24x 


(5--8x?—12x? 


(f) R(p) = [p. 2p? — 3p + 1]? 


i 
"us 
© / 14464? 


(h) «(0) = £10 


q 
4p—3 
M/10416p2—24p A/1041652—24p 


A-72 Answers to Selected Exercises 


= 9 94/8425 g A —9--/8132s = 3 , = 3 g = 
29. (a) T(s) | 8T425 BE O VELEN T (b)x = [9T JETER (81428) (©) «(p) = (19 Jp 0D xui = (81-18p- p) Jp 
35. (a) (h, k) 2(-3, 2) (b) y (c) (See plot.) y 


E 

-$ x 101 
(d) (x + 3)? T(y-— y= 15 , the point (0, 1) is on the circle. (e) Yes, both slopes are 2 at (0, 1). (f) Yes, the second derivatives agree and 
equal 4 at (0,1) (g) No, the third derivatives do not agree. The curve has a third derivative 8 at (0, 1), while the circle of curvature has a third 
derivative % at (0, 1) 

43. (a x! -iy!-0 (b) 48. (a) y 232 75)? 41 (d) 
(b) y—p? +3 =# =0 


(c) y 2 307 iyi +å 


Exercises 17.4—Part A, Page 432 
P 1 T zu o al i ly LZIN =f- — sj T 
i Nc 2 mH 2. T—[- $V2sin p, 34/2cos p, 142] : N = [— cos p, — sin p, 0] 


Exercises 17.4—Part B, Page 433 
2. (a) See (e). (e) 4 (f) (1) = V2 
(b) R = [p, 2p? — 3p + 1]T 

() TQ) = [142, 12] 
(à Nb = [- 142, 1/2] 


qi 
T = 4p—3 ; 1 
(£) T (p) | EEE ras Na 
WNG) = [- 142, 12] 


12. (a)See (d). ()k = 25/118 (NCO) 2 [- $59, 5/3245] 
(b) T(1) = [354/3245, 2. v59 J" 


ONC) = [- £459, 54/3245] 


Answers to Selected Exercises A-73 


T 
43. R= 2. 3 p2]T: R” = [6, 0, 6p]? p 2 1 . p " EN d: 2 3 T 
(a) [6p, 2, 3p*]'; [6.0,6p] (b) T(p) E Just Wu 3 CEU ; T(1) = [$ 49, 2/49, 2/49] 
" ER jae 9p*—4 p(2+p?) (9p^42) T. 30 108 132]T 
(c) «(1) = 343 17 (d) T'(p) — [ Sara 36 ces iai y: D ab sot | ;T(D- mer 343° 2] 


ONO) = [- 354/17, -4$ 4/17, 2/17] Ba =[2V17, - 2417, - 2/7] 


T jh 
2 2 
1 p . p Dp 1 . 
(g) T(p) 6 P 2 3 ; B(p) 2 3 ,—2 
= P 9/36 p?-+4+9 p* i 36p? +449 pt ? a/36p2-+4+9p4 P a/4p2+9p4+4 É Af Ap4-9p^44 af Ap? 9 p*--4 i 


T 
N(p) = 9p*—4 6 p(2+p?) 2 pOp?+2) 
Al 4p2-+9 p* 44/36 p 4-9 p* Af Ap^-9p* AA /36p? A9 pA f Ap? 9p! 44/36p2 4-9 p* 


3M). PNE P 2 2 
(a), (b) and (c) t TT Y (d) -2 sD 
7 9p*—4 24-p?) 9p?42 T. dN p 288p? +1080 p4+80+648 p® +405 p* 48 p?+112p4+81p!9+1224p®+486 p§—3 
37. (a) Z = | - 6528 36 BSE, 12 PE]: — - SEE 6 Se 

ds (36p^-449p^)" (36 p*--4--9p*) (36p?--4--9p*) ds (36 p? --4--9 p*)? (4 p? --9 p* --4) (36p2 --4--9 p4)? (4p2 9 p* 4)3/2 

p p 1 3 
2— 890p 248p 9p -S04 pi ath m]. dB. |.» 9p^—4 12 p(2+p?) 4 p(9p?+2) 
2 4 3 D et n , D 
6p? 1449 p) (4 p 9 ph 4)3/2 ? ds (4p2+9 p^--4)3/2 A / 36 p2--4--9 p* (4p?--9p^--4)3/24/36p2--4--9p* — (4p?--9p^--4)3/2 A /36p?-4--9 p^ 


Exercises 17.5—Part A, Page 436 
1. Use a = o'T + x p?N and take the dot product with T. Observe that the dot product of T and N will vanish. 2. k 


j 1 
2 (1- p^)? 
Exercises 17.5—Part B, Page 436 
2. (a) ! (b) R"(p) = [0, 4] 
dH T 
(c) T(p) = | : c | :N(p) = l m | 


A/104-16p2—24p  A/104-16p2—24p Af10--16p2—24p. ./10-+16p2—24p 


p(p) = V/10- 165? — 24p;] p'(p) = 4 3 ik = oi Aeon 


= 2 
A/ 102-1652 —24p 


FPE "ap DE NE n (d) Yes, it is. o'T + xk o?N = [0, 4] = R” 


(e) T(0) = [4 v10, — 54/10 |, NO) = [3,V10, 54/10], Rr = [— $. 8] = OTO), R" (wo;  [$. 3] = «(09(0? N(O) 
(f) (g) dp — 4 4x—3 ù Kp? — av 104-16x2—24x 


6 dx A/10--16x2 24x 2 5--8x2—12x 
5 
4 
3 
5, 
+4 x 
9-1 1 1 2 
Ë 
13. a A b R" = 1 1 10 
(a) ,t (D) Ep) 4 (Ep opty 1003107 
MEA 
T T 
3j © T(p) = | Sov, tee | :N(p) (A, AEN s 
m. A/sorp ap?! ./50+7p242p3 | > A/5041p32p3 „/50+7p?+2p3 
0.4 T JSA/ 501p? 2p V5(p4—8p3+4p?— ` 2(p3 2 
1 V54/50+7p*+2p? |, 1 5(pf—8p?--Ap?—8p-4-100) č . — g ¥2(p3+30p+20) 
E (p) = = SS: pp = 4 a kp) a 
j } | j x» ind to ATE pA 10+p? i 4 [504-1 p2+2p3(1+p)3/2(10+-p2)3/2 P (504-7 p? --2 p?)/ 
} ; 
0 0.5 1 15 2 
T 
fed / 2 1 10 <= n 
(d) Yes, itis. o'T + kp'N = EESTI acm =R 


(Raw = [- BG V2. -a VT]! = p ITO), R Oro = [= s 2. si; 10] = «(Op NO) 


A-74 Answers to Selected Exercises 


Note: the vectors in the accompanying 
figure have been scaled for visibility. 


06 1 14 18 


25. (a) v(t) = /29 (b T =[3.V29, —4./29, 2429] (0v = #V2 (3x —,L117769. (e) 
B = [— 25 4/4061, 21/4061, 35/4061]. (£) N = [1255 /117,769, 2, /117,769, 5.5 /117,769 |" 
Exercises 17.6, Page 439 
1. 13333.33333 Ib 2. 17997.99989 mi/hr 6. 5.401897895 revolutions per minute; 30.08000000 ft/s? 


8. a = [—64,32]" — 11. 8.400000000 m/s 14. F = [— 105,840 osp —44100 inp F 


14,161 cost p+5950 cos? p+625 * 14161 cost p+5950 cos? p+625 


1 
I 
0592 


CHAPTER 18 
Exercises 18.1—Part A, Page 442 
2. 3,4 
207 
di 
12+ 
» x a 
ol24 6 


Exercises 18.1—Part B, Page 443 
2. (a) (0,0) (b) i 


y 


(c) ) (d) (0, 0) is unstable. 


(e) The eigenvalues of the linearized system are —1 and 0; 
no conclusion can be drawn regarding the type of 
critical point of the non-linear system. 


Exercises 18.2—Part A, Page 445 
L. Dif =Vf-i= f, and Df 2 Vf-j- f, 


To Ea da NA. 


SS 


4. —38./69 


r2 
jæ 

= 

v 


Exercises 18.2—Part B, Page 445 
2. (a) 


(c) V f = [-14xy — 6y? — 18x, —7x? — 12xy] 


Answers to Selected Exercises 


d » TE" (f) Tail: (—2, —2), Head: (46, —78) (g) 32. /73 
> 3 
-1 APF P PENRO RD D 

isi 

ast 

3% 


-3 -2.5 -2 -1.5 -1 


12. $3:./1913 — 22. 328 /681 — 32. 3358/1309 


681 1309 


44. (a) —1cos0 + 5 sin (b) A (c) — arctan 2 + 2 ( [- 145, 24/5] (oh [= 145, 245] 


Exercises 18.3—Part A, Page 451 


1. (a) 3x? + 2xy + Sy? = 27 > b) T = [1,-4]' 
A 
(c) [10, 22]7 
(d) (11, 24) 


>x (e) 2/146 (£)[-10, —22, 1] 


Exercises 18.3—Part B, Page 451 
2. (a) See(b). (b) y (c) Tail: (8, —10); Head: (1036, —266) 
LY T 
@rT=[, 2] 
(e) V f (8, —10) - R'(8, —10) = 0 
(£) 5(@) = 1028 cos 0 — 256 sin 0 


= $F x 
6 ; 8 9 10 
(h) Ô = —arctan S5 +27 (i) u(Ô) = [zz /4,633,007, 105, — 5. V4,633,007, 105 ]" 


q VO) -[ 257 


251. /70,145, — 74, /70,145]. (k) 6(6) = IV f(P)I| = 34 V4,633,007, 105 


IVA(P) T 
14. (a) [44, 280, —20]" (f) 005. 9? .— (g) Ê, $) = (arctan L, x — arctan 1/5021) 
LS 2 
(b) Tail: (—11, —2, 3); Head: (33, 278, —17) 


5, (hu(0,9) = [H V6, S /6, —.5; 6] 


(c) T. = [1,0, 4]; T, = [0, 1, 14] 200 EAT 
at O path = [46 V6 eT 


(d) Vf -T, 2 Vf.T,-0 
(e) 8(0, 9) = 44 cos(0) sin($) + , 
280 sin(0) sin($) — 20cos(Q) 67 


Vg(P) 


70 (j) 6, 9) = |Vg(P)|| = 1166 


Exercises 18.4—Part A, Page 457 

1. 2/83 
Exercises 18.4—Part B, Page 457 

1. 2483; (-2, 15, 8); 1, -2,3]" -[-g. -5. B] = 8B, -5,717 


83* 83 


A-75 


A-76 Answers to Selected Exercises 


5. Min at (14/3, 14/3), (— 14/3, - 14/3); Max at (C1, 1), (1, —1); (See plot.) 9. Max 6 at (0, 2, 2), Min 2 at: (0, —2, 2) 


10. Max © at $), Min -$ 4/13 at (  $4/13,0, - B. /13) 


Exercises 18.5—Part A, Page 460 
l. u(x) = ih 2. (a) false (b) trueu(x, y) = xe"y +c (ec) true: u(x, y) = sin(xy)y + c 
a xf( x?-+y?) _ fex» Fay O a ( xf x€y» 
dy p24 y2 m x24 y? (x2+y2)3/2 ax NA 
Exercises 18.5—Part B, Page 460 
2. (a) (b) (See Plot.) eo^ (c) [222xy + 12y?, —6y? — 11x? + 24xy]" (d) (0, 0) 


Vee 


(e) y (f) y (g) The case of an eigenvalue zero is not covered by this text. 


(h) The system exhibits a saddle like behavior. 


SSS 8p — 
SSNNA GS 
SANNA Fe] SS 


" 
“ie 
dI tA pb rrr, 


aT 


13. u(x, y) =—llxy? — 12x?°y —3y+c 28. (a) F = [—5,22yz — 8z, 11y? — 8y]! (b) 


40. u(x, y, z) = —4x?z — 3x22 + 7yz? +c 
CHAPTER 19 


Exercises 19.1—Part A, Page 466 
1. 24; 48 i ms 5. Hint: Write x = x(t), y = y(t), and r(t) = [x(t), y (2)]!, then expand the integral on the left. 


-77 
890 


, 


A 


(c) 2,723,935 


577 - I 


0 46,443,1 


3 


1,935,1 


F(1, 21) = [—1910, 80710]"; 


Fr(1, 21) =[ 


Answers to Selected Exercises 


A 


reece ttf ft 0 


1155 


frees / i 
ae Lecce sf T] 


66,795,668,098,653,968 


field. 


5,696, 142,704,640 , 


(b) Use a direction 


5,333,015,562,273 


.684,016,702 . 


Exercises 19.1—Part B, Page 467 


244,129,358 
(c) — 


[648, 0]T 


F(2, —8) = [648, —254]T; Fz(2, —8) 


(b) 


e 
fon 

u^ 

un 

| 

=, 

e 

— 

c^ 

a 

= 

+ 

a 

ll 

ms 

| - 

CE et 

© Rl? 
m | i. 
e ala 
= ajg " 
=F wn 
+ Ss 
eu. 

i ll 

ce 
BR 

pe cw g 
*- < T 
[RP 
see 
X B 5 
ERE 


KR 
mmr ff Sos 
SRS 
So 

SN 
RAAE 


No 


ESSRSNSSSSN 


(b) (See plot.) 


44. (a) 


44444474 
A 


(c) 


(d) 


(c) (0, 0) is a saddle. 
Classification of the first point 


is not possible because linearization produces 


11 


Bs? 


an eigenvalue zero. The second point is a saddle. 


(b) (0, 0), ( 


19.2—Part A, Page 470 


s 19.2—Part B, Page 471 


xercises 

xercise 
(a) 

3. (a) 
(d) 


E 
E 


Answers to Selected Exercises 


A-78 


(b) (—0.2071067810, 0.4571067810), A; = 2.594521170, A. = —2.180307608: saddle; 


13. (a) 


(1.207106781, —0.9571067810), 11.» = —1.207106781 + 2.049328541i: spiral sink. 


MM fN 


A NECS 


(e) 0 


(c) 


1 


0.4 0.6 0.8 


0.2 


ALLIES, 
Lh fir 


23. (a) 


A 


81 


-404 


(c) 16,458 


300 400 


00 


2 


100 


~ 
= 
A 
est 
+a 
~~ + 
wile 
SSSYS SB 
SSS SSS SS SASAS SS SSS 
SSSSSSSSSSISSSSSSSNNSN 
SOSSSSNSSNSSSSSISSNSSSN 
=> 
a 
— 
en 
e 


—100 
—200 


(b) 


43. (a) 


Po mM 


CHAPTER 20 


Exercises 20.1—Part A, Page 476 


5 
< 


3 


5 


zt -- 12x 


zt + 6x? 


3 
=2y 


“u 


= V 


5 


3 


inu 


A 


a 


5 


=y +x 


1. (a) V- F 


2y 


2y 


(b V-F=y+ 


Exercises 20.1—Part B , Page 476 


(c) O Yes, F is solenoidal. 


(b) 


> < 


15. (a) 


14,036,560 
108,541 


li = 


Answers to Selected Exercises 


26. (a)S8 (b) v (c) v (d) Zp*z +58? (e)58 (f)23295?--28p^ (g)58 
E. uius | 
254 
ot 
1.54 
i 
0 id 
3$. (a)100 (b oj, 5 55 6 65 7, (0 gas 55 6 65 7 (d) 400p?z (e) 100 


Exercises 20.2—Part A, Page 479 
1. (a) (ycosx —xe’)k (b) (x — yi (x — yj 4. (a) irrotational (b) irrotational 
Exercises 20.2—Part B, Page 479 


4. Hint: First compute the divergence of the cross product of A and B, then apply the condition that both fields are rotation free. 


(a) F is neither solenoidal nor irrotational. (b) -9 -8.5 -8 -75 -7 0 (c) -9 -8.5 3 -15 -1 0 
x< - - - - x~<4 : - 
+-1 
+ -1.5 
+2 
T -2.5 
+-3 
Y 
M 
(e) io*z — Tlp?n (f)—-77 (g)—308p? + 4p* 
15. (a) F is solenoidal, but not irrotational. (b) -3 
x —l I 
: N tos 
: M La 
y A 
} E 
| £—— ras 
La 


(e) 64p?r —2720*m (f)16 27. -44 


Exercises 20.3, Page 483 


l. The gradient of a vector, the divergence of a scalar, and the rotation of a scalar are all undefined. 


—4--3z (—4432)? 


2. (a) V(fg) = ( SIT ; (e má saad) k 


0 (d) 16k 


(b) V(u- v) = (18xy? — 9y^ — 6xz2y — 922y? + 108x?zy — 216x? + 48xz + 322? — 24xz^ + 32yz* — 2Axyz3)i + 27x? y? — 36xy? — 
3x72? — 18xz?y + 36x?z + 32xz* — 12x225)j + (—6x?zy — 18xzy? + 24x? + 36x73 y + 160xz* — 48x? 2 + 128xyz? — 36x?yz2)k 


A-80 Answers to Selected Exercises 


(c) V - (fv) = -108xz?y + 54z?y? — 243x?zy + 162xzy? — 240x?z? + 45x32? — 240xz* (d) V. (ux v) = 

—2Txy? 45x? z! —72xz°y -18x?yz? — 48xyz? + 72x?zy — 108xzy? + 64xyz+ 162x 2 --27x? y J6x^z + G4xz^ — 2Az* +4x7y3 - 32y?z?x 
(e) V x (fv) = = (72x? yz? — 96x?z + 72x3 yz — 72x3)i + (-108x?zy + 108xzy? — 81x?y + 81x72 y? + 482? + 108xz* — 81x?z°)j + 

(—48xyz? + 96xz? — 108x? yz? + 216x?z + 54x72? — 108xz?y + 81x? z — 162x?zy)k 

(f) V x (u x v) = (6x?y?z + 146x?y — 822 — 81x? + 27x?z — 54xyz Ta ay H 72xzy? — 36x? y? + 36xy? + A0xz^ + 24y?z?x)i + 
(—146xy? — 54x3z + 243x? 2? — 48x? yz? — 8xyz? — 54xyz + 27z y 96xz? + 275x? y + 64x?z + l6xz? — 8y? xz — 32x? y?z)j + (72xz?y — 
3622 y? + 72xzy? — 36y?z — 8y! e + 6y?z)x — 82 + 6xz^ + 32x? yz? — 32x?z + 16x? z!)k 


Exercises 20.4—Part A, Page 487 
2. @ = —1 makes V. v = 0 3. 2xi - 2yj 
Exercises 20.4—Part B, Page 487 
2. (a V. Vf 2 Vf-2gá (VS) x (Vg) =V x (fVg) 2 -Vx(gVf) = Si-3j- sk 
17. u(x, y, z) = —6x — ix? +c(y,z) 24. y = —10 
CHAPTER 21 


Exercises 21.1—Part A, Page 491 

2. 13/6 3. (a do = /1--g, 4g? dydz (b)do = /1-- hj? +h? dx dz 4. 3BA/155 

Exercises 21.1—Part B, Page 491 

2. (a) $155. (b) 2/155 (c) S155 (d) S2. 155 (ein 62 (f)?aV155 (g)5xV155 (hb) 2/155 (i) $155 
6.» in419 + iz /21nG74/2--124/19) — 54/2122 1146551654. 7. 8 12. 22-0 4/49,105 


! +> x 
0 i 2 3 4 


Exercises 21.2—Part A, Page 496 


2 sagen Cas 3 
e em 5 — 33597 4. jm 


Exercises 21.2—Part B, Page 496 
5 -1728% — 15, LELOS — 38, 


Un 
© 


Exercises 21.3—Part A, Page 501 
L fff, V.Fdv — ff,F.Ndo =0. — 2. ff [V x F]- Ndo = f, F-dr =0 
4. In section 20.3 it was proved that V - (fF) = f V -F -- F- Vf, the divergence theorem then gives ff, fF- Ndo = fff, V - (fF) dv. 


Exercises 21.3—Part B, Page 501 
2. fff , V -Fdv = ff, F-Ndo =0. 9. fff, V. Fdv 2 ff;,F-Ndo — $zx 16. fff, V. Fdv 2 ff, F- Ndo = 4r 
23. fff, V -Fdv = ff, F- Nac 20 30. ff.[V x F]- Ndo = f, F-dr = 0 


Exercises 21.4—Part A, Page 505 

3. (a) ff, V. Fdxdy = f, F- Nds = ŽV5 (b) ff [V x F]-kdxdy = f. F-dr = — 45 V5 (c) The area is 2/5 
4. (a) ff, V. Fdxdy 2 £.F- Nds 20 (b)/f,[V x FJ. kdxdy = f. F-dr = —144z (c) The area is 127 
Exercises 21.4—Part B, Page 505 

1l. (a) $ (b) ff, V -Fdxdy = f. F- Nds = —$%, ff ,[V x F]-kdxdy = f, F-dr = - € 


2231 * 


24. Pon [5 (Qrcost--8)r?sintdrdt — 0 — 28. pr gm —(1 4 r? cos? t)r dr dt = — n 


Answers to Selected Exercises 


(b) lim, .9 — 4 = —ooilim,,97; — oo (f)f,F.Tds—0; f, F -Nds = —27 


Exercises 21.5-Part A, Page 512 
x(— sin(*)z* = sin(*)y* + 2cos(2)yz) 


74 


—Vu = (12xy + yz)i + (6x? + xz)j + xyk = F 8. -Vu = — 


Exercises 21.5—Part B, Page 512 
(a) F = 6zi + 15y?2j + (-12z? + 6x)k (b) du = —6zdx — 15y? dy + (1022 — 6x) dz (c) F-dr = 6z dx + 15y? dy + (—12z? + 6x) dz 
(e) u = 6ac — 5y? + 5b? --A — 6xz — 4A (f) v = bac — Sy? + 5b? +423 — 6xz— 4 (g)u—v=0 (h) 6xz+5y? — 423 
(i) 6ca + 5b? — 4c? 

12. (a) V x F-0 (b)u = —5ab —9ac + 5yx — 8bc + 8zy + 9zx —9z4+ 9c (c) v = —5ab — 9ac + 5yx — 8bc + 8zy + 9zx — 9z + 9c 
(d)u—v=0 (e)—Syx —9zx —8zy -9z (f) V.F-0 (g) A= (—8xy — 2x? T 9x + 8ay + 2a? —9a+5yz+ 2z? — 5cy — 2c5j + 

8xz + 3x? — 8az —2a?)k (h) B = (—42? — 5xz + 4y? + 9xy — 9y)i + (Syz + 2z) (i) V x (A- B) 20 
22. Vx F = 0, u = v = —2a?c + 7b?c -Ichb +2x?z — 1zy? — 1yz2 +22 — 2 37. (a) Vu 20 (b) —666 


40. [f “do = fff, V -(Vu)dV =0 


45. (a) Vu = 0; fff I Vul?dv = ff us3*do = 88x (b) fff, lI Vul?dv = ff ut do = Ba’ + 432a? 


EE 2 ^ ðu 2% 23 di 
(c) f/ff , Vul dv = ff u%do = Sn 


Exercises 21.6—Part A, Page 519 
Jw 1G, bth, z) — fy, b —h, 20 fT ST dx dz inl fœ, b+h,z)— f(y, b —h,z) 
in im 


a—h 


= T (x, b, z) 


um = 
206 h? h>02 h 


- E NONSE 
2. F-Ndo = eee) dx dy 
—y*--p* 


Exercises 21.6—Part B, Page 519 
2. (a,b,c) V-F = 62 5. (a,b,c) V x F = —50i + 24j — 5k 8 (a, b, c) Vo = —540i + 240j + 72k 12. (a) trj (b) 8j (o izj 
14. (a) S;zk (b)48k (c)I2zk 17. (a) 9 (b) 0 (c)0 20. (aj 0 (b) —28j (c) —7zj 


CHAPTER 22 
Exercises 22.1—Part A, Page 526 


l. (7,8) = (A13, — arctan 2) 0 a 3 Du aa es 2 A 4 $ 
-0.5 
- n 
-15 afs 
uL 
Y 


Exercises 22.1—Part B, Page 526 
3. (a : (b)r—i-Fcos0 (c) 
A 


A-82 Answers to Selected Exercises 


P 5 3 
13. (a) 4 (b) (See plot.) (x= $vtqwy-gu-3v @) | 
20 0.8 
15 0.6 
10 0.4 P 
5 0.2 
0 
] x 0 02 04 06 0.8 1 
6 8 1012 14 5 10 15 20 25 30 35 
8Q.»| 1 Y A i i 
(e) 0.6 (f) a(u,v)| 3 (g) (h) (i) q 
0.5 10 8 
i 6 
0.4 g 
0.3 - - 2 
0.2 =A 0 
-2 
0.1 a 2 
0 02 04 06 08 1 -10 -6 


=] 345 


p IU x 
Y -2 -1 0 1 2 


17. (a) [25,2 eo | wis. 2 =] (e) 


(2402)? ^ (a240? HE | (u2-- 82)? (u*-8*)* 


18. (a) v (b) and (c) 4 


lu? Um 


-10- 
20. (a) -$424-2/3-2. (b)y=v+2-2/1—utov,x=1-J1—uty; UN ——PXtU (e) area = —$ V2 + 2V3 — 2 


Exercises 22.2—Part A, Page 530 
7. (22.7a) and (22.7b) are direct applications of the chain rule to f. = F,r, + F50, 


Exercises 22.2—Part B, Page 530 
2. (a) Vf = 14xyi+ (7x? +2)j (b) Vf = (21r? cos? 0 sin0 + 2sin0)e, + (—14r? cos @ + 21r? cos? 0 + 2 cos 0)es 
(c) F =7r> cos? 6 sin +2rsin@ (d)sameas (b). 
7. (a V-F=18x+18y (b) -F= 18r(cos0 --sin0) (c) 
G(r, 0) = (9r? cos? 0 — 7r cos0 sin0 + 9r? sin0 — 9r? sin 6 cos? 0)e, + (—9r? sin 0 cos? 0 + 4r — 7r cos? 0 + 9r? cos 0 — 9r? cos? 0)e; 
(d) V. G = 18r(cos0 + sin 8) 
12. (a) V. f = 18y — 48xy (b) V?f = 18rsin0 — 48r?cosOsinO (c) F(r, 6) = 9r? cos? 0 sin — 8r* cos? 0 sin 
(d) VF = 18r sin 8 — 48r? cos0 sind 


17. Leche? —-ivclwy-2-iu- a (b) au, = Ži- 4j,; Z = Ži+ j (0e = 4v4 -— vj, e = 4V1314 v13), 
i = į vT4e, + i413e,j = — 2 74e, + 4 re (d) f = 3F, + 5F,; f, = —2F, TF, 
(VF = (BVIF, + 47 aF,) eu + + (S35, + BVP) eo (D VF = (aeb VTA Tu) (v — 12u)(—Su + 3v)? ) e. 


(scel VT (2v + 7u)(72v +97u)(—5u +3v)?)e, (8) same as (f). 
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22. (a) VF = (u? +v) (Fuu + Fp) (b) Vp 5625029). (c) V? f = 6xy* + 12x°y? (d) and (e) same as (b). 


(u^4-v*)? 


25. (a) V.F — (ui fuv Fu gu gov tg (b V -F =7(u? —v?)uv  (c)l4xy (d)and (e) same as (b). 


(u^ -v^)*/ 


Exercises 22.3—Part A, Page 537 
3 5? f(p.0,0) 


a . a 
= 9 LI 0.0) 3 d zg 8 (0.6.0) sind ag 8 (79.9) 2(p.$,0) coso 
l p? T as / (0. 0. 0); psing => p + psing 
2 sg (0.0.0) h(p.0,@) cos PEAKI . h(p.9. 5 f (9.9.0) (p, ; ag / (0.9.0) 
1 ó | p.0,0) coso ag £V m $) — 38 J 0.7.9) g(o.0.0) 2 — 3¢ 
igj | p l psing psing €, Jr s; hG. 9, $) s psing eo T p + 3p &(0. 0, $) p € 


Exercises 22.3—Part B, Page 538 
5. (a) V f 2 200 (b) F = 2p? cos(@) sin($) cos?’ ($) — 8p° sin *(8)sin'($); P = (3V5, — arctan 2, — arctan 2/54 x) (c) V? F = 200 
(d) Vf = 50i — 384j — 40k (e) VF = $2. /5e, — 246e, — 2 /5e, (f) VF = 50i — 384j — 40k 
12. (a) V -f = 134 (b) The expression is too long to display here. (c) P = (v97, arctan 2 — gr arctan( 3i /974/5917) — x) 
(d) V -F —134 (e)Vxf=—486i+41j (f) V x F — —22 97e, — $26 /5917e, — “$ Vole, (g)V x F = —486i + 41j 


5917 61 


x x: M 
2 J+? 422 yt 
x z x 
22. (a) j x+y? 0 (b) and (c) The expressions are too large to display here. 
zs zy Nx | (d)FE,--2F,-4-—LF,--—-F,- Fo 
XI RW Jom ELSE: 2 pp | p P T oo T sing P singo f 
(x2+y2+422)a/x2+y2 (x2 +y2-+22)q/x2+y? FAFE i 
28. — —1,h— un h3 = u; sin u3 
79 = at 2 : 2 ae 9 ue — . aR = 9 = ue x : u? Ex 24? 5 E) . Zn = 
29. (a) 5 du (u24v2 Ln (u2+02+w2 nj * (u2+u2+w2)2 ° ðv 7 (u2+u2+w2)? (u2-+v2+w2 72J ^ (u2- pv? +w?) 
1 
(u2-+v2 +w?)2 0 0 
IR _ ^ wu : wy * | u2+v2—w? A " 1 M 
jw e Lu 2a +02-++w2)2 zj 7 (u2- 2 2)? k; 0 (3-22? 0 (b) 
0 0 a 
(u^ -v^-w^)* 
1 2 2 2 2 2 2 2 2 2) Ff 
(c) hi = h = ha = Fare (d) Vo = ((u^ + v^ + w^$,)e, + (u^ + v^ + w^) fo)e + ((u +u°+w ) fu) e, 
3; 2 aA 24; , 
(e) V -A = (u? + v? + w?) 8 ta v? + w?) AL + (u? + v? + w) — 4A4,u - 4A - 4A (f) V xX A= 


(u? + v? pw? 2) das + (—w? = v? — w? 2222 — 2Asv + 2A.w) e, + (teu —v? — w?) 43 + (u? +o? + w?)74. — 2Aiw + 2A3u) e, + 


ou 


(Gc us ud 2) dg (ou —v? — w? 2) aa 2A:u 2A;v)e, (g) V?ó = (U? + v? + WY puu + Q3 + 0? af Poy + 


ðu 


(U? + v? + w? huw — 2U? + v? + w? Sud, — (u? + v? + w*)vd, — 2 + v? + w?) wey 


CHAPTER 23 
Exercises 23.1—Part A, Page 544 
)do 2 pp CVH- 73 943a 124172437249 dr dó = x42 37/10 8. E 2sinr£l qe — 0 


0 JO (r2+1)3/2 (r24.9)3/2 544 sint 


L. | o1xyl pm + 


3 
(x2 +y24+9)3/2 


Exercises 23.1—Part B, Page 544 


2w pV2/2 2 Z 
r r*-4 1 4 2r(r2+1) pee 
= ll. a iad y! I t =r? 4193? (4r? + ya)” drdé —0 (9) fy paipa dr = d 


9. Implementing the condition gives a differential equation for f (r), 0 = V. F = 2f (r) - rf'(r), with solution f(r) = 5. 


Exercises 23.2-Part A, Page 548 


l. ys =; ye = $, do = Mfl dxdz 6. 90 
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Exercises 23.2—Part B, Page 549 


1. (a) (b) Use the second derivative test. (c) y 


(d) do = \/1 + 592x? + 336xy + 340y? dx dy (g) 4 


3/2 p—2/9x+1/94/ —104x2 4-234 5 z g 

1 + 592x? xy + 340y? dy d: 

© [^f io Jis V | + 59287 + 336xy + 340y? dy dx 
(£) Z(u, v) = 1080u? + 552uv + 321v? 


(h) do = 514/55,360u? + 32,224uv + 12,820? + I du dv 


a p1/171/30 p- v+1/1804/ —751402+780 - 

(i) err E 514/55,360w? + 32,224uv + 12,820? + 1 du dv 

(j) Evaluate the Jacobian of the transformation and compare the integrands, the new integration region is given by (g). |J| — 51; 
gf + 592x? + 336xy + 340y? = /55,360u2 + 32,224uv + 12,8202 + 1 


Sg " soinen T" " 
2. (a) Bis, (b) —341,879.380 (c) 92 6. [f E- Ndo = 4355597. 11. ff, F- Ndo = &z 
Pss. 
40 
30 
20 
10 
9 212 
4 
Exercises 23.3, Page 552 
1. Write the continuity equation as + (pu) = 20) and integrate both sides with respect to x 


3. (a) (See plot.) (p) Gero » 1 (d) y (e) ) 
A 


(x—t)*+2 (x—t)*+2 


(c) Au(t, f) =0 


! t pæ x 


4 6 8 
(g) (See plot.) 


f t) 


2 xf 9 à " " P 
5. (a) u(x,t) = 569 (b) u(x, t) = 8. In the continuity equation let v = E , and substitute E = —VV. 


Exercises 23.4, Page 554 


2. (a) fff IfV?s + (Vf) (Va)ldv = ff(£ Vg): Ndo = 63007 (b) fff LA V?g — gV? fldv = ff,LfVg — V f]: Ndo = 22x 
7. (Ax) - y = x«(AT'y) = —992 


CHAPTER 24 


Answers to Selected Exercises 


Exercises 24.1-Part A, Page 563 


n-l 


Exercises 24.1—Part B, Page 564 


1l. Sf(x+et) = 2 


ar 


> 2(—1)!+" — 1) sin(n7 x) cos(2nz és T" 3 
l. u(x,t) = D2 4e singra co) 3, X A, X (0) = 0, X(r) 20; 17 -3 5 —À 
ta c? f" (x +ct) 
3. (a) 2c2e(- 6*0) (51 4 2x? + Axct + 27202) = 22e 76D (1 4 2x? + Axct + 26212); 
2c?g CC C900 (1 3s 2x? — 4xct + 2c) on 2c?e C Cater) (_] f 2x? — 4xct J- 2c?t?) 
(c) » (d) (e) 


(b) » 


9s I 15 225939 


9 


11. (a)u; = —9sin(2x) cos(3t) = n u(0, t) = 0, u(x, t) = 0, u(x, 0) = sin 2x, “(x,0) =0 (b) f(x) = u(x, 0) = sin2x 


(c) 9 


i, a 

A 
ANY 
s» 


at 


(d > (f) 
A 


eo 


SS » 
FEO 
Uy Ls 


13. (a)u(x,t) = 35. 


m=1 


N 
Un 


4 sin( 1 mz )sin(mx) cos(mt) 


(b) » (c) 


zm? 
R A 


" 1 e V? sin(1A/—] + 4p?t 
. (a) T, (t) = e^!?' cos(7 y —1 + 4n?t) + - ) 


4 —1 + 4n? 


—1/2t sin( 1 4/—1+4n2 x 
o 5 (=D 4 10) (e^ cos(24/—1 + 4n?t) + E --— d sin nx 


X —1+4n? 


(b) u(x, t) = » : 


n=l 


zn? 


(d) 


—1/2t ancl 2 
. —1/2 e sin( 5 4/ —1+4n-r) * . 
c sin(inz) (e 1/2 cos(14/—]1 + 4n?t) + cmm em) sinnx 


/ —14-4n? 


(b) » 
A 


> 
wn 


(c) 0 dá 


5 
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A-86 Answers to Selected Exercises 


Exercises 24.2- Part A, Page 567 


—1)"—1) sin( 13 ax) sin(nt) 1 i 
> zc oo A6) 1) GL a c) = $^ 
2. u(x, t) — D -iag28 n?z (n--2)(n—2) 3. Let d SM L 


Exercises 24.2—Part B, Page 567 


50 > 2 3 $8 4 Sino tanga 4,4 
2. (a) u(x,t) = y d — 100(5 cos inn — 5cos inn — nz sin $nz + 5cos nz — nz sin znz — 5 cos(znz)) sin(3nz x) sin(3nzt)/(n*x ) 


(b) with 20 terms y (c) (e) 
we 
0.8 + i 
0.6 o3 
04- Í \ 
021 f À 
opeet d RR S 
0 1 2 3 4 
-— P jo C2 sin Gnn) + sin(Gnr))e i7 sin(3/4n? — Iz) sin(nzx) 
. (a) u(x,t) = 2 ; : = : 
"€ n?z?/4n — 1 
(b) 7 (c) (e) 
it 
0.8 - 


0.6 
04 4- / 
0.27 x 


Exercises 24.3- Part A, Page 570 


2. (a) F(x) = 4sin(x)x? + 2 sin?(x)x + i sin (x) — 4x? — 2x — 1 


3 


(b) F'(x) = 4cos(x)x? + 8 sin(x)x + Asin(x)x cos(x) + 2sin?(x) + sin? (x) cos(x) — 8x — 2 
(c) F'(x) = 8sin(x)x + 2sin?(x) — 8x — 2 + (2x + sin(x))? cos(x) 


Exercises 24.3—Part B, Page 571 


1. u(x, t) = cos(x—ct)—cos(x-rcr) = eism: 


In this case g(y) = sin y equals it's own odd periodic extension on [0, 7]. 
Exercises 24.4—Part A, Page 573 


2. (a) Substitute the given expression into the differential equation and simplify. 


(b) If f is twice differentiable, then substitution shows each 
term solves the PDE. The sum is a solution by linearity. 


Exercises 24.4—Part B, Page 573 


1. u(x,t) = ean T, (t) X, (x); b, denotes the n-th Fourier sine coefficient of f, (d) 


X, (x) is an eigenfunction of à ——AÀ,X(0)20,X(L)20 
and T, (1) is a corresponding solution of T" + 2e T'(k + c?A)T = 0. 


n oo (20 cos( sna) +sin( 4s nz)nz —20) cos( AJ /2+n?t) sin(nx) 
(c) u(x,t) = > 4 u Lu 1 


zn 


n-l 


Exercises 24.5, Page 578 


1. (a) un = cu, Uy (0, t) = 0, u, (10, t) = 0, u(x, 0) = ix, u,(x,0)=0 (b)u(x,t) = Y adi cos( nct) cos( 5n x); a, denotes the n-th 
Fourier cosine coefficient of f. 


Answers to Selected Exercises A-87 


(e) 


Ot ROOOIS 


10 20 30 40 50 10 20 30 40 50 Ser >r 


2. (a) un = cĉuxx, U(0, t) = 0, ux Gr, t) = 0, u(x, 0) = 5 u;(x,0)—0 (b) m cos(c(3 +n)t) sin((3 +n)x); b, denotes the n-th Fourier 
sine coefficient of f. (c) ^ (d) 0 x (e) , 4 
351 
2 En 
05+ 
at} 
05 5 10 15 20 ‘ 
- x 43/2 3 \3/2 
5. (a) u(x, 0) = (3) (b) ui = c^uxs, Ux (0, t) — 0, ux (5, t) = 0, u(x, 0) = (3) 
denotes the n-th Fourier cosine coefficient of u(x, 0). 
(d) 4 (e) 
0.84 " 
0.64 i 
044 af 
02 d 
Ol 5 10 15 20 25 30 ld i 3S9 d AD | 
7. (a) uu = cu us (0,t) = 0, uy (a, t) = 0, u(x, 0) = —=,u;(x, 0) = 0; u(x, t) = eat cos(nct) cos(nx); a, denotes the n-th Fourier 
cosine coefficient of u(x, 0). 
(b) y $ m 52 , (c (d) (e) ,t 
-03 " 
-0.5 BEFRIA JA 
-0.7 it 
“09 OATS VS VS 
—Á— » 1 
0 5 10 15 20 


Exercises 24.6-Part A, Page 583 


1. u(x t+h,t) + u(x —h,t) = 2u(x, t) + uy (x, t) 2 u(x,t) = a 


Exercises 24.6—Part B, Page 583 


(c) (d) 
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CHAPTER 25 


Section 25.1, Exercises A, Page 590 
L. D =A T' - KT 50; X — X 9 X" — AX =0. 4. 0.8824969026, 0.6065306597, 0.1353352832. 
5. In case of non-homogeneous boundary conditions the method will fail because we don't know how to divide the non-zero boundary conditions 
among the infinitely many solutions. 


Exercises 25.1—Part B, Page 590 
1. In the beginning the heat flow through the endpoint rapidly increases, 


but after a while the flow dies down as the temperature in the rod uniformly 
0.3 
Med approaches zero. 


0.1 


0 2 4 6 8 101214 


oo It .: 
(=p + De 1/2n*t sinnx 
3. (au(x, t) — >) 4 ; (b d 
(a) u(x, t) 3 — (b) ud 
1 
0 t 
=] 4 6 8 101214 
E 
8. 0.4840934508 
oS ((=1) e + Det”) sin nx 
9. (ayu(x.t) ) 4 b 
(x, 1) » ai (b) (c) 
1 
0 


to zero over time. When h = 1 there is a term which does not die off. 
When A = 3 there even is a term which increases over time. 


Exercises 25.2, Page 593 


2(-1)!" = Len Am? sin(iznx) 
—À5 (b) 


2. (a) u(x,t) = y 108! 


n=1 


m?n? 


o-nmuuds 


Answers to Selected Exercises A-89 


E Ux (3,t)—Ux(0,t) _ 3 
(a) Qo = 7M (8) Jo Ur(x,t) dx d wr 
(b) The expressions are too large to display here. 


.. 79,908,043,688 M 
(c) A Quot = 37,550,625 x4 


^3 r — 79,908,043,688 M 
(d) Mf, U(x, 0) dx = s0625 a? 


(e) The expression is too large to display here. 


oo 


12. (a) u(x,t) = Y a,e" sinnx. Ifn #2 then a, = GZD D a =0 (b) 


m(2+n)(—2+n) ° 


n=1 


0.3 


Exercises 25.3, Page 597 
git + Le /"" t cos nx 


s 
n^ 


2. (a)u, = uxx, Ux (0, t) = 0, us Gr, t) = 0, u(x, 0) = x(x — x); u(x, t) = ig. 


5 


(b) 40 terms 0 t (d) lim, >œ u(x, t) = iz? 


Exercises 25.4, Page 601 
3. (a) 


== i —2n?n?t i: 
10. (a) u(x, t) = e — TA m. —— (i 


(c) exact: 1.656467786 
1+n?n2 


numeric: 1.656465773 
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CHAPTER 26 
Exercises 26.1—Part B, Page 606 


oo . . 
((—1)!*" + 1) sinh(n(1 — y)) sin(nx) 
2. (a)u(x,y)= > 4 - : c d) x 
90 SOS) 2 z n? sinh(n) diis i 0 05 1 15 2 25 3 
n- Pid 1 
g lx. AZA 
(b) u(ž, 5) = 1.110562454 p - 
f, 10.6 5 
gi 0.4 
N 0.2 
RA 


NANA S888 
wypas 
EREPPPEETE 


Y 


Exercises 26.2-Part A, Page 611 


fog) sin tnax dx 16 sin( 1nz)nz —sin( 3 nz)nz +4 cos( Inz)-4cos( inz) 2 n 


1. 


1 
2 sinh nz sinh(nz )n?z3 


Exercises 26.2—Part B, Page 611 


2.5 n j M 
3. u(x. y) = yo 9 CD” —4+n n7) sinh(ny) sin(nx) r 
(a) u(x, y) n=l 12 zn? sinh(n) (c) 


2 25 3 
; PX 
(b) u(Z, 1) = 2.917603834 Ho 
8 0.8 
4 0.6 
0 » 
0.4 
0.2 
0 
(e) » (f) > 
A À 
Ip- 2E WC 
og A dl 
Llirggí 
0.6 i; 
T 
044 
- X 
9. gs 115225 3 
De x 
(b) x 


0-05 L 15 2 25 8 
- - 


i D 05. - 
B Ap: 
10.6 " 
0 Mon 104 
| | pe 


Answers to Selected Exercises 


34. ; y (b) x (c) » 
< 0i a 05 1 15 2 25 3 
K ie 5 1 
UTER 0.8 
aS 
0.6 
E oce ee y 
* 0 0.4 
^. BIEN 
i AWAAWA x 
(d) » (e) os (f) 0 
| i PANI 
^ 04 —— - 
si 0 05 1 L5 2 25 3 
0.6 
x 
0.4 
0.2 
45. (a) (b) » (c) 0 
1 
4 0.6 
3 0.2 " 
1 0 05 115 225 3 
0 
xercis 40.5-F 4 "D ur 
Exercises 26.3—Part A, Page 616 
1 A. = 16 4+4 cos inzcna sin dnatnx sin 3na+4 cos nzt —4 cos inz 
7: ATE sinh(nz )n?z3 
b d ;QORAYy $ “b ; sn Ary ; 
. "nu [ore] E: nz(a—x) ot nny ss TX : ny yy». Jo f(y) sin Ub dy 5 h F(y ) sın b dy 
4. u(x, y) = pn sinh( —7—^7) sin( ^) + B, sinh(“=) sin( b DH An =2 bsinh =r pom : 
à b 


b sinh *z* 


Exercises 26.3—Part B, Page 616 


ab R m 
co nx . nay JI F(y) sin "2 dy 
l. u(x, y) 2 X A, cosh b sin ;:A 2 


b 
sn = 2 


b b cosh "44 
n=1 b 


X (DH + DsinhGen(—x + 2)) sin ny 
14. (a) u(x, y) = 4 : = - c) 
id: 3 m?n? sinh nz? 


; +) = 0.001855494658 


b) ut 


oo 
ROO 
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A-92 Answers to Selected Exercises 


(e) » (f) » (g) os 
A 

i Y 04 
E. 0 , 
27 7l 005 | L5 2 25 3 
0.6 x 
04 
0.2 

+ x 
Ol oS 1 15225 3 
4 E > X 


19. (a) u(x, 


x ((—1)" + 2) sinh nz x sin nny 
»24 = (c) 


m? sinh m?n 


nzl 


(b) u(%, 3) = 0.0009277473290 


0.12 


0.08 M 
` 0 1 M y 
104 
102 
0 
(e) » (f) y (g) os 
i ^ i Li Y 04} 
€ 0 P 
0.84 Us | 005115225 3 
0.6+ x 
0.64 o4t See 
04 0.2.4- f 
0.24 zl + x 
05051152253 
0 
26. (a) 0.8 | 
> 0.4 | 
0 " " + 


0.4 


Exercises 26.4—Part A, Page 621 
1. If dx = dy then (26.14) becomes v, + Uy 41,5 — 40pm + Up ma + Unm—1 = O. 


"- =), 9 D 
z Un—1,m QU p,m + Untim Un, m1 ZUn.m F Un.m—1 Z UO, m T 4LVI,m 
>: A t = =0,1<n<N-1,1<m<M-—1,and ; - 
dx? dy? dx? 
U0,m4-1 — 2V0,m R3 U0,n—1 


Ty? =0,1 <m < M — 1. The Dirichlet conditions along the other sides remain unchanged. 
dy? 


Exercises 26.4—Part B, Page 622 


Un—1,m — ZU m er Un--1.m Un.m+1 — Dam JJ: Un. m Un—1,0 — 2Un,0 + Un+1,0 


l 
1. "D = —0,1n«N-—1,1 € m «x M - l,and T 
dx? dy? dx? 
2 E ij —2 ) —2v 2 
ZUn,] — £Un,0 Un—|,M — ZUn,M + Un. M ZUn, M + 2Un,M-1 - es 
Z =0,1 <n <N — 1, and — ? = z s jy £ = 0,1 <n < N — 1. The Dirichlet conditions along 
dy? dx? dy? 
the other sides remain unchanged. 
» 9 
Un—i,m — ZUn,m + Un+1,m Un,m+1 — 2Un,m TU m—1 Un-1,0 — 2v, 0 xl Un+1,0 
4. i? + - = om =0,0<n<N-1,0<m <M - l,and = 
dx? dy? dx? 
4 = i 9 2 
2v, | — 2Un,0 200m + 2vi, Vo.m+1 — 2U0,m + Vo,m—1 ale ii 
DG ^ xe 0,0 <n < N — Il, and F — m 7 us 7— =0,0 <m < M — 1. The Dirichlet conditions along the 
dy? dx? dy? 
other sides remain unchanged. 
—2 2 ? ? 
= Un—1,m £Un.m + Un--1,m Un.m--1 — 2Un,m =F Un,m—1 ZUQ,m T ZU]. m 
5. = + = - =0,0<n<N-—1,1<m< M, and -——__—— 
dx? dy? ax? 


Vom+1 — 2V0,m + V9.1 n—1.M — 2Un.M + Vni. | —2Un.m + 2Un,m—1 


l 
—0,1 € m x M. and 


= 0,0 <n < N — I. The Dirichlet 


dy? dx? dy? 
conditions along the other sides remain unchanged. 


CHAPTER 27 
Section 27.1, Page 626 


(ix — 12e? sin x 


3. (a) u(x,t) = - 4422 = 


(c) (d) 


0.6 


0 02 04 06 08 1 


T 
+92 


(— [yg a sin 


TH 


(—1)" e?" sinnx 


1 " 
197 X 


9. (a)ju(x,t) = —2x +20 + 0 


n-l 


(c) ^4 (d) —2x + 20 


a 
0 2 4 6 8 10 12 14 


Section 27.2—Part A, Page 630 


1. Because the eigenfunctions are orthogonal, the coefficients in the summation preceding (27.6) need to vanish. This produces (27.6). 


2. Substitute (27.7) in (27.6) and simplify. 
Section 27.2—Part B, Page 631 


(f) 


(—1)"n sint 


N+ 


(4n4 + l)zn 7 


xcost «. (—1)" cost 
ET x,t) = ——-r 2 
(a) u(x, t) * + » 


(b) 


ncost 


(4n* 4- 1)x 


sint 


“(4n* + 1)a0 


) sinnx 


n 


. oo 

X sint 
8. (a) u(x, t) = sint — + ( 
(a) u(x, t) = si = 2 


z (nt + 4)x 


(nt + 4)zn T 


4 
(nt +4) 
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e 2r (ys 
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(b) 


CHAPTER 28 


Answers to Selected Exercises 


(d) 


Exercises 28.1—Part A, Page 639 


2. 


0236910 
X23. 5 $59 


18 
5 


Exercises 28.1—Part B, Page 639 


2. (a) x «0, 51,7 (b) c = = 


11. 


16. (a) XI Yu a (6m (3e-* (—1) m --3e77 (—1)" pe (—1)yrtg? 


21. 


(a) u(x, y, t) = 


oni Done (8 7 D) mn + 2(-1)nt"n?g? + 8(—1)" + n?z?(-1)" +4 + 4(—1)!*?) sin(nx) sin(my) cos (4x n 


(b) 


NI% 
(o 
N 
I 


vit 2 1)/ Gom? n?) 


e7( 1)" m? ( ])"*"e77 ; + e-* (-1)";z — (—1)*** e" m? + 


e" m^(—1)"z +3(—1)" —3 — m?(-1)" + m? — (—1)y'z +7 — zm? (—1) + zm?) sin(nx) sin(my)/(( + m2) n?z?)) 
(b) (30 terms in both x and y) 9 og (c) R9. y 
Z 3 d 
6 
81 9, 
4 -2 
ds 0 is V 5-3 
3 x 22 
(a) 


1)?" 529? + 3(—])!*"*" + 3(—1)"*") cos(nz x) cos(mz y) 


2 owv/(^4c 
zx 


m=1 n=1 
e2 


9 n?n? 


Eye (—1)" cos(nz x) 


n=1 


4 (5(-1)'*"*" — (—1)"*") cos(nx x) vn) 


n?z $m* 15 n^z^m? 
»( 4 (Am?n?(—1)" + 3(—1)*" + 3(—1)") cos(mz y) n 4 (5(-09*» + pns») 
45 mint 45 m?x? 


mzl 
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(b) (c) This f is not odd. 


Exercises 28.2—Part A, Page 643 
2. T. (t) = K Qu 23 Im) Thm (t) =0 => T; (f) ex? (5 sp m )Tam (t) =0> Thm (t) = (Cg OTOP RA 


nm nm b2 


os a T x TEES r b , "ES. ] Š E 
3. Using the orthogonality of the trigonometric functions and fj fy sin? ^** sin? ™ dx dy = jab, one obtains that the dnm in 

"(v v)-— eo oo MX oin "my : _ 4 fb [a "e nax gin MEY Jo 4. 

F(X, y) = oo dnm cos ^ sin 77" satisfy dam = 7 Jo Jo f (x, y) cos * sin "77 dx dy 


Exercises 28.2—Part B, Page 643 


co oco . . 22? ((n? Ja? 2,42 
8 (—(-1)"" + 2(—1)!+™ st (—1) + 2) sin(nx) sin(my)e~2* ((n* /z^)-- (m^ /n^))t 
2. (a) u(x, y, t) = - 
LIP P anmi 


m-ln-l 


(b) 


0.016 
0.008 
0 


| T i x t F + t >x + + t F + œx 


0 05 1 13 25 3 0 OS 1 15 2 25 3 


, 2 & 4 1 I2(-D"(-0" — 12(—1)” + 2z?2n* (-1)" 
fa (a) uy D=) ap ge ) ) ) 


t3 -] 
t3 
I 
w 
© 
> 
in 
[7 
N 


drum ment 
m=i n= 
oo ] z*(—1)" 1 x4 ; —2n?t 
1 —64- 6(-1)' + n?m? EROS E (— 2; ++ +—55) sin(my)e 
; —292((n2 x2 2 » 60 m? 60 2 
. E ) cos(nx) sin(my)e zt * ((n* /n^)2-(m^ /n^)t 4) m m 
3 mn m-l M 
(b) 
« EN 2e-06 
0.004 LEON 1e-06 
0 
-1e-06 
—0.004 —2e-06 


N+ 
N 
tn 
w+ 
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œ 00 2 á » 2 " " 

12. (a) u(x, y, t) = » es ( : om n a ; Ta ad ) sin(nx) cos(my)e 2? ^ Hom Int) 
xX 1 x(rn(—-1)" + 2zn) sin(nx)e-?** 
2, 15 n^ 
(b) p y 


w 


[n 


8e-10 


le-05 D< 4e-10 
0 Se 0 
—1e-05 SM. -4e-10 
Nd 8e-10 
EN ao 
SES 0 0 
3 X 
(d) » y 
4 
| ee : 
2.5 2.5 
2T D at> 
L54 ist 
E" 1s 1 


r ae AAA yy 
15 5 3 © 08 1 $20 2 os À 
17. (a) u(x, y,t) = 

4 l6zm(—1)"(—1)" + 81(—1)"(—1)" (-—1)" e . 4 2 2 
X A = (4 5 1 64 > -)sin( (2n + 1)x) sin(z (2m + Lye PU /4@nt °F 1/4@m+D 
meee (2m + 1 (2n + 1»? (2m + 1)3(2n + 1)2 2 2, 
(b) 0 " 

0 0 NS RES 

SR ANA S 
0.0001 -1e-08 S ES. 
0 
3 b 

(d) y y y 


3 3 
B 2.5 
2 2 7 
L5 1.5 ` 
1 

0.5 0.5 
0.5 

N x A x K 
0 05 17 15 2 25 3 0 05 1 15 2 25 3 O° ds d 15 2 oe 4 : 


CHAPTER 29 


Exercises 29.1—Part A, Page 648 
3. With 4 = —4?, 9(0) = o, cos(u0) + B, sin(u0), GO(—1) = Gr) > —2a sin(u) = 0, O'(—z) = G'(zx) > 2f sin(ux)u = 0, so u =n, 
resulting in eigenfunctions o, cos nÓ + B, sin nO 4. R(r) ci - c; lnr 


Exercises 29.1—Part B, Page 648 
2. (a) u(r,0) = irsin (b) 


| 
t 

I 
ox 
N 


N 


Answers to Selected Exercises 


13. (a) Eneee =0 (b)u(r,0O) —rsinO (c) (d) and (e) 
oo 3 167^((—1 l+n te 1 „ån sin 4n@ 
19. (a)u(r, 6) =)> LI M 


TN- 


n=1 ^ 


(d) Flow lines are perpendicular to level curves. 


oo 1671+" CT l+n =f DY Camas _ (1)")sin 4n@ 
30. (a) ulr, 0) = 724 ; an ie 


n=1 


(d) Flow lines are perpendicular to level curves. 


oo 1641)" + Dg + ery sin 4n0 
dh wangka x56 + Dn 


n=) 


(d) Flow lines are perpendicular to level curves. 
Exercises 29.2, Page 654 
= Al rf (r)JoQ ar) dr 
o? cosh(Ayh) J? Axo) 


4. (a) u(r, z) — y» Jo (Xr) cosh(A,z), Ay = 


k=l 


2 
3 43 
2.5 d 
2 2:5 
1:5 T2 
1 er *X 
0.5 ES 
0 
T 0.5 
PÜ 


(£) Flow lines are perpendicular to level curves. 


A-98 Answers to Selected Exercises 


oo 
15. (a) u(r, zZz) = Ag Jo (Xr) sinh(A;z), Ax 
k=1 


2 fy rf (r)Jo(G ar) dr 
6? sinh(A,A) J? Axo) 


(f) Flow lines are perpendicular to level curves. 


Exercises 29.3, Page 658 
| 2 So rf (r)Jo(Agr) dr 


3. (a) u(r, t) = Aca) cos(eA,t), A, = 


o? J? Aro) 


(b) A 


Exercises 29.4—Part A, Page 663 
1. Make the substitution z = cos $. 5. R(p) cip cp 


Exercises 29.4—Part B, Page 663 


3. (a) u(p, 9) = Y Aro P. (cos d), A, = “42 f" f (4) PL (cos 9) sing do 
k=0 
(b) 


Answers to Selected Exercises A-99 


Exercises 29.5, Page 667 


I. 


N 


14. 


(b) ak SE + BS = fe (©) azot = orot + Bio (d) kako = agko™™! + B,(—k — 1jo ~* 
S feko (k — 1)(Sa?)* fuS** P (2k +1) 


e W- H = d 
HP kka (0?)* — kk(S?)* S — ko(a?)* — k(S?)*S — (S2) S k —kko (0?) + kk(S?2)*S + ko (o?)* + k(S2)KS + (S2)*S 
fS“ (k + ik +1) 
w= 2 23k L( 25k , 2k — ø S2 2\k 
Kko(a7)k — kk(S?*)*S — ka(o?)* — k(S?)*S — (S?)*S 
T fuS** (k +k +1) " 
f) U(p, = - 
uites 2 ko (03) — KS — ko (oF — kS S — (SFS T 


Sfeko (k — 1)(So?) e :j P, (cos) 
«(COS ; 
kko (0?) — Kk(S2)kS — ka (32) — k(S2)FS — (SES? i 
= fS (2k + 1) r 
] a = 0^ P, N 
(9.9) = ) eg GE EMSS + ko FF SVS 3 Gorg? Prod) 


k=0 


(a) U(p, p) = Yee + Pep!) Px(cosh) (c) z (d) Flow lines are perpendicular to level curves. 


(b) Take eleven terms. 


(b) o4kS*-! + Be(—k — 1)$-*? = fy (c) auo" = arot + Bo! (d) karkat! = ako"! + pk(—k — 1)o *? 
fx SV? (ck +k 4- 1) 


e) o, = ; 
(€) o k(k(S?)* S + k(S2)* S + (S2)*S + cko (02)* — ko(o2)* — (o?) *o + (o2)*ok) 
B= fir S20 (x — D0? S)* . 
E KG2y Sk -kGDYSS + (2*8 + ko (02)* — ko (62)* — (o2)*o + (o2)*ok" 
fS"? (2k + 1) . . 
dj ; Clearly ao and œo are undetermined. Moreover if 


~ K(k(S2 Sk + k(S2ES + (82) 8 + ka (02) — ka (a?Y — (o2)*a + (o2) ox) 
fo = 0, then fo = 0 and the equation found in (c) dictates that ag = ap. Finally if fọ 4 0, then Bo 4 0 which contradicts the equation found in 
(d), so in this case there is no solution. 
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oo 


(f) U(p, 6) = 9 X 


k=0 


FAS? ck +k +1) k 
k(k(S?)* Sk + k(S?)*S + (S2)*S + kko (o?)* — ko (0?)k — (o?) *o + (orton) 
f. S?o (k = D(?sy 
k(S2)* Sk + k(S2)* S + (S?)*S + ka (02)* — ko (0?) — (o?)*a + (o?)*ok 
ES ^ Ok+2 (9) 
u(p. 6) =) x Le - & iac - - — 
(k(S?)k Sk + k(S?2)* S + (SHES + cko (o?)* — ko (o?)* — (o?) *a + (o?)*ok) 


)p *" P, (cos $); 


p* Pr(cos $) 


k=0 
15. (a) u(p, $) = Y gap" P: (cos $); U (p, 6) = Yos go p + Pup") Px (coso) (b) Take eleven terms. 
(c) (See plot.) z (d) Flow lines are perpendicular to level curves. 
CHAPTER 30 


Exercises 30.1—Part A, Page 674 
2i (a) LE fi G, »)] = Xu (b) Lyl fr, »)] = oe (c) Lf, y)] = -e (d) Ly[ fy, y)] = - (e) Ly[fex (x, y)] ———— 


524-1 524-1 
C LL, G6. I=" (g Lf )) 2 899. h LEG )] 9 4 


s 


Exercises 30.1—Part B, Page 674 


2. (a) u(x, y) = Q- 4x H(y — fx") 13. (a) sU(x, s) = 235 U(x, s) (d) wa 
(b) b fas e!/2V 25x | (p-1/2x) 2s E 
(b) U, 5) = — et 08 
(c) lim, +0. U (x, s) = je VE 04 

0-2 H4: 9 
-0.2+ 2 4 6 8 10121416 1820 

-04 

~0.6 + 


18. (a) u(x, t) 
(b) 


ll 


20. (a)(H(r — == Ez) — H(r — ==) sin(-t + ££) 


s? (s? p(eP*? = pte”)? ES 2(eP5y? 4 Jer PS) psx 


28. (a) s(sU(x, s) xe) = SU (x, s) (b)U( s) = (Sex — sxe — 2se7 - 
) ) ax* ( ) ) e e ePtPs(s4(ePs)2 - 25? (ers)? + (ers)? uan st -1 + 2352) p 
s?’ (s? ple”) 7” pler}? — 2(eP*y? + ZePtPs)esx s(s? p(e?*)? _ ple” y — 2(eP*y? + 2ePtPs yess 
~ eP+Ps (54 (eps)2 " 2s? (ePs)2 + (eps)? eem b uem | 4 252) eP*Ps(s*(ePs)? E 2s2(ePs)? + (ers)? = st = f + 252) 
al = DVePtPS) gS oPS—P gsx d ay. a — 9 9 o(PHPS)) 63 p(Ps—P) p(—sx) Dogs c Sy 2oP- ps ps—pp-sx 
(sfp—p SE )"e i ,$ p-p = 2e )s"e = (síp—p = )se bs y/G* — 2s? +1) 
(s* — 2s? + 1)(—1 + (e?) (s* — 2s? + 1)(—1 + (e)?) (s* — 2s? + 1)(—1 + (e”s)?) 
s(s*e-*x — xe? — 2e7* + 2e7*) 1 "TES l 1 ' À 
(c) U(x, s) = (d) u(x,t) = 5(x — e? + 5(x + a — x)e + (-1 T x)e^*)H (t — x) 


st — 2s? +1 


(e) 05 T 
A 46 
0.2 
U 0 
-0.2 
4 
$9 x 


Exercises 30.2—Part A, Page 681 


sin(—a+ax)+sin(a+ax) 


2. E cos(a(B — x)) dB = 
Exercises 30.2—Part B, Page 681 


[S] 
Un 


— 
1 ai 1A 
(b) f(x) = foe a (3 al 
2 T 
© fG) = Lf, - He ae 
(d) Ao) = — y: B@) = 2g 


| 


b) u(x, y) = ifs [S fB) cos(a(B — x))e dB da 


T 2..2 2 2 
2x arctan( I )—y In(y? x?) -2x arctan( € )+y In(y^-1-2x4x^) 


š l 
(c) U(x, y) = 5 = 
(e) 
-3 -2 -1 0 1 2 3 
! I—34 t ! t 3 
T25 
T2 
415 F 
T! 
T 0.5 
(oN 
+0 
^00 p sinh(@y) n =. n sinh(wy) sin(a) cos(wx) 
(b) dn fü» sinh o cos(a (B x) dp = o sinh(o) 


u(0, 3) = 0.4725062710 


alpha 


alpha 
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1 
- 


) = 0.1107956086 x 10? 


A-102 Answers to Selected Exercises 


37. (a) 


dore) ; sh(ay) r cosh (ay) (sin(a) cos(ax)—cos(@) sin(ax)+sin(a@x)) 
(b) Le FAS ay cos(a(B —x) dp z= cosh(a y )(sin(a ) COS! c TS! 


o cosh(a) 


cosh o 


(d ^4 u(0, 2) — 0.4051093372 u(5, 1) = 0.0006658926660 


Exercises 30.3—Part B, Page 688 

i(—e7* +1) 
Eh AN 
i(—e™* +1) 


2. (a) A (b) F[f(x)] = 


(o) F[f G0] 2 — 


(a) 2 [^ FLf]é** da = $HG) - 3H C3) 
IH(x—1)4£iHü-x) 


+ x alpha 
-1-05 0 05 1 15 2 (e) 5 H(x) iH( X) iH(x 1+ iHü =x) 
—1+2ie qe —. i — 2e ne 4 jee 
12. (a) F[f G0] = z FIF œ = 
a? a 
(nra? + 2ia rje ia 
22. (a) FIF] = 2 ! 
(a) FIF] a^ — 2a? + 1 at —2o? + 1 
"— (=r? + Aix à? — Aix a + 217a? — nat -- 2 ++ 692)e7i7* 2+ 6a? 
F[xfQ)] = 7 j 7 2 
a$ — 3o^ + 3a? — 1 o5 — 3a^ + 3a? — 1 
l + EL i(—1 + ge) 
30. (a) F(a) 22———— ——— (b) g(x) = 1(— cosQx) +1)H(x)+ $(-1 + cos(2x))H (x —^z) (e) F[g(x)] = —2 


(a — 2)(a +2) o? —4« 


Exercises 30.4—Part B, Page 693 
2. (au, t) = 32H(x +1 +t- H(-x - 1-0 HiH -1-0) - 3H(-x - 1) - 3H(x — 19 0) 
iH(-x-*1—1:)—iH(x-1-1) 4 iH(-x-1-t) 
(b) u(x,t) = $H(x -1—1) -iHa -1—1) -3H(x 1-0 - $H(x — 1-1) © 


10. (a) u(x,t) = im (erf (x +t) +erf(—x +1)) 
(b) u(x,t) = i erf (x F t) 7 4 ierf( x +T 


—a? + iat) sin(a)e 
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fax 


.[ 99 
T J—oo 


2z J—oo 


29. u(x, t) = + f (era 1799 (49? + /1— 4o? — 1) — (1 — 4a? + 1 — 4o?)e 


Exercises 30.5, Page 695 


T 
I 


Gr 


da 


a 


1/21 (1—4/ 1—4a2) e'** sina da 


(—14+4e?) 
(d) The flow lines are perpendicular 
to the level curves. 


lxt) v2 /8 dx 
2. (a) u(x,t) = lxerf( S727) FET i lx ert ( 4t 


2 vt 
(b) 0 | "E; (c) X 
a sante, 
(1 4s i : I—-5 
0.2 Ja 
U p ls 
-02 
74 T? 
4 2 L X +1 
CIA? I 
13. (a) ux, t) = (H(x t rt - 1) - H(x rt — 1)) sin(x (x + rt) 
(b) (c) A 


(c) T 
5 
E7 . T E 0 2 TK 5 10 <5 0 5 
(g) The decreasing temperature profile moves to the left with speed r. 
e o tx? fne) 
32. (a) (UG © 


U 


E 
i 2 3 4 5 
(h) The decreasing temperature profile moves to the right with speed r. 


tzl.kappa-l -2 Y t= 1, kappa= 1 E 
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Exercises 30.6, Page 698 


f ] sin(2)f(x—o) 
1. u(x, y) = m d 
’ = b(cosh( 4?) + cos(**)) 


RC (ns y) 


Lf inh(a(b — y $ —Xx gn] ) = 
à. uy f f &(B) sinh(a(b — y)) cos(a(B — x)) dpda (b) ux. [ sin g(x —o) do 
Jt 


sinh(ba) oo 2 b(cosh(Z 7^) + cos( OY) y) )) 
(c) The inverse Fourier transform will result in an absolutely integrable function over (—oo, oc). 


1 (7 f° f(B) cosh(ay) cos =x * cos(4 =) cosh( iu '(x—oc 
3. (a) u(x, y) = Í f (B) cosh(oy) cos(a ($ — x)) dids (b)u(x,y) = | yr ) " 
ui cosh(ba) E 


b(cosh(42) + cos(>*)) 


oo 


0 
] f? fe sinl » — b)) cos =i o sin} 205 2) + cosh(1 Z2) 
E E A / g(B) sinh(a(y — b)) cos(a(B — x)) dBda (b)u(x,y) = x fim In( 3 jets matic 
m cosh(ba)a Qn cosh(1 1 z2) sin( (i m b ) 
(c) The boundary y = b is kept at temperature 0, while the local heat flux on the boundary y = 0 is prescribed by u(x, 0) = g(x). 


. L X 1—x 
Exercises 30.7—Part A, Page 702 3. Integrate by parts twice. 5. 1— H(x) = " oe H(1 -x)= 9 - au 
0 x>I1 1 1-x20 


Exercises 30.7—Part B, Page 702 
2. (a) F, [1] = 24/2 
17. (a) 4 (b) u(x, y) = 2(— arctan(22) — iy In? + 4 — 4x + x?) + 1x arctan(52) + 
i+ 


iy In(y? + 4+ 4x +x?) + arctan(*==) + arctan ( 222) arctan(?*5) 
Dj — Ly In(y? + 1 92x +x?) + 


0.8 + 


0.65 ty In(y? + 1 — 2x + x?) — x arctan (= 


044 
x arctan( == Es )— ix arctan( 2 yy 


be ee 1 14 18 3g 
30. (a) i —6 — y) arctan($2) + (— 6 + y) arctan(— $22) + (6 + Éy) arctan(?£?) + (-$y + 6) arctan(— = y+ (2+2 x) arctan(*1) + (2 — 
2x) arctan(4—. t) + (~x — 2) arctan( 255) + (x — 2) ) arctan (=) — y In? + 1+ 2x x?) + Ty ln? AA +x?) - yIn(y? -1—2x 4 x?) — 
$x In(x? 436—12y +y? ) — 2x In(x? +25 + 10y + y?) + 3x InG? 4-25 — 10y + y?) — Sy In(y? +4 — 4x x?) + 5x In(x? + 36+ 12y + y2)) 
(b) (c) Y 


RUN E - 


l 2 3 4 5 


Exercises 30.8, Page 707 
3. (a) F.[f 00] = 3 (b) £F. [f ()] = m (c) Except when a = 0, f(x) is not an even function. (d) £F. [f"(x)] = As 
02/20 


| OFM Ol = AERE OFM = mei FAO = A 
Vi (aa) ber: j” Vn (a2 0232) 


Eds = V2(-a? +02 yi. v2aa 
(g) F [ef 60] = — 35255: xf 020] = 2753 
A ma ^ -— V2a(a? ca? +w?) oy ee x r ES 2a (a? -a? —o?) 
(h) F Lf (x) cos(wx)] = r (a2 +a 2)(a2--o? —2ac--a?) Ff (x) cos(@x )] V Jn (a? a? Hawt) a o? -2aw+w") 


V7 (a^ --a^ 3-20.04-0? (a? --a 
V2aaw 


i c) sj eT e V2w(a? —a? —o? ) NOM , 
() Lf GO sin(ox)] = — m orisriosotoDatral2aerg5 7 sL (X) sin(@x)] = 27 x mrs lea 


DFAS feel Eus 0974 00)--2 
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23. (a) u(x, vy) — 2 foo sin(a) sinh(a (y 1)) cos(x) da 
- x40 æ sinh(a) 
(b) 


p sin(o) sinh( $ ) cos(2a) 


(d) i = —0.7387722634 x 1079 


20 o sinh(@) 
12 ee 2 fœ sin(@) sinh(a@y) cos(ox) 
32. (a) u(x, y) = = Jo BH da 
" ( ^00 S sinh( $ ) cos(2@) 
X 2 poo sin(a) sinh( 5 ag 9963, - 
(b) (c), , 1(G2fy 97 0.7387722634 x 10 
=A I 
oe "i I 
y y 
0 
: OO 4 cos(aox) sin(a) sinh(ay) V2 cos(æx) sinh(ay) /2 cos(ax) V2 cos(ex) sinh(a(y—1)) 
y= 9 a v 9 ) 
41. (a) u(x, y) h = zo sinh(æ) ai Jra? sinh(a) Vrat Ta? sinh (a) da 
(b) 0 Y (c) " X p 
1 1 
l 
U SSLZII, 
0 Y 
0 
— 
rx UK | 
^ 0 
^00 4, cos(2a) sin(@) sinh( lo) V2 cos(2a) sinh( 1 o) 2 cos(2. í 
(d) Ja 2 zo sinh (a) : H2 Sra sinh@) 2GA do ~ 0.0007724864554 
2 7 Ta? s J7 
"um 42 [oo v2 (cos(a)--o sin(w)—1) cosh(ay) | et sinh(ay) sinh(a@) cosh(@y) 44 cos(a@x) » 
63. (a) u(x, y) = mx JO ( o cosh(o) } V2 sin(a)( a cosh(a)o )) a da 
(c) x 
0 2 
ws 3 1 


EX O 


/3 poo , VA (cos(o)--o sin(a)—1) cosh( 4 æ) ' sinh(lo) sinh(c)cosh(lo) 2 a 
aa ap i = o D da e —0.6869479346 x 19-5 


a cosh(a) cosh(a)a 


CHAPTER 31 


Exercises 31.1—Part A, Page 715 
1. ||Pll, = Q* +34 4.45% 3. cos?a + cos? B + cos? y = L tete = ] 4. u = | 146, 4 146, -2 146 ]" 


— Jab Ic? 


Exercises 31.1—Part B, Page 715 
2. (a) |All; = 11; All = 4/69; Als = 5212; [Allo — 8 (© ut (d) ||A + BI? + ||A — BI? = 352 


(b) [Bll = 17; [Bll2 = 4/107; (Bll = 713'^; IBllo =7 (e) u = [3; 286, — 15/286, 35/286 ]' 
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(g (o B. y = (5 8 1] 

(h) Hint: 3(A +B) = A + 1(B— A) 

G) ;(A + B) = A + 3(B — A); į (A + B) 
= jA-F 5(B - 3A) 


(f) It is the half line starting at A in the direction of B 


D. a = $g V221, B = 22/685 17. Pı — Py = P, — P3; P, —P; — P P, 22. See exercise (2i) and use A = P, — P4, B = P; — P, 


Exercises 31.2—Part A, Page 719 
2. (x, y) = Qxi + xy + (x1 + 3x2) y2 
. Observe f(x), x2) = xl Ax has (0, 0) as its only critical point, and f, (0, 0) = 10 is a minimum by the 2”? derivative test. 


Un 


Exercises 31.2—Part B, Page 719 
2. (a), (b)andd()a = —2,B8—3,y 2-6 8 A.B— —19,0 « 108° 
18. (a) and (d) A. B = —54 (b) (rA+sB)-C —635 (c) A-(rB 4- sC) = —660 
23. (a) and (d) A - B = —43 — 701. (b) (z;A + z;B)- C = 261 + 830i (c) A- (z;B--z;C) = 1 — 942i (d) See (a). 
28. (a) and (b) e = —& 38. (a) and (b) œ = —2133, g = 4623 


13 17,258 * 8629 
(c) 


(d) Shortest vector B — «A occurs when B — «A 1 A 


Exercises 31.3—Part A, Page 722 
1. Ax(B + ©) = [2, 2, -4]T 3. Bx A = [0, —2, 2]T 4. Ax(B x C) = D, —2, 0]" 


Exercises 31.3—Part B, Page 722 
2. (A x B) x (€ x D) = [(a3b; — ajb3)(cido — codi) — (aiba — a3bi)(esdi — c1d3), 
(a, bz — asbi) (coda — c3d5) — (asb3 — a5b5) (cid, — codi), (abs — asb3)(csdy — e1d3) — (azb; — ayb3)(cod4 — c3d>)|" 
9. (a) and (b) A x B = 24/6434, 0 ~ 103° 19. C = [264, —132, 143] 
27. (a) Ax (B x C) = [-1380, —633, —1226]" (c) (Ax B)xC = [—1980, —73, —786]* 37. area — 1412417 


(b) —0.6 (d) A-(Bx C) 2165 (e) 


-0.2 y 


42. (a) P; — P; = [-2, 5, 11]; P — Ps = [—2, 5, 11]"; Two opposite sides are parallel. (b) P; — P; = [—3, —6, 13]*; 
P; — P, = [—3, —6, 13]"; All opposite sides are parallel. (c) /17939 (d) 4/602: 11 (e) (-3, -$.0) 


50. (a) T = [45, —99, —117]7; |T| = 274/35 (b) 


x 
0.4 


HAPTER 32 
ercises 32.1 Page 726 


s [-* SRT 6 —m 
a net( |; a= 1 (b) and (c) V = [-10, 24] 


2 -3 6 1 0 0 
ajmef[|6 —9 3 —|0 1 0 (b) and (c) V = [- 4, 3, 2] 
8 -2 -2 0 0 1 
: -70 -2 
21. (a) Y = [-84, —32]"; Y = [52, —9] 0) B= [m eov 
3 

509 573 
. 70 140 
31. (a) Y = [—180, 29, -18]"; '¥ 2[-38, 2$, :9]T (s-|$8 Be 
2 — | 49 
7 21 

11 DOW ‘ 85 39 h)’ 07 ]T r / 
4i. av-w=122c= |i d (bw =[-16, 77] (9'VTC'W = 122 


Exercises 32.2-Part A, Page 734 


2. Compare the coefficients of x and of y. 3. arccos (SX) = im 


4. Both J and uu! are symmetric matrices, so H is symmetric. This implies HH! -— 


Exercises 32.2-Part B, Page 734 


2. (c) and (d) See (a). (g) j (hb) || Pv? = | $V37a + 537b 
(e) Z(x, Px) 20 1 
(£) |x|] = /101 10 

12. (c) and (d) See (a) (e) [3; /17,670 + P y & 155 3/114, 1, B+ 


1085 


(f) (5, /17,670 + 2 + S155 + VTA) + y Cg + gr 17,670 + 


e; /17,670 + 
25 /114 + $ V/155)z = 0 
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na" 

3 

183 

70 

163 |. pry — [—318. =% ET 
105 ;B'v-[ 35 * 105 21 
61 

21 


H? = I — 4uu? + 4duu' uu! = ] — 4u(1 — uuu! = 1. 


E I-3 87a + £/31b =a +b = |ivl? 


871 


871 

(9) v, 0.1 871 a S5 m 54/17,6704-2581--61V/155-- 183/114 
= cR 1085--21,/17,670--246//1144-82 155 | °? * ! 77 0 10854214/17,6704-2464/114--82 V155 
G livi l| = || Pv) || = 1.006678308 for both; (k) vl] = || Pvl| = Va? + b? + c? 


1/2 
24 


| 30. P= 


-4v5 345 6 0 
l }o-[ —14 


2 1 
-148 i438 -4 
3 1 1 1 1 
E 5-510 +310 
wo eR-|ben40 O -avt 
| 1 17 
3 —4V10  xvlÜtg 30 
Ru--2 Ti + (4+ 1/10)4 + (—$+ 35 10), Ztu fu) = $7 
Exercises 32.3, Page 741 
2. (a) y (b) V = (cos p — psin p)i+ (sin p + p cos p)j 


(c) V =e, + € 


(e) e, = cos(p)i + sin(p)j, eo 


T 
| (h) and (i) 0.8378750561 


7 
s; 19 3 0 0 
4738 -2V19|,D=|]0 -7 


© 


19 0 0 


(c)x+5y+2z=0 (du-j- 3k, 


(d) i = cos(p)e, — 7 sin(p)eo, j = sin(p)e, + 7 cos(p)e 


— p sin(p)i + pcos(p)j 


A-108 Answers to Selected Exercises 


16. 


N 
N 


40. 


48. 


2 2 
yag ^5 Xy 
2 2 2 2 y24 ¥2)2 ^ (42. .x2)2 
-- u^—w e 5 vu 2. 5 vu .j u^—w e os Qe") (^x^) 
(b) e, Q33221 t dun ev = —4 u42 T uT) (d) Jo xy x? 
iu» 9. di (y?-+x2)? ^x? 
(c) J p= (u2+v2)? * (u2+v2)2 
® P) vu u? —v? 
MOS (u? +2)? 


(a) V = (cos p — p sin p)i+ (sin p + pcos p)j (b)'V = (4(—2sin(p)/p2(3 cos(p)? + 1) cos(p) + 3 sin(p) p cos( p? 
—2p,/p*(3.cos(p)* + 1) — 2\/p23 cos(p? + 1) cos(p)? p + 5p? cos(p) 43p!cos(p) + p sin(p))/(/2/ PG cos(p)? + 1) — 4p cos(p) 
(3p cos(p)* + p — 2,/ p? (3 cos( p)? + 1) cos(p)))e,4- (-$Qy p*3 cos(p)? + 1) cos(p) 

—2,/p2(3 cos(p)? + 1) p sin(p) — 3p cos(p)? + 3p? cos(p) sin(p) — p)/( NENTZ cos(p)? + 1) — 4p cos(p),/ p? (3 cos( p)? + 1)))e, 


(c) i and j are the columns of Ja (d) e, and e, are the columns of Jon = Tes 


. (a) V = (cos p — p sin p)i+ (sin p + pcos p)j (b)'/V = (i peeping ) e, + (1-55gSgenpet ) e, (c)iandjare the columns of Ja 


2 /p/1-cos p VP4A/1—cos p 


(d) e, and e, are the columns of J4-: = Js 


p 


(a) V = (cos p — p sin p)i + (sin p + pcos p)j (b)'V = ( psin ayer) e, + ( sin ptp cos P) e, (c)iandjare the columns of Jẹ 


(d) e, and e, are the columns of Jo-1 = T 


(a) V = (cos p — psin p)i+ (sin p + pcos p)j (b)'V = (5 cos p + psin pd Z sin p 4- i pcos p) e,4- 

(3 cos p à psinp i sin p E: pcosp)e, (c)iandjare the columns of Jẹ (d) e, and e, are the columns of Jo m Js 
(a) (b) V = —sin(p)i + cos(p)j +k 

(c)'V = (Le, + e; 


A/ p^ 


1 
p^ €o 


(d) i, j and k are the columns of Jẹ, i = ea — sin(p)e, + PE 
z pil 2 
: — Sin(p) psin(p) p 1 
= `e, + cos(p : k= 
J Je? + cos(p)es + 75: es, K jaa? Pie 
(e) e,,€9 and e, are the columns of Jg-1 = Jz’. 
cos(p) į 4 sinp) j + —-=k, e; = — sin(p)i + cos(p)j, e; = cos(p) pi + sin(p) pj — k 


e, 


= Jp Jp J p?+1 


Exercises 32.4—Part A, Page 745 


1. 


zum 3 
e= [oale = [5 8T 


Exercises 32.4—Part B, Page 745 


r2 
N 


.ez[-$ 9) se =[4. a] 


LP. de 0 ny a 
ae =[ 14° 14? 71 3se= 


(c) e; - (e; x e) = —14 


8x?— y? 4 / Ax? y2x 
Qf Ax ey! 2x) 2 f ax cy) Lay A f Ax y u 
woi = 
; 2v 


y 
Vau Ax cy? -Ax a /4x2+y2 


y 


Ni 


[m - " 2 

(a) Jo 5 y2 4x? ee 
af 4x2+y2 -2x 

y2 Ax? y2 Ay f Ax24-. y? 


~ (b) e, = ui + 2vj, e, = —vi + 2uj 


NIK 
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ox. cH T 
(c) y (d) E 72 zi ; [ LS z z] (g) 
u I v 
(e) Js - <a niin 
, udo 28g 
© (JoJo — 1 
Wu lys - 
ue+u*)* u^trv^) |. à ou :Lí( 9. v ; wv? Y. uv H 
24. (a) Jo-1 = > s gar paS (2 a)i t (2 2ia)i = ( unD ) I+ ( 2n )i: 
mam (u2- 22 
eye (& =) i + (2 Zi )i = ( mnm ) i H (ato )i 
(b) y (c) [-i? + v?, —2uv]"; [-2uv, u? — v?" 
—w--v?  —2uv 
(d) Jo — | Oya i "| (e) JoJo je 
28. (a) JaJa-: 27. (b) - 
Exercises 32.5, Page 750 
cos?  —rsinO |. cosÓ  sin6O| ET. : eo Boe asst 
1. Jou = Pr " -— o= be =a | The rows of Jẹ are the vectors e” and e^ respectively. 
3. (a) Vf = (9y — 14x)i +9xj (b) V f = (9r sin(20) — 7r cos(20) — 7r)e' -- (9r? cos(20) + 7r? sin(20))e? 


(c) Use the rows of J4-:, i= (cos0)e" + (—r sin 0)e^, j = (sin 0)e” + (r cos0)e? 
(d) f. 0) = 3 + 9r? sin(0) cos(0) — 7r? cos? (0), f = 9r sin(20) — 7r cos(20) — 7r, af = 9r? cos(20) + 7r? sin(20) 
(f) e = (cos0)i + (sin 0)j, e? = (—522)i + ($59)j, V f : 9r sin(20) — 7r cos(20) — 7r, 25 ser sign 
14. (a) Vf = Q0xy + 27x?)i + (1 + 10x? 4-365?)j. (b) V f = QSu*v 4-258? + Z6 — Tuv? + Zuv* + 2v + 5v)e" + 
(258v? + 25uv* Huty } x: uv? 2 ys +2u+5u>)e” (c) Use the rows of Jg-1; i = ue" — ve", j = 2ve" + 2ue" 


Cr e 9 2 3 2 
(d) f(u, v) = 6 + 2uv + Surv + 860v? + Suv? + ĝu — Suto? + aut — 20%, 


8 
af 2 2 2 2 5 af 2 2 27.2 2 5 
9f —25w*v + 258u203 + Zu’ — 2,9? + Zuvt + 20 + 5v5, 24 = 2589? + 25uv* — Lutu + Z2 — 205 + ou + 5u5 
4 4 jv 4 4 


ðu é 

(f) e" = u i+ E v )i; e" —(— v ji E (à u ) Vf "zi Q5u*v-2582 9-225 - 2 wd 2 + Fant 2v) A Au? +02 
ERUIT 2 u2+v2 J: = u2- v? 2 u2+v2 IVI +3 u2+v2 ý 

1 (25803 v?+25uv4 — 2 ut vt Fu? v3 — 219 +2450) a/ 4v2+u2 

2 u? +v? 


(a) Vf = (y — 4x + 9x? 4+ 3y?)i+ (5 +x +6xy + 18y°)j b) Vf = Gu — 2u? + 2uv? + zu + Susy? Suv + Sv jv : 
18u2v°)e" + (Suv? + 2vu? — 2v? + vyt = gp - 2v +5u+ je + 18u3v7)e” 


r2 
un 


| . a ) p " 3 2 9 3 2 T a 
(c) Use the rows of Jẹ-1; i = ue" — ve", j = ve" +ue” (d) f(u, v) = Suv + tu?v — tuv? — tut + iv? — tut + iu^ + uv? — gv 
af 9.5 4 8 NN 2,3. of 3 2 3 3.8 
—2v° + 6:9); H = Suu? — 2u? + 2uv? + Fu? + Surv? — $uv* 5v — lj) 180v; = = —3uv? + 2vu? — 2) + $vu* — 32 — 
9.5 5 1.3 18 3.3 (f) it u . v * QU ( v . (—# : Vf 3vu? 215 42uv? 4-9 45 3102 3uv*45v- 1 918429? 
zv zw 3y* = | == —— = (+ — :2 —— 2 
4U +u + 24 + Bu e u*--v* Lj mus J. e u^-4-v* nc u^--v* A A 2.2 ? 


4 2 
3 uv?+2vu?—2v + 3 vu^— 3 u? — 1 v5-5u4- H i 8v? 


AJ u2- v? 
29. (a) Vf = (Ty B3 27x? S 3y^i $ (7x + 14y = 6xy)j (b) Vf - ( UMS ae i aA nie osi w) e“ 


A-110 Answers to Selected Exercises 


14u2y? &21uv* 6013 v— 1203 —7u5 — Mvu* +1409 v y a u2+v2 u 9 uv v 
+ ( uly e” (c) Use the rows of Jg-1; i = eme a r a 
* uv u u? +u? v f 7u$4-21u*2 21u2 v T6 Tu v Tu? +12 2 4704 +9103 —3uv? 
= 353 7 7 .U)-— 553 A 

J ( 2 ) erem ( (u2+v2)2 ) e (d) f (u c ) (u^ v^) 

af 21vu* - 35 27u* 42422 3) 14242 2892 —284. ð f 14u? v2-+21uv4+60u3 v—12uv3 —Tu5 —14uu4 +1405 f M L1. 22 ;23* had t 
| au —— (u2+v02)4 > av /— (u2+v02)4 (f) e" = (-w + i+ ( 2uv)j, 
| " 5 5 ^ 3 z 5 
| e = (—2uv)i + (u? Ll v2j. Vf : Zu E TT Sa He at cat "e Dan iet LE Ju —14vu4 +1409 


37. (a) Vf = (y — 14x + 9y?)i + (11 + x + 18xy)j (b) V f = (—620u3 — 486uv? + 43201? — 11232u3v? + 3402uv* + 88u)e" 
-(—486vu? — 360v? — 5616vu* + 6804u^v? + 13122v° — 198v)e” (c) Use the rows of J4-:; i = 10ue” + 6ve", j = 8ue" — 18ve" 
(d) f(u, v) = 44u? — 99v? — 155u* — 243u? v? — 90v* + 720u* — 2808u^v? 4-170142 v* + 2187v6; 
af 


aL —620i? — A86uv? + 43200) — 11232u^v? + 3402uv^ + 88u; af = —486vi? — 360v? — 5616vu* + 6804u^i? + 13122v5 — 198v 


ü 4. 1X3 LIAR ug 3 TY S Y ~ 1 (762005 —486uv2 432040? —11232u3 v? +3402uv4 +88u)/10 
Ee = (3) it (eh = (35i + Hah Fo? , 


|u| 


1 (—486vu? 360? —5616vu* +6804u? v? +131220> — 198v) V41 
114 lvi 


45. (a) Vf = (10 — 4y + 24x — 8xy)i + (6 — 4x — 4x?)j (b) Vf = (60 + 96u + 188v — 540i? + 24uv + 256v?)e" 

--(—22 + 188u + 208v + 124? + 512uv + 336v?)e" (c) Use the rows of Jo-1;1= 3e" + 2e". j = 5e” — 7e” 
(d) fu, v) = 60u — 22v + 48u? + 188uv + 104v? — 1804? + 12u?v + 256uv2 + 11203; z = 60 + 96u + 188v — 540w? + 24uv + 256v? ; 
af 


9; = 22 + 188u + 208v + 12u? + 512uv + 336? (f)e" = Zi $j, e = Zi- Aaj, VS: 


31 


3; (60 + 96u + 188v — 540u? + 24uv + 256v?) V53, + (—22 + 188u + 208v + 12u? + 512uv + 336v) V34 


CHAPTER 33 
Exercises 33.1, Page 755 


—45 19 1020 28 156 —108 —26 129 
. (a2A -3B = 5B —7C)- = —BA- 
1. (a) 2A --3B | » MET B -76) E ghana E es] (b) AB — BA | s A 


—26 —43 —13 43 —985 8: 
4c-ca-| =" 2 8C-cB=| Ths A e reas] 25 e] (d) det AC — 1032, 


13 1070 —236 
^ s 46 54 0 0 
E A T. =e t -l_ 1. . -1 Lg 2 86 Te — = -1 _ p-14-1.— 
det(A B) det A det B = 0, det A ma = 0 (e)A na- [S | a= |S 8 (f) (AB) B'A =li a 
; 4 [0 0 10] | 
T. CTAT — m — —Á = 
(AC) C'A l^ 3 (g) rref( A) = rref( B) = rref(C) E | 


aft 2 ft a8 
6. (a), (b. (Qand(x-[9,-9] n. exea = 230, 4-1 =| 4 d waat ox an =] > j (c) 


—10t 3 )—3t 35-30. 3 ,-10t 
e +3e 7€ Fé 


3 ,—10t 4 ,—3t 
p-3 8 2 +e 
€ 7€ 3e 7€ 


Àj = —3,e, = [1, due" = —10, e — [-1, 1]? (e) e^ = | 


Exercises 33.2- Part A, Page 759 


2 1 1 
3 9 3 
34 5177 2 i 2 2 
1. Ba =[#, 5] :Bia = [-#, £] &P=P*=| i 2 i 6. Bray = [4, 1, 23]; Bupa) = [—2, 2, —2]T 
- 3 $ 
Exercises 33.2- Part B, Page 759 
16 4 
2. (a) B4 = FZ, sr (c) P — p? = k | (e) Amax = -E (£) A 
- 36 144]T : 7 17 
(b) Bia = [- 35, 1] (d) PB = 2, e 


Answers to Selected Exercises A-111 


1 0 
Wise o 1 ()Ba-[-$.—$. 8] | 0e--$«--X 
UH 
a m 54 GBua-[-2,-$.-5 
162 81 162 
22 73 10 
QP-P--£5 s Ta 
285 00 — m 
162 81 162 
25. P? = (A(AT A)" AT)(A(AT A)-1 AT) = A(AT A)- (ATA)(ATA)-! AT = A(ATA)-1AT = P 
m 8 v s 7 
230 230 23 230 230 23 
— 63 149 9 a = — - 63 81 9 
26. (a) A(ATA)-"AT2 |—$€ — 19 -2| (pn-[5,9,10,P —na mn -|$ 3 3 
7 _9 B 21 2 10 
23 23 23 23 23 23 


Exercises 33.3, Page 762 
L w = | v262, - -zg V262, — za V 262 li 3 Wa — [- EU 13,951. /131, — sagi v 13,951 131, — -V DSN], 
= | pin 213381, — 92, /2,/13,981, 331; 2/1981] 
6. w =[ VITIS, S TIS, — VIS, TI] we = [2523 - 8.3. -8V3 av) , 
m [xis V TIO ISB, — 283/0288, zd /110:28, 05 TIO ISB] 
10. wi = [-L 1, -3]", w = [z. -g -ef w = [8.39 By 
Is. wi = .11,-9,47, wo = [3. -15, 3. ET! we = [89 5. 88, 10 
18. w, = [—0.8751130126, —0.07955572842, 0.4773343705]', w; = [—0.4082482906, —0.4082482906, —0.8164965812]7, 
ws = [0.2598279207, —0.9093977240, 0.3247849006]" 


T 


23. w; = [0.2760262238, 0.8280786714, 0.4830458916, —0.06900655595]", 
= [0.4083490719, —0.3539796488, 0.2591223573, —0.8005029966]", Be careful, the vectors are linearly dependent. 
26. Lx = $, x? +b =x, x8 E t bx — 3x? xt + FR 2x t 3x? — 243 


~ ^ 334,519? 334,519 ^ — 334,519" 334,519 


T 
- T . [20414 26461 19927 19379]T __ [395,000 2,370,674 89,392 931,885 
36. wi = [-6,6,8,9] wo = [S 3D5' 3125? | m s[ | , 


T 
w 52,252,375 52,675 7,906,150 7,601,125 
4 — | 17,131,476? 8,565,738’ 4,282,869 17,131,476 


Exercises 33.4- Part A, Page 767 


1. (#,-# isasaddl. 2 Q= E J à12 =545V2 


Exercises 33.4—Part B, Page 767 
2. (a) (5,2) (b) T = —48, itis a saddle. (c) A; = —2, 43 = 24 


—54xy + 10 +4y? 21y? — 27x? + 8xy 
—116512, 11652? = 
12. (a) ( 5155 ^ Gi 165 ) poe od he — 27x? + 8xy 42xy + Ax? 

(b) A; = —20.77714920, A» = 34.74944822, it is a saddle. 


0  iy35 iM 


2 -6 18 
32. @)Q=|-6 2 -6| (b)x’Ox=x?—6xy+18xz+y?—6yz +92 (OP— $510 34435 -v14 |; 
adig diio: v10 -3V35 i14 
0 0 0 
D=|0 -10 0| @u=AVl0y + i V10z, v = 1435x + 5$ 35y — $35; w = GV 14x — d 14y + G14 
0 0 32 


T Hild 
(©) Q is indefinite. (g) xı = [1435, 5,35, -3V35] x = [5 14. -4 v14, 14] 


A-112 Answers to Selected Exercises 


42. (a) Vmax = [2c, c, ét (b) vais = [—c. c. cf? 


Exercises 33.5—Part A, Page 771 
4. A, = 0.17825461, X» = 20.92979274, X4 = 291.8919527, V/A; = 0.4222020962, /A2 = 4.574909042, Vis = 17.08484570 


Exercises 33.5—Part B, Page 771 

5. lvl = 205 [Ivll2 = 4/13; Ivlls = 2240"; |[vlloo = 12 

15. (a) All: = 16; Allo = 2/373 + 54/29; All; = V201; All; = 14. (b) Ana = 14373 + 1/29 
(c) fmax = arctan (Z — 4,/10,817) +x 


Uu 


26. (a) 20 (d) y 20 
(b) y 
A 
1 
E "n 
-1 
(c) y = —|x| + 1 => [Axl; = 5x — 10|x| + 10 + |11x + 10)x| — 10], 


y = |x| —1 = lAx|s = [5x + 10]x| — 10] + |11x — 10|x| + 10] 


29. (a) ||Alı =9 (b) (d) maxz=1..12 || Ax; || = 9 


37. (a) and (b) || A|| = 12.33212576 
Exercises 33.6—Part B, Page 779 


a NEUE y 29 09. 4 16. 2 ; 
4. y — GX" — 3gX + 35 ? 9. Y= sygX + gs* 370 * — 8 ? 


-o : 
-8 -6 -4 -2 0 2 4 


14. (a) da — 2b + c = 14, 16a 4b + c = 85, 9a — 3b + c = 55, 25a + 5b + c = 228, 16a + 4b + c = 176, c = 23, 
4 —2 1] 1000 
16 —4 1 0100 
9 —3 1 0010 
25 5 1 000 I 

4a+2b+c=30,a+b+c=45,a—b+c=25 (b)A-|16 4 1 (c) rref([A,y]} =]0 0 0 0 

0 0 1 0000 
4 2 1 0000 
1 1 l 0000 
1 —1 1 0000 


(d) rank A = 3; rank[A, y] = 4 
(e) S = —1362c — 2782b — 21234a + 1252a* + 196ab + 152ac + 76b? + Abc + 9c? 97,485. (f) a = 233955, p = S259 (mass 


— 3,126,802 — 34,345 = 232,559 70.148 
(g) Smin ig 1815 (h) a= 5082 b= 25,410 ° " ^ 4235 


Answers to Selected Exercises A-113 


67 159 23 9 5 127 71 307 145 
363 847 121 121 363 847 847 2541 847 TEM 
159 18,569 1626 458 81 1959 4003 3666 1118 100 AE 7 
847 29,645 4235 4235 3235 29,645 29,645 29,645 29,645 Pe 
23 1626 169 3 14 244 57 61 492 0 1 0 ME 
121 4235 605 605 605 4235 4235 4235 4235 3i bid 
9 458 3 401 258 348 359 87 424 001 2 
12i 4235 605 605 605 4235 4235 4035 4235 » 
" 5 81 14 258 587 191 667 1202 38 : x : 0 0 0 0 
(i) P= 363 3235 605 605 1815 3235 4235 12705 = 3235 G) rref([A, Py]) = 000 0 
127 1959 244 348 191 7129 6093 7076 6252 
847 29,645 4235 4235 4235 29,645 29,645 29,645 29,645 0 0 0 0 
71 4003 57 359 667 6093 6821 6817 4649 000 0 
847 29,645 4235 4235 4235 29.645 29,645 29.645 29,645 
307 3666 61 87 1202 7076 6817 5798 000 0 
2541 29,645 P35 4235 12,705 29,645 29,645 88,935 29,645 000 0 
145 1118 492 424 38 6252 4649 5798 6011 T 
847 29,645 4235 4235 4235 29,645 29,645 29.645 29,645 
£ T 
34,345 232,559 70148 4099 13,067 3067 _ 1984 26,674 27.257 135.101 159.139 45.866 2 _ 3,126,802 
(k) u = [ 5082 ^ 25.410 ° oe | Q yia = [ 363° 4235" 605" 605^ 1815 4235" 4235 ° 12,705 ° 4235 | (m) |y — Pyl = 1815 
(n) y 
A 
t F >x 
4 2 0 2 4 6 
34, (a) rank A — 5. (b) {[0, 1, 0, 0, 0], [1, 0, 0, 0, 0], [0, 0, 0,0, 1], [0, 0, 1, 0, 0], [0,0,0,1,0]} (ce) {} 
(d) {[0, 1, 0, 0, 0, sm 1,0,0, 0, 0, 222; |. [0.0.1,0,0. 248]. [0,0,0, 1,0, 25]. [0.0.0,0, 1, 2222] 
ADE — HOS ; . "in - 
(e) {[ LN l, EDS. x = a a |} (f) The row space and the column space both have dimension five. The null space has 
dimension zero, while the nullspace of the transpose matrix has dimension 1. (i) This follows from the definition of the null space. 
(j) This follows from the definition of the null space. 
1000 0 
0 1 00 0 m 
m " a 179.977.111 297.856.765 56.299.192 10.111.149 
44. (a) mef([A, y 2 |O 0 1 0 0}, (seerow5). (b)u= [monu 829,272,507* 118,467,501* E 
0.00 1 0 
0.000 I 
179.977.111 
100 0 y 516 
297.856.765 
T T 0100 gs 
(c) rref([A A, A yp = 55:29:10 
"i 0.0 1 0 56,299,192 
118,467,501 
10,111,149 
0 0 0 ! zenio 
CHAPTER 34 
Exercises 34.1—Part * Page 789 
: i 100 100 2 0 0 1-9 5 
Lh 4 10 XL 410[;D-2|O0O 3 O|;U,=]0 1 8 
—3 8 1 —3 8 1 0 0-2 0 0 | 
2 0 0 1-9 5 
3, L= 8 3 O|;U=]0 1 S8 
—6 24 -2 0 0 i 
Exercises 34.1—Part B, Page 789 
4 5 
—6 8 10 1 00 1 00 -6 0 0 lo =—g =3 
29 8 ] l 29 
£4)U-| 9 — 3l |s 1 0) r-2|-s 1 0|; D= -3 Oku-2|0 1 -$ 
191 1 10 ] 10 191 
0 075 3 T% 1 3 7% | 0 x 0 @ 1 


A-114 


Answers to Selected Exercises 


-6 0 0 I P = 
(c) L — 1 -3 0|. Uy = |0 1 -5 (d) A is not positive definite. 
2 oT 0 0 1 
] 0 0 7 -—1 0 
9 85 3 9 1T T. 2 T 
12. (a)Li =|] 7 1 0|;u=]|0 7 M (b) xi mi x m 3] x = li m al x= [ n ce mil 
=) =o 1 0 0 Xe 
7 0 0 i =y 0 0 0 
@L=| 9 $ OEu-|o 1 Z| @ r=] -F 1 0 
-7 -20 3$ 0 0 1 -2 8 | 
1.0 0 0 —7.0 1.0 —5.0 
22. (a) Lı = | 0.2857142857 1.0 0 ;U-—| O 11.71428571 —0.5714285714 
—0.5714285714  —0.03658536585 1.0 0 0 —7.878048780 
—1.0 0 0 0.9999999996 —0.1428571428 — 0.7142857140 
(b L = | —2.000000000  11.71428571 0 i= 0 0.9999999999 — —0.04878048781 
4.000000000 — —0.4285714284  —7.878048780 0 0 0.9999999998 
5 45 15 1 0 0 5 45 15 
25. (a) A= 20 —180 60| (bL2j|-4 1 ;U=]0 O0 0J (e) The procedure will fail because it hits a zero pivot. 
—45 —405 —143 -9 —2 1 0 0 -8 
Exercises 34.2- Part A, Page 792 
1 1 1 1 
1. det A = —2; 315 = —2,1 2 zu ;| 3 Peli J 


Exercises 34.2—Part B, Page 793 
11 


6 1 7 8 -4 17 : j 4 " 
. d. sB = = . 1 — H, Y, Y, 2 = E Us UF ,p3 = u Aa , 
5. @ PA—|, EP [0| @P 6 1 15. (a) pı =[1,0,0,0]" (b) p» = [0, 1, 0, OJ"; ps = [0, 0, 1, 0]; 
p4 = [0, 0,0, 1]"; Ap) = pi + 2p». Aps = P2 + 2ps. Apa = ps + 2p4 
2 0 0 2 0 0 
25. (a) ài23 =2,-3,-3 (J4,2|0 -3 1ļ|;J»=|0 -3 0 
0 0 -3 0 0 -3 
_{-6 1], [-2 1 a [e — 6te** —4te ^?! dp. [65 tem 
"s e P=[ 9 0 Ii 0 E ud -[ ge epot] O —[o e” 
Exercises 34.3, Page 796 
-6 v3478 — Gt, V12,830,342 
ee ee a —a V3478 a 12.830, 342 
. (a) ran ) = 2; rank(A2) = (b) ES De n E 
i ^ |--V -ap V12,830,342 
ip v3478 — — cuiii; v 12,830,342 
—% v30 To v1,117,770 — UE EIEE v90, 144,610,895 
e» [^07 393/3478 3478 2 "n $30 zug VL1lLT70 a29 22170 V 90,144,610,895 |. 
Hu 215,739 . 
0 42:V12,830,342  —.5../12,830,342 aV30  —u 1117770 — ey V90~ 144,610,895 
ipn -z5 V 1,117,770 -esl V90, 144,610,895 
/ 191 / 
34/30 161/30 2/30 S 3478 ~~ 6,415,171 12, 830, 342 
ale wes : g -z V348 ap Vv12,830,342 
R, = aæv1117,770 -3gs V1:117,770| (d) Qı = SIE -3% _ TRIOS | 
0 2 /90,144, 610,895 —35i 3478 — 1z330,:45 V 12,830,342 
—-— 2354/3478 — — z 12,830,342 


Answers to Selected Exercises A-115 


[-4430  PLL/LITLTIO — —u iom; v 90,144,610,895 
- | H4350 =e VITO —u2229.../90,144,610,895 
E430 -rekk VLITI  — 3 /90,144,610,895 


45 
2430 -VLITI  —.2551 .. /90,144,610,895 
is v 30 sse,ge5 V 1,117,770 180,289.221,790 V 20, 144,610,895 
3795 931 3430 30 v30 5 v30 
" v 3478 aps V 3478 xg V 3478 - j TM ] 
e) R = " e * |; R= O0 gg 1,117,770 —ssasss V 1,117,770 
0 ara V 12,830,342 — 35. ./12,830,342 5 
3 VES 0 O zV 90,144,610,895 
9.636.411 126,469 580,783 209,293 
9,677,620 9,677,620 9,677,620 9,677,620 
.. 126.469 9,289,491 1,782,403 642,313 
7 rie . — T 9,677,620 9,677,620 9,677,620 9,677,620 
(f) R^ exists only for the second matrix; 020, = 580.783 1,782,403 1492.299 2.949.691 
9,677,620 9,677.620 9,677.620 9,677,620 
209,293 642,313 2.949.691 ^ 8,614,659 
9.677,620 9,677,620 9,677.620 9,677,620 
2910 355 737 1264 
59» 68 3689 3689 3689 3689 
7 3 355 75 208 319 
Í = —2—/90,144,610.895 xx = =F | T. 3680 3689 3689 3689 
(g) |R222| = sg 1,117,770, |Ro,33] = 37555 V 90, 144,610,895 (h) B; = 7 60l’ P-QQ|- = = ei ee 
3 7 
26 3 3680 3689 3689 3689 
á : 1264 319 1229 1406 
3689 ^ 3689 3689 3689 


(i) A; does not have full rank, while A» does. 
295.5119 43.8650 194.3208 
17. (a) M = | 43.8650 117.9937 19.7825 |; C(M) = 11.71707814 (b) u = [—0.7374763180, 0.3989617388, 0.1540718815]? 
194.3208 19.7825 208.2692 
0.5671750638 0.3989889761 0.2576692751 


0.4799173617 | —0.7297048079 | —0.3058376261 17.19045956 — 2.551706069 . 11.30399099 
(c) Q = | —0.4903882860 | —0.4251230460 0.07709365611 |; R = 0 10.55852718 —0.8582600832 
0.2175625373 0.1794610481 —0.7586767171 0 0 8.930418655 
—0.4002219938 0.3088734665 —0.5084644514 
0.05817180141 0 0 
(d) u = [—0.7374763178, 0.3989617386, 0.1540718814]T (e) L = | —0.01405852693 — 0.09471017902 0 


—0.07498409845 0.009102145070  0.1119768331 


Exercises 34.4, Page 801 
3. (a) 4153 = 15.47690512, —9.857886436, —8.619018681 (b) r; = 0.6369417115; r; = 0.8743272442 (c) After 100 iterations we find: 


21.2.3 = 15.47690515, —9.857888750, —8.619016363 (d) The largest sub-diagonal element is —0.2578878042 x 1075 which is in line with 
r1? = 0.8743272442!? = 0.1470283656 x 105. 
43 32 40 4 
67 67 67 67 
32 73 i60 — — 16 " : " 
67 201 201 201 243 30) 277 716 88 352 440 4477, __ 78s 352 _ 440 44 
13. (a) Hy = | 4 160 1 20 (b) y = Ez E ,» 72017 mi (c) Xw [ e 201° 201° A de = [55 201° aT unl 
67 201 201  — 201 
4 16 20 199 
67 201 201 201 
43 32 40 4 
" m & — m 1000 
32 73 160 16 0100 
: 155 50 163 760]l. . [155 50 163 76077 _ |e 201 201 200 |. pty T 
(d) xi = [9 dr sore 201] i Yaw = L7 or 291 291] ©) H= | 4 . 160 l gp [ee S 001 0 
67 201 201 201 
4 _ 16 20 199 00 0 1 
67 201 201 201 
—0.518321055 —0.3455473703 —0.08638684258  0.7774815832 


—0.3455473703 0.9213585396 —0.01966036510 0.1769432859 
—0.08638684258 —0.01966036510 0.9950849087 . 0.04423582147 
0.7774815832 0.1769432859 0.04423582147 0.6018776068 

x|| = 11.57583690 


23. (a) H, = (b) Hwx = [11.57583690, 0, 0, OJ"; 


A-116 Answers to Selected Exercises 


18.78829424  4.896665923 1.437064905  —4.896665925 
“Te 0 —2.842128040 12.32551077 1.899391110 
0 2.842128040 — 2.674489237 —14.89939111 
0 9.157908023 —4.106547944 — —3.524644813 
18.78829424 —4.896665923 — 1.437064995  —4.896665925 
T - 0 10.00113308 ——6.502945902 — —8.001359678 
3 0 0 6.841101136 —12.70842099 
0 0 9.319113384 ——3.535101474 
18.78829424  4.896665923  1.4370649905 ^ —4.896665925 
iid s 0 10.00113308 — —6.502945902  —8.001359678 
0 0 11.56055963  —4.670671972 
0 0 0 —12.33635804 
0.2128985179 0.6386955549 —0.6386955549  —0.3725724069 
(a) g = | 07041695047 0.2872195798 —0.2872195809 — 0.5823702724 |. 
0.2694397941 0.6876766018 ^ 0.6098384387  0.2874024479 |’ 
—0.6214673989 0.1915040280 ^ 0.3710390543 + —0.6628985592 
1.000000001 0 0 0 
" " 0 1.000000000 0 0 
oe ea 0: 0 0.9999999997 0 
0 0 0 1.000000000 
3.999999998 —6.000000009 ^ 8.000000009 ^ 11.00000001 
(D) HA, —| 1200000002 ^ 6.000000000  6.999999996 —11.00000001 
3 = | —12.00000002 — —6.000000011  8.000000008 + —1.999999991 


—7.000000007 3.999999987 —1.000000003 4.000000006 


Exercises 34.5—Part A, Page 808 
1. Multiply both sides of the stated equation by A. Then it becomes clear that Ax is an eigenvector of AAT with eigenvalue A. 


2. In (34.21) replace A with AT. 4. (u;u;l) Uy = w (ww) = w |u;||? = u; 
Exercises 34.5—Part B, Page 808 
; Los z 5 : , T 5 T 
2. (a) ATA = | 5 fix = $, vi = [1 1T, M = $, va = 1-1, IT, o = 210,0; = 110 (b) u: = [2v5. 15] KA [15. -4v5] 


-— 2/5 — i5 NIHIL B4€9 9] avs l | 
c saa -V=]~ K = |> = 
145 -$45 1:2. $2 o sVI0 A 


ÍAR aA YT " 
| lA — Wir = V100 — 304/10; WW? 


I 
LE] 
or 
— © 
[NÉ 


— 
; ||A — Bl = |A — Bile = 110; ||A — W|z = +v 100 — 30/10 


— 5 


n 
i 
ll 
UL —1 
AIN vle 
Mins vle 
p 


—0.3417905767 —0.8844032455 —0.3178208631 —0.8110122690 0.09447627313  0.5773502692 
6. (ajk 22 (b)U-— | 0.1074948563 —0.3727598508 — 0.9216805029 |; V = | —0.4873249871 —0.6551190912 —0.5773502692 
—0.9336080856  0.2808576026  0.2224746042 —0.3236872819 — 0.7495953643 —0.5773502692 
9.033565692 0 0 1.999999999 5000000000 ~~ —3.000000000 
== 0 6.032801247 0| (© $l, o;u;v? = | —1.000000000 0.9999999995 — —2.000000000 
0 0 0 7.000000000 3.000000000 3.999999999 
2.50407 1447 1.504658601 0.9994128472 
(d) B = | —0.7875430710 —0.4732227015 —0.3143203694 |; ||A — Bll, = 6.032801247 


6.839923362 4.110006336 2.729917026 


Answers to Selected Exercises A-117 


35 |.] 25 1 
19 197 1 V51l 19 19-15 VIII 


A/2044--62./511 A/2044—624/511 -LJA 
a) } $4511 $ —45 511 1 p T 
€) A153 = 0, 81.60530911, 36.39469089 (g) Vi = | 19-222 19 19 = 1/3 (b) (2, 5, 23], [- 1, 1, —2]"} 
A/2044--624/511 A/2044—624/511 1/3 
19 19 3 
„2044+62 V511 „2044—62 V511 
(B+5 SIDA 152278+5702 V511 (3-5 /51D4/ 152278—57024/511 
(594-/511)(10224-314/511) (1022—314/511)(59—4/511) -—4V110 
(DU. = 57 152278--57024/511 57. 4/152278—5702 511 DbU,—| 2%./110 
EE 2. (59/510) (1022431 511) 2 (1022-314/511)(59— 511) @ U 330 v 110 
(299 45./511) / 1522785702 V511 -269 J511 / Jil a v 110 
“a AID LST) C —5V511)v 152278 — 5702V511 
Exercises 34.6—Part A, Page 813 
0 3 
1. If A is a square matrix with full rank, then X is an invertible diagonal matrix, and X^! = E+. The result follows. 2. AY = Í | 
74 


Exercises 34.6—Part B, Page 813 


1. (a) This follows from the definition of Z*. (b) XX* is a block matrix with the identity matrix in the left top corner and zeros everywhere 
else. (c) ^X is a block matrix with the identity matrix in the left top corner and zeros everywhere else. (d) This follows directly from 


A* —VZE*UT. (e) AA* is the projection matrix onto the column space of A. (f) A*A is the projection matrix onto the row space of A. 
18,958 18,772 3299 
18,58 —— 621 14185 376 468,837 468,837 468,837 
468,837 468,837 468,837 156,279 . 621 12,392 3976 
^ 18,772 12,392 5044 2572 es 468,837 468,837 468,837 
2. (a) rank(A) = 2 (b) AY = | — iss; 468,837 468,837 Bes! Qu»- 14185 5044 1711 
3299 3976 1711 119 468,837 468,837 468,837 
468,837 468,837 468,837 156,279 3763 2572 119 
156,279 156,279 156,279 
0.1657659827 . 0.7543546402  —0.5523675100 0.3136253334 
(e) Xt = [ 316,655 269,004 34,849 li (e = —0.6373689962  —0.3717920243 | —0.6734231328 0.04508589107 |. 
~ L 468,837? 468,837" 468,837 0.7180412379  —0.3849560807  —0.4880310949 . —0.3131313573 |’ 


0.2251647892  —0.3801691511 0.05671920769 0.8952961330 


int" d 13 " PR o —0.6228720773 0.7410129476 0.2508588982 
D= 0 i 0 0 ; V = | —0.6263333277  —0.6644783955 4 0.4076457096 
0 0 0 0.4687610671 0.09678984145 0.8780061438 
2 — 15,652 
1143 
0.04043622836 | —0.01326900393 —0.03025571786 —0.02407873098 17 10,976 
(h) VE*UT = | —0.04003950199  0.02643136100  0.01075853655  0.01645774543 Q= p 
0.007036560681  —0.008480559342 0.003649455995 —0.000761458672 —27 127 
aff] 6076 
275 178 79 115 "E 
461 461 461 461 
. 178 251 145 1 - " 
5 1 461 461 3 25 2192 617 28 7877 — 269,924, 
QP- pa = 306 142 (k) Py = [ a a ims T ] v= [ » za i‘ fi, fi, f E (m) fmin = 468,837 * 
461 461 461 461 
115 1 142 90 
461 461 461 461 
953 104  — 224 
i 1 0 1017 1017 1017 T 
dis ES 2 ; / 3 / 316,655 269,924 34,849 
A es | oe ccm Ed (n) C = p l (o) P' — a am e| Py | M ro aes | 
-i -E 224 364 233 
^ 1017 1017 1017 


T 
2,159,392 | 8 269,924 7,557,872 , 28 = m 
(q) V — | 6094.881 + 13/1: — 468837 + b — 609488] * 13 n] (r) AV = [0, 0, 0, 0] 


A-118 Answers to Selected Exercises 


792.449 49.745 223.055 792.449 49.745 223.055 
60,450,639 60,450,639 60,450,639 60,450,639 60,450,639 60,450,639 
223,576 222.623 36,588 223.576 222.623 36,588 
1 —30 18 6 —30 20,150,213 40,300,426 20,150,213 20,150,213 40,300,426 20,150,213 
_ j $ 1,894,849 289.453 2,347,733 1,894,849 289.453 2.347,733 
13. (b) A = | —16 —143 18 -9 42| ()AT= 781,351,917 302,703.86 362,703,834 | (C= 181,351,917 362,703,834 ~ 362,703,834 
46 73 —140 35 74 2,991,022 305,411 730,297 2.991,022 305,411 730,297 
781,351,917  362,703,834 181,351,917 181,351,917 ^ 362,703,834 181,351,917 
4,492,340 879,452 206,663 4,492,340 879,452 _ 206,663 
181,351,917 181,351,917 181,351,917 181,351,917 181,351,917 181,351,917 
i B1 /219,486 — d. ; 114 97 63 
34 V 314 zg 219,486 — 454/699 JV314 is; V314 — 34V 314 iu V314 
= 3 ; 217. /5 23 po 10 fF 3/5187 Ho 5 
? dtes E-A — E PER — 
23. (a) Q = 34314 3:543 V 219.486 — 255/699 |; R 0 :54/219,486 —35./219,486 — 7. ./219,486 
2 197  /519 7 _ 2B 
15V 314. 1557433 219,486 — 5, V 699 0 0 0 0 
(b) Be careful. Because R does not have full row rank, the matrix RRT is not invertible. Use R and Q instead; 
3632 1 83 
E ii /219,486 82249 82,249 82,249 
314 314 219,486 219,486 722 2966. 5192 


246,747 246,747 246,747 


J/314 13 314 — 71/314 i314 = 
X 2 3 " f x / 217 / Z «A I 

| 0 yaa -4./275386 -iL/209486] ^ | 33 meam ido SA = ss y a 

57 d 314 $ SE wmv 164,498 164,498 82,249 


1 
3 
1 
IE 2/314 197. /219,486 
157 V314. 1535 219,486 12,281 2863 3005 


493,494 493,494 246,747 


33. If k denotes the rank of A, and U’ denotes the matrix formed by the first k columns of U, then AA* = (UEVT)(VX*UT)- 
USE U" =U p 4 UT = U'IUT = U'(UTU')-! UT = P, where P is the projection matrix onto the column space of A. 


0 0 

CHAPTER 35 
Exercises 35.1—Part A, Page 825 

1. Use tan(u — v) = eee. 2. Substitute A = 3 and B = Z. 4. v41 cis (arctan(#)) 
Exercises 35.1—Part B, Page 825 

2. (a) |z| = 4V5; Arg(z) = arctan(1) (c)z+z7= 16;z -Z = ĝi 

(b)z=8—4i Im (d) zz = 80 
v 5 (e) 44/5 cis (arctan(+)) 


()2=2+h;?=2-4i 


0 t t t t I Re 


-4+ n 
12, (a) zi +z. = —5 + 12i = 13cis (— arctan(2) +r); zı — z2 = 13 + 2i = ~ 173 cis (arctan( 2.) (b) ziz 
(c) V6890 cis (arctan(?) — x) (d) 4. 6890 cis(arctan(83) — 7) (e)|zi — z? = 173 (£) |z1 + z2| = 
(g) llzil — Izal| = —V65 + 106 < 4/173 = |zi — 29] 


I^ 
h 
Cn 
E 
EN 
ON 
ll 

R 
+ 
T 
e. 


29. 231+17i 34. —3— 2i 39, Im 44. Im 
145 145 A A 
4 2+ 
3.5+ i+ 
tt 0+ 
2.5 + afe 
2+ -2+ 

- i i +» Re +++» Re 

2 - 0 1 2 Ol ug 5 -4 -3 ~2 


Exercises 35.2-Part A, Page 828 


2, jj = —2i = 2cis (—47) 3. 22=-z=1-i 


P 


Answers to Selected Exercises 


Exercises 35.2-Part B, Page 828 


2. (a) |z| = V5; Arg(z) = arctan 2 — m (d) In (e)r, = 5^ sin(5 arctan 2) — i5!/^ cos(5 arctan 2); 
(b)o = —3 + 4i = 5cis(— arctan( 2) +r) rı = —51/4 sin(3 arctan 2) + i5!/^ cos(3 arctan 2) 
(f) Im (g) z? = 5?/^(— sin(3 arctan 2) + i cos(3 arctan 2)) = —3.330190677 — 0.30028310701i; 

: 2 l 2 
rn esu sin(; arctan 2) — i5!/4 cos(3 arctan 2))? = —3.330190674 — 0.3002831078i; 


rj = (—5'4 sin(7 arctan 2) + i5'/* cos(5 arctan 2))? = 3.330190674 + 0.3002831078i; 


Ue Sia Ji 1/22 + 10/5 + tiv —22 + 10V5 = 3.330190677 + 0.3002831081; 
(h) 2? = = 5« wn arctan 2) — i cos(2 arctan 2) 2.729624461 + 6.960664460:: 
rp = (5'4 sin(4 5 arctan 2) — i5!/ ^ cos(1 L arctan 2))? = 2.729624454 + 6.960664453i; 
rj = (—5"/* sin(; l arctan 2) + i5!/4 cos(1 3 arctan 2))? = —2.729624454 — 6.9606644531; 


VE = 1-82 505 + 1i v/82 + 50/5 = 2.729624466 + 6.960664460i 


12. (a) /zz; = 10101 | —— i 10b —— | 41692466917 — 9.656571756i 
[14- 3X /101--43 5/101— 43 | 1+ 54 /1014 +43 


Y 54/101—43 Y 5/101—43 


(b) Ja /z; = 3/—20 + 2/101 — 1/20 + 24/101 + i(1/—20 + 24/101 + 3/20 + 24/101) = —2.692466918 + 9.656571757i 


z 505/101+3737 
(c) ,/2 = +./1010101'/4 | — TUE yo | = 0.3621905044 — 0.9294381254i 


(d) = x —20 + 2//1014/101 oT + d 2OT V 101 + i(xz v —20-2 V 1014/101 — 1420 4-2 7101 / 101) = 


0.3621905043 — 0.9294381252i 


Exercises 35.3—Part A, Page 831 
2. 2 =x? — 3xy? Hi y — y?) 3. lile; i arctan 3) +i5! si n(i arctan(5 3), —5' sin(4 arctan(= i) + in) + 
3 ) 
i51? cos(1 arctan (È ) + in), —51/3 cos(1 arctan(= $) + iz) = i5" Sint arctan’ y+ day) 4. w = dic = 2/2 cis(2 


Exercises 35.3- Part B, Page 831 


2. (a) |z| = J/34; 0 = — arctan(3) (b) z? = S-N — 10i = eae (0) — z) ( (c)r= 34/34 w = —3 arctan(3) 
(d) {34'/°(cos(4 l arctan(3)) =i sin(} arctan ( 2). 341/6( — sin(—} arctan($ >) + Ut) +i cos(—4 arctan(3) + im), 
34/6 (— cos(-1 arctan(3) + x) — i sin(—} acti) + in))} 
7 (e)z ah — 2.504881547 — 2 PHDR = 2.504881547 — 2.054422803i; 


rz = —3.031623111 — 1.142079653i:r = 0.5267415656 + 3.1965024551; 


Vz = 2.504881548 — 2.054422803i 
(£) 25/3 = —2.757469393 — 18.68767614i;7? = —2.757469387 — 18.68767614i; 


4 5 Re r$ = —14.80526760 + 11.73187659i;r> = 17.56273698 + 6.955799523i; 
i z5 = 17.56273697 + 6.955799549i 


23. Write the circle as |z — zo| = r, then r = \/|zo|* — a. 25. Hint: cos(50) = R (cis(50)). 


31. Let (wj, w2, w3} = {3.697293048 — 1.988523512i, —3.582990856 + 8.403739562i, —1.114302188 — 0.4152160521] denote the three roots. 


Compute the midpoint m of w; w2, then add “+. The result follows. 


Exercises 35.4—Part A, Page 834 
|. Z = 20 4. ei = e! = ecos l — iesin l 5. + (12^ 24 2 4 4i2"/4 2-2) 


A-120 Answers to Selected Exercises 


Exercises 35.4—Part B, Page 834 
2. (d) "d = et 100530 cos(6-16 sin 30) — je* | 99539 sin(e-16 sin 30); (e^ m3 cos(e? sin 5)? — 2i (e^ 9955)? cos(e? sin 5) sin(e? sin 5) — 
(e€ 908532 vd sin 3 (e)z = 3 ^ ^ (f) 34/4 cos(5 l ari 3) — i34!/^ sin(1 arctan(3 »; 
—34!/^ cos(2 arctan($ 3) + i34'4 sin(Iarctan(3)) (g)34'/6 eos pa 5)) — 4341/6 sin(} aretanls 2) 
—341/6 Snil arctan(3 5) + im) + 1341/6 cos(-1 arctan(3 3) + 1j); —34V6, cos(— 1 arctan(3 5) + 47) — i346 sin(— arctan( (3) + im) 
12. (a) = = e~! cos4 + ie™! sin4 (b) = T 2 = —0.1995123695 + 0.01713768921i 
(€) zie? + ze?! = 5e* cos 1 + 4e ihe — é sin 3 — 3e* sin 1 + i(—3e* cos 1 + ef cos3 + 4e° sin 3 —5e*sin1) (d) ont = cos 34+ i sin 34. 


22. (a) xe* cos y — ye* sin y +i(ye* cos y + xe* sin y) (b) 


Exercises 35.5—Part A, Page 837 


1. Logzı = 5 In2-- fiz; Logz: = į In 5 +i(— arctan(}) +7); Log(ziz;) = 4 In 10+ i (arctan(1) — 2); Log 2 = $In()- i(arctan( 5) —7) 


3. Logz; + Logz; = 5 In2 + In5 + i(2z — arctan(3)) = Log(ziz2) + 277i 


Exercises 35.5—Part B, Page 837 
2. (a) Loge* = —2 + i (8 — 27); nı ——1 (b) Ni((z2)—-1 (ez, ——2- 8i 4+ 2kwi, k = £1, £2, +3; 
w =e = e?cos8-r ie? sin 8, k = +1, £2, +3; log w = —2 + 8i -2mzi,m € Z 
12. (a) Logz” = —51n3 — 51n 5 — Aarctan(2) + 4 + i(41n3 + 41n 5 — Sarctan(2) — 31) = w Logz — 87i; n =—4 (b) N(z, w) = —4 
22. (a) Log(zız2) = 5 In29 + 1 In 41 + i(— arctan(45) + x) = Logzi + Logz: -2zi;n3 —1 (b) N3(z1, 22) = 1 


T 
a2 


32. ( (a) Log (2: ) = iln24 $In61 — $1n53 +i(- arctan(32) + x) = Logzi — Logz: + 2mi;ng=1 (b) N4(z1, 22) = 1 
42. z= 11cos 12 — 11i sin 12; Argz = —12 +47 
Exercises 35.6—Part A, Page 841 
1. 2' = e" cis(In 2), for integer k. 2. (2i)! = e-1?7—* cis(In 2), for integer k. 
5. ((—1— i)! = J2cis (arctan(sin(5z(—1 + 8k)), cos(i;z(—1 + 8k)))), fork = 0, 1,2 
Exercises 35.6—Part B, Page 841 
2. (a) 409 =3— 5i (00(9-—5) 7*9 =3 — 5i,n =2,--- ,5; 
(8-50 Eo visis arctan( 5) + zz) — i34 cos(4 arctan(3;) + iz), 1156'/4 cos(— ; arctan(2?) + 4 Im) 
i1156" sin(—1 arctan(229) + iz), 11561/5341/10 cos(1 arctan( £2) +i 1 1561/5341/10 sing arctan( 25))) 


717 
22. (a) (zw)? = 0.7971139227 x 105 + 0.1238830966 x 10%: z^w^ = 0.5191134384 + 0.8067777818i (b) and (c) n3 = 1 
(d) (i) = —16.10390854 — 64.53326170i; = = —16.10390853 — 64.53326169i (e) and (f) n4 = 0 
32. (a) z^^ = —0.9771024323 x 10!4 + 0.1018864921 x 10!5i; (z*)’ = —636329.3735 + 663526.8281i; 


(z’)* = —0.004144039139 + 0.004321160161i (b)n; — —1 (e)no(z,a)=—1 (d)n —1 (e)m(zb)-l 


Exercises 35.7—Part A, Page 846 
4. sinz = sin(x) cosh(y) — i cos(x) sinh(y) = sin z 7. coshz = cosh(x) cos(y) — i sinh(x) sin(y) = cosh z 


Exercises 35.7—Part B, Page 847 


2. min: sin(1); max: /cosh(1)? — 1 18. (a) Im (b) Im 


: —1—»- Re 


Answers to Selected Exercises 


4 


22. sin(4 In(13)) cosh(arctan(3)) + i cos(4 In(13)) sinh(arctan(3)) 

Exercises 35.8—Part A, Page 851 

L r= £0,w=4 (r+!) er? -2wr4+1s0erawtivl—w = e? & z= ilog(w-iV1- w?) 
d rco z0,w-i(r-4l) er? —2wr-120e&r-w-tXw?—1-2e $ z = log(w + Vw? — 1) 


1 
i ~ +w ) +w 
4. w= er = OD r= = & z= llog (1) 
rere á 
7 


1-w l—w 1—w 


Exercises 35.8—Part B, Page 852 


2. In this problem Z denotes an integer, while B denotes a binary integer. (a) z = arcsin(1 — 37) — 2arcsin(1 — 3i) B 4-22 Z + x B 


(b) z = arccos(1 — 37) — 2 arccos(1 — 3i)B +27 Z (e) z = 1.461461854 — 0.3059438579i + n Z 
(d) z = 1.824198702 — 1.233095218i + 2niZ (e)z = 1.864161544 — 1.263192677i + 2zniZ 
(f) z = 0.09193119503 — 1.276795025i + xi Z 


2 2 
cosh^ y—1+cos* x 
cosh? y—cos? x 


10. (a)9t(cot(x + iy)) = — ==; S(cot(x + iy)) = — Sinhycoshy — (b)|cot(x + iy)| = 


-3 eV) Der CETT) 
sin* x-Fsinh^ y sin“ x--sinh* y 


16. wz i(Z +) 6r? = 2 & z= ilog(2Ż) 23. (a)z = —0.00004872447884 — 1.000076624i 


(b)z = 0.01293874902 — 0.0037649142051 (c) z = —0.003765833120 — 0.01293955699i (d) 
z = 0.9999896892 + 0.6685093531 x 1075; (e) z = 0.001406279660 + 0.004753891074i (£) z = 0.001406233379 + 0.004753851458i 


Exercises 35.9—Part A, Page 856 


1. If f(z) = u(x, y) *- iv(x, y) and f(z) = u(x, y) — iv(x, y) are both differentiable on the open connected set R, then the Cauchy—Riemann 
equations imply that uy, Uy, Vx, and v, all vanish throughout R. The desired result follows. 


Exercises 35.9—Part B, Page 856 


Sr: id A " " By. s ; 1/ cos ; 
2. The region is open and connected. Verify the Cauchy-Riemann equations. u = r‘'/") cos(2); v = r6) sin(2); 9€ = eU _ oe, 
, 1/5 ini ; i 
Qu |, | r” sin(0/n dv 
dy /— ) Hs ax 
7 — _10x?=x-21410y?_, |. y . ðu 50 _25x7+70x+49-25y?__ av. ðu 5 y(5x+7) _ __ av 
2S 0 = 29 33 = 29> Ss mt = 290—, as = 
25x*+70x +49+25 y* 25x^4-70x--49--25y^ ? ax (25x*4-70x--494-25 y^)* dy? dy (25x*4-70x--494-25 y^ )* ax 
8 u= sin x cos x v sinhycoshy — . du __ 2 cos? x cosh” y—cos? x—cosh? yl — dv. 
ý — eos? x+cosh? y—1? ^ ^ cos? x+cosh? y—1° x ^ cost x-+2cos? x cosh? y—2 cos? x+cosh* y—2 cosh? y+1 ay? 
a sin x cos x sinh y cosh y A àv 
ay ^. ^C cos! x+2cos? x cosh? y-2cos? x+cosh* y-2cosh? y--1 ^ — àx 
Exercises 35.10—Part A, Page 860 
1. Hint: | sin(iy)| = |i sinh y| = | sinh y| = sinh y, when y > 0 2. Vu- Vv = uU, + Uydy = UU, — Vv, = 0. 
32 3 32 32 » 
3. 663 —3xy2) + 463 —3xy?) 20; 22 (3x?y — y?) + 22 (332y — y?) 20 
axe v dye 7 ax? - i: ay : - 
Exercises 35.10—Part B, Page 860 
RR umso af d ll dy _ y’ Ux uy 
L. v(x, y) 2c ux’ +yy 202m -5- ides 


6. (a) Z, (cos(x) cosh(y)) + 5 (cos(x) cosh(y)) = 0; £c sin(x) sinh(y)) + $^ (— sin(x) sinh(y)) = 0 
(b) Im (c) c — sin(x) sinh(y) + sin(xo) sinh(yo) (d) cos(x) cosh(y) + c 


Exercises 35.11-Part B, Page 870 


f. f dz d dz 1 dz p - SN dz m 15ie" dt —0 
4. (a) f. US Jig gas Js: zig — 3 3 —0 (b)See(a) (c) cz 9 E o 225e% +9 P= 


19. f"(24+31) = 35 f. gér td = — sh — magi When C is the circle with radius 1 centered at 2 + 3i. 


24. fo ze'dz = —2e~! cos(3) — 3e7! sin(3) + 2e sin(2) + i(—3e7! cos(3) + 2e7! sin(3) — 2e cos(2)) 
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Exercises 35.12, Page 876 
i g À " k a T 
l. fG)-115tiug-iX o +5 Eol- 4) 2. fG-i-iuir fied HE phew — 3 eala) 
3. @ Erol t oir) (09410 © burner of the ratio test to the series » ^; (=) and $7, (4 ) confirms v10 as 


the radius of convergence. 13. (a) Zeros: (4 ti L /29, 4 m 4 v 29); Each has multiplicity one; Poles: (3 + 9i, —5 + 6i); 3 + 9i has 
multiplicity one, —5 4- 6i has multiplicity two. 


sd 2 1 (z +5% 5 — (5 (2-9) . . 
24. Seriesatz = —5: 2 : ; Series at z = 9:24 + ( p The radius of convergence is 14 for both series. 
7:5 »( 49 14 ) n 77-3 2. 98 (—14)F n 
co (k+1) oo oo k Kj 
l Qu 4)*)z* B l 1 GG +4- te 
31. (a)In A: Y ( ); In B: D »(* ) ) (—1)€ 94€ 2 In C: D 
k=0 —4y3t T 0 28 k=0 k=0 (- 9G 5) 


Exercises 35. iii A, Page 880 
2. (a) fe z c z5 —-—2im (b)2zi(2—3)- —2im (e)2zi(Res(f (z), 1) + Res( f(z), —2)) = 27 ($ 3) = —2in 


Exercises 35.13—Part B, Page 880 
2. (a) f. 35 =0 (b)Res(f(z),—3i) = li; Res(f(z),3i) 2 —ii — 17. (a) 18 + 24(z — 1) + 14(z — 1) -3(z 1) (b) 5; 5; 553 


2-+9 


27. FD = 4 f. 


2xi v 


LQ, dz = 2! Res ( ——— , 2) =0 
CHAPTER 36 
Exercises 36.1—Part A, Page 891 
r BESED Lam — ny3 2. Qi (Res (25. I i) + Res (2555, -1 +i)) = ín. 4. 27i Res (6:155, i) = (1 re? 


1. 
Jc 2z4(z4+4z+1) 


Exercises 36.1—Part B, Page 891 


2 , 2i x ; ae evi a dia NS aed (8z—9) fi 89 16. 

: [^ wg dz = 2 —» with C the unit circle centered around the origin. 17. 2xi Res (cox on ,4+3i) = (i + 15 i)n 
5:3 222-244 ; 295 , 1075 4... ,—45—30i 

27. 2zxi Res (z ATEA 6+9i) —(—2u + m re 


37. 2ni (Res (a S ,64 9i) + Res (e% 3 9:2 4:6 24 8i)) = — 83654 46-8! sin(54) — $0768 5-81 cos(54) + 


424-68) (z—6—91) (z*^—4z4-68)(z—6—9i) ” 5185 5185 
78 -—]9 " 2. 5 —72 
Tere 7 sin(18) + 28777 cos(18) 


2-7; 522—9:—1 ; ; Rec 5z?—9z—1 ; Rec 5:2—9:—1 9233 
48. 27i Res ( o 7+ ei) + 27i Res (, ZBE n 75 91) PÆL Res ( oa m 0) = 711222907 
57. — iyi // 3899/5 cos(4 arctan(2)) — z457 89° sin(+ arctan(3)) — 47 V/389/5 sin(4 arctan( 2) + z457 89%6 cos(1 arctan(2)) - 15 3!/5 = 
0.02881987826 
Exercises 36.2—Part A, Page 895 
eU H»t cos(ty)  sin(ty)y | i(sin(ty) — cos(ty)y), , 5 : : Pikas ; Bien ; 
)e 2. The imaginary part of the integrand is an odd function of y 


lp o i4y day Ir y? 
4. Direct substitution in the results of 1.0 and 2.0 yields the desired result. 
Exercises 36.2—Part B, Page 895 


oc st 79 M al 
e 1 l 2 sin(57t) 2 sin(57t) 

+ Res( —————,. zin +inrm) = = = £ 
2 s(l +e”) 2 : 2 9 T T m 


m=—00 


(5+2)2? 


N| = 


2. f0 =Res (zz -2) =e 12. f@)= 


2 sin(3ztf) sin(5 àrt) , sing 71) 


2 
3 m m 
H(t —2) — H(t - 4) -- H(t —6 — H(t —8) --H(t —10) 7? 


5 m 
(b) f(t) = 
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Exercises 36.3—Part A, Page 899 


—-1+( (—1)" yeint 1 oo (—1 + (—1)5)einzt 
Fi | 
aa n?z? id 2 » n?n? 


When x > 0, f(x) 2 e^, and when x < 0, f (x) = 0, because F(a) has no poles in the lower half plane. 


Exercises 36.3- Part B, = 899 


71 (71e m CDS (—1) n P costaz) 
L. » (2 niz? Rial 2 x ya 


n” 2772 
-—00 n=1 n=1 


: - : 1 fux a : l iex z . fix a . l iex 
16. If x > Othen f(x) =i Res | e^? — =>, bi} = ; When x < 0 then f(x) = —i Res | e : —~,—bi} = 
(b* +a’)? (b? + a?)? 4 b 
Exercises 36.4—Part A, Page 903 
L s,(k)2 -lktiJ/P? —4k — 2. lim, —ik— GW —4k — —oo —— 3. limi, — GK + 3? — 4k = —1 
6. s(0) = 0; s(1500) = —0.9993346500 ta 


E 
-1 -0.98 -0.96 —0.94 —0.92 
Exercises 36.4—Part B, Page 903 


2. (aji = ic + i + sc? —2c +85 (b) A (c) The system is unstable for all values of c. If c < 21, 
the origin is a saddle. If c > 21 the origin is a source. 


A-123 


-40 + 

10. (a) T (s) = SE (b) s. (K) = z EE 5441 336K (c) The system is stable for K > -$. 

0.2 | If K > ie? the poles are complex, 
0+ = but remain in the left half-plane. 
-0.2 i 
t———3———————- 
-1 -06 -02 0 02 
Exercises 36.5—Part A, Page 907 
l. w(C,0-21 2 N=2,P=1 3 5b pom Ainetdivcos—D) qr 


Exercises 36.5-Part B, Page 907 


4 


2. (a) zeros: z = —4,z = 1 (b) poles: z = —0.5472305167 + 0.7241075608i, z = 2.427794367 (c) Use R=3;0 
(d)VN=1,P=1,v=0 (e Im Yes!, note G(0) = = 


A-124 Answers to Selected Exercises 


L 
-H 


xl- 
Hu 


12. (a)s = /29 (b) Use R = 2; 0.9999999995 (c) 


; Yes, 1 time. 


Exercises 36.6—Part A, Page 912 


Lv), = 3j; v; = 3 3i 3j;0 = ix 2. w = i(1— i), i.e. the line y = —x 


2t 


Exercises 36.6—Part B, Page 912 
2. 0= arccos( $ v 10) 3. (a) Y, = 0 — 3t +i (3tt — 1$; Y =P — H Lit — 3 (b) 6 = arccos(5 v10) 
13. (a)z = ci 
= 
(b) Y, = 
(c) The image of z = —2 + e! is given by w = 2 — Bi 
The picture shows the images of the circles with center —2 and radiis, 1, and 2 respectively. 


3 ; 
(d) The image of z = t + 2(t + 1)i is given by w = $$ +4 i.e., v = 2 — 2u; 
The picture shows the images of the lines z = t + i(2t +2 + A) for A = —1, 0, 1, respectively. 
(e) The image of z = A + ti is given by w = -ag + 2, ie. |w| = 1; 
The picture shows the images of the lines y = A + it for A = —1, 0, 1, and 2,respectively 


= Cy — it ; . — 2cost+l isint_. * 4 z inh 2. 
(f) The image of z = 1 + e" is given by w = fer C235 Which is equivalent to lw + | = 55 


The picture shows the images of the circles. with center 1 and radii +, +, 4, 1 and $ respectively. 


17. f(z) = 172-10 


11z+2 
Exercises 36.7, Page 915 
1. |z,(O)| = 6 and | — 2 — (-2 + 2/5i)| = 2V5 < 6 5. 


Answers to Selected Exercises 


Plot the image of the circle with center 4 and radius 2. A 
gett tt teas 
sil "ud ic" 
+ 
1 k 
* 
0 fp aa a 
1 2 4 53 
-1+ X 
a 
¥ 
ag. + +t 
eee gett? 


= iQ 5-442); t = iQ 5 — 44/2; wi = fG) = i($5-- $42); w = flO) = i($V5 — $42); t = arecos(1); t; = — arccos(1) 
Exercises 36.8—Part A, Page 919 


Simplification of the difference of the two sides yields zero. 


toe 


Observe that the function W (w) = c+ — Arg ( (w) + ££ = (Arg(w — 1) — Arg(w)) has the property that W(x) = c if x € (—2, 0), W(x) = b 


1+<z 


if x € (0, 1), and W(x) =a if x € (1, 2). Moreover the ficti mapping w = f(z) = G £y maps the boundaries of the quarter unit disk 
in the first quadrant, exactly onto the given line segments. The solution in the z-plane can now readily be obtained. 


Exercises 36.8-Part B, Page 919 
1. (a) Observe that Arg(s + ti) is harmonic, and therefore u(x, y) is harmonic; Moreover u(x, 0) = o + — 0 2 a, when xo < x, while 
u(x,0)=a+ Pty = P whenx < x9 (b) ATEK — xo) = Arg(x — xo + yi) = arctan(y, x — xo) 
(c) 0 as Y (d) (e) The flow lines are orthogonal to the level curves. 


> X 
3 (a) u(x, y) =a + me NT a JE: 4 
(b) » (c) » (d) » 
5 5 5 
4 4 4 
3 3 
2 2 5 
l l 
! t t >x t t >x paa i >x 
0 1 2 3 4 5 0 1 2 3 5 0 1 2 3 4 5 6 
14. (a) A (b) zi = 2; z2 = 2, f @) = 3z = (g) The flow lines are orthogonal 
) vel curves. 
()R 23 (dr to the level curves 


> A x? -4x+4+y2 
- 0 In(3 ————————— 
a/ 9x2 —132x+48449y2 


In(3)—In( : ) 


3 
)-In($) 


Exercises 36.9, Page 927 
i. e(x. y) — — arcsin(— 1 /x? +2x+1+y4 5 /x x? -2x+14+y*); y(x, y) = In(3 yx? +2x+1+y + i /x? —2x +1 +y? 
TJI sx? +2x +14 y^ 3 /x? —2x+14+ y 2 — 1); ming(~) = q(1.069110828, 2.365301723) = 0.3986118666; 


maxg(g) = q(2.462574282, 1.113419471) = 1.118655582; ming (y) = w(1.363725569, 1.228537203) = 1.300984786; 
maxg(V) = v (2.673820091, 2.738895449) = 2.036241351 
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6. (a) $ (x, y) = cos x cosh y; y = —sinx sinh y 


(b) 


dtt 


ili 


> xX 


(ec) F=@+iv F=9-iWS>V=F -qg,—iy, =a +ip, = Vo = — sinx cosh yi + cos x sinh yj 
(f) v= x sin x cosh y|? + | cos x sinh y|? ao» (g) All three integrals are zero. 
2 (h) In(sinh y) + In(sin x) = ci; 
Combining the logarithms shows that this is 
equivalent to w(x, y) = — sin x sinh y = c». 


Die S "m 
* (x^ +y* ) xx 
sinh( € ——? = ) cosh( 

x“+y x 


N^ 
5 25.2.3 E 
inh? (265E H ) )-Ecos2 ( 2€ 
x^ d 


yl 


11. (a) (x, y) = sinh x cosh x (b) V (x, y) = sinh(x2—y2) cosh(x2—y?) , Vy =0 (c) y (x, y) -- 


sinh? x--cos? y sinh? (x2 —y2)--cos? Qxy) ° 
Exercises 36.10—Part A, Page 936 
1. The parabola maps onto the horizontal lines v — 1 and v — —1 4. Vo(1,1) = (44278 + 3427/3 V3) i+ (442^ - APP 43) 
6. Ve (0, 3) = SA 3i + &Aj 


Exercises 36.10—Part B, Page 937 
1. This is the definition of the principal value of the square root. Im 
Plot the image of the unit circle centered in the origin. l 


0 Re 


2. (a) Plot the image of the unit circle, centered at the origin. (b) The condition Arg(z) > 0 is equivalent to 3(z) > 0, while Arg(z) < 0 is 
equivalent to 3(z) < 0. In this particular branch of the square root, 


T the branch cut lies along the positive Real axis. In the overlapping 
NEL region ( 0 < 3(z)) the functions coincide, outside of that region 
l BL bc" the relationship arg(z) = Arg(z) + 27 introduced a negative sign. 
044 
0.2+ : 
! } » Re 


1 ! 
-1 -05 0 05 
9. (a) Plot the images of the unit circles centered at —24/2, 0 and 24/2. 


Im Im Im 


0 Re 
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b) Plot the image of right half of the unit circle centered at the origin under both transformations. The image under o is 
dotted. Plot the image of left half of the unit circle center under 
: both transformations. The image under ø is dotted. 


ie ecco sen esie 


at Se Da a: RN, + 
0.02 0.06 0.1 0.14 0.18 


(c) Plot the image of the ellipse (thick) and of two exterior curves (thin). 


(d) Plot the image of the unit circle (thick) and of two exterior curves (thin). 


7 ) 


/2i(Arg(z+2V2)+Arg(z—2V2))) 


SS z 
(g) Plot the contour v (x, y) = 0. y 
CS Mà 
13. The graphic shows the images of a set of horizontal line segments in the upper half plane: zg = x + E, Ems 16, x € [—8, 8]. It is 


commensurate with the statement made in Exercise 25, Section 36.6, that this mapping takes the upper half plane to the union of the first 


CHAPTER 37 


Exercises 37.1—Part A, Page 948 
l. sinl © .841471 2. tan2 + —2.18504 4. (2.718281692, 2.718281964) 
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Exercises 37.1—Part B, Page 948 


2. (a) (252.78, 252.781, 252.7814, 252.78136, 252.781362} (b) (253., 252.8, 252.78, 252.781, 252.7814} 12. (a) 5 (b3 24. 


Exercises 37.2—Part A, Page 953 


3. (1, 5, Bry 5. x = —5,4; Yes, it will converge quadratically for both. 


Exercises 37.2—Part B, Page 953 


[X2 — Xk+1l ] 


k Xk 
leie — Xe] 
1 —0.6677 0.4266648038 
2 —0.667113099 04367317599 
9.9) |; E nol (b) C, = 0.4443850267 (c) x = —0.6666666667 (d) g/(X) = 0.444444444 
5 —0.666705092  0.4438099696 
6 —0.666683727 0.4441046193 
7 —0.666674245 0.4440750416 
L8 —0.666670034 0.4443850267 | 
m " X42 — Xil 
lxi — xd? 
12. (a)|1  —3.863636363636363636363636 0.4411014535799611956913476 
2 —3.855227727895589179451304 —.0.4402476087454627607488304 
| 3 —3.855196539748933806803053 —.0.4402767021015987052995771 


(b) Co = 0.4402767021 (c) ¥ = —3.855196539 (e) g"(x) = 0.4402444065 


"n " |Xk+2 — Xil 
|Xk+1 — Xl? 
1 2.040 0.5045070474955341326191188 
p) 4434 9 991149 92 ? 53542 
22. (a,b) |2 1544349939246658566221142 2.170509331890821161953544 | (6) 1 993809568 
3  1.382299470490548993777343 — 1.231960922494253053894907 
4 1.268077679326924056143668 — 1.475156743378981638301195 
5 1.231264550232827789664409 — 1.195414169973818446771502 
L6 1.224208171987134542086538 — 1.200422435653427722504667 
[Xi2 — Xil ton tix 1 
32. (a) lim = lim — 4 4 Fb) lim ome =3 (Cr = 4 (A) 57 = 2.999656986 
ko |X] k> a tage 3 i 


36. (a)g(a)=a (b)(—10,—4 — J34) U (4 34. 2) (œ) z'(a)=0 & a= —4+ J/35 
CHAPTER 38 
Exercises 38.1, Page 957 


2. dmi 


3. (a)0.1609394091 (b) y 


>x 


! = t j t 
0.05 0.1 0.15 0.2 0.25 0.3 
g'(.1609394091) = —0.3709553320; {[xz, f (x:)1) = {[0.2, 5.280], [0.1444210526, —2.11780795], [0.1667137679, 0.75620194], 
[0.1587537475, —0.28407063], [0.1617439647, 0.10486621], [0. 1606401099, —0.03896985], [0.1610503188, 0.01444649], 
[0.1608982505, —0.00536031], [0.1609546749, 0.00198826], [0.1609337459, —0.00073758], [0.1609415098, 0.00027360]] 


16; 1 
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(c) » 


0.1 


t ! t + tje 
0 0.05 0.1 0.15 0.2 0.25 0.3 


g/(0.1609394091) = —3.259228175; {[xx, f (xi)]) = {[0.2, 5.280], [0.12481565367, —19.48000000 + 11.740817307], 
[0.4559006182 — 0.1355422055i, 47.48834917 — 29.538846131], [0.1614869989 + 0.5800704493i, —41.67514463 + 63.91661435i]} 
(d) » 

Á 


St A 
0 0.05 0.1 0.15 0.2 025 0.3 
g’(0.1609394091) = —26.93505922; {[xz, f (x) ]} = {[.2, 5.280], [0.2154434689 + 0.3731590343i, —11.15188922 + 50.72509685i], 


[0.8399775495 — 0.4395184361i, 116.8264101 — 162.62461597], [0.9769813313 + 0.9728165398i, —34.88984663 + 384.89757397]} 
13. (a)rı = —3,r2 22 (b) (2.6)U (6,00) (©) (00, -4)U(-4,-3) @Mp=6 @p=-4 (f) xm e (-3.—1) 
(g) xo € (—3, 2) 
Exercises 38.2- Part A, Page 959 


n( eal c F(a)— = E 
l. n» “Z2; 2.0 {[0, 1.5], [0.75, 1.5], (0.75, 1.125] — 3. 0— f(a) = SOLADE g = Aoife 


Exercises 38.2—Part B, Page 959 
3. (a) 


U 


(b)a = —1; b = 0; n = 24; x = —0.4364916686; a = 3; b = 4; n = 24; x = 3.436491673 


(c) a = —1; b = 0; n = 15; x = —0.4364916732; a = 3; b = 4; n = 15; x = 3.436491673 


Exercises 38.3—Part A, Page 966 
1. g(x) =x — Eze = 20-8 2. C92 = }; Co(4) = -i 3. X, = 1.750000000; X; = 1.975000000; X, = 1.999695122 


2x—6 2(x—3) 


Exercises 38.3—Part B, Page 966 
1. (a) /"(00 28 (b Qo) = i — Hy? + EN = ax? + O(x’) 
X42 — Xk4l 


Qai — x? 


k Xk 


0 —0.2 —0.5831962496 
1 —0.1031914894  —0.7210005817 
2 —0.1086571391 —0.7132673601 
3 —0.1086786778 —0.7132370297 


(d) This is an immediate consequence of the fact that f'(r) #0 (e) — tg" (r) =— j a = —0.7135 


6x? +8x7+10x+1 
18x?+16x+10 (b) 


3. (a) g(x) =x — (c) Co = —0.713 


A-130 


2 


15. (am = 4; Q(x) 2 4x? +6 (b) 


= = 
KB OUOAMAANN 4 tUt:t.€t5-—c 


a 


Xk 


Xk42 — Xk+ 
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Xk 


2.0 

1.788461538 
1.617065654 
1.479480923 
1.370125435 
1.284056055 
1.216929852 
1.164996962 
1.125090100 
1.094593477 
1.071390320 
1.053796844 
1.040492100 
1.030450978 
1.022884572 
1.017189606 


k 


Xk42 — Xk+1 
Xk+1 — Xk 
0.8102350889 
0.8027306605 
0.7948228454 
0.7870604556 
0.7799080663 
0.7736604583 
0.7684313842 
0.7641949627 
0.7608434754 
0.7582363356 
0.7562316660 
0.7547023753 
0.7535419334 
0.7526645338 
0.7520027490 
0.7515044199 


Xk 


; Cz =0:7515 (e) mt = 0.7500 (d) g’(r) = 0.7500 


Xk+2 — Xk+1 


e = x)? 
—0.2083448467 
—0.2099527350 
—0.2003718227 


Qui — x? 
0.09084923758 
0.1448263128 
0.1499669537 


2.0 
0.8852603982 
0.9981536928 


2.0 
1.153846154 
1.004676175 


(e) (f) (g) Co = —0.2000003490 


0.9999994891 
1.000000000 


oe = —0.2000000000 


BWNr OC 


(h) — 


BWNFK OC 


1.000004373 
1.000000000 


25. 0.1049770865 + 0.7947096438i, 0.5200229135 + 0.3444279335i 


Exercises 38.4—Part A, Page 969 
2. 


Exercises 38.4—Part B, Page 969 


x2 = 1.600000000, x3 = 1.882352941, x4 = 1.981308409 


—0.2000003490 


2. Establishing empirical evidence of superlinear convergence is not an easy task. The given table was created using extended precision 


— 
© 


—0.1157407407 
—0.1092364965 
—0.1086758746 
—0.1086786793 
—0.1086786782 
—0.1086786782 
—0.1086786782 
—0.1086786782 
—0.1086786782 
—0.1086786782 
—0.1086786782 
—0.1086786782 


arithmetic. 


WNrF OC iO 00 —-1 ON tA 4 09 F2 


[X2 — Xil 
Ix — xl? 
1.564744673 


0.2130629378 
1.936385675 

0.5112642622 
1.073698717 

0.6823007842 
0.9033232874 
0.7594937168 
0.8454227020 
0.7912333874 
0.8242994759 
0.8037040231 
0.8163712079 
0.8085191960 


es 
" 208115092723 


> 


[e] 


No o0o0o-10g tA WN 


eee 
Ne O 


2.0 

1.9 

1.743867847 
1.633236892 
1.530318506 
1.444922600 
1.371390693 
1.309386508 
1.257009587 
1.213054162 
1.176269499 
1.145598526 
1.120095197 
1.098942429 
1.081434615 
1.066969496 


|Xk+2 — Xil 
[Xii — Xx] 
1.561321530 
0.7085725296 
0.9302856192 
0.8297439306 
0.8610706285 
0.8432283084 
0.8447320334 
0.8392136051 
0.8368628663 
0.8337978417 
0.8315135409 
0.8294120470 
0.8276842640 
0.8262093295 
0.8249839464 
0.8239609974 


14. (a) g(x) = 


(c) g(r) = 


g(r) = 


(b) 0.9942313043 


(12x32—2x—5)5 


A £e qo)" v)-3f" oy»). 
? *, 


fay 


960x7 —416x5—420x? —2763x4+850x3 --2808x? —2088x —156 (b) 


expressions vanish at a point where f(r) = 0. 


) 


W” Nele 


20. 


- OV tA A 


r 
oo 


Xk 


1.5 

1.845679012 
1.945978662 
1.980207929 
1.992640095 
1.997248603 
1.998969422 
1.999613701 
1.999855 161 


[Xk42 — Xil 
[xii — Xl 
0.2901525587 
0.3412700540 
0.3632028118 
0.3706922485 
0.3734005616 
0.3744024349 
0.3747762246 
0.3749161281 
0.3749685541 


Exercises 38.5, Page 972 


2. (a) 


k 


Xk 


0.05 — 0.8i 

0.2 — 0.8i 

0.1 — 1.07 
0.1024453086 — 0.7927956524i 
0.1049442648 — 0.7945375 108i 
0.1049767715 — 0.7947097645i 
0.1049770865 — 0.7947096439i 


aABWN Ke Cc 


ON 


[Xi42 — Xil 

[X1 — xy |? 
7.326379935 
3.257712271 


0.05508457920 |; 


7.445225594 
2.734020064 


a~ 


PUNEO 


Answers to Selected Exercises 


. [X2 — Xil 

Xk SSS 

Ix — xk? 

—].5 1.159587226 


—1.632900000 
—1.635621939 
—1.635621955 
—1.635621955 


0.7954714051 


; Convergence is linear; g'(r) = 0.3749999990. 


Xk 


0.05 + 0.87 

0.2 + 0.8i 

0.1 + 1.07 
0.1024453086 + 0.7927956524i 
0.1049442648 + 0.7945375108i 
0.1049767715 + 0.7947097645i 
0.1049770865 + 0.7947096439i 


|xka2 — Xil 

[xia — xil? 
7.326379935 
3:2917122/71 


0.05508457920 |; 


7.445225594 
2.734020064 


A-131 


EFE EP FY? + AFP IU) + PEPE” OFM) 9f" OF (m) fa) + 12f" y FEFE); Clearly both 


A-132 Answers to Selected Exercises 


k X |Xk+2 — Xil k m [X42 — eA J 
[xii — el [xia — xd 

0 0.5 — 0.3i 13.16491894 0 0.5 + 0.3i 13.16491894 

1 0.6 — 0.4i 1.704545540 j! 0.6 + 0.4i 1.704545540 

2 0.3 — 0.2i 0.03627708121 2 0.3 + 0.2i 0.03627708121 

3 0.5196059530 — 0.3411713905i  9.417676218 3 0.5196059530 + 0.3411713905i  9.417676218 

4  0:5200574229 — 0.3442061161i  2.680060091 4  0.5200574229 + 0.3442061161i — 2.680060091 

5. 0.5200224073 — 0.3444280602i 5. 0.5200224073 + 0.3444280602i 

6 0.5200229136 — 0.3444279332i 6 0.5200229136 + 0.3444279332i | 


(b) The claim of superlinear convergence cannot be verified for this particular problem. (c) Cy (0.520 + 0.3447) = 1.308006693; 
Cy (0.104 + 0.7947) = 1.180832955 


i ii |Xk+2 — Xil 
lxk+1 — xrl 

0 0.8 0.2500000000 

I 1.2 1.299106920 

2 1.3 0.3709036054 

3 1.170089308 0.5449481914 

4 1.147828965 — 0.04273415660; 1.308658941 | Convergence is linear. 

5 1.124215409 — 0.05421810285i  0.7249531051 


6 1.090345143 — 0.06001484372i — 0.8376919628 
7  1.065762002 — 0.06404539927i — 0.8736739163 
8 1.044971644 — 0.06224634380i  0.8197157050 
9  1.027369959 — 0.05749430616i — 0.8369417274 
O  1.013810847 — 0.05120923816i — 0.8364129837 


CHAPTER 39 
Exercises 39.1, Page 981 
1. (a) J (b)n = 10°: 0.00225 96; n = 10°: 0.00225 %. 
600000 + 
500000 4- 
400000 4- 
300000 4- 
200000 4- 
100000 4- 


+ {+++ > 1 
0 20 40 60 80 100 


2. Numeric Solution: x = [0.2274, —0.09203, —0.4809, —0.3825]7; “Exact” Solution: x = [0.2261, —0.09119, —0.4774, —0.3800]. 
8. Numeric Solution: x = [—0.1500, 0.1949, 0.2203, —0.006542]"; “Exact” Solution: x = [—0.1501, 0.1947, 0.2203, —0.006549]? 
14. x = [—0.01557632340, 0.4174454833, —1.200934580, 3.147975078, 2.454828660, 3.954828660]1. 16. x= [£ ER -$ ay 


12! 12? 2° 4 
Exercises 39.2—Part A, Page 986 
1. (a) xo = [82, —9y'; xX. = [ —824c zu 


2 -[ 819c 90c ]T 
» Ax= =1+10e? —14 TA 


—1-10c? —1+10c 


Answers to Selected Exercises 


Exercises 39,2—Part B, Page 986 
3. (a) x —[—199, 168, 256]" (b)x, = [—228229«, 842:3«..52-]" (c) Ax = [0728-2 —8192 2, 125442]; 


2+49a 2+49a’ 24-49a 2+49a ° 2--49a ? 2--49a ] * 


A-133 


a T 
a = 12544 za ;condA = S8; g = L(a| (d e)z— [-19, —19, 312 
ont ba SERED piP=gslal © a eios mos] 
100 
80 B cond A 
60 
40 
20 
St 
0 02 04 06 08 1 
7 S0ra  —10947a 100. ]T 1122 ^a _ 1632 a 510 a T, 1632 Ester : 
(f) zi = oe —3114-5a? Ana (2) Az = [ 311 —311+5a’ 311 —311+5a’ 311 d p= 311 max(— 10 —109+7a | 3| _50+a y* 
^*|-31145a]'| —311+5a |^! —311+5a 
cond B = 7%; v = L|a| (h) (i) det A = —2; det B = 622 
j -1j = 192 — 1737094261 _ o 
03 G) ILAlla]|A llo = 1921.805761 = 5555 oisscixEi = oy 
v cond B 
0.2 
0.1 
u 
+++» a 
0 02 04 06 08 1 
- T j so sr 
(a) x = [131, —420, 966]"; x, = [131 + 24a, —420 — 77a, 966 + 177a (z-[i.2.i]:z = [i- 3&.2—- ła, $ — 3a] (©) 
4 T i . d 
Ax = [24a, —77a, 177a]"; Az = [- 3a, —ia, —2a] (d) a = 25 lal: B= zal: A= ial (e) cond-&— 5350; cond B = A det A = 1; 
—? JE 10 : -1y. — —.  16.599373322 . o, 
det B — 21 (f) 1000 (g) (i) || All LA llo —/3277.188396 = sosna = = 
800 + 8 
600 + 6 
À cond B 
400 + 4 
200+ 2 
0 0 5 
0 02 04 06 O08 1 02 04 06 O08 | 


11. (a) xp = [-10, —364, 202]" (b) a = 0.00008019459922 (c) z = [—10.02065541, —364.0126093, 202.0141066]T 
AX = [—0.02065541, —0.0126093, 0.0141066]T; 8 = 0.00005674366621; cond A = 6.613064634 (e) | Ax|| < 0.19 
(f) || Ax|| = 0.02065541 


15. (a)z = [326.71, 37.997, 243.70, 216.43]! (b) r = [0.000025357, 0.00024247, 0.000360857, 0.00042875]T 
(c) u = [0.043143, 0.016573, 0.025484, 0.017813]? (d) cond A = 92.73061750; !* 105 = 13.20528909 


lizil 


Exercises 39.3, Page 991 


(d) 
30475599 


1. (a) x, = [125, —2880, 14490, —24640, 13230]? (b) x; = [111.40, —2586.6, 13132., —22495., 12147.]"; x, — xi] = 2145 (c) 


x. — xil| < |}x,|] cond A =! = 96881.6 (d) x, = [124.00, —2858.6, 14390., —24482., 13150.]T, 


TAI 
x; = [124.93, —2878.5, 14483., —24629., 13224.]", x3 = [125.00, —2879.9, 14490., —24639., 13230.]", 
x, = [125.00, —2879.9, 14490., —24640., 13230.]" 
(a 


)x, = [-10, —364, 202]" (b) x, = [—9.9935, —363.99, 202.00]; ||x. — xı || =0.01 (c) x2 = [—10.000, —364.00, 202.00)" 


T 
6. (a)x, = fees 100,712,501 645,360,867 rd = [326.56, 38.016, 243.61, 216.37]7 (b) x, = [326.71, 37.997, 243.70, 216.43]*; 


2,649,203 ° 2,649,203 ' 2,649,203 ° 2,649,203 


X, — xı || = 0.1549187 (c) x; = [326.56, 38.016, 243.61, 216.37]" 


Exercises 39.4, Page 995 
=22 6 6 —7 
—9 21 3 = 


i5 
2 (Az (b) xe 5221. 8697 31651 as] = [0.050514, 0.084145, 0.30629, 0.033041] 


—6 0 ii =2 103,357 ° 103,357 103,357’ 103,357 
1 8 8 25 


(c) X4 = [0.05050667154, 0.08414344350, 0.3062806785, 0.03304675129]"; o4 = 0.756552 x 10? 
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3 3 
-22 0 0 0 0 c aw 7m 
9$ Ww v. 7 9 ap i$ 53 aif = 0.4951091354 
11 11 
0 0 0 25 ft E 8 x 


(Œ) x14 = [0.05050667159, 0.08414344344, 0.3062806785, 0.0330467513]": o14 = 0.756547 x 105 
12. (a) p —0.3813047054 (b) x, = [—199, 955, 230" = (0.59172, 5.8284, 0.4931] 


(c) x13 = [—0.5917140990, 5.828399731, 0.4930961944]", [xi — x,|| < 105 


Exercises 39.5, Page 998 
2. (a) x7 = [0.05051457853, 0.08414448153, 0.3062879762, 0.03304103036]'; ||x, — x;|| = 0.76262 x 1076 


P 


0 jb 
12. (a) x, = [-22, 8, 1T (b Bos |O0 2 —1| (© for A: A = 0.5889664716, 9.685215241, 14.72581829 (d) for Bes: 
0 0 g 
A = 0, 0.04545454545, 0.6666666667 (e) x35 = [—4.249995918, 11.92856326, 0.1428571433]"; ||x, — xas|| = 0.817 x 107? 
18. (a) x, = [ Bit, — 4555, E96. 497]" — (1.2633, —4.7399, 1.4527, 4.6171]* 
0 -$ -i 
(b Bas 2 |0 i -f | © for A: A = 1.655908493, 4.393079379, 9.692847811, 27.25816432 (d) for Bos: 
0 49 11 


264 24 


à = 0, 0.4308202185, 0.4308202185 (e) xi; = [1.263262222, —4.739845965, 1.452653012, 4.617060260]'; ||x, — x31 || = 0.8353 x 107 


Exercises 39.6, Page 1004 
2. (x, = [-45. - 4, — 4 ]" = [—0.17747, —0.023928, —0.40578]" 


1003 ° 1003 * 1003 


(b) result: x = [—0.1774675972, —0.02392821535, —0.4057826520]T 


l— w — Zo 


8. (a) Bw) =], - (b) Ax = —o + Few? + 1+ 35 / 425040? — 4250403 + 592904 
gel +o) meo tl-o@ x e 


@O=12 
0 0.5 1 15 2 
1 1 
1—o gt —£ 
14. (a) B(w) = 20(—1 +o) io? +1l-@ io? — lo (b) i A (c) ô= 1.25 
-£o(-1 oy zo? + zo m w TON + so? +l-—@ ost 


— -4— L—— omega 
0 0204 06 08 1 12 
(d) reward: 15 iterations were required, compared to 35 for Gauss-Seidel. 
7 7 9 2 2 2 
20. (a) B(w) = [1 O; =O. —150; to]. [ot 1+), 2 o? +1l-a, oo lo, io? Zo], 

7 \ 49,3 2_ 6 0: <3! 1 85.2 | 21.0 $ 
[73;9(» — 2)(-1+@), - 5 o? 4 Do? — io, Zw +a -l-o, -j0 + Ho? - io]. 

l 542 693, L 320 49 4. 415 3 4 4090.2... 49 A 4793,93 95.2. 1... 2. 4. a 828.0 
[ 19s; (420° — 623w + 396) (-1 + œ), IRL — 1550" -F 359" — BOs 3:509. — Tre + 320 — gs FG — ami + sx tl-a] 


Answers to Selected Exercises A-135 


(c) @ — 1.2 (d)reward: 23 iterations were required, compared to 31 for Gauss-Seidel. 
0.9 
0.8 
0.7 
0.6 
02 06 1| 14 18 . 
0 -5 0 0 0 0 
-$ 0 -i 0 0 0 
" 0 -i 0 -8 0 0 : 
26. (a) By = ; p = 0.9617197192; ó = 1.569815585 
0 0 -# 0 - 0 
0 0 0 -3 0 -$ 
0 0 0 0 -4 0 
(b) x = [235.2485 RE UR, RAS. - -gaf - = [1.2879, 1.3071, 1.7565, —2.2076, 5.505, —0.23857]" 


(c) x = [1.287901658, —1.307096881, 1.756473991, —2.207585526, s 805026400, —0.2385740700]", 29 iterations are required for 
convergence of SOR. with w = ô 


Exercises 39.7, Page 1008 
E asd 28 1 8 l 3 asd 3: g2 ] x2 


2. (a) f(2, 1) = 0; g(2,1)=0_ (b) GG, y) = [- 5xy* E y) - x^ 4 Zxy+ Ly? +2 13k — ak Yay L ee — a 
(c) || V f (x1) |]; = 0.9800000000; || Ve(x;)|]; = 0.9947916667 (d) A = id. 3415650255. 0. 3415650255 (e) with xo = [0, OJ", 
X13 = [2.000000248, 1. DOODOEBS] S and |X — xi3]| = 0.2795 x 1075 (f) o = 0.9947916667 (g) with xo = [0, OJ, 

X15 = [1.999998626, 1.000004501]"; and |X — xis|| = 0.4501 x 1055 (h) » 


f(x,y) =0 


+ > 
0 OF T LS 25 3 35 
12. (a) f (5,5, Ig: —0:86,5,12 —0:46,5,12 -0 (b) GG. y. 2 =f x y + gigXyz - s y?z 4 m sx A. 
LET 7 2.2 S 2 4 9578 S. Sieg 2 l 21:22 arta D x y -2 41.833 
po^ 1501 > c+ a ides 1501 y 1501 © cum 1000% J E y T500% N 1500% » 500 3000 * "4 3000 J" 
(c) IY f (:) h = 0.8120000000; || V.g(x;) |]; = 0.7921385743; | Vh(xi)]|; = 0.7426666667 (d) 


à = 0.2804058191,0.5185947642,0.5185947642 (e) x3, = [4.999999013, 5.000004533, 11.99999164]7 (£) æ = 0.8120000000 
(g) x43 = [4.999991832, 5.000008324, 12.00000608]" 


Exercises 39.8, Page 1011 


2. (a) G(x, y) = E (4830y + 1252x + 110x?y — 3384y? + 84x? F 3056xy* + 228y?x? + 144xy* — 192x*y + 216y?x? — 1164x? + 8635y? 4 
153y?x? + 48x3y + 28y?x + 27y* + 12004 — 5776xy)/ (171y?x? + 108y* — 22y? + 1427y? — 12x? + 111xy? + 86xy — 1500x — 6x? y — 
184y + 222x? + 4800 — 144x? y + 162y°x), (—626y — 3008x + 7825 + 318x? y + 442y? + 300x? + 31xy? — 24x* + 72y? — 96y? x? + 


108xy^ + 114y?x? — 279x? + 1352y? — 45y?x? — 36x% y + 60y? x — 20y* — 336xy)/ (171y?x? + 108y* — 22y% + 1427y? — 12x? 4 
111xy? + 86xy — 1500x — 6x?y — 184y + 222x? + 4800 — 144x3y + 162y°x)]! (b) Je(2, 1) = k ol (c) with xo = [4, O]T, 
X6 = [1.999994428, 1.000004464]T 
12. (c) with xo = [4, 6, 10], x4 = [5.000000002, 5.000000005, 11.99999999]T 
0 0 0 
19. (a) F(-12, -5,-5) 20 (b) Jg(—12,-5,-5)=]0 0 0| (e) with xo = [—11, —4, —6]", 
0 0 0 
x4 = [—12.00000000, —5.000000001, —5.000000003]" 30. with x; = [0, 0]7, x; = [2.000005569, 0.9999995278]! 
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CHAPTER 40 


Exercises 40.1—Part A, Page 1017 
L Lo(x) = 22; Li) = SR Lox) = Gx + $ Li) = gx t+ 


xo—x1 ? 
Exercises 40.1—Part B, Page 1017 
2. (a) p.(x) = 9.596726166x — 8.880334790x? + 3.746264282x? — 0.9021763333x* + 0.1279278366x? — 0.009939314523x° + 


4 f(x) = zx - x-5 


3 


w= 


1 0 0 0 0 0 0 0 
1 d 1 1 1 1 1 1 
1 2 4 8 16 32 64 128 
1 3 9 27 81 243 729 2187 98. 593.92 
7 = ; — 828,593,920 
0.0003259661579x’ (b) A= 1 4 16 64 256 1024 4096 16384 |° cond(A) = 5 
1 5 25 125 625 3125 15,625 78,125 
1 6 36 216 1296 7716 46,656 279,936 
1 7 49 343 2401 16,807 117,649 823,543 
(e) Py(x) = 10 x? 3x6 ds 3 y 5— Lyt p 394 2392 47:671 207 dox? + Bd 235 4 nya ae ! qo x? Hye 4 
pu LN a E LUC fe | DM d TM tow ps E ra Er 6 UON ESO id 
M07. | wt F» 3 M : : Vg sre? + 60( nzo* + 369%" nY + 79% t 369% pc E TOC -= mt t 
ar — age tor rx? += Lye" (d) f 
3.5 
3 
2.5 
2 
L5 
1 
0.5 


(d) M = field = cete Dg =D 390 O6 —DO-He—7 


T 


VORTAG) 


1 2 4 8 
1 3 9 QF 
2 = = = 3) 
12. A 1 5 25 125 (b) cond(A) = 6734 (c) det(A) = 72 
1 6 36 216 
17. (a) (b) x = —0.8943035503 (c) x = —132.1210881; This is the polynomial wiggle at its best! 


05 e 
04 = J t >x 
-0.5+ -2.5 -2 -1.5 -1 -0.5 
df l 
-1.54 " N 
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There is no quadratic osculating polynomial p2(x). The osculation cubic is: p3(x) = 3a — g + (—4a + 42)x + ax? — 2x5 Va € R. 
26. p3(x) = 1+ 6x — 8x? + 3x? 


Exercises 40.2-Part A, Page 1022 
DD| DD2 


rk ox 
10 3 
|| 
| 
eoii g 
| 
| 
lo 5 


y 
2 


4 


in 


3 BA 3 pma)=- 3 +3 
8 


Nin 


Exercises 40.2—Part B, Page 1022 


k 
0 


N 


5 


x 


—16 


y DD] DD2 DD3 DD4 DDS 
14 
X 
3 
4 
15 57 
sti, exco. 
" 546 
j _ 13 339 
4 42 18,200 
| 14 227 | 375,369 
3 840 239.439.200 
44 40,767 
=18 15 ^ 1,841,840 
8197 
10 ^ 34,320 
127 
10 T 
cali 
11 
—7 


(b) P5(x) = Ë + ix — EG 16x + 13) — Hew + 16)(x 4-13)G + 6) + 333 (x 4+ 16)(x + 13)(x + 6)(x 4-3) — 


375.369 
239,439,200 


P(x) = 


[k 


N 


12. (a) 


4 


5 


ast 546 18,200 


(x + 16)(x 4-13)(x 4- 6)(x -3)(x +1) (©) 


Ts. 
$ y 
0 5 
] 13 
2 295 
3 4l 
4 6l 
5 85 


18. (a) Clearly f(t) 
product of the t — xy. (b) From (a) we find that f (t) — p, (t), has at least n + 1 zeros on [xo. Xn], therefore the n-th derivative of this 


difference will have at least one zero on [xo, x, ], and noting the fact that the n-th derivative of p, (t) equals n! f [xo, «++ , Xn] yields the desired 
result. £ = 0.09111223034 


858,074,351  , 968,174,619 2 _ 89,357,399 ,3 _ _783,039 4 375.369 5 
+ 735,650,800 * + 239,439,200 ^ 718.317.600” 18,418,400% 394392954 (©) 
DD| DD2 DD3 DD4 DDS5 


8 
2 
12 0 
2 0 ; er 
16 0 0 (b) The fifth column of this tableau (c) po(x) = 5+ 8x + 2x(x — 1). 
2 0 
20 0 
2 
24 
Pat) —U0 forr-xE-—0,L.22a n. This implies that f(t) — p, (ft) equals some function of xo, ... , Xn, t, times the 
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Exercises 40.3, Page 1025 


3. (a) Pg(x) = 0.08174711402x° — 1.1478981363? + 5.765280127x^ —11.61652409x? + 4.166861647x? + 13.02831112x — 11. (b) 
Po(x) = 0.05540841278x* — 0.80146305803? + 4.142973395x^ — 8.560385190x? + 3.20952491x? + 8.797316165x — 6.961112122 
(c) M; = 0.3809228067 x 108 (d) e, = 8.564415162; e; = 4.187775308; e = 258270.7646 

7. (a) P;(x) = 0.000325966158x7 — 0.00993931455x$ + 0.127927837x? — 0.902176337x* + 3.74626428x? — 8.880334797x? + 9.596726768x 
(b) p; (x) = 0.0003482288298x7 — 0.01066417176x° + 0.13701403163? — 0.9581051648x* + 3.922478274x? — 9.142597069x? + 
9.727955517x --0.0147311975 (c) Mg = 80 (d) e; = 0.04852423200; e; = 0.01405198000; e4 = 0.3490630255 


18. Hint: Solve the equation k arccos x — (n $ i) x for x. 


Exercises 40.4, Page 1032 


10 +x -15<x<-9 
—53 — 6x —9 < x < —6 
2. $)RG)-]| $*$94 —6Sx53 
Biy 3<x<7 
18 — 3x T<x<15 
2 -15<x<-9 
—197 — 46x — $x? -9 < x < —6 
(c) Fæ) = E + Bx + BY? ~6<x<3 y 
4651 3947 .. 793 2 ^ 
48 ^ m^ 144 * 3<x<7 
58,081 17,077 L 1523.2 
192 288 ^ T 576 * Tex <15 
685 2 676 .. 3345 
Ee — gy Is $329 
rr gd —9 <x < —6 
(d) RA) = ja + rte | 6 Sx <3 
wag Ha Lm 35x57 
9 2 135 2537 a 
ax - ix 64 Jarai 
10 +x —15 <x < -—9 
—-ix?-4lx — 179 -9 <x < —6 
(e) F3(x) = = x? + ae on 6.x =3 y 
751 x? UE. 4399 
tage t ds 48 35x57 
1451 2 16285 .. , 55561 7«x« 15 


576 * 288 " ' 192 


en 40 = uem 15x «-—9 
Mg? 4 MO, 4B 9 <x <6 
(f) Fy(x) = -4x ae m —6 <x <3 
-4x + 2x43 82287 
Wy? — By 4 $57 14x <1I5 
10 +x —15 <x < 
—jx? — 41x — 179 -9 <x < 
(g) Fs(x) BoOrXx-- -6<x< 
yt My MB 3x x 
Wet MO | HE Te x 
nad 1433 y xs ieee ead 
E: 9 <x <6 
h) Fx) 2 1-28? + 28x - B 6<x<3 
-g + Ert - 3<x<7 
-42 + iH S 722215 
— tx? -15<x<-9 
-$e p 95 —9 < x < —6 
(i) F;(x) = Ho x? + Six — m —6 <x <3 
T M 
WES pp Te <I 
Wes? My MO 1552-9 
4p Hy 9 <r <6 
(j) Fs (x) = -me 2 y + —6 <x <3 
-gx 4+ xt 3 3zxx7 
-4r + hrt X T= x = 15 


Answers to Selected Exercises 


A-139 


A-140 Answers to Selected Exercises 


T 60,871 1037 E 10,903 ..3 56911 2 , 41,234,507 . , 8951 
(k) Ps(x) = 169,827,840 ^ 8.491,392° 101,088 ~ at 1,886,976" ™ 76.289.920 ^ ' 9984 


16.486.267 20,502,806 . — 2.553.087 „2 44701. .3 Berz 
161,051 805,255 1.610.510 1,610,510 = 
E M f Sg x + p 3 + ag md 
TORETE MON, IPIS EX — ga 
ip NAM, uno BMS —— src 
E Batt ES Ass 
X 
de- SG a? psp — T PEPEE 
P EE EE E 
TORE TE c MS 
Ruso pmo BOS y UE “S<x< 
Dat — supino + 2a 5 + terest 44x%% 
j++ +. 
-15-10 -55 | 5 10 15 
- Hle qos, — qune -19 sx 5-8 
ER E c E MEM 
TEE et — pose e gy <5 ; 
{CE TE TE ee 
ZES ya 4 DON. 4 tons -4 <x <18 
a ME Oo M 
EL “prise X + Sine x LOL. 8<x< 
Ho 6 <x < 
PU MES EE NE 5 x s 
525,743 p 1,045,269 „2 | 43.604.881 y | 29.935.725 -4<x< 


13,458.58 4,486, 196° 6,729,294 "^ ' 1,121,549 


Deo ipo imm, mum L19 <y < 
IMP M CMES S 
(9 Gace) = | ABBE — ees AD. sass og cx 
E RE PM 
Bae O y? ia y BBE caa 
_ 156,941 „3 — 3,474,222 „2 _ 94.073.769 „ _ 175.214.909 19 < 
2,520,914 1.260.457 2,520,914 1,260,457 & 
SZAZ, ALS 4 UMN DS g < 
(t) Gs) = 1- us — ania T — Hase * — Ns 6< 
160.571 3 _ 2.016891 „2 _ 1,860,123, _ 1,139,955 - 
458,348 458,348 114,587 114,587 SN 
Fila — s PLI + BBE ca 
TAGS — LOLUPT — ONIS A -192 
x g " 
amr x + Tee + ee TS 
TEE E o BRE 6 « 
Em + raad + mS xc ny 5s 
PX UT M 4 
4.9006263x — 1.221831x? 0 
—2.680108 + 12.94095x — 8.040325x? + 1.458276x? 1 
10.59727 — 6.975118x + 1.917709x? — 0.2013959x? 2 
7. (a) 4.068263 — 0.44610975x — 0.2586266x? + 0.04041917x? 3 


11. 


irski z= 


9.67138 — 4.648450x + 0.7919584x? — 0.04712958x° E 
4.980575 — 1.833965x + 0.2290615x? — 0.009603116x? 5 


6.953093 — 2.820224x + 0.3934379x? — 0.01873514x> — 6 
(b) f; [G" (x)P dx = 34.06104636 < 124.9987319 = fo Lf" GT dx 
(a)r —0.1, 1,10. (b) if c = 0.1: z6 = 0, zs = —0.8300317786, z4 = 2.758098187, z3 = —4.008889185, z2 = 2.544798588, zı = 0; 


IA TA IA IA 


I^ 


I^ IA |^ IA 


I^ 


Answers to Selected Exercises A-141 


+—t >x 


! P. 
-15-10 34 5 10 IN 


0.8300317786, z4 = 2.758098187, z3 = —4.008889185, z2 = 2.544798588, zı = 0; if t = 10: 


zg = 0, zs = —13.13717471, z4 = 21.80901408, z3 = —49.91184844, z2 = 44.90981995, zı = 0 


(c) 


“ 


t=0:1 


A-142 


Answers to Selected Exercises 


176,477,517 .3  1,595,081,549 .2 _ 6,413,003,493 | _ 30,375.236,378 19-x«-—9 
373,114,280” 93,278,570 “ 33,919,480 “ 46,639,285 242 
176,477,517 .3 _ 1,595,081,549 .2 _ 6,413,003,493 ..—— 30,375,236.378 9<x<-8 
373,114,280“ 93,278,570 ~ 33,919,480 * 46,639,285 >42 
307,694,681 .3 , 5,389,155,407 ..2 į 9,532,293,951 15,381,128,982 ; 
208) x3 4 [2 7 «t am e 
13. (a) 213,208, 160" 186,557,140 * + 53,302,040 ^ + ~ 46,639,285 82r <6 
76,035,599 ..3 , 803,215,943 2 , 2,232,920,301 , _ 105,100,161 62221 
746,228,560 746,228,560 T 186,557,140 " 26,651,020 =4 2> 
76,035,599 3 , 803,215,943 „2 4 2,232,920,301 . _ 105,100,161 1=*x=17 
746,228,560" 746,228,560” 186,557,140 “ 26,651,020 —24— 
5 3854 10,797,2 __ 3599,3 "TT. 
23 209 t+ 209 t 209 t Ixtz2 
105,663 147,430 5895,2 | 9008,3 
30 + 29 ! — i19! t 20! 23123 
403,800 _ 362,033 104,976,2 _ 519,3 
16. G,(t) = 209 209 l x ! — ^! 2244 
636,968 , 418,543 90,168 ,2 ,. 6401 43 
29 + x | 209 Tow! 4205 
406,782 __ 207,707 35,082 ,2 _ 1949 43 ; 
200 — x» |t 2! mt SSx <6 
2133 5265,2 | 175543 9 
47 209 t 209 us 209 t 1stx2 
50,591 _ 63,285 2301,2 _ 3341 3 
209 209 | t iot 209 ! 2x13 
172,483 , 159,789 49,047,2 , 259,3 
= < 
Gy(t) 200 ^! 209 t 209 t 11 d sie 
559,741 _ 389,379 88,245 ,2 _ 6520,3 
2 4 *5 A-cf« 
209 209 | + 39 ! 209 ! LR 
653,384 , 338,496 57,330,2 , 3185,3 : 
< 
209 T x»! x9! + appt 32x56 


Exercises 40.5, Page 1036 

2. R(u) = [1 + 12u — 6u? + u?, 3 + 3u — 21u? + 23u7]'; R'(0) = [12, 3]7, P; — P, = [4, 1]7; R'(1) = [3, 30]7, Py — P; = [1, 10]? 
(a) R(u) = [-16 + 72u — 631? + 251,2 — 33u + 54u? — 43u3]" (b) R'(0) = [72, —33]7, P; — P; = [24, — 11]? 
(c) R'(1à) = [21, 54], P, — P = [7, -18]" (d) Qiu) = [—16 + 24u, 2 — 11u]?*; Q, (u) = [8 + 3u, —9 + 7u]?; 
Q3(u) — [11 + 7u, —2 — 18u]'; Q4(u) = [—16 + 48u — 2142, 2 — 22u + 18u7]"; Qs(u) = [8 + 6u + Au?, —9 + 14u — 25u°]"; 
Q«(u) = [716 + 72u — 63u? + 25u3, 2 — 33u + 54u? — 43u7]? (e) Po 


w 


8. (a) R(u) = [-2 + 6u + 2u?, —18 + 8u + 22u2]" (b) R'(0) = [6, 8], P, — Po = [3,4]? (© R'(I) = [10, 52]", P; — P, = [5, 26]! 
(d) Qi (u) = [—2 + 3u, —18 + 4u]T; Qo (u) = [1 + 5u, —14 + 26u]"; Q; (u) = [—2 + 6u + 2u?, —18 + 8u + 22u?]" 


Answers to Selected Exercises A-143 


13. (a) R(u) = [—18 + 40u — 54u? + 924? — 40u*, 20 — 140u + 354u? — 320i? + 79u*]! (b) R'(0) = [40, —140]T, P, — Po = [10, —35]* 
(c) R'(1) = [48, —76]", P — P = [12, -19]T (d) Qı (u) = [—18 + 10u, 20 — 35u]*; Qo (u) = [—8 + u, —15 + 24u]; 
Q3(u) = [77 + 15u, 9 + 3u]T; Q4 (u) = [8 + 12u, 12 — 19u]*; Qs(u) = [—18 + 20u — 9u?, 20 — 70u + 590]? ; 
Q«(u) = [—8 + 2u + 14u?, —15 + 48u — 21u7]"; Q4 (u) = [—7 + 30u — 312,9 + 6u — 224] ; 
Qs(u) = [—18 + 30u — 27u? + 2312, 20 — 105u + 177u? — 80u7]"; Qo (u) = [—8 + 3u + 42u? — 17u3, —15 + 72u — 63u? — i]; 
Qio(u) = [—18 + 40u — 54u? + 921? — 40u*, 20 — 140u + 354u? — 320i? + 79u^]T (e) P, 
Pi 
18. (a) R(u) = [Bau + (—6a + 3c? + (5 + 3a — 3c)u?, 3ub + (—6b + 3d)u’ + (3b — 3d)u3}" 
(b) Ri (u) = [2u — Hu? + 94’, —2u + Hug ~ 54u3]"; pi - (2, 3); po = (2, 3) 
(c) Ro(u) = [13u — 24u? + 16i), Bu + H2y? = 128 id p= (2, 4 x £); po = (3, 16) (d) R3(u) = [Su, 125 y } e ^i E 
p= (3, —); po = (2, 25) © l There are infinitely many control points, 
sl which make the Bezier curve go through 
one fixed set of four points. 
CHAPTER 41 


Exercises 41.1, Page 1042 


- 


12. 


(c) None 


(a) || fll; = 45/630 — 300arctan3 (b) 


j=j jj 
2 «1 0 1 2 3 


d) Ifllo= $5 (e dod ( x = +3 


ON 


+—_+—4 —+—+—++—> « 
-3 -2 -02- 1 2 3 
-0.44 
0.6 4 
-0.8 -lLFlL. 


(c) There are no real solutions to this equation. 


(a) f — gll = V27; lf — gll = V2 (b) 


A-144 Answers to Selected Exercises 


-Ilf£ - ell. 

i (a) y= 3 Gesu" Jt = $20 (b) y= 2 (c) y= 350-1 3:8, x 420 (d) y4 = 3 Soe L3 (à 
(e) || f — yı ll2 = 0.02441443924; || f — y2ll2 = 0.4352361784; || f — ysllo = 0.02441443924; || f — yallı = 0.02441443924 
(f) | 


N 
N 


EI 


32. (a) flo =1 (bIfll = (0-4-307* 
37. (a) p3(x) 21— ix? -— xí (b) a = 0.006046988; 8 = 0.3750000000 (c) 


| f(x) - P369] 


47. (a) || f llw = 0.5690943663; ||g||,, = 0.5552046117; || f — gll, = 0.7307536169 T A 


Exercises 41.2—Part A, Page 1047 


2. 1+(2+(3+4x)x)x Three multiplications and three additions. 5. 4 operations, 2 additions and 2 divisions. 


Exercises 41.2—Part B, Page 1048 


2. (a) [3/2] = Hosni (c) || f — [3/2] l]oo = 0.02329412857; —1.0, 1.0 (d) Five multiplications/divisions and two additions/subtractions 
(e) Five multiplications/divisions and two additions/subtractions (f) Two multiplications/divisions and two additions/subtractions 
(g) lf — Pslloo = 0.01996895776; xu; = —1,1 (h) ps(x) = 1. + (—1.233700551 + 0.2536695081x7)x? Four multiplications/divisions 


and two additions/subtractions (i) 


Answers to Selected Exercises A-145 


12 x p e e 7)g-7 jo- (c34322e7 (—4432)e77 aiar n 

12. (a) [e *, — lz? 1+z+z22? ETE TTE TET 1, (-1+2)e™, (71 2e7, MDC 3 124+3z+3z2—z3 ],(-1+2)e", (—1 + 
De (6+3z+z?)e 7 q (—10—6z+9z2)e -7 1, (—1 +z — 1g5e-77, 1 CHa 3:22-2:3)e77 1 (—604+302+4212?-11z3)e~™ 1 (7330412024138: 53e" ] 
5 |o 64324222? ~ 3048282122112 7 AME 22 2+2 3 20-+102+32? 3 110+70z+24z7+5z3 


1.043213919 49.25793223 1.005591855 101.3704196 
1.178974447  1.178974447 . 1.041237904  1.027542383 
1.178974447  1.178974447 . 1.014714631  1.049735658 
0.7323402113 162.7882892  0.6879756915 289.3653054 


(b) (c) || F — [3/0]|| = 0.7323402113, only [3/2] is smaller. 


18. (a) Lae = 0.8941818118 x 10-5; ||G — [4/4] loo = 0.1496470170 x 10-7 


Exercises 41.3, Page 1051 
1. ag = 1.264241118, a; = 0.2516889099, a; = 0.03123247381, b; = 0, b2 = 0 3. Ao = 1.111645383, A; = 0, A; = —0.2419335080 


5. (a) Ss(x) = 0.4720012157 — 0.499403258275(x) + 0.027992079607;(x) (b) Ss(x) = 0.9993965535 — 1.222743153x? + 0.2239366368x4 
(c) ^ (d) || f — Ss||;; = 0.00060344650000, 2-0.8649407780 (e) || f — Ds|loo = 0.01996895776 


15. (a) ss(z) = 0.1845322548 + 0.2247310296z? — 0.01685760178z^ (b) 


(©) lg — sla, = 0.1845322548 0 (d) lg — pslloo = 72.90000000 


18. (a) gs(x) = 0.2052124962 — 0.307818745x + 0.128257810x? + 0.106881508x? — 0.2004028289x^ + 0.1670023572x5 
(b) gecon (x) = 0.2052124962 — 0.3600069816x + 0.128257810x? + 0.3156344545x? — 0.2004028289x^ 
(€) Pecon (Z) = 0.1774400044 + 0.4527968310z — 0.32337000430z? + 0.07150372929z3 — 0.005130312420z^ 


(d) lg — pslloo = 0.1670023574; ||g — pello; = 0.1774400044 
0.35 
0.3 
0.25 
0.2 
0.15 
0.1 
0.05 


0 D 2 4 d § 
(e) g5(x) = 0.1941903404T5 (x) — 0.1232811407T; (x) — 0.036072509507> (x) + 0.07890861363T3 (x) — 0.02505035361 T4 (x) + 
0.01043764733Ts(x) (f) Secon (x) = 2052124963 — 0.3600069816x + 0.1282578099x? + 0.3156344545x? —0.2004028289x* 


22. (a) os(z) = 7.031306465 — 12.75203101z + 7.462293256z? — 0.9806709512z? — 0.6200657562z* + 0.18673368432> 
(b) ss(z) = 7.014207256 — 12.58327593z + 7.024632549z? — 0.530864556z? — 0.8177881387z* + 0.2176148566z? 
(c) lg — os llo = 0.03130646500; ||g — ss]; = 0.01420725600; ||g — pslls; = 0.3703703700 


24. (a) 0.05184783285 — 0.03679426501 cos(Z£) — 0.009437991726 sin( 42) + 0.01050425481 cos(zz) — 0.0009233791256 sin(zt z) + 
0.002933085745 cos( 32) + 0.006327050379 sin (222) 
(b) ss(z) = —0.8457568581 + 1.611422751z — 1.031009947z? + 0.3106980831z? — 0.04536006861z* + 0.002588433222:5 
(c) llg — Wilco = 0.02557853592; ||g — osl|;, = 0.005597557199; ||g — ss||;; = 0.002582393612; ||g — pslloo = 0.06177890469 


A-146 Answers to Selected Exercises 


Exercises 41.4, Page 1056 


5 


Un 


JA cos 0.8889310763--0.8898438804x? 
(a) Ri (x) = 0.8878978895+0.2242042210x2 


(c) xo = —1, xı = —0.8624429066, x; = —0.4933522231, x3 = 0, x4 = 0.4933522231, xs = 0.8624429066, x = 1 
(d) £1 (xo) = 0.0008207914209, &; (x1) = —0.0008931996, £1 (x2) = 0.0010632579, & (x3) = —0.001163632, e, (x4) = 
0.0010632579, e (xs) = —0.0008931996, £1 (x6) = 0.0008207914209; m, = 0.0008207914209; M, = 0.001163632 
(e) lleill = 0.001 163632454 


-) — 0.8889511526—0.8898706254x? 
(a) R(x) ~~ 0.8879247271--0.2241505446x? (b) 


(c) xo = —1, xı = —0.8620831573, x; = —0.4928180048, x3 = 0x4 = 0.4928180048, xs = 0.8620831573, x= 1 


(d) £2 (xo) = 0.0008268078565, &;(x1) = —0.0008960528, £2(x2) = 0.0010592963, £2(x3) = —0.001155982, (x4) = 
0.0010592963, £2(x5) = —0.0008960528, £2 (x6) = 0.0008268078565 m; = 0.000826878565; M; = 0.001155982 
(e) Iles], = 0.001155981884 


— 0.8890294897—0.8899739032x? 
(a) Ra(x) = Ss88031657410.2239366857 (P) 


(c) xo = —1, xı = —0.8606950817, x; = —0.4905955918, x3 = 0, x4 = 0.4905955918, xs = 0.8606950817, xg —1 


(d) £4 (xo) = 0.0008493166895, #4 (x1) = —0.0009083194, (x5) = 0.0010445736, &4(x3) = —0.001123645, £4 (x4) = 
0.0010445736, £4(xs) = —0.0009083194, £4(x6) = 0.0008493166895; m4 = 0.0008493166895; M4 = 0.001123645 
(e) |le4llao = 0.001123644964 


sy — 0.8891893732—0.8901851387x? 
(a) Rs (x) ~~ 0.88824898004-0.2235020401x? (b) 


(c) xo = —1, xı = —0.8578794742, x; = —0.4859952979, x3 = 0, x4 = 0.4859952979, x = 0.8578794742, x, = 1 
(d) £s (xo) = 0.0008956729106, &5(x,) = —0.0009336891, &5(x5) = 0.0010150641, &;(x3) = —0.001058705, &5(X4) = 
0.0010150641, &5(x5) = —0.0009336891, £s (x6) = 0.0008956729106; ms = 0.0008956729106 M; = 0.001058705 
(e) [les |loo = 0.001058704509 


7. (a) Ro(x) = 


0.8894307947 —0.8905080542x? 


0.8885695485--0.2228609030x? 


A-147 


Answers to Selected Exercises 


(c) xo = —1, xı = —0.8536389477, x; = —0.4791788838, x = 0, x4 = 0.4791788838, xs = 0.8536389477, x, = 1 
(d) &&(xo) = 0.0009692547744, &(x1) = —0.0009703348, £6(x2) = 0.0009703661, 
&g(x3) = —0.000969250, &6(x4) = 0.0009703661, &&(xs) = 


Mg = 0.0009703661 
10. (a) R(z) = 


(c) Rminimax (z) = 


(e) ||€6 loo = 0.0009703660256 


0.163228 1602+0. 16540766 15z—0.0440592347 12? --0.003473589487z? 


0.1650415865—0.02416230030z4-0.06152671580z? 


—0.0009703348, && (xg) = 0.0009692547744; mg = 0.000969250; 


lelle = 0.01183136923 


CHAPTER 42 


Exercises 42.1, Page 1065 
2. Subtract f"(c) and expand the resulting expression in a Taylor series. Alternatively the formula can be tested with f(x) = | a,x" 
9, (a) f'(—2) © 0.6004235992; f”(—2) ~ —0.9060761451; f’”(—2) ~ 0.9985027767; f” (—0.9590377328 

(b) gı (x) = —0.2325441580x? — 0.3297530328x + 0.2706705664; 
g2(x) = 0.0734979716x? — 0.0120502432x? — 0.1827570896x + 0.2706705664; 


g3(x) = 


0.2084131490—0.2114891686z--0.05745879244z? —0.004641841626z> . "- 
0.2091127136—0.0104223354z+0.055634 1122922 5 ll€minimax lloo = 0-003345394873 


—0.01548652632x* + 0.04252491898x? + 0.00343628304x? — 0.1517840371bx + 0.2706705664; 


g4(x) = 0.00244733791x? — 0.01548652632x* + 0.03028822945x? + 0.003436283018x? — 0.1419946853x + 0.2706705664 (c) Yes, 
(42.2a) through (42.2d) are the first, second, third and fourth derivatives of the appropriate interpolation polynomials. 


(d) 


L 


f(c)-—8g(c f"O-sec  f"()-—85(c  f"(c)— g (c) 
h? h? h? h? 
0.3995764009 — —1.093923855 2.001497225 —3.040962271 
0.6192724870 | —1.927934003 3.945743792 —6.618644814 


0.7828654971 
0.8836465857 
0.9397189012 
0.9693121134 
0.9845164668 
0.9922229850 
0.9961026361 
0.9980490984 
0.9990239936 
0.9995118578 
0.9997558941 
0.9998779384 
0.9999389670 
0.9999694830 


—2.633069064 
—3.099604621 
—3.369173271 
—3.514236469 
—3.589505324 
—3.627846182 
—3.647196059 
—3.656916220 
—3.661787651 
—3.664226210 
—3.665446201 
—3.666056374 
—3.666361506 
—3.666514082 


5.787603182 
7.089250786 
7.86847 1642 
8.295560698 
8.519243497 
8.633722298 
8.691634351 
8.720760232 
8.735365849 
8.742679354 
8.746338784 
8.748169 169 
8.749084529 
8.749542250 


—10.38232335 
—13.21378594 
—14.96758026 
—15.94607067 
—16.46321583 
—16.72910245 
—16.86391841 
—16.93180019 
—16.96586024 
—16.98292014 
—16.99145758 
—16.99572816 
—16.99786382 
—16.99893234 
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19. 


29. 


47. 


(a) ds A: —0.1092591180; f"(—2) ~ 0.0241004865; f” — 2) © 0.2551495139; f" (—2) ~ 0.371676632 

(b) gı (x) = 0.0120502432x? — 0.061058145x — 0.4409878299 g(x) = 0.0120502432x? — 0.061058145x — 0.4409878299; 

g3(x) = E 8403387008x + 0.623389862x? + 0.1664171294x? + 0.01548652632x*; 

g4(x) = 0.8403387008x + 0.623389862x? + 0.1664171294x? + 0.01548652632x " (c) Yes, (42.3a) through (42.3d) are the first, second, 
third and fourth derivatives of the appropriate interpolation polynomials. 


f'(c) — gic) f" (c) — g5(c) f"(c)—g1(c | f"(c)— gi" (c) 
h? h? h? h? 

0  —0.02607616520 —0.02410048667 —0.1198142306 —0.1010060642 
(d) 1  —0.02341015829  —0.02293433862  —0.1058148872  —0.09279946308 

2 —0.02276786702  —0.02265002086 | —0.1025639855  —0.09086028949 

3  —0.02260877867  —0.02257938608  —0.1017661144 —0.09038226688 

4  —0.02256909892  —0.02256175508  —0.1015675644 —0.09026318046 

5 —0.02255918475  —0.02255734906  —0.1015179841 —0.09023343499 
(a) gí (c) — sk Luce uer h). : g! (c) = 2f(c)— Dou f(c+3h), T4 '(c) = 1U— e eo m 14 f (c+ Sh) +3 f (c4) . 
aj (c) = 3f (c) 14 f (c +h) +26 f(c42h)— feb el Fej 2 f(c+5h) (b) ([-31, 2. 11 (3. - E E I; {-3 il 2-4 3,-3.4); 
[i mue mar cad 


. (a) €; = —0.2513391738 (b) & = —0.3635833218 (c) £, = 0.1132631118 (d) &, = —0.0371483540 (e) £s = —0.2379679108 


(E) £6 = —0.1265706096x (8) ui]. = (-0.4630312868, 1.066769489, —0.872359964, 01763632267, 0.09225853610); 
Yi o wi f (xj) = 0.1358443804 = g/(4.6) 


For this problem with € = 1.488732157, [(n + D)c" "o Llo TEZO = f(e) — p'(c) = 0.369289462. 


(n+1)! 


Exercises 42.2, Page 1070 


2. 


(a) Ag. = 0.99999999999497311142; error: 0.502688858 x 107!! (b) Aga = —1.9999999999954249424; error: 0.45750576 x 107"! 
(c) As s = 2.9999999999958641500; error: 0.41358500 x 107!! (d) As = —4.0000000000134955357; error: 0.134955357 x 107? 


12. (a) Ag; = 0.99999999999999 179883: error: 0.820117 x 107^ (b) As s = 2.0000000000008615161; error: 0.8615161 x 107? 
(c) As.5 = 3.0000000000000161233; error: 0.161233 x 10-8 (d) A45 = 4.0000000000005467459; error: 0.5467459 x 107? 
22. (a) and (b) f, (1) © 3.12156685; error: 0.010455744 
Yo prox |] 
k hy Weppeet s A f | 
hj? 
0 10 0.02033267021 
1 | 0.5000000000 0.01691523117 
2  0.2500000000 0.01546367638 
: . . . 3  0.1250000000 0.01479357243 
+ 21 f(C)+32F (310-12 f (c+ 38) fee) , 3 
27. (a) f'(g) = — eee FOR) «| 4 006250000000 0.01447149068 
5 0.03125000000 0.01431358104 
6  0.01562500000 0.01423539553 
7 0.007812500000 0.01419649345 
8 0.003906250000 0.01417708987 
9 0.001953125000 0.01416739993 
10 0.0009765625000 — 0.01416255790 | 
CHAPTER 43 


Exercises 43.1—Part A, Page 1078 

A = 0.3740172474; actual error: 0.0856804467; error bound: < .1 

A = 0.4581643459; actual error: 0.0015333482; error bound: < 0.003333333333 

à = 0.45969967 14; actual error: 0.19773 x 1075; error bound: < .8888888889 x 10? 


2. 
3i 
S, 


Exercises 43.1—Part B, Page 1078 
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3. Using fi: (a)n =46 (b) A —0.9595723180 (c)error:0.0010105135  (d)n = 15 
5. Using fi: (a)n — 10. (b) A = 0.9595723180  (c)error:0.0009965107. (d)n = 6 
L(h) — À 
k h |L(h) | 
h IT (h) — A| 
0 L0 0.09839854970 k h EN n 
1 0.5000000000 ^ 0.05911647467 
0 1.0 0.08155368220 
^) o 
2 02500000000 003817446092 1 0.5000000000 0.08454321434 
" . ,.|3 0.1250000000 — 0.02753411242 
6. Using fi: (a) (b)|2  0.2500000000 . 0.08531837368 
4 0.06250000000 . 0.02219255306 
3 0.1250000000  0.08551395940 
5 0.03125000000 — 0.01951909339 
i 4  0.06250000000 0.08556296904 
6 0.01562500000 — 0.01818202834 
5 0.03125000000 0.08557522854 
7 0.007812500000 0.01751345391 € DISHES DiRSTRDUES 
8 0.003906250000 0.01717916145 i i ds 
9 0.001953125000 0.01701201457 
k h H i |S(h)—al 
1 k h TEC 
0 1.0 0.03928207503 
1 0.5000000000 . 0.04188402750 L ee  10.01534417140 
2 0.2500000000 0.01653673264 
(c) |2 0.2500000000 — 0.04256139399 | (a) 
i 3 0.1250000000 0.01668998098 
3 0.1250000000 — 0.04273247488 
: 4  0.06250000000  0.01672862265 
4 .0.06250000000  0.04277535477 2 
5 0.03125000000 0.01673830383 
5 0.03125000000 0.04278608161 Pone ud. 2155959 
6 0.01562500000 0.04278876375 ia i S 


7. (a) f^ file) dx © 2415499275. (b) f}? fiG) dx © 2476105335. (c) f1" fiG) dx © 2.482211868 (d) f}? fi (x) dx © 2.478140846 
(e) f^ fio) dx © 2476105336. (£) f}? fiG) dx © 247814082. (g) f^ file) dx © 2477979391. (h) f, f(x) dx © 2478139643 
(i) In this case, integration of the interpolation polynomial gives the best result. 

12. (a) [74 e73 cosxdx = —0.3998575930 (b) f; ^ e73 cosxdx © —0.9327099885 (c) f ^ e-3 cosxdx ~ —0.8317929509 
(d) f, ^ e73 cosxdx œ% 4470812497. (e) f/ ^ e-3 cosxdx © —0.8317929515. (f) f] ^ e73 cosxdx © —1.723499224 
(g) f, ^ e-3 cosxdx © —0.6948618837 (h) f, e75 cosxdx © —0.3695444806 (i) f. e75 cosxdx © —0.001805570816 
(G) f^ e-3 cosxdx e —0.2758313418 (Kk) f, e-3 cosxdx © —0.4397406968 (I) f, e-3 cosxdx © —0.4311833903 (m) Using the 
quartic spline gives the best result. 


S se . 
22. (b) On [0, 5], 0 < f(x) < .367879441; /9)*9"* —5 162178832 > f(E), VE € [0, 5] 


Ip gx) dx 


Exercises 43.2—Part A, Page 1083 
T [1] = 0.4207354924 


1 


4. T [i] — 0.4500805155; Richardson extrapolation yields: 0.4598621900 5. 


Exercises 43.2—Part B, Page 1084 


2. (a) 0.9084218054 (b) Jerror| ~% 0.2 x 107° 


Exercises 43.3, Page 1092 


Un 


. Using fi: 
Using fi: 


(a) A2 = 0.5387787308 
(a) A4 = 0.5366106099 


(c) 33 function evaluations 


(b) |A? — A| < 0.008175098693 
(b) |A4 — A| x 0.2674983948 x 10-8 


S [4] = 0.4598621899 


(d) 71 function evaluations (e) 47 function evaluations. 


(c) | A» — A| = 0.0021681219 


(c) |A4 — A] = 0.10 x 1075 


6. co = 0.1713244915, c, = 0.3607615743, c; = 0.4679139382, c3 = 0.4679139336, c4 = 0.3607615737, cs = 0.1713244923; 
o = —0.9324695142, £y = —0.6612093865, & = —0.2386191861, & = 0.2386191861, & = 0.6612093865, &; = 0.9324695142 


n An |^; T A| 

2 2.478073693 . 0.000066311 . 
2 5 Sio = 2.478132120, — A| = 0.78 -5 
12. (a) | 3 » 478138895 0.1109 x 10-5 | (D Sto 478132120, |$jg — A| = 0.7884 x 10 

4 2.478140069 0.65 x 1077 
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17. (a) co = 57, c1 = 30, & = 342, & = 342 (b) co = 4r, ci = im & —-1/2, 5 = 142 


21. (a) po =1,pr=x—- S, p — + P2-Bx (x =? -VT x = 2+ 8/0 © 
Lo = —i5 V 10x + {V70 + 3, Li = d V70x — 1/704 1 (d) co = —£V70 + $, ci = 4/704 $ 


160 


23. (a) Aapprox = 281.2092536 (b) |Aapprox — A| = 16.4604382 


Exercises 43.4, Page 1097 
2. (a) Aapprox = —13.65046005 (b) 225 function evaluations (c) |S224 — A| = 0.312 x 10 (d) 301 function evaluations 
(e) 257 function evaluations. 
12. (a) Aapprox = 1.157142517; 17 function evaluations (b) Aapprox = 1.151738342; 269 function evaluations. 


Exercises 43.5, Page 1100 
2. Aapprox = 5.149952789; |Aapprox — A| = 0.23 x 1077 


CHAPTER 44 


Exercises 44.1, Page 1104 
2. (a) (-9a +b = — $2, 3a +b = —8,2a +b = $,4a +b = 4, 10a +b = 24 17a +b = 95); The first two equations imply 


, E 


a=-l1,b= —18) these values do not satisfy the third equation 
(b) S(a, b) = "59 — a + 42ab + 499a? + 6b? — p E gs d (c) and (d) (23, 22€) 
0.5 
x) 1 
1020 <a NOD NI 
1018 Oy 
1016 
18 
198g 
(e) y (f) Smin = SSL ~ 1016.360235 
Exercises 44.2, Page 1109 
3. (8) Spin = 12805260055 2: 0,1002248873 x 107; g(x) = HUI _ S7890 4 173922.145 y2 
me r 
-20-15-10 -5 0 5 10 15 
1 —19 361 
1 —17 289 
1 —14 196 
1 —12 144 » 
(b) A = | —9 gl > y = [1684, 1343, 2110, 659, 850, 951, 1169, 1425]T; rank([A, y]) = 4 
1 9 8i 
1 10 100 
1 17 289 
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8 —35 1541 
(0 M = | —35 1541. —10,331 |; b = [10,191, —55,451, 2,179,113]; cond(M) = 2457.82.18 2; 231.624.8779, using the infinity 
1541 —10,331 — 379,637 


T 
norm: ü — | 13,197,719,788 82,776,901 173,922,145 (d) [ 3:262,461,218 52,230,793,187  44,019,248,093  19,707.247,711  33,811,782,503 
yu 17,006,139." 68,024,556 ° 68,024,556 ya = 5,668,713 ’ 34,012,278 ’ 34,012,278 ^" 17,006,139 ’ 34,012,278 ° 


95,19 5 2,32 59 T T 
16.533,393.197 34.677.662.21 $2] (ed: = [1 1, 1, 1,1, 1, 1, 1]7, 6; = [-19, —17, —14, —12, —9, 9, 10, 17]", 


©; = [361, 289, 196, 144, 81, 81, 100,289] (f) || Aa — yll = AOR RECO — 


17,006, 139 min 
53,257,289,786,210,631,643 r 8. 
10. (a) Smin = 52:252.289.786.210.631.643 4, 02945607137 x 108; 
(x) — 275,292,997,297,315 2b 319,009, 937,263,933 |. TS 9,830,956,137,955 x? 1. 1,865,959,211,801 ..3 y 
gu = 452,006,049,309 1,808,024,197,236 " 3,616,048,394,472 ~ T 1,205,349,464,824 " j 


1 -9 81 -729 
1 —-5 25 -125 


1 6 36 216 
1 7 49 343 
(b)A=]1 10 100 1000]|:y =[—1972, —156, 1786, 723, 8742, 2932, 11143, 13267, 18294]"; rank([A, y]) = 5 
1 11 121 1331 
1 17 289 4913 
1 18 324 5832 
|1 20 400 8000 
9 75 1425 20,781 
(c) M = 73 1425 20,781 384,021 |. V = (54,759, 948,094, 16,001,498, 293,206,048]"; 


1425 20,781 384,021 6,732,885 
20,781 384,021 6,732,885 125,632,725 


cond(M) — DUO cum o x~ 0.1295986480 x 10°, using the infinity norm; 


T 
ü 275,292.997,297,315  319,009,937,263,933 9,830,956,137,955 — 1,865,959,211,801 (d) y, = [ 3,412,190, 120,703,353  —720,858,097,618,655 — 949,189,901,969,893 
2 452,006,049,309 °’ 1,808,024,197,236 * 3,616,048,394,472 ° 1,205,349,464,824 JA 77 1,808,024,197,236 ^"  1,808,024,197,236 ^  452,006,049,309 


4,535,135,989,888,303 — 1,895,439,496.606,960 — 8.930.441,711,799,497 — 5,424.025.123,994,522 — 6,189.844.234, 780,978 7.959.768.125.917,730]T . Aü — y 
1,808,024,197,236 " 452,006,049,300 >  1,808,024,197,236 ^" 452,006,049,309 ° 452,006,049,309  " 452,006,049, 309 ? TJA 


(e) 6; = [1, 1, 1, 1, 1, 1, 1, 1, 1]T, 6; = [—9, —5, 6,7, 10, 11, 17, 18, 20]T, 
©; = [81, 25, 36, 49, 100, 121, 289, 324, 400]T, , = [—729, —125, 216, 343, 1000, 1331, 4913, 5832, 8000]" 


^ 2 __ 53,257,289,786,210,631,643 
(f) |Aà — yl = 1,808,024, 197,236 75 P niti 


22. (a) Smin = 0.02372863; g(x) = 2.462761245 — 3.181049767e- + 6.685919601e-?* — 3.467315656e 7" 


y 


b e ù 


i2 


N N N NDN 


A-152 


(b) A= 


je. gm» a l 


rank([A,y] =5 (©) M = 
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0.9417645336 
0.8187307531 
0.5827482524 
0.5488116361 
0.5272924240 
0.4965853038 
0.4771139155 
0.4676664270 
0.4231620823 
0.3906278354 


0.8869204367 
0.6703200460 
0.3395955256 
0.3011942119 
0.2780373005 
0.2465969639 
0.2276376884 
0.2187118870 
0.1790661479 
0.1525901058 
10 

5.674503163 

3.500670315 

2.362616088 


0.8352702114 


0.5488116361 
0.1978986991 
0.1652988882 
0.1466069621 
0.1224564283 
0.1086091088 
0.1022842067 


sy = [2.5, 2.44, 2.15, 2.21, 2.1, 2.21, 2.09, 2.0, 2.04, 2.05]7; 


0.07577400402 


0.05960594271 


5.674503163 
3.500670314 
2.362616088 
1.735116933 


3.500670315 
2.362616088 
1.735116934 
1.366407964 


2.362616088 
1.735116933 |. 
1.366407964 |’ 
1.133399899 


b = [21.79, 12.61920309, 7.968800415, 5.504904595]"; cond( M) = 0.1333848190 x 10’, using the infinity norm. In contrast with 
problems 3 and 10, where were able to use exact arithmetic, this problem requires floating point computation. Therefore the large value of 
cond(M) really does have an impact. Just look at the difference between the values of Aü and y4, computed in (d); 


û = [2.462762777, —3.181057471, 6.685931975, —3.467321974]T 


(d) y4 — [2.497456311, 2.434357891, 2.191201035, 2.155523924, 


2.134049930, 2.105362444, 2.088591386, 2.080926456, 2.049496667, 2.032140652]"; Au = [2.500694620, 2.437140782, 2.193341170, 


2.157580967, 2.136020209, 2.107231047, 2.090423343, 2.082729517, 2.051151089, 2.033687255]" 


(e) 6; = [1, 1, 1, 1, 1, 1, 1, 1, 1, H]T, 


e, = [0.9417645336, 0.8187307531, 0.5827482524, 0.5488116361, 0.5272924240, 0.4965853038, 0.4771139155, 0.4676664270, 


0.4231620823, 0.3906278354]", o, 


[0.8869204367, 0.6703200460, 0.3395955256, 0.3011942119, 0.2780373005, 0.2465969639, 


0.2276376884, 0.2187118870, 0.1790661479, 0.1525901058]", 4 = [0.8352702114, 0.5488116361, 0.1978986991, 0.1652988882, 


0.1466069621, 0.1224564283, 0.1086091088, 0.1022842067, 0.07577400402, 0.05960594271]7 
. (a) Smin = 2.5730682; g(x) = 


(b) A= 


0.945537065 | 
0.9174311927 
0.8963786303 
0.8378016086 
0.8127438231 
0.6711409396 
0.6217358866 
0.4708984743 
0.4179903026 


rank([A, y] =5 


(©) M = 


5.135125981 
1.408779685 
0.6464200448 
0.4082193012 


x24] 


0.1166407465 
0.1435406699 
0.1607109094 
0.2005835 157 
0.2152080344 
0.2811244980 
0.2990338905 
0.3393520297 
0.3478363401 


1.408779685 

0.5511873996 
0.3324707433 
0.2497173577 


§.828037253 _ 25002059814. 


0.01883830455 
0.02912621359 
0.03710360765 
0.06062124248 
0.07132243685 
0.1404011461 
0.1686065846 
0.2724803570 
0.3170020945 


0.6464200448 
0.3324707433 
0.2342182558 
0.1917231420 


(f) || Aa — yll} = 0.02372858747 
— 8.90058699 3 7 


3 


+ 35.234583104 


x*43 


0.003406940063 
0.006601466993 
0.009550004860 
0.0203 1285769 
0.02614220877 
0.07639198218 
0.1029754362 
0.2324568663 
0.3046940138 


iy = [4.07, 2.86, 4.41, 3.01, 2.07, 1.44, 1.79, 2.78, 2.31]T; 


0.4082193012 
0.2497173577 |. 
0.1917231420 |" 
0.1645567286 


b= [18.98338693, 5.330216808, 2.647460832, 1.834521782] ; cond(M) — 200905.7330, using the infinity norm; 

à = [6.828037253, —25.00205981, 35.23458310, —8.90058699]T 

(d) y4 = [4.173330465, 3.642932023, 3.324734710, 2.660721060, 2.449155880, 

1.820972392, 1.793072047, 2.262645038, 2.615037475]'; A = [4.173339426, 3.642935009, 3.324732409, 2.660707387, 2.449136278, 


1.820926192, 1.793013468, 2.262541804, 2.614909444]T 


(e) b, = [0.9455370651, 0.9174311927, 0.8963786303, 0.8378016086, 


0.8127438231, 0.6711409396, 0.6217358866, 0.4708984743, 0.4179903026]", à; = [0.1166407465, 0.1435406699, 0.1607109094, 


0.2005835157, 0.2152080344, 0.2811244980, 0.2990338905, 0.3393520297, 0.3478363401]", 3 = [0.01883830455, 0.02912621359, 
0.03710360765, 0.06062124248, 0.07132243685, 0.1404011461, 0.1686065846, 0.2724803570, 0.3170020945]T,  — [0.003406940063, 
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0.006601466993, 0.009550004860, 0.02031285769, 0.02614220877, 0.07639198218, 0.1029754362, 
0.2324568663, 0.3046940138]* (f) || Aû — y|[? = 2.573068254 


(D) A= 


0.7651976866 
0.2238907791 
—0.2600519549 
—0.3971498099 
—0.1775967713 
0.3000792705 


—0.09033361118 


0.4400505857 
0.5767248078 
0.3390589585 
—0.06604332802 
—0.3275791376 
—0.004682823482 
0.2453117866 


0.1149034849 
0.3528340286 
0.4860912606 
0.3641281459 
0.04656511628 
—0.3014172201 
0.1448473415 


32. (a) Smin = 0.172225760; g(x) = —0.073033567 Jo (x) + 5.447793840J, (x) — 6.476566945 Jo (x) + 4.710220186J3 (x) 


0.01956335398 
0.1289432495 
0.3090627223 
0.4301714739 
0.3648312306 
—0.1675555880 
—0.1809351903 


—0.5 4 


y = [1.609, 1.675, —0.01184, —0.7530, —0.1353, 1.041, —0.3137]7; rank([A, y]) = 5 
0.9907579145 0.4385170863 . —0.2159056973  —0.3061041245 

in M - 0.4385170863 0.8130866132 0.4165073282  —0.00375783635 |. 

—0.2159056973 0.4165073282 0.6205700857 0.3958982602 |’ 

—0.3061041245 — —0.00375783635 0.3958982602 0.4914905947 
b = [2.273101973, 1.682263945, 0.1304186934, —0.2471487063]'; cond(M) = 279.4615013, using the infinity norm; 
û = [—0.073033580, 5.447793865, —6.476566979, 4.710220205]' (d) y4 = [1.689387371, 1.447724181, 0.1736666953, 
—0.6628831287, —0.3547597547, 1.115498175, —0.4473526675]'; Aû = [1.689387344, 1.447724205, 0.173666711, 
—0.662883123, —0.354759749, 1.115498179, —0.4473526651]T (e), = [0.7651976866, 0.2238907791, —0.2600519549, 
—0.3971498099, —0.1775967713, 0.3000792705, —0.09033361118]", $z = [0.4400505857, 0.5767248078, 0.3390589585, 
—0.06604332802, —0.3275791376, —0.004682823482, 0.2453117866]7, &3; = [0.1149034849, 0.3528340286, 
0.4860912606, 0.3641281459, 0.04656511628, —0.3014172201, 0.1448473415]", 4 = [0.01956335398, 0.1289432495, 0.3090627223, 
0.4301714739, 0.3648312306, —0.1675555880, —0.1809351903]" (f) || Aû — yl = 0.1722257984 


. (a) Smin = 89.1933927; g(x) = 3.951066318 sin x + 2.363710979 sin(2x) + 5.391879107 sin(3x) + 1.344585539 sin(4x) + 


0.887191007 sin(5x) y 


-10 


[ 0.94630009  —0.61185789 | —0.55068554 0.96791967 —0.075151120 

0.041580662 —0.083089403 0.12445442  —0.16560418 0.20646748 
—0.81827711 0.94073056 | —0.26323179 | —0.63810668 0.99682979 
—0.37387666 | —0.69352508 | —0.91258245 . —0.99927599 | —0.94103141 

0.11654920 0.23150983 0.34331493 0.45044059 0.55142668 |. 

DA= 0.31154136 0.59207351 0.81367374 0.95428509 0.99991186 |' 
0.98816823 0.30311836 | —0.89518737 . —0.57771504 0.71797459 
0.98935825  —0.28790332 . —0.90557836 0.55142668 0.74511316 
0.41211849 = —0.75098725 0.95637593 —0.99177885 0.85090352 
0.024775425 —0.049535641 0.074265446 —0.098949658 0.12357312 


y = (0.1312, 0.1328, —2.971, —4.614, 1.721, 16.38, 0.1390, —0.5887, 4.255, 0.3169]"; rank([A, y) = 6 
3.942977404  —1.177534432 . —1.050399923 . 1.718105340 . 1.649796653 
—1.177534432 2.892577480 0.5405709092 0.5993967282  1.696857465 


(c) M = | —1.050399923 0.5405709092 4.542374131 . 0.5193230329  1.171847635 |; 
1.718105340 0.5993967282 0.5193230329  5.114825038 . 0.5398750749 
1.649796653 1.696857465 1.171847635 . 0.5398750749  5.041369638 
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b = [10.90580910, 7.410770360, 23.35741273, 18.36156787, 22.04636341]T; cond( M) = 34.9841491, using the infinity norm; 

à = [3.951066318, 2.363710979, 5.391879106, 1.344585539, 0.887191007]T (d) y4 = [0.5581867085, 0.5994389393, 
—2.402376578, —10.21552524, 3.953705244, 9.187872436, —0.3457463422, —0.2517712027, 4.431236504, 0.3578183993]'; 

Ati = [0.5581867138, 0.5994389406, —2.402376571, —10.21552525, 3.953705246, 9.187872427, —0.3457463434, 

—0.2517711984, 4.431236503, 0.3578183997]" (e) &; = [0.9463000877, 0.04158066243, —0.8182771111, —0.3738766648, 
0.1165492049, 0.3115413635, 0.9881682339, 0.9893582466, 0.4121184852, 0.02477542545]T, ə = [—0.6118578909, —0.08308940282, 
0.9407305567, —0.6935250848, 0.2315098251, 0.5920735147, 0.3031183567, —0.2879033167, —0.7509872468, —0.04953564088]', 
d, = [—0.5506855426, 0.1244544235, —0.2632317914, —0.9125824498, 0.3433149288, 0.8136737375, —0.8951873678, 
—0.9055783620, 0.9563759284, 0.07426544558]', ^, = [0.9679196720, —0.1656041754, —0.6381066823, 

—0.9992759921, 0.4504405943, 0.9542850945, —0.5777150444, 0.5514266812, —0.9917788534, —0.09894965755]', 

®; = [—0.07515112046, 0.2064674819, 0.9968297943, —0.9410314083, 0.55142668 12, 

0.9999118601, 0.7179745928, 0.7451131605, 0.8509035245, 0.1235731227]! (f) || Aà — yl = 89.19339271 


Exercises 44.3, Page 1116 


2. 


21. 


24 35 22 4,951. 671,032 _ Q3 | 15.825.263 .2 869,741,981 |. _ 986.586.476 
(a) po = 1, pi =x + 3, P2 — X yr xo^ P3 =X + Gira 3.779.142 ^ — 1.589,57] 
(b) g(x) = 14:142.303.900.329,972 | 261,992,150,985.283 . |  177.399.787,474,817 2 126,533,962,426 3 
Ex) = "7967906496287 F 71,871,625,985,148 ^ T 71,871,625,985, 148 ` 5.089,302.165,429" 
8 0 0 0 
11,103 

g -— 0 0 | uu ND 

(c) M — 0 0 272.098.224 0 ; cond( M) — 0.1584831204 x 10', using the infinity norm 
3701 
7.985,736.220.572 

s m 0 EN 

(f) y (h) S; = 85,062.68468, S; = 56,5664.0009, 
A 
* al S3 = 571,322.9385; R(gi1) = 0.05425217560, 

1800 + R(g2) = 0.3607751486, R(g3) = 0.3643843655 

1600 + 

1400+ 

\ 
Hej t——379 x 
-15-10-5 0 5 10 15 


. (a) po = 1.0, p; = x — 8.333333333, p; = x? — 11.13250000x — 65.56250000, p; = x? — 18.48637531x? — 57.75792690x + 1099.325481, 


pa = xf — 21.34518066x> — 35.81046951x? + 1608.455004x — 1116.778547 
(b) g(x) = 581.6316264 + 215.9267605x + 1.839598938x? + 1.024067238x? + 0.02454875791x* 


9.0 0 0 0 0 
0 800.0 0 0 0 
(c) M=] 0 0 59,249.95500 0 0 ; cond( M) = 0.1832604284 x 10?, using the infinity 
0 0 0 0.1830911970 x 107 0 
0 0 0 0 0.1649343855 x 10? 
norm (f) y (h) S; = 0.3022959366 x 10°, S2 = 0.3604791371 x 10°, S3 = 0.3648669270 x 10°, 


S4 = 0.3649663232 x 10°; R(g1) = 0.7666201009, 
R(g2) = 0.9141722366, R(g3) = 0.9252996370, R(g4) = 0.9255517050 


15000 


10000 


5000 


(a) po = 1.0, pı = x — 0.6040000000, p; = x? — 0.9702624309x + 0.1517185083, 

pa = x? — 1.589641494x? + 0.6883591996x — 0.05512226276, 

pa = x* — 2.0081191553? + 1.311416846x? — 0.3022674903x + 0.01666919189, 

ps = x? — 2.556531784x* + 2.344763204:x? — 0.9134782460x? + 0.1356751963x — 0.005397054824 

(b) g(x) = 2.301619111 + 5.311776274x — 38.83721438x? + 98.14035582x? — 106.3529509x* + 41.695930725? 

(c) M has diagonal elements (10.0, 0.6950400000, 0.04470465616, 0.001885276149, 0.0001280697219, 0.2092321138 x 1075}; 
cond(M) = 0.4779381051 x 10’, using the infinity norm 
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(f) v (g) R(gi) = 0.8861933609, R(g2) = 0.9022653965, 
" $ R(g3) = 0.9077519696, R(g4) = 0.9077817541, 
a R(gs) = 0.9219860725; R(goia) = 0.9073432895 
2.3 
2.1 
2 mH x 


+—+—++- 
0.2 04 06 08 


. (a) po = 1.0, p; = x — 0.6133333333, p; = x? — 1.407411936x + 0.3852570985, 


p3 = x? — 2.106253424x* + 1.307180183x — 0.2314309868, 

p,-x*- 2.762682995x? + 2.638222075x? — 1.016929320x + 0.1320523070, 

ps = x5 — 3.583171673x^ + 4.833531596x° — 3.031088660x? + 0.8730455673x — 0.009181385490 

(b) g(x) = —5.692171218 + 93.20215800x — 3 12.3638260x? + 430.5308689x? — 257.5917505x* + 54.63279391x? (c) M has diagonal 
elements (9, 0.9160000000, 0.05645744689, 0.002911236122, 0.0002079804423, 0.8588300459 x 10-5); cond(M) = 0.1047937254 x 107, 
using the infinity norm (f) v (g) R(g1) = 0.2895069893, R(g2) = 0.6583444336, 

e R(g3) = 0.6653860815, R(g4) = 0.7663958207, 


R(gs) = 0.7696520847; R (goia) = 0.6715832973 


04 06 08 1 


. (a) po = 1.0, pı = x — 4.428571430, p; = x? — 10.01197605x + 17.91017963, 


ps = x? — 14.80916745x? + 60.30495793x — 60.96538818, p4 = x^ — 19.76605258x? + 129.5103099x? — 317.8199146x + 226.9400310, 
ps = x? — 23.90130856x* + 207.7928358x? — 802.2101368x? + 1332.843380x — 727.8098744 (b) 

g(x) = —6.435828256 + 15.18133567x — 9.126773495x? + 2.214854773x? — 0.2342331094x^ + 0.008991397070x° (c) M has diagonal 
elements (7, 47.71428571, 268.8502995, 1 129.706281 3903.317261, 5551.241286); cond(M) = 793.0344697, using the infinity norm. 

(g) R(gi) = 0.2367150694, R(g2) = 0.4235393459, 


R(g3) = 0.6700351677, R(g4) = 0.9223170669, R(gs) = 0.9999720954; R(goia) = 0.9932521452 


36. (a) po = 1.0, p; = x — 6.210000000, p; = x? — 11.42161294x + 26.72721638, 


3 _ 17.33819336x2 + 89.62276748x — 129.0626011, py = x* — 22.47877239x? + 174.9675033x? — 546.5605068x + 562.3309402, 


P3 = xX 
ps = x? — 28.72129394x* + 31 1.7525247x? — 1577.435588x? + 3657.053809x — 3053.584691 (b) 
g(x) = —162.9698314 + 203.4798526x — 91.513471 18x? + 18.70200738x? — 1.763562908x^ + 0.06233076738x° (c) M has diagonal 
elements {10, 56.36900000, 263.8824790, 998.4303302, 3533.644039, 7542.548394}; cond(M) = 754.2548394, using the infinity norm 
(f) » (g) R(g;) = 0.03865213281, R(g2) = 0.05103911563, 

° R(g3) = 0.1081762111, R(g4) = 0. 1166088092, 


R(gs) = 0.2150160939; R(goia) = 0.7908463466 


5T e. 
0 X 
6 7 8 9 
-54- . 


Exercises 44.4, Page 1122 


4. 


(a) g1(x) = In(1 + J/7.285076709 + 2.074543406x?) (b) Solve the equation y = In(1 + va + bx?) for a + bx? 
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(c) 22 (x) = In(1 + 4/8.046937627 + 2.007839527x2) (d) (e) S(g1) = 0.07887460831; 


S(g5) = 0.08155110762 


5. g(x) = Vx 4-4.537731834 + vx + 2.3466715573 » 


<1 te 
L 


115 2.25 3 35 4 45 


6. g(x) = Vx + 10.17009985 + 2./x + 3.617206074; Be careful, the sum of squares has more than one stationary point. Choose the one which 


results in the smallest residual y 
9.8 . 
94 $ 
9 $ 
8.6 
82 
78 
t—+-—}—+—+— 9 — x 
1 15 2 25 3 3.5 4 45 
7. g1(x) = 3.074104719e 1540386228. o^ (^) = 2 24968976] e 1.680446565s y S(g1) = 0.1765379204; 
S(g2) = 0.7070043153 
10. m) eR BoC) = GRADES. g(x) = deme, S(g1) = 0.001861354984; 
S(g2) = 0.001867671997; 
S(g3) = 0.001956725462 
CHAPTER 45 
Exercises 45.1, Page 1130 
k Àk Vk 


50 0.8001055731 — [1.000000000, —2.001649366, 1.000000001] 

3. Scaling the first component yields: | 100 0.8000000120 — [0.9999999998, —2.000000188, 1.000000001] |; with errors: 
150 0.8000000002  [1.000000000, —2.000000009, 1.000000004] 
200  0.8000000002  [1.000000000, —2.000000009, 1.000000004] 


Bi 
- 
7 


17. 


20. 


[ k 

50 
100 
150 
| 200 
[k 

50 
100 
150 
200 


E;, 


0.0001055731 


0.120 x 1077 
0.2 x 107? 
0.2 x 107? 


Àk 
0.7999736327 
0.7999999972 
0.8000000000 
0.8000000000 
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Ey, 
0.001649366000 
0.1880027659 x 107 
0.9848857802 x 107° 
0.9848857802 x 10-5 


; Ey, represents the 2-norm of the difference of the approximation and the exact 


eigenvector, both normalized so that the first component of each equals one; Scaling the component with largest magnitude yields: 


Vk 
[0.9999999998, —2.001649361, 1.000000002]" 
[1.000000000, — 2.000000182, 1.000000003] 
[1.000000000, — 2.000000002, 1.000000002]T 
[1.000000000, | — 2.000000002, 1.000000002]T 


; For reason of comparison, the printed vectors have again been 


k Ey, Ey, 
50 0.0000263673 0.001649361000 
re-scaled, making their first component equal to one. Errors are given by: | 100 0.28 x 108  0.1820247236 x 1079 |; The second 
150 0 0.2828427125 x 1075 
200 0 0.2828427125 x 10-8 


method appears to be slightly faster than the first. 
4. = 0.6666666667, v = [1.000000000, 0.5000000014, 1.000000003]" 


. à = 0.7500000000, v = [1.000000000, —1.062500000, —0.1718750002]"; using a shift of £. 
9. (a) {A} = {10.95902794, —11.84940473 + 5.995958806i, —11.84940473 — 5.995958806i, 3.739781511} (b) 


(c) The information provided by Gerschgorin’s disk theorem is very crude. 


10 
20 
L30 


k 
10 
20 
30 


Hk 


0.9087174453 
0.8090500620 
0.8015897745 
0.8003089803 


Hk 


11.33267659 
11.99998561 
12.00000000 


Àk 
—6.999588128 
—6.999999914 
—7.000000002 


[L1 — àil k [Mazi — Ail 
Heel AL m I krl 7 Hl 
[pu — àil [uk — Ail 
0.8332664404 25 0.8152690588  1.026822996 


- 
Un 


0.9274811362 50  0.8039290728  0.9361583523 
0.9355800601 75  0.8007644761 0.9370536445 
0.9371175278 100 0.8001513799  0.9374047532 
Iti — Ml 

[i — àil 


0.3634487291 
0.3402782776 
0.3402777778 


Hint: Eigenvectors of symmetric matrices, associated with distinct eigenvalues, are orthogonal. 
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«a-] 


Iw 


13 
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4. u= 15, A y =[-5, 0]" 


Exercises 45.2—Part B, Page 1138 


3 6 2 
7 7 13 
LEz| $$ -4 $jbhye-ILL1" 
2 3 6 
A 7 7 
3. u = [4,./1954/78 + 3042, — L V 104/78 + 156 + x5 /1954/78 + 3042, 2/10/78 + 156 — 24 /195./78 + 3042)" 
~ [0.8849120051, —0.1279536300, 0.4478377046]'; y = [—4/78, 0, 0]T 
—iv114 -2/114 —2V/114 x V114 
4 / / 25 50 / 8C / 32 20 / | 24 
5, Hs -5vV1l4 3 + 3073 114 5075 114 — ij ioi V 114 + is -y, = [- 114, 0, 0, O]"; 
g 2H 2 y 3 /114 32 2 ( 7 2 p317 U, U, " 
757 114 v 114 89 gl ev 114+ 35 
gvil4 —GVIM-$ -ovlt Staay 
1 = Py 2 1 0 0 0 
H T m EM ve 5, —/89, 0, 0]7; H: E Pr 5. 8, —5, 0]? 
Tjo -8V9 B+ VD -agv hob vM )0 0 -g BPE BOO 
9 2 > 3 4 
0 vO -J/548 B+ BD AN 
—-i451 -v51 z 5l 1 0 0 
9 0H -|-$/51 VSI4+4 —5VST+4] ©) Ix =V5T= ly =lel (I =|9 -2 $2 
£451 -aviri di 0 3v2 342 
94 15 90 37 — 15  — 45 
i T 131 131 131 262 262 131 
12. (a) u = [5 /262, zz v 262, Bi y/362] (b) H = a n c () P = "d I = 
90 6 95 45 3 113 
m 131 131 e 131 131 131 
(d) y 2 |$, 22, 239] ; Ix] = v51 = Ilyl (e) M = [ =$, -23, =)" = Px = Py; Observe that y is the reflection of x in the plane V, 


through the origin and perpendicular to u. Hence x + y is in this plane and = 
T T - —V—— š 
(f)x - Px — E ; 3i à TET ] y= Py = [ 3 1 m , ET ] ; Observe that x — Px and y — Py are the vectors pointing from the tips of x 


and y to the plane V mentioned in (e). These two vectors are parallel and have the same length, but obviously point in opposite directions. 


is exactly the projection of x (and of y) on that plane. 


cadi E m tu fel? a tg 
16. exe [VB -AVB -AVA v [L-hi! euo mE Sagem ma BD 
Ben B+ BV B-mg 

() Hx = [1, -2, 2] =y 


T 
24 p2 
a—A/ ab b 
2 2112 2112 " 
2a? —2a A/ a? +b?+2b2 V 2a? —2a4/ a? --b2 2p? 


" (ou=|- 
V 
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1 14 TA 
3 15 15 
T 14 23 4 |. [ 13 494 ET. 
27. (a) H — 15 75 75 | 15' 75? 75 
2 14 73 
15 75 75 


Exercises 45.3, Page 1141 


2 t 5 -2 
5 " NM b — 
Z2 Lr Ki 


—0.8581163303 —0.1906925178 — 04767312946 1.0 0 0 
(a) Hı = | —0.1906925178  0.9804298387 — 0.04892540334 |; Hı = | O — —0.9984499371 — 0.05565719242 
0.4767312946 ^ 0.04892540334 0.8776864917 0  0.05565719242  0.9984499371 
—0.8581163303  0.2169304578  0.4653789209 10.48808848 ^ 4.195235392  —0.9534625893 
b) Q = | —0.1906925178 —0.9761870602 0.1034175381 |; R = 0 —1.843908892  —7.050239880 
0.4767312946 0 0.8790490730 0 0 —0.6205052271 
—9 =f -V110 -8v85 -2 374 110 24110 -1v110 
QR = | —2 i 7|=A (04-2 | -ÀZVl10 $85 cum r=] 0 — 1485 v85 
dil. z V110 0 374 0 0 i374 
1 0 0 
(D-|0 -1 0 
0 0 -l 


Exercises 45.4, Page 1150 


1 2. $ 4 2 3 9 1 18 8 31 14 
- 2 | 4 2 8 1 3 1 12. 11 39 11 
s No. C = h = H = 
1 o. A counter example is given by A 02 15" B 01 4 1" AB 16 3 15 13 
0 0 1 2 0.0 1 2 0 1| 6 5 
2. Let G = Gj; denote an n x n Givens rotation matrix. Let A = GG". Then observe that A,, = 37; 4 Ga GL, = Ara Gune i 4 y 
j ù 
-Vio 0 -v10 1 0 0 
3 @)Ga=| o 1 0 Lme-I/10,—,07;G5—|0 —5v2 —1v2|.u = [-3, 542,0] 
4v0 0 -V10 0 4⁄2 -4v2 
-iJ -1/58 0 
G5 = Z 58 -2 V58 o | ,u; = [V58, 0, —1 
0 0 l 
1.0 0 0 0 0 
0 —0.08908708064 —0.7126966451 —0.5345224838 —0.4454354032 
6. Using C2: (a) H; = | 0 —0.712696645 1 0.5336125853  —0.3497905610 —0.2914921342 |; 
0 —0.5345224838 —0.3497905610 0.7376570792 —0.2186191006 
0 —0.4454354032 . —0.2914921342  —0.2186191006 0.8178174161 
10 0 0 0 0 10 0 0 0 0 
0 1.0 0 0 0 0 10 0 0 0 
H;—|0 0  —0.6540042187 0.3430595809 —0.6742318636 |; H= | 0 0 10 0 0 : 
0 0 0.3430595809 0.9288454801 0.1398434768 0 0 0 —0.5430676521 —0.8396889456 
0 0  —0.6742318636 0.1398434768 0.7251587386 0 0 0  —0.8396889456 0.5430676521 


—0.08908708064 
—0.7126966451 
—0.5345224838 
—0.4454354032 
—8.0 
—11.22497216 
0 
0 
0 


(b) B= 


{Ala = { 


Us ={ 


Using C»: 


1 
0 
0 
0 
0 


(a) Ga = 


0 

0 
0.6736496122 
0.7390508777 

0 


Ga = 


oo oro 


13. a 
(b) R= 0 
0 
0 
p Ala = 


6.398425560 
20.22700124 


0 
0.5830602952 


—0.2724506003 


0.6292247946 


—0.4357608520 

—13.89758458 
2.047619048 

15.89766737 


0 
0 


0 

0 
—0.7390508777 
0.6736496122 

0 


Answers to Selected Exercises 


—0.8143450711 
—0.58038 10002 


0 


0 


0 


0 
—20. TN —6.541861236, —6.182865448, 4.915959720, 10.72966312]; 


0 


0.3667397166 
0.6198342985 
—0.4418555928 
—0.5348561096 
3.768143904 
3.303726311 


—11.07725841 
— 6.521095408 


0 


—1.716270822 
0.9386230100 
0.687631232 

—4.869458047 

—4.260727016 

—20.92089615, —6.541861236, —6.182865448, 4.915959720, 10.72966312}: 

—20.92089615, —6.541861193, —6.182865490, 4.915959720, 10.72966312) 

—0.5803810002. 
0.8143450711 


0 
0 
0 
l 
0 
1 
0 
0 
0 


0 


oOoococ—cccocoo 


0 


0.7194485142 
—0.1834110270 
—0.3508924439 

0.5706388731 


m 
| 


—4.877332366 0.2317279545 
—9.418037056 
80.823608230 

0 


1.741385160 
4.340806276 


4.923020672 


0 


oococo rf 


—0.5009606455 
0.8654700642 
—5.759402151 
—1.471710248 
1.369330974 
—2.371980719 
—3.685357569 


0 


—0.6182739864 
—0.7859626438 


0 
0 


4.439892886 
3.908 137705 
—0.812570859 |; 
—2.360178650 

3.899097410 


0 
0.7859626438 0 
—0.6182739864 0 
0 1 0 

0 0 1 


0 0 


0 


0 
—0.8654700642 
—0.5009606455 


he — $3. goce 4.923020672, 8.823608230, 13.78404875, 20.22700124], obvious from (b) 


—13.21052632 
—16.47175876 
0 
0 
0 


—8.4 
—0.1 


(d) B, — 6.9 


—0.6256510008 
0.7801030862 
0 
0 
0 


—0.78 
—0.62 
Gy 


0 

0 
0.9392085973 
0.3433470691 

0 


, 
Giz 


OOOO = 
N 
CT"oococr-o0 


0 
0 
0 
0 


(f) R = 0 
0 


0 


(g) {A}r, = { 


11484885  5.416374620 
9.520862024 


71533651 
44079941 
35026452 
0 
0 


01030862 0 
56510008 0 
0 1 
0 0 
0 0 
0 
0 
—0.3433470691 
0.9392085973 
0 


0 


0 
0 
1 
0 


—5.580421098 
—0.088038509 
10.59674910 
0 

0 
—6.005020624, 3.489107942, 9.520862024, 10.59674910, 21.11484885], obvious from 


—2.116886441 

8.851206129 
—6.883109791 
—3.638362749 


0 


0 
0 
0 
0 
1 
0 
0 
0 |; Gy, = 
0 
1 


;Gy = 


5.975698450 
—4.885853847 
—0.630230321 
0.391496946 
3.189566652 
{A}e, = (—20.92089616, —6.541861167, —6.182865514, 4.915959723, 10.72966311] 


coor 


0 


1 


0 
0 
0 
0 


oor oO 


0 


—0.685 1487174 
—0.7284032090 


1 


0 


0.072767949 
—5.747382267 
—5.009267707 

3.489107942 
0 


(e) 
0 


0 
0 
0 
0 
0 
—0.4053769815 
—0.9141496062 
—9.610415414 
3.052750692 
3.909151580 
—0.643306112 
—6.005020624 


0.7284032090 
—0.6851487174 


1.172974436 
11.37867923 
—1.644611220 |; 
4.058506095 
1.846219107 


0 


0 
0 


oro oS © 
re OOOO 


0 

0 

0 
0.9141496062 
—0.4053769815 


Answers to Selected Exercises A-161 


—17.43585687 —13.02859631 . —5.384371677 | —8.018834123 5.624397677 

— 7.427253848 4.017123083 6.105137465 4.366585851 2.316268777 

(f) (h) By = 0 7.718706049 —5.099064865 6.491277307 4.994972848 
0 0 —1.197974986 —1.916498469 —2.734886931 

0 0 0 —5.489487239 2.434297 134 


[4] a, = {—20.92089615, —6.541861127, —6.182865540, 4.915959719, 10.72966311} (i) M will be an upper triangular matrix with the 


eigenvalues of A on the main diagonal. 


1.0 0 0 0 0 
0  —0.3746343246 0.4682929058 | —0.7492686493 —0.2809757435 
8. (a) Hi =} 0 0.4682929058 0.8404679400 0.2552512961 0.09571923603 
O  —0.7492686493  0.2552512961 0.5915979263  —0.1531507776 
0  —0.2809757435  0.09571923603  —0.1531507776 0.9425684584 
10 0 0 0 0 10 0 0 0 0 
0 10 0 0 0 0 10 0 0 0 
H;-|0 0 | —0.4676446104  —0.8154837466 0.3410202008 |; H; = | 0 0 10 0 0 
0 0 | —0.8154837466 0.5468836691 — 0.1894848583 0 : : —0.7356352068  —0.6773779171 
0 —0.6773779171 0.7356352068 


0 0 0.3410202008 0.1894848583 — 0.9207609414 


H=| 0 0.4682929058 | —0.5685513926 0.1015533400 0.6686837726 
0  —0.7492686493  —0.6540328952  —0.1029066819  —0.01573778747 


1.0 0 0 0 
0 | —0.3746343246 0.2962033473 0.7847706376 0. "— 
0 | —0.2809757435 0.4015642701 —0.6026874649 0.6297353320 
0 
0 


8.0 —10.67707825 0 0 
—10.67707825 — 0.2105263160 2.479649396 0 
(b B= 0 2.479649394  —3.525513546  —7.760053051 0 $ 
0 0 —7.76005305 1 0.345112123 0.771445314 
0 0 0 0.771445312  —8.030124898 
{A}4 = {—10.52836325, —8.037873696, —6.501073893, 6.462053498, 15.60525734}; 


{A}p = {—10.52836325, —8.037873698, —6.501073893, 6.462053497, 15.60525734} 


Exercises 45.5, Page 1157 


1. (a) We use A; and By: (c) u; = —0.471245006, zı = [—0.1394175539, —0.8954685321, 0.1615431331]', 


H2 = —1.819611306, z2 = [0.799311581, 0.05866334473, 0.4884726533]', 
La = 3.766266140, z3 = [—0.2408878726, 1.064822681, 0.9643300772]'; Az, — u Bz, = 0, k = 1, 2,3 


(d) det(A — AB) = 394 + 948) + 1804? — 12243, which has zeros: {A} = (—1.819611301, —0.4712450048, 3.766266142} 


—0.3761152742 0.06407780528 0.1008416593 —1.819611302 0 0 
2. (a) S = | —0.02760397830 — 0.4115669599 — —0.4457612780 |: A = 0 —0.4712450048 0 
—0.2298503236 | —0.07424695950 —0.4036925725 0 0 3.766266146 
—1.819611301 0 0 0.9999999992 0 0 
(b) STAS = 0 —0.4712450045 0 ;STBS = 0 0.9999999995 0 
0 0 3.766266145 0 0 1.000000001 


(c) AX; — A, Bx, =0,k = 1,2,3 (d) (uj = (—0.471245006, —1.819611306, 3.766266140} (e) Hint: Normalize the first components and 


compare, or alternatively, normalize the vectors using the vector norm of your choice. 


—0.04861051851 0.8303081063 — —0.5551805708 0.6842058843 0 
3. (a) K = | —0.8410626694  —0.3338386183  —0.4256352451 |; P = 0 0.4255115464 
—0.5387491101 0.4462513033 0.7145692211 0 0 


0 
0 
0.3109724613 


0.7586308638 —1.632411766 —0.02680883078 |; {A} = (—1.819611304, —0.471245006, 3.766266154}; 


| 2.574328238 0.7586308644 —1.869330044 
M => 


—1.869330045 —0.02680883118 0.5334933679 


[—0.2416399736 —0.4520101111 —0.8586599923 0.3761152745 0.06407780548 


W = | 0.9533167718  —0.2757279505  —0.1231309468 |; T = | 0.02760397864 0.4115669596 
| —0.1811001266 —0.8483283308 0.4975357152 0.2298503242 . —0.0742469599 


—0.1008416591 
0.4457612779 
0.4036925732 


A-162 Answers to Selected Exercises 


—1.819611304 0 0 1.000000002 0 0 
(b) T'AT = 0 —0.4712450048 0 ; TTBT = 0 0.9999999996 0 
0 0 3.766266151 0 0 1.000000002 
(€) Ay, — 44By, = 6, k = 1,2,3 
0.08823529412 —— 0.7647058824 —0.8007487068 0 
RS, UR AR Us Ie 176471 —0.1 eed = | 0 T E 


p= —0.6522414459  0.7457784602 
~ | 0.7582421209  0.6661940321 


(b) R(r) = [0.5000000000c; e9:94942657 + 0.5000000001.c, e~ 8948456325" +. 0,5587555907(., 208918156329r _ 55875559077. 9089484563291. 
c3 c0s(0.87825790191) + 1.138617709c, sin(0.87825790191)]"; x(t) = [2.004650001 £9 5945456329 _ 9.59757539959-08948456320 _ 
0.4073746010 cos(0.87825790191) — 0.3738327662 sin(0.87825790191), —2.330440786e° 894845532" +. 0,694343 1278e70:89484563291 _ 
0.3639023417 cos(0.87825790191) — 0.3339398644 sin(0.87825790191)]". 
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absolute convergence 
integrals, 145 
absolute integrability, 705 
acceleration vector, 434 
accurate to k decimal places, 944 


accurate to k significant figures, 945 


action, 1210 
Adams-Moulton methods, 68 


Adams-Bashforth methods, 65, 66, 68 


testing the order, 67 
adaptive methods, 74 
adaptive procedure, 53 
adjoint operator, 553 
Aitkin's acceleration formula, 951 
alternating direction scheme 
heat equation 


finite-difference solution, 600 


amplification factor, 599 
amplitude spectrum, 227 

Fourier transform, 687 
analytic 

real functions, 213 
analytic continuation, 874 
analyticity 

complex functions, 857 
angle of incidence, 1208 
angle of refraction, 1209 


angular frequency, 98, 103, 318, 321, 359 


annihilating Givens rotation, 1145 


arbitrary constant of integration, 11 


arc length, 422 
as parameter, 423 
function, 422 
arc length function, 422 
Archimedes Principle, 103 
Argand diagram, 822 
asymptotic expansion, 254, 255 
linear combination, 257 
to N terms, 255 
asymptotic expansions, 351 


Index 


asymptotic sequence, 254 boundary condition 
asymptotic series, 255 Neuman condition 
composition, 259 Laplace's equation in cylinder, 653 
division, 258 boundary conditions 
multiplication, 258 heat equation 
termwise differentiation, 260 homogeneous Neumann conditions, 594 
termwise integration, 260 Neumann, 574 
asymptotic solutions ODE 
differential equation, 351 mixed, 373 
asymptotically stable, 329 periodic, 373 
attractor, 326 separated, 373 
autonomous system, 328, 331 periodic, 398 
linearization, 334 unmixed, 399 
Avogadro's number, 4 boundary value problem, 11, 370 
ODE 
B-spline finite difference method, 377 
of degree one, 391 least-squares, 380 
Bachman-Landau order symbols regular, 373 
big Oh, 253 shooting method, 376 
little oh, 253 singular, 373 
back substitution, 283, 784 box product, 279 
backward Euler method, 63 Brachistochrone, 1163 
banded matrix, 621 Bromwich integral formula, 893 
basis, 724 buoyant force, 103 
functions 
orthonormal, 399 calculus of variations 
orthonormal, 725 Brachistochrone, 1163 
Bernoulli equation, 48 constrained optimization 
Bernoulli separation constant, 561 differential constraints, 1205 
steady-state temperature in sphere, 661 Lagrange multipliers, 1197 
Bessel functions direct methods 
first kind, 403 Euler’s finite-difference scheme, 1167 
second kind, 403 Rayleigh-Ritz technique, 1168 
Bessel’s equation, 403 Euler-Lagrange equation 
Bezier curve, 1033 as necessary condition, 1180 
control points, 1033 first integrals, 1173 
bilinear concomitant, 400 higher derivatives, 1191 
binormal vector, 432 several dependent variables, 1192 
bisection algorithm, 958 several independent variables, 1193 
block diagram, 901 extremal curve, 1163 
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functional, 1163 
fundamental lemma, 1180 
indirect methods 
Euler-Lagrange equation, 1170 
isoperimetric problem, 1198 
isoperimetric problems 
endpoint above axis, 1201 
for a given curve, 1202 
hanging chain, 1203 
no auxiliary boundary, 1202 
minimal surface, 1165 
minimal surface with transversal, 1204 
Queen Dido's problem 
fixed endpoints, 1199 
free endpoint, 1200 
simply supported beam, 1165 
stationarity, 1163 
stationary value, 1163 
transversal, 1182 
transversality condition 
derivation, 1188 
transversality conditions, 1182 
vertical transversal, 1183 
variation, 1178 
varied extremal, 1178 
carriers, 7 
carrying capacity, 26 
Cauchy integral formulas, 868 
Cauchy principle value, 698, 885 
Cauchy-Riemann equations, 854 
center, 325 
characteristic equation, 85, 111, 153, 302 
characteristic polynomial, 731 
characteristic roots, 85, 96, 111, 115, 153, 
302 
characteristics, 560, 569 
Chebyshev economization, 1050 
Chebyshev interpolation, 1023 
Chebyshev polynomials, 1023, 1048 
Chebyshev—Padé approximation, 1052 
Cholesky decomposition, 785 
circle of convergence, 871 
circular drumhead, 655 
circulation, 478, 479, 500, 921 
classical solution, 10, 14, 387 
Clenshaw-Lord algorithm, 1056 
closed line integral, 465 
closed surface, 493, 494 
closed-loop property, 509 
cofactor, 278 
collocation, 384 
collocation methods 
BVP, 382 
collocation technique, 383 


column space, 775 
compact support, 386 
competing species, 332 
complete set, 399 
complex 
analytic continuation, 874 
analytic function, 857 
annulus, 875 
antiderivative, 861, 867 
bilinear transformation, 911 
Bromwich integral formula, 893 


evaluation by Cauchy residue theorem, 


894 

Casorati- Weierstrass theorem, 875 
Cauchy integral formulas, 868, 873 
Cauchy residue theorem, 878 
Cauchy-Gourset theorem 

generalized, 865 
Cauchy-Goursat theorem, 864 
conformal map, 909 
contour, 862 
contour integral, 862 

indented contour, 888 
contour integration, 861 
differentiation, 852 
Dirichlet problem 

conformal mapping, 916 
entire function, 858 
essential singularity, 875 
flow (with circulation) past cylinder, 933 
flow against a parabola, 929 
flow around a parabola, 929 
flow down step, 934 
flow into closed channel, 930 
flow over Joukowski airfoil, 935 
flow past cylinder, 931 
flow past line segment, 934 
flow past wedge, 930 
flow through slit, 931 
Fourier transform 

inversion by contour integration, 897 
harmonic conjugate, 859 
harmonic function, 859 
holomorphic function, 858 
hyperbolic functions, 844 
indented contour, 888 
inverse hyperbolic functions, 850 
inverse trigonometric functions, 847 
isolated singularity, 865 
Joukowski airfoil, 913 
Joukowski map, 913 
Laurent series, 874 
linear fractional transformation, 911 
Liouville's theorem, 858 


meromorphic function, 886 
Moebius transformation, 911 
Nyquist stability criterion, 907 
Picard's little theorem, 875 
Poisson integral formula, 884 
pole of order N, 875 
power series, 871 
principal part, 875 
principle of the argument, 905 
extended, 905 
residue, 875, 877 
residue calculus, 875 
simple pole, 875 
trigonometric functions, 842 
winding number, 903 
complex conjugate, 718, 823 
complex exponentiation, 838 
laws governing, 839 
complex exponents, 833 
complex function 
conformal plot, 826 
imaginary part, 826 
magnitude surface, 826 
real part, 826 
complex logarithm, 835 
laws governing, 835 
principle value, 835 
complex number 
argument, 822 
conjugate, 823 
magnitude, 822 
polar form, 822 
complex numbers, 821 
addition and subtraction, 822 
division, 823 
multiplication, 823 
rectangular form, 822 
complex potential, 922 
complex velocity, 922 
components, 713 
components of a vector, 725 
compound plane pendulum, 1215 
compression wave, 573, 576 
concentrated load, 165 
condition number, 982 
conditionally stable, 57, 72 
conformal map, 909 
conformal plot, 826, 833 
conjugate 
complex, 718 
conjunct, 400 
conservation law, 3 
conservative, 921 
conservative field, 479, 506, 508—510 


conservative force, 457 
constrained optimization, 452 
continued fraction, 1045 
contour, 16 
contour integral, 862 
contour integration, 861 
contours, 39 
contrapositive, 90 
contravariant law, 739, 747 
convergence 
mean, 196, 197, 241 
pointwise, 197 
sequence of numbers, 173 
uniform, 197 
converse, 91 
conversion 
ODE to system, 306 
system to ODE, 306 
convolution product 
Laplace transform, 157 
convolution theorem 
Laplace transform, 158, 160 
coordinate curves 
polar coordinates, 736 
coordinate surfaces, 747 
coupled systems, 314 
covariant derivative, 476 
covariant law, 748 
Cramer's rule, 280, 286, 287, 302, 755 
critical damping, 96, 99 
critical point, 763 
critical value, 763 
critically damped, 121 
critically damped motion, 79 
cross-product, 427, 720 
Crout decomposition, 784, 788 
cubic B-spline, 388 
cubic spline, 388 
curl, 478 
in cylindrical coordinates, 535 
in spherical coordinates, 536 
integral equivalent, 515, 516, 518 
current density, 551 
curvature, 426 
space curve, 426 
curve 
arc length, 422 
curvature, 426 
normal vector, 429 
piecewise smooth, 862 
principal normal, 429 
radius-vector representation, 419 
rectifiable, 498 
space, 419 
space curve 
principal normal vector, 430 
tangent vector, 419 


D' Alembert's solution 
finite string, 569 
infinite string 

derivation, 692 
wave equation 
infinite string, 690 

damped motion, 79 

damping force, 78 

deficient case, 311 

deficient matrix, 311 

del operator, 444 

deleted neighborhood, 865 

DeMoivre's laws, 830, 834 

determinant, 278, 755 
cofactor, 278 
Laplace expansion, 278 
minor, 278 
of a product, 280 

diagonal matrix, 296, 314, 791 

diagonalizable, 764 

diagonalization, 319 

dielectric sphere, 664 

difference equation, 73 

differential, 3, 34 

differential equation, 8 
Bernoulli, 48 
homogeneous, 43 
linear 

first-order, 42, 45 
nonhomogeneous, 43 
regular point, 343 
singular point, 249 
stiff, 57 

differential equations 
asymptotic solutions, 351 
BVP 

collocation, 383, 384 

Galerkin technique, 383 

least-squares, 380 
exact, 39 

condition for exactness, 40 
homogeneous coefficients, 37, 38 

linear, 81 
first-order, 322 
homogeneous, 81 

nonlinear, 81 

power series solutions, 345 

regular singular point 
solution at, 346 

second-order, 81 

separable, 34 

series solution, 345 

stiff, 57, 63 

Taylor series solution, 345 


dimension, 724 
Dirac delta function, 163 
sifting property, 164 
directed line segment, 712 
direction, 712 
length, 712 
direction cosines, 713 
direction field, 15 
directional derivative, 443 
first generalization, 475 
second generalization, 475 
Dirichlet boundary condition 
heat equation, 586 
Dirichlet conditions, 559 
Dirichlet problem 
for rectangle, 604, 607, 614 
finite-difference solution, 618 
in sphere, 659 
nonhomogeneous Dirichlet condition 
heat equation, 625 
on first octant 


solution by Fourier sine transform, 700 


on infinite horizontal strip, 697 
discontinuity 
jump. 223 
removable, 223 
discriminant, 96 
distribution, 163 
divergence, 473, 474 
in cylindrical coordinates, 535 
in polar coordinates, 529 
in spherical coordinates, 536 
integral equivalent, 514, 515, 517 
divergence theorem, 497, 498 
divergent series, 176, 250 
computing with, 251 
divided differences, 1019 
domain, 857 
dominant eigenvalue, 1125 
Doolittle decomposition, 783, 788 
dot product, 716 
doublet, 926 
doubling time, 25 
driven motion, 82 
driving frequency, 118 
driving term, 82, 115, 153, 168 


eigenfunction, 396—398 
2d wave equation, 635 
eigenfunctions 
orthogonality, 401 
wave equation 
struck string, 566 
weighted orthogonality, 401, 405 
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eigenpair 
for matrix, 396 
eigenpairs, 302 
eigensolution, 562 
2d heat equation, 643 
2d wave equation, 638 
Dirichlet problem for rectangle, 615 
heat equation 
homogeneous Neumann conditions, 595 
wave equation 
struck string, 566 
eigensolutions 
elastic rod, 575 
heat equation 
homogeneous Dirichlet conditions, 588 
Laplace's equation, 605 
Laplace's equation in cylinder, 654 
steady-state temperature in sphere, 663 
eigenvalues, 299, 301, 302 
complex, 308 
power method, 800 
power methods, 1125 
inverse, 1127 
naive, 1126 
scaled, 1126 
shifted inverse, 1128 
QR algorithm, 797 
shifted, 1148 
eigenvector 
generalized, 792 
eigenvectors, 299, 301, 302 
complex, 309 
Einstein summation convention, 725, 740, 
749 
elastic force, 78, 578 
elastic rod, 573 
elementary matrices, 786 
Energy theorem, 1229 
epidemic model, 7 
equation of continuity, 550 
equilibrium point, 325 
isolated, 328 
unstable, 330 
equilibrium solution, 26, 325 
equilibrium solutions, 5 
erf, 673 
error function, 673 
essential singularity, 875 
Euler equation, 662, 663 
Euler's differential equation, 122 
Euler's formulas, 309, 832, 896 
Euler's method, 50, 51, 56 
order, 53 
even extension, 236 


even function, 232 
even functions 
Fourier integral theorem, 704 
exact differential, 508 
exact linear convergence, 950 
existence and uniqueness 
algebraic equations, 20 
ordinary differential equations, 20 
second-order equation, 86 
exponential envelope, 97 
exponential growth, 5, 24, 35 
exponential guess, 84, 97, 100 
exponential order, 133 
extension, 235 
even extension, 236 
odd extension, 236 
periodic extension, 238 
extinguishing, 146 


feedback control system, 907 
Fick's law, 485 
field lines 
spherical dielectric, 665 
finite difference method, 377 
finite element, 386 
finite-difference solution 
BVP 
ODE, 412 
Dirichlet prolblem for rectangle, 618 
heat equation 
explicit, 597 
method of Saul’ yev, 600 
finite-element solution 
ODE, 393 
first integral, 41 
first integrals, 39 
first shifting law, 139, 140, 143 
fixed-point iteration, 956 
nonlinear systems, 1005 
fixed-precision device, 945 
fixed-step methods, 50 
flow lines, 442 
Dirichlet problem for rectangle, 608, 609, 
614 
flow of vector field, 442 
flux, 468, 485, 921 
surface, 493 
through parametrically given surface, 547 
forced motion, 82 
forcing term, 82 
formal adjoint, 400 
formally self-adjoint, 400 
differential operator, 400 
forward substitution, 784 


Fourier cosine transform, 704 
operational property, 705 
Fourier integral theorem 
equivalence of exponential forms, 677 
even functions, 704 
exponential form, 676 
odd functions, 699 
solving BVPs with, 679 
trigonometric form, 678 
Fourier series, 224 
2d, 638 
cosine series, 236 
even function, 232 
exponential form, 896 
odd function, 233 
sine series, 236 
termwise differentiation, 230 
termwise integration, 229 
trigonometric form, 896 
Fourier sine series, 606, 615, 630 
Fourier sine transform, 699, 916 
operational property, 700 
Fourier transform, 897 
amplitude spectrum, 687 
convolution, 685 
convolution theorems, 685 
exponential form, 683 
first shifting law, 684 
heat equation on infinite rod, 695 
modulation, 685 
operational properties 
differentiation, 683 
integration, 684 
multiplication, 684 
second shifting law, 685 
solution of Dirichlet problem on infinite 
strip, 697 
symmetry, 685 
Fourier- Chebyshev series, 1049 
Fourier-Bessel series, 406 
Fourier-Legendre series, 411 
Fourier-Bessel expansion 
circular drumhead, 656 
Fourier-Legendre 
approximation, 246 
Fourier-Legendre series 
steady-state temperature in sphere, 663 
Fredholm alternative, 372 
free motion, 82 
free overdamped motion, 83 
free vector, 714 
frequency, 98 
frequency domain, 131, 135 
Frobenius norm, 769, 770 
functional iteration, 956 


fundamental matrix, 294, 322 

inverse, 297 

matrix exponential, 296 
fundamental set, 85, 101, 111 
fundamental solution, 166 
fundamental strip 

for principle logarithm, 835 


Galerkin technique, 383 
gamma function, 137 
Gauss elimination, 282 
Gauss' theorem 
in 2d, 543 
in 3d, 542 
Gauss-Jordan reduction, 283 
Gauss-Seidel iteration 
nonlinear systems, 1005 
Gauss-Seidel method, 996 
Gaussian elimination, 283, 755, 786, 974 
general solution, 11, 85, 101, 102, 111, 
301, 309 
linear algebraic equations, 287 
generalized coordinates, 1228 
generalized eigenvalue problem, 1151 
simultaneous diagonalization 
preservation of symmetry, 1154 
generalized eigenvector, 792 
generalized momenta, 1229 
generalized solution, 163 
geometric series, 176 
Gerschgorin disk theorem, 1128 
Gibbs phenomenon, 225, 626 
Givens rotation, 1144 
Givens rotations, 1142 
global error, 53, 59 
gradient, 485 
in cylindrical coordinates, 535 
in polar coordinates, 528 
in spherical coordinates, 536 
integral equivalent, 514, 516, 518 
gradient field, 604 
steady-state temperatures in sphere, 661 
gradient vector, 444, 447, 747 
gradient vectors, 744 
Gram-Schmidt process, 733, 760 
Green's formula, 400, 553 
Green's function, 125, 167 
Green's functions, 373 
Green's identities, 552 
Green's theorem, 498, 501 
divergence form, 502, 503 
proof, 504 
Stokes' form, 502, 503 
growth-rate constant, 5 


half-life, 25 
Hamilton's canonical equations, 1229 
Hamilton's principle, 1210 
Hamiltonian, 1229 
harmonic conjugate, 859, 922 
harmonic function, 510, 859 
harmonic oscillator, 4, 103 
harmonic series, 177 
harvest rate, 6 
heat equation 
2d, 640 
derivation, 591 
finite-difference solution 
explicit, 597 
homogenizing substitution, 625 
infinite rod, 694 
solution by Fourier transform, 695 
solution by Laplace transform, 672 
time-dependent Dirichlet conditions, 627 
heat sink, 30 
Heaviside function, 132, 146 
heighborhood 
deleted, 865 
Hermitian matrix, 553 
Hessian, 764 
Heun's method, 62 
higher-order equations, 100 
Hilbert matrix, 991 
holonomic constraints, 1210 
homogeneous algebraic equations, 285 
homogeneous of degree k 
function, 37 
polynomial, 37 
homogeneous solution, 45, 106, 111 
first-order linear ODE, 322 
homogenizing substitution 
Dirichlet problem 
heat equation, 625 
Hooke's law, 78, 573, 576 
Horner form, 1044 
Householder reflection matrix, 1130 


iceberg gouge, 17 
imaginary numbers, 821 
improper node, 327 
improved Euler method, 62 
impulse, 163 
incompressible, 921 
index of determination, 1115 
infinite series 
absolute convergence, 181 
alternating series, 183 
circle of convergence, 871 
conditional convergence, 182 


divergent, 250 
Fourier-Bessel, 406 
Fourier-Legendre, 411 
functions 
nth-term rule, 200 
pointwise convergence, 199 
termwise differentiation, 204 
termwise integration, 203 
Laurent series, 874 
numeric, 176 
sum, 176 
radius of convergence, 871 
ratio test, 181 
rearrangement of terms, 183 
regrouping of terms, 182 
root test, 181 
initial value problem, 11, 81 
inner product 
complex, 718 
real, 717 
integral transform, 131 
integrating factor, 43, 44 
integration by parts, 135, 157, 249, 1179 
interpolation, 772 
by Lagrange polynomials, 1016 
Chebyshev (minimax), 1023 
naive, 1015 
Newton form, 1021 
inverse Laplace transform, 139 
irregular singular point, 346 
irrotational, 921 
irrotational field, 479, 506 
isocline, 16 
isolated equilibrium point, 328 
isothermal surfaces 
steady-state temperatures in sphere, 661 
isotherms, 604 
Dirichlet problem for rectangle, 608—610 
iteration sequence 
linear divergence, 950 
iterative improvement, 989 
iterative refinement, 989 
iterative sequence 
linear convergence, 949 
quadratic convergence, 950 
superlinear convergence, 952 


Jacobi's method, 992 
Jacobian, 523 
Jacobian matrix, 334, 523, 525, 738, 744, 749 
Jordan canonical form, 791 
Joukowski airfoil, 913 
Joukowski map, 913 

jump discontinuity, 223 
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kernel, 125 

kinetic energy, 1209 

Kronecker delta, 739 

Krylov-Bogoliubov 
method of, 365 


Lagrange expansion theorem, 354 
Lagrange interpolating polynomials, 1015 
Lagrange multiplier, 453 
Lagrange multiplier method, 452 
Lagrangian, 1210 
Laplace expansion, 278 
Laplace transform, 130, 893 
partial, 670 
solution of heat equation, 672 
Laplace transforms 
partial 
of derivatives, 671 
Laplace's equation, 122, 604 
in cylinder, 651 
Laplaces equation 
on semi-infinite horizontal strip 
solution by Fourier cosine transform, 
705 
laplacian, 475, 485 
averaging property, 486 
in cylindrical coordinates, 535, 536 
in polar coordinaters, 529 
latent roots, 113, 114 
Laurent series, 346, 874 
law of cosines, 716 
law of mass action, 4 
laws of exponents 
complex exponentiation, 839 
least dominant eigenvalue, 1125 
least-squares fit, 773 
general linear model, 1104 
straight line, 1102 
least-squares method 
for ODE, 380 
least-squares solution 
minimum length, 811 
Legendre polynomials, 245, 411, 662 
Legendre transformation, 1224 
extended, 1226 
Legendre's equation, 408, 662 
recursion relation, 409 
series solution, 409 
Leibniz' rule, 1187 
level curve, 16 
level curves, 39, 604 
level sets, 447 
limit cycle, 363 
semistable, 363 
stable, 363 
unstable, 363 


Lindstedt's method, 360 
van der Pol equation, 363 
line integral, 464 
closed, 465 
flux, 468 
in the plane, 861 
work, 465 
linear, 87 
linear combination, 85, 87, 102, 287, 
309, 615 
linear convergence, 949 
linear dependence, 89 
linear independence, 87, 90, 101, 725 
vectors, 288 
linear iteration, 956 
linear operators, 87 
linear regression, 1102 
linearly independent, 102 
lines of force 
spherical dielectric, 665 
locus of roots, 899 
logistic equation, 35 
logistic growth 
with constant harvesting, 26 
logistic model, 5, 26, 48 
longitudinal vibrations, 573 
longitudinal wave, 573 
lowering indices, 750 


machine epsilon, 945, 959 
Maclaurin polynomial, 207 
Maehly's method, 1053 
magnitude 
vector, 713 
magnitude surface, 826, 833 
mathematical model, 3 
matrices 
elementary, 786 
matrix 
arithmetic, 275, 755 
banded, 621 
condition number, 982 
decomposition 
LU, 783 
QR, 794 
deficient, 311 
diagonal, 296, 314, 791 
factorization 
LU, 783 
QR, 794 
Givens rotation, 1142, 1144 
annihilating, 1145 
Hilbert, 991 
Householder reflection, 1130 


ill-conditioned, 982 
inverse, 290, 755 
by Gaussian elimination, 291 
Jacobian, 334 
Jordan canonical form, 791 
multiplication, 275 
dimension rule, 275 
identity, 276 
multiplicative identity, 276 
norm, 769 
notation, 275 
of quadratic form, 764 
orthogonal, 730 
outer product expansion, 807 
positive definite, 717, 1153 
pseudoinverse, 811 
rank, 775 
real symmetric, 732, 734 
reflection, 729 
rotation, 729 
similar, 316, 790 
similarity transform, 791 
simultaneous diagonalization, 1153 
singular, 291 
singular values, 802 
sparse, 621 
strictly diagonally dominant, 993 
strictly dominant, 993 
symmetric, 717 
tridiagonal, 979 
operation count, 979 
upper-Hessenberg form, 1142 
Vandermonde, 1015 
matrix exponential, 295, 755 
matrix norm 
compatible, 769 
subordinate, 769 
maximal rank, 795 
maximum sustainable harvest rate, 6 
mean-value theorem for integrals, 517 
meromorphic function, 886 
method of Krylov and Bogoliubov, 365 
method of simultaneous displacements, 992 
method of successive displacements, 996 
metric, 1039 
Michaelis-Menton model, 1119 
nonlinear fit, 1120 
midpoint method, 62 
Milne's method, 72 
minimax rational approximation, 1056 
minor, 278 
mixed boundary conditions, 373 
mixing tank, 27 
constant volume, 28 
varying volume, 28 


mixing tanks 

with flow-through, 270 

without flow-through, 266 
modified Bessel equation, 653 
modified Euler method, 62 
modified Newton's method, 962 
mole, 4 
monitoring error 

Euler's method, 54 

rk4, 54 
Muller's method, 970 
multiple roots, 961, 969 
multiplier, 786 
multipoint method, 61 
multistep method, 71 
multistep methods, 65 


nabla symbol, 444 
natural basis, 747 
natural frequency, 117 
natural tangent vector, 419, 532 
neighborhood, 857 
nested form, 1044 
Neumann boundary condition 
Laplace's equation in cylinder, 653 
Neumann boundary conditions, 574, 594 
neutrally stable, 329 
Newton's law of cooling, 30, 589, 593 
Newton's method, 960 
anomalies, 965 
in complex plane, 964 
linear convergence at multiple root, 962 
modified, 962 
nonlinear systems, 1009 


Newton's second law, 78, 79, 103, 318, 437, 


572, S1, 1211 

Newton's second law of motion, 2 
Newton-Cotes integration formulas, 1073 
nodal curves, 635 
nodal lines, 633 
node, 325 

improper, 327 

proper, 327 
nodes 

wave equation, 635 
nonautonomous system, 328, 331 
nonlinear least-squares 

linearization, 1118 
nonlinear pendulum, 337 

phase portrait, 337 
norm, 1039 

Frobenius, 770 

infinity, 1040 


matrix, 769 
compatible, 769 
Frobenius, 769 
subordinate, 769 
square, 1039 
vector, 713 
normal component of a vector, 469 
normal coordinates, 317, 319 
normal equations, 242, 774, 1041, 1106 
ill-conditioned, 1112 
matrix formulation, 774 
normal modes, 316, 320, 1151 
nth-root test, 179 
null space, 287, 304, 724, 776 
nullcline, 17 
numeric differentiation 
backward-difference formulas, 1059 
central-difference formulas, 1062 
forward-difference formulas, 1059 
nonuniform spacing, 1063 
numeric integration 
adaptive quadrature 
efficient, 1096 
naive, 1094 
Gauss-Legendre quadrature 
by Legendre polynomials, 1088 
by polynomial exactness, 1084 
iterated integrals, 1099 
Left-end rule, 1073, 1075 
Midpoint rule, 1073, 1075 
Newton-Cotes formulas, 1073 
recursive Trapezoid rule, 1080 
Romberg's method, 1074, 1080 
Simpson's rule, 1073, 1075 
Trapezoid rule, 1073, 1075 
numeric method 
order, 52 
numeric methods 
Taylor, 58 
Nyquist stability criterion, 907 


oblique asymptote, 36 
odd extension, 236 
odd function, 232 
Fourier integral theorem, 699 
ODE 
BVP 
elf-adjoint, 400 
finite-difference solution, 412 
regular Sturm-Liouville problem, 399 
self-adjoint, 399 
singular, 405, 408 
eigenfunctions 
orthogonality, 401 
finite-element solution, 393 
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one parameter family of curves, 11 
one-sided derivative, 226 
open connected set, 827 
open sentence, 8 
operational law, 135 
operational laws, 139, 141, 158 
operations count, 976 
orbitally stable, 329 
ordinary differential equation, 8 
boundary value problem, 370 
first-degree, 9 
first-order, 9 
linear, 9 
homogeneous, 9 
nonhomogeneous, 9 
nonlinear, 9 
second-order, 9 
oriented surface, 494 
orthogonal coordinate system, 532 
orthogonal matrix, 730 
orthogonal polynomials, 1112 
orthogonality 
and least-squares, 381 
functions, 242, 245 
with respect to weight function, 399 
orthogonalization 
Gram-Schmidt process, 760 
orthogonally diagonalizable, 733 
orthonormal, 729, 743 
functions, 399 
basis, 399 
orthonormal basis, 743 
complete, 399 
osculating plane, 434 
outer product expansion, 807 
outward normal, 493 
overdamped, 121 
overdamped motion, 79 
overdamping, 96 
overdetermined, 773 
overdetermined system, 809 
least-squares solution, 810 


Padé approximation, 1045 
partial Laplace transform, 670 
of derivatives, 671 
partial pivoting, 976 
particular solution, 45, 106, 111 
first-order linear ODE, 322 
path 
phase plane, 271 
path independence, 509 
pendulum 
nonlinear, 337 
pendulum with oscillating support, 1220 
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per-step error, 53 
period, 104 
periodic boundary conditions, 373, 398 
periodic extension, 223, 225, 238 
periodic functions, 154 
Laplace transform, 154 
perturbation series, 353, 355 
Lagrange expansion theorem, 354 
regular, 355, 360 
secular terms, 355 
perturbation solution, 352 
algebraic equation, 352 
phase angle, 104, 118 
phase plane, 324 
path, 271 
phase portrait, 325 
nonlinear pendulum, 337 
Picard iteration, 18, 956 
Picard's theorem, 20 
piecewise continuity, 223 
piecewise continuous, 133, 684 
piecewise linear splines, 391 
piecewise smooth, 388 
piecewise smooth curve, 862 
plucked string, 559 
Pochhammer symbol, 404 
pointwise solution, 10, 14, 387 
Poisson integral formula, 884 
polar coordinates 
coordinate curves, 736 
forward map, 736 
inverse map, 736 
natural basis of tangent vectors, 736 
orthogonality, 736 
pole 
order N, 875 
order one, 346 
order two, 346 
polynomial exactness 
central-difference formulas, 1062 
numeric differentiation formulas, 1059 
numeric integration, 1075 
polynomial wiggle problem, 1017, 1023 
power guess, 123 
power method, 800 
power series, 210, 871 
asymptotic, 255 
composition, 216 
formal, 249 
reversion, 217 
termwise arithmetic, 215 
termwise differentiation, 218 
termwise integration, 218 
predator-prey model, 331 


predictor-corrector, 72 
predictor-corrector methods, 68 
principal normal, 429 
principal normal vector, 432 
principal part, 875 
principle of the argument, 905 
projection 

along vector, 756 

orthogonal to vector, 756 
projection matrix, 757 
projection onto subspace, 757 
proper node, 327 
pseudo-inner product, 1108 
pseudoinverse, 811 

from SVD, 812 
pulsed functions, 151 

Laplace transform, 151 


QR algorithm, 797 

shifted, 1142 
QR decomposition 

by Householder reflections, 1139 
QR factorization 

upper Hessenberg matrix 

by Givens rotations, 1146 

quadratic convergence, 950 
quadratic form, 764 
quadrature formulas 

closed, 1074 

open, 1074 


radius of convergence, 871 
raising indices, 750 
rank, 775 
maximal, 775, 795 
rarefaction wave, 573, 576 
Rates of change, 2 
ratio test, 179, 872 
rational function 
continued-fraction form, 1045 
rational-function approximation, 1044 
Rayleigh-Ritz solution, 390 
Rayleigh—Ritz technique 
BVP, 382 
reciprocal vectors, 742, 745, 747 
rectangular membrane, 632 
rectifiable curve, 498 
recurrence relation, 345 
recursion relation, 345, 351 
Legendre’s equation, 409 
recursive Trapezoid rule, 1080 
reduced row-echelon form, 283, 775 
reduction of order, 99, 124 
reflection matrix, 729 


regular BVP, 373 
regular perturbation, 355, 360 
regular point, 343 
regular singular point, 346, 350 
solution at, 346 
relaxation, 999 
removable discontinuity, 223 
repeated substitution, 956 
repeller, 326 
residual 
for ODE, 380, 382, 386 
residual correction, 989 
residual vector, 988 
residue, 875 
resonance, 117 
real resonance, 117 
unreal resonance, 117 
resonant frequency, 117, 118 
resultant, 714 
reversion of series, 217 
Richardson extrapolation, 54 
for numeric differentiation, 1067 
Riemann surface 
cosh z, 846 
cos z, 844 
et, 833 
sinh z, 845 
sin z, 843 
z2, 827 
z^, 830 
right-handed system, 279 
rk4 
systems, 341 
rkn4 
Runge-Kutta-Nystrom method, 340 
RLC circuit, 77, 80 
Romberg integration, 1074, 1080 
root-locus diagram, 899 
rotation matrix, 729 
round-off error, 789 
rounding to k decimal places, 944 
roundoff error, 53 
creeping roundoff, 946 
error magnification, 946 
negligible addition, 946 
subtractive cancellation, 946 
row space, 775 
row-echelon form, 283 
rref, 283 
Rule of 72, 25 
Runge-Kutta 
systems, 341 
Runge-Kutta-Fehlberg method, 75 
Runge-Kutta-Nystrom method, 340 
Runge-Kutta method 
order, 53 
rk4, 51, 52 


Runge-Kutta methods, 60 
rkf45, 75 


saddle, 325 
scalar potential, 457 
secant algorithm, 968 
second shifting law, 147, 151, 160 
second-derivative test 
one variable, 763 
three variables, 767 
two variables, 763 
secular terms, 355, 360 
self-adjoint BVP, 399, 400 
self-limiting growth, 26 
self-reciprocal, 743 
semistable limit cycle, 363 
separated boundary conditions, 373 
separation of variables, 10 
2d heat equation, 642 
2d wave equation, 636 
circular drumhead, 657 
Dirichlet problem for rectangle, 615 
heat equation 
homogeneous Dirichlet conditions, 587 
Laplace's equation, 605 
Laplace's equation in cylinder, 653 
PDE 
Dirichlet problem for rectangle, 608 
steady-state temperature in sphere, 661 
wave equation 
finite string, 569 
plucked string, 561 
struck string, 565 
separatrices, 326 
separatrix, 326 
sequence 
asymptotic, 254 
functions, 186 
pointwise convergence, 189 
uniform convergence, 191 
numeric, 172 
series 
nth-term rule, 177 
p-series, 176 
partial sum, 176 
termwise arithmetic, 178 
shifted QR algorithm, 1148 
shock wave, 576 
shooting method, 376 
significant figures, 944 
similar matrices, 316, 790 
similarity transform, 316, 733, 791 
simple plane pendulum 
solved by Hamilton's principle, 1214 
solved by Newton's second law, 1213 


simple pole, 875 
simply connected region, 40, 506 
singular BVP, 373, 405, 408 
singular point, 249, 346 
irregular, 346 
regular, 346 
singular value decomposition, 802 
and pseudoinverse, 812 
singular values, 802 
slope methods, 967 
Snell's law, 1208 
solenoidal, 921 
solenoidal field, 474, 486, 510, 511 
solution surface, 560 
elastic rod, 575 
heat equation 
homogeneous Dirichlet conditions, 587 
wave equation 
struck string, 567 
SOR, 1001 
Southwell's relaxation method, 999 
space curve, 419 
sparse matrix, 621 
special functions, 403 
specific heat, 591, 592 
specific solution, 11 
speed, 434 
rate of change of, 434 
spherical coordinates, 535 
spherical dielectric, 664 
field lines, 665 
lines of force, 665 
spherical pendulum, 1218 
spiral, 325 
spline, 387, 388, 1026 
cubic, 388, 1026 
algorithm, 1029 
cubic B-spline, 388 
cubic Bezier, 1035 
piecewise linear, 391 
quadratic, 1026 
spring constant, 82 
square norm, 1039 
square-norm approximation, 1041 
stability, 327 
finite-difference scheme 
heat equation, 599 
stable equilibrium point 
asymptotically stable, 329 
neutrally stable, 329 
orbitally stable, 329 
stable limit cycle, 363 
stable solution, 5 
stack, 1094 


standing wave, 560 
standing waves, 635 
steady-state temperature 

in sphere, 659 
steady-state temperatures, 42 

in sphere 

isothermal surfaces, 661 

Steffensen's method, 963 
stepsize, 50 
stiffness, 57 
Stokes' theorem, 498, 499 

for closed surface, 500 
strain, 574, 576, 577 
stream function, 922 
streamlines, 922 
stress, 576 
strict solution, 10, 14 
strictly dominant variable, 993 
strong solution, 10, 14, 387 
struck string, 565 
Sturm-Liouville BVP, 399 
Sturm-Liouville eigenvalue problem, 561 
subspace, 725 
successive elimination, 282 
successive overrelaxation, 1001 
sum of squares, 774, 1102 
superlinear convergence, 952 
superposition 

for homogeneous equations, 88 

nonhomogeneous equations, 115 
support 

compact, 386 
surface 

oriented, 494 
surface area 

general case, 490 

surface of revolution, 489 
surface area element 

parametrically given surface, 545 
surface flux, 493 
surface integrals, 492 
surface-area element, 490 
susceptible, 7 
system point, 268 


tangent vector, 419 

natural, 419 

unit, 420 
tangent-line approximation, 333 
tangent-plane approximation, 334 
tangential component, 479 
Taylor polynomial, 58, 207, 208 
Taylor series, 210 

absolute convergence, 213 

analyticity, 213 


I-10 Index 


composition, 216 
interval of convergence, 211 
radius of convergence, 211 
reversion, 217 
termwise arithmetic, 215 
termwise differentiation, 218 
termwise integration, 218 
uniform convergence, 213 
temperature gradient, 589, 591 
tension, 571 
thermal conductivity, 592 
thermal diffusivity, 586, 592 
third shifting law, 152 
time domain, 131, 135, 142, 332 
total differential, 508 
transfer function, 166, 901 
transform domain, 135, 142 
transition matrix, 733, 764 
change of basis, 728 
transpose, 292 
traveling wave, 560 
traveling waves, 635 
triangle inequality, 769, 1039 
tridiagonal systems, 979 
triple scalar product, 279 
truncation error, 52 


uncoupled system, 314 
undamped free motion, 103 
undamped motion, 79 
underdamped, 121 
underdamped motion, 79 
underdamping, 96, 97 


undetermined coefficients, 106, 111 


uniform convergence, 191 
continuity, 193 
differentiation, 194 


integrals, 145 

integration, 193 

negation, 192 
unit basis vector, 533 
unit basis vectors, 712, 724 
unit pulse, 151 
unit tangent vector, 420, 432 
unmixed boundary conditions, 399 
unstable equilibrium, 7 
unstable equilibrium point, 330 
unstable limit cycle, 363 
upper-Hessenberg matrix, 1142 


van der Pol's equation, 363 
KB solution, 367 
Lindstedt's solution, 363 

Vandermonde matrix, 1015 

variation of parameters, 46, 99, 106, 125 

variational embedding problem, 1210 

variational principle, 1210 

variational principles, 1209 

vector 
bound 714 
components, 713 
components of, 725 
direction cosines, 713 
free, 714 
head, 712 
infinity-norm, 713 
one-norm, 713 
parallel translation 714 
tail, 712 
two-norm, 713 

vector field, 441 
flow, 442 

vector potential, 486, 511 

vector-valued function, 442 

vectors 


angle between, 716 


linearly dependent, 761 
orthogonal, 717 
orthonormal, 743 
reciprocal, 742, 745, 747 
self-reciprocal, 743 

viscosity, 78 

viscous force, 78 

vorticity, 500 


Watson's lemma, 261 
wave equation, 559 
2d, 632 
disk, 656 
derivation, 571 
finite-difference solution 
explicit scheme, 580 
stability analysis, 581 
infinite string, 690 
D'Alembert's solution, 690 
polar coordinates, 656 
wave speed, 573 
weak solution, 386, 391 
Weierstrass M-test, 201 
weighted residual method, 386 
weighted residual methods 
Galerkin techniques, 382 
weighting functions 
Galerkin methods, 382 
Galerkin technique, 383 
winding number, 903 
work, 3, 465 
Wronskian, 89, 100, 101, 108, 126 


Young's modulus, 576 


zero of order m, 961 
zero-principle, 276 
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